00000800:00000200:0.1F:1721879699.938188:0:3684:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8801364196c0] -> 12345-192.168.201.124@tcp (2) 00000800:00000200:1.1F:1721879699.938718:0:3675:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8801364196c0] -> 12345-192.168.201.124@tcp (2) 00000800:00000200:1.1:1721879699.938725:0:3675:0:(socklnd.c:186:ksocknal_destroy_peer()) peer_ni 12345-192.168.201.124@tcp ffff88012d8d56c0 deleted 00000800:00000010:1.1:1721879699.938774:0:3675:0:(socklnd.c:195:ksocknal_destroy_peer()) kfreed 'peer_ni': 184 at ffff88012d8d56c0. 00000800:00000200:1.1:1721879699.938778:0:3675:0:(socklnd.c:409:ksocknal_incr_conn_count()) Add conn type 1, ksnr_connected 2 ksnr_max_conns 1 00000800:00000200:1.1:1721879699.938783:0:3675:0:(socklnd_cb.c:746:ksocknal_queue_tx_locked()) Sending to 12345-192.168.201.124@tcp ip 192.168.201.124:1023 00000800:00000200:1.1:1721879699.938786:0:3675:0:(socklnd_cb.c:765:ksocknal_queue_tx_locked()) Packet ffff880070f22300 type 2, nob 96 niov 1 nkiov 0 00000800:00000200:1.1:1721879699.938889:0:3674:0:(socklnd.c:409:ksocknal_incr_conn_count()) Add conn type 1, ksnr_connected 2 ksnr_max_conns 1 00000800:00000200:1.1:1721879699.939138:0:3676:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8801364196c0] -> 12345-192.168.201.124@tcp (4) 00000800:00000200:1.1:1721879699.939140:0:3676:0:(socklnd.c:186:ksocknal_destroy_peer()) peer_ni 12345-192.168.201.124@tcp ffff88012d8d56c0 deleted 00000800:00000010:1.1:1721879699.939141:0:3676:0:(socklnd.c:195:ksocknal_destroy_peer()) kfreed 'peer_ni': 184 at ffff88012d8d56c0. 00000800:00000200:1.1:1721879699.939143:0:3676:0:(socklnd.c:409:ksocknal_incr_conn_count()) Add conn type 3, ksnr_connected a ksnr_max_conns 1 00000800:00000200:1.1:1721879699.939217:0:3674:0:(socklnd.c:409:ksocknal_incr_conn_count()) Add conn type 2, ksnr_connected e ksnr_max_conns 1 00010000:00000010:0.1:1721879700.032311:0:11:0:(ldlm_resource.c:1521:__ldlm_resource_free()) slab-freed '(res)': 240 at ffff8800b523a100. 00010000:00000010:0.1:1721879700.032318:0:11:0:(ldlm_lock.c:196:lock_handle_free()) slab-freed 'lock': 552 at ffff8800b154c240. 00010000:00000010:2.1F:1721879700.076838:0:27:0:(ldlm_resource.c:1521:__ldlm_resource_free()) slab-freed '(res)': 240 at ffff88012cc78700. 00010000:00000010:2.1:1721879700.076848:0:27:0:(ldlm_lock.c:196:lock_handle_free()) slab-freed 'lock': 552 at ffff8800b154c240. 00010000:00000010:2.1:1721879700.076851:0:27:0:(ldlm_lock.c:196:lock_handle_free()) slab-freed 'lock': 552 at ffff88011e830240. 00010000:00000010:1.1:1721879700.082811:0:20:0:(ldlm_resource.c:1521:__ldlm_resource_free()) slab-freed '(res)': 240 at ffff880070f23700. 00010000:00000010:1.1:1721879700.082816:0:20:0:(ldlm_lock.c:196:lock_handle_free()) slab-freed 'lock': 552 at ffff8800b154cfc0. 00080000:00000010:2.1:1721879700.088823:0:27:0:(osd_handler.c:1595:osd_oxc_free()) kfreed 'oxe': 68 at ffff880073416300. 00010000:00010000:0.0:1721880422.188383:0:16130:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095d8b840/0x8a60d30f571e6b30 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe250:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12794e expref: 503 pid: 15515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.188392:0:16130:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095d8b840/0x8a60d30f571e6b30 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe250:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12794e expref: 503 pid: 15515 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.188402:0:16130:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b084a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0000_UUID:16130:1805522011577216:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.188422:0:16130:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e300 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.188600:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257648640 00000100:00100000:0.0:1721880422.188604:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257648640 00010000:00010000:0.0:1721880422.188618:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880072a39d40/0x8a60d30f571ea74a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfed8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1290d2 expref: 2302 pid: 15497 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.188640:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913791 00000100:00100000:0.0:1721880422.188645:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008876ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:262d1f41-ba81-41c5-b215-67c74ea63f50+2302:2007:x1805522257648640:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.188652:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.188657:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880072a39d40/0x8a60d30f571ea74a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfed8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1290d2 expref: 2302 pid: 15497 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.188666:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880072a39d40/0x8a60d30f571ea74a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfed8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1290d2 expref: 2302 pid: 15497 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.188679:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880072a39d40/0x8a60d30f571ea74a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfed8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1290d2 expref: 2302 pid: 15497 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.188689:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.188690:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.188694:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106f600/0x8a60d30f5727b179 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfed8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.188701:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106f600/0x8a60d30f5727b179 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfed8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.188714:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.188747:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008876ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:262d1f41-ba81-41c5-b215-67c74ea63f50+2301:2007:x1805522257648640:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 101us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.188751:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913791 00000100:00100000:0.0:1721880422.188772:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.188791:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011576448 00000100:00100000:0.0:1721880422.188793:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011576448 00000100:00100000:0.0:1721880422.188804:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631610 00000100:00100000:0.0:1721880422.188806:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2552:3688:x1805522011576448:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1721880422.188815:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:57934 count 1 00000100:00100000:0.0:1721880422.188829:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257648768 00000100:00100000:0.0:1721880422.188831:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257648768 00010000:00010000:0.0:1721880422.188837:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800970dad00/0x8a60d30f571e6533 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12771e expref: 504 pid: 15515 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.188846:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257648896 00000100:00100000:0.0:1721880422.188847:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257648896 00010000:00010000:0.0:1721880422.188853:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092962d00/0x8a60d30f571ea7dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfed9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129126 expref: 2301 pid: 9459 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.188862:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913792 00000100:00100000:0.0:1721880422.188864:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b9ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+504:2007:x1805522257648768:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.188871:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.188873:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800970dad00/0x8a60d30f571e6533 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe249:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12771e expref: 504 pid: 15515 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.188879:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800970dad00/0x8a60d30f571e6533 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe249:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12771e expref: 504 pid: 15515 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.188886:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800970dad00/0x8a60d30f571e6533 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe249:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12771e expref: 505 pid: 15515 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.188892:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.188893:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.188895:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801363518c0/0x8a60d30f5727b180 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.188899:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801363518c0/0x8a60d30f5727b180 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.188907:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.188919:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b9ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+504:2007:x1805522257648768:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 53us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.188924:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913792 00000100:00100000:0.0:1721880422.188945:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880091ae3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:15453:1805522011575680:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.188963:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727b18e lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe24b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.188980:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325f600/0x8a60d30f5727b1cd lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe24e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.188990:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007294a880/0x8a60d30f571e698c lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe24e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1278a6 expref: 502 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.189082:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.189084:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.189086:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325f600/0x8a60d30f5727b1cd lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe24e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.189104:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007294a880/0x8a60d30f571e698c lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe24e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1278a6 expref: 501 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.189113:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007294a880/0x8a60d30f571e698c lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe24e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1278a6 expref: 501 pid: 16111 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.189123:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b086a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0000_UUID:16028:1805522011578112:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.189145:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3eb40 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.189158:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727b18e lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.189166:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727b18e lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.189173:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727b18e lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.189180:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727b18e lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.189188:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727b18e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.189194:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325c480 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.189197:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727b18e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.189202:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727b18e lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.189209:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727b18e lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.189212:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727b18e lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.189367:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b9e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2554:3689:x1805522011573504:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4373us (4419us total) trans 4296061495 rc 0/0 00000100:00100000:0.0:1721880422.189372:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631601 00000004:00080000:0.0:1721880422.189408:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008ad00e00/2, rc 0, transno 1052498 00000100:00100000:0.0:1721880422.189415:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008ad00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011574656:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.189427:0:16130:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b084a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0000_UUID:16130:1805522011577216:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.189436:0:16130:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325d440/0x8a60d30f5727b1b1 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe250:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.189478:0:16188:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257649536 00000100:00100000:0.0:1721880422.189480:0:16188:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257649536 00010000:00010000:0.0:1721880422.189488:0:16188:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130a20240/0x8a60d30f571e6a3b lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1278f3 expref: 502 pid: 15515 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.189497:0:16188:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257649920 00000100:00100000:0.0:1721880422.189498:0:16188:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257649920 00010000:00010000:0.0:1721880422.189504:0:16188:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009236aac0/0x8a60d30f571ea9e3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfedc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1291f8 expref: 2299 pid: 16112 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.189512:0:16188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913800 00000100:00100000:0.0:1721880422.189515:0:16188:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008876ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+501:2005:x1805522257649536:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.189520:0:16188:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.189522:0:16188:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130a20240/0x8a60d30f571e6a3b lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1278f3 expref: 501 pid: 15515 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.189529:0:16188:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130a20240/0x8a60d30f571e6a3b lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1278f3 expref: 501 pid: 15515 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.189536:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.189536:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.189538:0:16188:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136350b40/0x8a60d30f5727b1aa lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.189542:0:16188:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136350b40/0x8a60d30f5727b1aa lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.189551:0:16188:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.189616:0:16188:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008876ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+501:2005:x1805522257649536:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 99us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.189621:0:16188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913800 00010000:00010000:0.0:1721880422.189638:0:16130:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325d440/0x8a60d30f5727b1b1 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.189643:0:16130:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325d440/0x8a60d30f5727b1b1 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.189648:0:16130:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325d440/0x8a60d30f5727b1b1 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.189652:0:16130:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325d440/0x8a60d30f5727b1b1 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.189655:0:16130:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325d440/0x8a60d30f5727b1b1 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.189659:0:16130:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325d440 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.189660:0:16130:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325d440/0x8a60d30f5727b1b1 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.189664:0:16130:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325d440/0x8a60d30f5727b1b1 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.189673:0:16130:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325d440/0x8a60d30f5727b1b1 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.189678:0:16130:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325d440/0x8a60d30f5727b1b1 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.189873:0:16130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880134fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0000-mdtlov_UUID+2554:3686:x1805522011576832:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1551us (1836us total) trans 4296061497 rc 0/0 00000100:00100000:0.0:1721880422.189879:0:16130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631606 00000004:00080000:0.0:1721880422.189905:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008ad00a80/2, rc 0, transno 1052497 00000100:00100000:0.0:1721880422.189911:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008ad00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011574528:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.189932:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011578368:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.189953:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.189968:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1721880422.189973:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b084000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011578496:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.189991:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257650176 00000100:00100000:0.0:1721880422.189995:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257650176 00010000:00010000:0.0:1721880422.190006:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007294a880/0x8a60d30f571e698c lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe24e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1278a6 expref: 498 pid: 16111 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.190036:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913803 00000100:00100000:0.0:1721880422.190040:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e197c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+498:2005:x1805522257650176:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.190047:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.190051:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007294a880/0x8a60d30f571e698c lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe24e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1278a6 expref: 498 pid: 16111 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.190061:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007294a880/0x8a60d30f571e698c lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe24e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1278a6 expref: 498 pid: 16111 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.190071:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.190072:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.190074:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009325f600/0x8a60d30f5727b1cd lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe24e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.190081:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325f600/0x8a60d30f5727b1cd lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe24e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.190091:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.190116:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e197c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+498:2005:x1805522257650176:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 74us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.190122:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913803 00010000:00010000:0.0:1721880422.190165:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007294a880/0x8a60d30f571e698c lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe24e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1278a6 expref: 497 pid: 16111 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.190172:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b086a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0000_UUID:16028:1805522011578112:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.190182:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325f600/0x8a60d30f5727b1cd lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.190189:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325f600/0x8a60d30f5727b1cd lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.190196:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325f600/0x8a60d30f5727b1cd lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.190204:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325f600/0x8a60d30f5727b1cd lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.190211:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325f600/0x8a60d30f5727b1cd lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.190217:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325f600/0x8a60d30f5727b1cd lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.190222:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325f600 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.190225:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325f600/0x8a60d30f5727b1cd lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.190232:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325f600/0x8a60d30f5727b1cd lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.190242:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325f600/0x8a60d30f5727b1cd lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.190249:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325f600/0x8a60d30f5727b1cd lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.190349:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2553:3688:x1805522011576448:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1540us (1574us total) trans 4296061500 rc 0/0 00000100:00100000:0.0:1721880422.190355:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631610 00000100:00100000:0.0:1721880422.190459:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1721880422.190490:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012cfbaa00/2, rc 0, transno 1094204 00000100:00100000:0.0:1721880422.190500:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012cfbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011576448:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1721880422.190541:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008ad02680/2, rc 0, transno 1094203 00000100:00100000:0.0:1721880422.190547:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008ad02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011576960:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1721880422.190570:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009c078000/2, rc 0, transno 1052501 00000100:00100000:0.0:1721880422.190575:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c078000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011577344:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1721880422.190600:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008bcf5180/2, rc 0, transno 1094198 00000100:00100000:0.0:1721880422.190605:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008bcf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011572992:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1721880422.190630:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880092335c00/2, rc 0, transno 1052503 00000100:00100000:0.0:1721880422.190636:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880092335c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011576320:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1721880422.190711:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008571f480/2, rc 0, transno 1094199 00000100:00100000:0.0:1721880422.190716:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008571f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011573504:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1721880422.190756:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880084312d80/2, rc 0, transno 1094197 00000100:00100000:0.0:1721880422.190764:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880084312d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011571968:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.190771:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b087480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011579008:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.190787:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.190800:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fde2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011579648:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1721880422.190823:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880084311c00/2, rc 0, transno 1052502 00000100:00100000:0.0:1721880422.190830:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880084311c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011572352:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.190923:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b085c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011579264:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.190941:0:16130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011578752 00000100:00100000:0.0:1721880422.190945:0:16130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011578752 00000100:00100000:0.0:1721880422.190972:0:16130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631616 00000100:00100000:0.0:1721880422.190978:0:16130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0000-mdtlov_UUID+2554:3687:x1805522011579520:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1721880422.190991:0:16130:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:57941 count 1 00010000:00010000:0.0:1721880422.191001:0:16130:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b1fe lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe255:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.191012:0:16130:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009432db00/0x8a60d30f571e7038 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe255:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127af2 expref: 496 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.191029:0:16130:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.191030:0:16130:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.191033:0:16130:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b1fe lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe255:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.191122:0:16130:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009432db00/0x8a60d30f571e7038 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe255:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127af2 expref: 496 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.191131:0:16130:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009432db00/0x8a60d30f571e7038 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe255:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127af2 expref: 496 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.191141:0:16130:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008876ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0000_UUID:16130:1805522011580672:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.191163:0:16130:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.191176:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.191239:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fde1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011580800:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.191256:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.191269:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1721880422.191272:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008876ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011579776:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.191283:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.191293:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fde0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011580928:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.191311:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011579776 00000100:00100000:0.0:1721880422.191313:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011579776 00000100:00100000:0.0:1721880422.191329:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631621 00000100:00100000:0.0:1721880422.191332:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008571c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2557:3688:x1805522011580800:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1721880422.191343:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:57943 count 1 00010000:00010000:0.0:1721880422.191353:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727b221 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe257:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.191364:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097911f80/0x8a60d30f571e7222 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127b9a expref: 496 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.191370:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.191372:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.191374:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727b221 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.191392:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097911f80/0x8a60d30f571e7222 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127b9a expref: 496 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.191401:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097911f80/0x8a60d30f571e7222 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127b9a expref: 496 pid: 16089 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.191410:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880091ae2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:15453:1805522011581696:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.191426:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e300 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.191450:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.191482:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1721880422.191560:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009b084a80/2, rc 0, transno 1052505 00000100:00100000:0.0:1721880422.191580:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011578368:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.191616:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1721880422.191675:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008bcf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011582208:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.191697:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1721880422.192311:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009b087480/2, rc 0, transno 1052506 00000100:00100000:0.0:1721880422.192322:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b087480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011579008:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.192378:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099e76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011582720:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.192395:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1721880422.192479:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009b084000/2, rc 0, transno 1052507 00000100:00100000:0.0:1721880422.192484:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b084000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011578496:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.194213:0:16130:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008876ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0000_UUID:16130:1805522011580672:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.194230:0:16130:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b1fe lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe255:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.194301:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.194314:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.194329:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.194339:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257651456 00000100:00100000:0.0:1721880422.194342:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257651456 00010000:00010000:0.0:1721880422.194353:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130a2dd40/0x8a60d30f571eafcb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfee5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1294fa expref: 2293 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.194366:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913809 00000100:00100000:0.0:1721880422.194369:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a70ed850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:262d1f41-ba81-41c5-b215-67c74ea63f50+2293:2005:x1805522257651456:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.194376:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.194379:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130a2dd40/0x8a60d30f571eafcb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfee5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1294fa expref: 2293 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.194386:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130a2dd40/0x8a60d30f571eafcb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfee5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1294fa expref: 2293 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.194394:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130a2dd40/0x8a60d30f571eafcb lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfee5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1294fa expref: 2293 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.194404:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.194405:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.194408:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727b21a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfee5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.194415:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727b21a lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfee5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.194438:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.194459:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a70ed850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:262d1f41-ba81-41c5-b215-67c74ea63f50+2291:2005:x1805522257651456:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 87us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.194470:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913809 00010000:00010000:0.0:1721880422.194492:0:16130:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b1fe lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.194500:0:16130:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b1fe lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.194507:0:16130:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b1fe lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.194515:0:16130:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b1fe lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.194522:0:16130:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b1fe lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.194528:0:16130:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325cd80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.194531:0:16130:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b1fe lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.194538:0:16130:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b1fe lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.194548:0:16130:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b1fe lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.194555:0:16130:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b1fe lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.194669:0:16130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0000-mdtlov_UUID+2560:3687:x1805522011579520:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3689us (3820us total) trans 4296061501 rc 0/0 00000100:00100000:0.0:1721880422.194676:0:16130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631616 00000100:00100000:0.0:1721880422.194725:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.194761:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.194770:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257651328 00000100:00100000:0.0:1721880422.194773:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257651328 00010000:00010000:0.0:1721880422.194786:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009811b180/0x8a60d30f571e70e7 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe256:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127b4d expref: 496 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.194842:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880091ae2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:15453:1805522011581696:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.194856:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727b221 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.194887:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1721880422.194896:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d121c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011583360:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.194918:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.195026:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.195043:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.195068:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.195081:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257651968 00000100:00100000:0.0:1721880422.195085:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257651968 00010000:00010000:0.0:1721880422.195098:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800923b4240/0x8a60d30f571e74bb lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe259:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127c49 expref: 493 pid: 9459 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.195115:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257652352 00000100:00100000:0.0:1721880422.195118:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257652352 00010000:00010000:0.0:1721880422.195126:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009eee5200/0x8a60d30f571e7387 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe258:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127bee expref: 494 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.195155:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257651712 00000100:00100000:0.0:1721880422.195158:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257651712 00010000:00010000:0.0:1721880422.195167:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097911f80/0x8a60d30f571e7222 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127b9a expref: 496 pid: 16089 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.195189:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257651840 00000100:00100000:0.0:1721880422.195192:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257651840 00010000:00010000:0.0:1721880422.195201:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d107840/0x8a60d30f571eaec8 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfee3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12944b expref: 2289 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.195215:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257652736 00000100:00100000:0.0:1721880422.195217:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257652736 00010000:00010000:0.0:1721880422.195225:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131b31200/0x8a60d30f571eb130 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfee9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129651 expref: 2292 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.195245:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913817 00000100:00100000:0.0:1721880422.195250:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129d23050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+496:2004:x1805522257651712:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.195258:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.195262:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097911f80/0x8a60d30f571e7222 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe257:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127b9a expref: 495 pid: 16089 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.195270:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097911f80/0x8a60d30f571e7222 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe257:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127b9a expref: 495 pid: 16089 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.195282:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097911f80/0x8a60d30f571e7222 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe257:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127b9a expref: 494 pid: 16089 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.195292:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.195294:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.195296:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727b221 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.195309:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727b221 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe257:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.195320:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.195335:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880129d23050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+491:2004:x1805522257651712:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 85us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.195340:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913817 00010000:00010000:0.0:1721880422.195458:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727b221 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.195466:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727b221 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.195473:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727b221 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.195480:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727b221 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.195486:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727b221 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.195491:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325c6c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.195494:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727b221 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.195504:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727b221 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.195513:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727b221 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.195518:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727b221 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.195665:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008571c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2561:3688:x1805522011580800:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4330us (4406us total) trans 4296061507 rc 0/0 00000100:00100000:0.0:1721880422.195672:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631621 00000004:00080000:0.0:1721880422.195707:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008fde0700/2, rc 0, transno 1094209 00000100:00100000:0.0:1721880422.195715:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fde0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011580928:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.195776:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913823 00000100:00100000:0.0:1721880422.195782:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fde1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:262d1f41-ba81-41c5-b215-67c74ea63f50+2286:2004:x1805522257652608:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.195797:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913824 00000100:00100000:0.0:1721880422.195801:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a70ee450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+490:2005:x1805522257652864:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.195807:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.195812:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d6df180/0x8a60d30f571e7635 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe25a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127c96 expref: 490 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.195822:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d6df180/0x8a60d30f571e7635 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe25a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127c96 expref: 490 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.195835:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d6df180/0x8a60d30f571e7635 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe25a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127c96 expref: 490 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.195847:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.195849:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.195851:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098aa9680/0x8a60d30f5727b260 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe25a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.195859:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098aa9680/0x8a60d30f5727b260 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe25a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.195883:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.195899:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a70ee450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+489:2005:x1805522257652864:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 96us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.195905:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913824 00010000:00010000:0.0:1721880422.195923:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.195927:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135180900/0x8a60d30f571eb0ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfee8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1295fd expref: 2285 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.195936:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135180900/0x8a60d30f571eb0ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfee8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1295fd expref: 2285 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.195949:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135180900/0x8a60d30f571eb0ce lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfee8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1295fd expref: 2285 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.195961:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.195963:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.195966:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727b252 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfee8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.195972:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727b252 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfee8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.195988:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.196006:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fde1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:262d1f41-ba81-41c5-b215-67c74ea63f50+2284:2004:x1805522257652608:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 224us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.196025:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913823 00000100:00100000:0.0:1721880422.196164:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009bf68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011583744:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.196186:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1721880422.196212:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099e76300/2, rc 0, transno 1052514 00000100:00100000:0.0:1721880422.196226:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099e76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011582720:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1721880422.196238:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008bcf7800/2, rc 0, transno 1052511 00000100:00100000:0.0:1721880422.196241:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008bcf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011582208:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1721880422.196250:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009b085c00/2, rc 0, transno 1094213 00000100:00100000:0.0:1721880422.196257:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b085c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011579264:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1721880422.196293:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008fde1180/2, rc 0, transno 1094211 00000100:00100000:0.0:1721880422.196299:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fde1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011580800:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.196318:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fde1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011584512:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.196338:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.196350:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1721880422.196355:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fde1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011584256:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.196372:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1721880422.196402:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008fde2680/2, rc 0, transno 1094210 00000100:00100000:0.0:1721880422.196406:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fde2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011579648:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.196420:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011585664:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.196434:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1721880422.196445:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008876ca80/2, rc 0, transno 1052512 00000100:00100000:0.0:1721880422.196457:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008876ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011579776:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.196461:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1721880422.196464:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007b9e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011585152:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.196475:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.196482:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009bf69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011585792:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.196497:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.196512:0:16040:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011585792 00000100:00100000:0.0:1721880422.196514:0:16040:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011585792 00000100:00100000:0.0:1721880422.196533:0:16040:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631641 00000100:00100000:0.0:1721880422.196536:0:16040:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:lustre-MDT0000-mdtlov_UUID+2564:3688:x1805522011585792:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1721880422.196546:0:16040:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:57953 count 1 00010000:00010000:0.0:1721880422.196554:0:16040:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325c240/0x8a60d30f5727b2a6 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe261:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.196610:0:16040:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092b56f40/0x8a60d30f571e7d9e lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe261:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127ef7 expref: 487 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.196616:0:16040:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.196617:0:16040:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.196619:0:16040:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325c240/0x8a60d30f5727b2a6 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe261:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.196636:0:16040:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092b56f40/0x8a60d30f571e7d9e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe261:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127ef7 expref: 487 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.196643:0:16040:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092b56f40/0x8a60d30f571e7d9e lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe261:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127ef7 expref: 487 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.196649:0:16040:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801302caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_040:lustre-OST0000_UUID:16040:1805522011586688:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.196665:0:16040:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e780 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.196752:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009bf6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011585024:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.196776:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.196794:0:16098:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011585024 00000100:00100000:0.0:1721880422.196797:0:16098:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011585024 00000100:00100000:0.0:1721880422.197835:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.197860:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.197872:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257653120 00000100:00100000:0.0:1721880422.197876:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257653120 00010000:00010000:0.0:1721880422.197889:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee4a1c0/0x8a60d30f571eb1d8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfeeb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129707 expref: 2285 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.197907:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913825 00000100:00100000:0.0:1721880422.197913:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:262d1f41-ba81-41c5-b215-67c74ea63f50+2285:2006:x1805522257653120:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.197921:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.197925:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ee4a1c0/0x8a60d30f571eb1d8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfeeb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129707 expref: 2285 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.197940:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ee4a1c0/0x8a60d30f571eb1d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfeeb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129707 expref: 2285 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.197949:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee4a1c0/0x8a60d30f571eb1d8 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfeeb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129707 expref: 2285 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.197958:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.197959:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.197960:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727b275 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfeeb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.197965:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727b275 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfeeb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.197982:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.198056:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880091ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:262d1f41-ba81-41c5-b215-67c74ea63f50+2283:2006:x1805522257653120:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 142us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.198063:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913825 00000100:00100000:0.0:1721880422.198151:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000004:00080000:0.0:1721880422.198224:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d121c00/2, rc 0, transno 1052517 00000100:00100000:0.0:1721880422.198231:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d121c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011583360:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.198411:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.198461:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.198483:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.198555:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.198613:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.198713:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.198758:0:16040:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801302caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_040:lustre-OST0000_UUID:16040:1805522011586688:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.198768:0:16040:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325c240/0x8a60d30f5727b2a6 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe261:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.198800:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.198833:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.198949:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.198975:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.199042:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.199059:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257654912 00000100:00100000:0.0:1721880422.199062:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257654912 00010000:00010000:0.0:1721880422.199075:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131b97cc0/0x8a60d30f571eb383 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfef1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1298b9 expref: 2278 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.199101:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913840 00000100:00100000:0.0:1721880422.199107:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b08f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:262d1f41-ba81-41c5-b215-67c74ea63f50+2278:2004:x1805522257654912:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.199114:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.199118:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131b97cc0/0x8a60d30f571eb383 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfef1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1298b9 expref: 2278 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.199127:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131b97cc0/0x8a60d30f571eb383 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfef1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1298b9 expref: 2278 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.199139:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131b97cc0/0x8a60d30f571eb383 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfef1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1298b9 expref: 2278 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.199154:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.199156:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.199158:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727b2d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfef1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.199165:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727b2d0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfef1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.199177:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.199194:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b08f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:262d1f41-ba81-41c5-b215-67c74ea63f50+2276:2004:x1805522257654912:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 87us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.199199:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913840 00010000:00010000:0.0:1721880422.199214:0:16040:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325c240/0x8a60d30f5727b2a6 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.199221:0:16040:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325c240/0x8a60d30f5727b2a6 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.199227:0:16040:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325c240/0x8a60d30f5727b2a6 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.199233:0:16040:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325c240/0x8a60d30f5727b2a6 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.199239:0:16040:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325c240/0x8a60d30f5727b2a6 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.199249:0:16040:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325c240 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.199252:0:16040:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325c240/0x8a60d30f5727b2a6 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.199257:0:16040:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325c240/0x8a60d30f5727b2a6 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.199265:0:16040:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325c240/0x8a60d30f5727b2a6 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.199271:0:16040:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325c240/0x8a60d30f5727b2a6 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.199372:0:16040:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:lustre-MDT0000-mdtlov_UUID+2569:3688:x1805522011585792:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2834us (2872us total) trans 4296061514 rc 0/0 00000100:00100000:0.0:1721880422.199377:0:16040:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631641 00000100:00100000:0.0:1721880422.199436:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011587584:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.199450:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1721880422.199463:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b9e9180/2, rc 0, transno 1052519 00000100:00100000:0.0:1721880422.199474:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007b9e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011585152:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1721880422.199480:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009bf69500/2, rc 0, transno 1094218 00000100:00100000:0.0:1721880422.199485:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009bf69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011585792:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1721880422.199491:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009fff1f80/2, rc 0, transno 1052521 00000100:00100000:0.0:1721880422.199494:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009fff1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011585664:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.199502:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1721880422.199506:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011587712:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.199519:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.199531:0:16040:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011587712 00000100:00100000:0.0:1721880422.199533:0:16040:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011587712 00000100:00100000:0.0:1721880422.199554:0:16040:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631649 00000100:00100000:0.0:1721880422.199557:0:16040:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b08c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:lustre-MDT0000-mdtlov_UUID+1754:3688:x1805522011587712:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.199568:0:16040:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:65267 count 1 00010000:00010000:0.0:1721880422.199577:0:16040:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727b2de lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfef3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.199584:0:16040:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880123b5dd40/0x8a60d30f571eb42b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfef3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12995a expref: 2275 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.199589:0:16040:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.199590:0:16040:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.199592:0:16040:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727b2de lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfef3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.199602:0:16040:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880123b5dd40/0x8a60d30f571eb42b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfef3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12995a expref: 2275 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.199608:0:16040:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880123b5dd40/0x8a60d30f571eb42b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfef3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12995a expref: 2275 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.199614:0:16040:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b08ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_040:lustre-OST0001_UUID:16040:1805522011588096:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.199630:0:16040:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36000 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.199666:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880091ae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011588352:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.199680:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1721880422.199702:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008fde1880/2, rc 0, transno 1094216 00000100:00100000:0.0:1721880422.199712:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fde1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011584256:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1721880422.199722:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009bf6aa00/2, rc 0, transno 1094217 00000100:00100000:0.0:1721880422.199726:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009bf6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011585024:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1721880422.199756:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008fde1f80/2, rc 0, transno 1052520 00000100:00100000:0.0:1721880422.199763:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fde1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011584512:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.199798:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880091ae1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011588224:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.199826:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.199844:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008bcf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011588864:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.199919:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.199938:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1721880422.199943:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008bcf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011588992:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.199956:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.199976:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631654 00000100:00100000:0.0:1721880422.199980:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b08dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2571:3688:x1805522011588864:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1721880422.199994:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:57958 count 1 00010000:00010000:0.0:1721880422.200004:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325c000/0x8a60d30f5727b301 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe266:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.200012:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800913a3a80/0x8a60d30f571e8236 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe266:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128094 expref: 480 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.200035:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.200036:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.200038:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325c000/0x8a60d30f5727b301 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe266:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.200143:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800913a3a80/0x8a60d30f571e8236 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe266:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128094 expref: 479 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.200155:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800913a3a80/0x8a60d30f571e8236 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe266:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128094 expref: 479 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.200165:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b08fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:15452:1805522011590272:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.200184:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36c00 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.200315:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.200330:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257655040 00000100:00100000:0.0:1721880422.200334:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257655040 00010000:00010000:0.0:1721880422.200345:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880123b5dd40/0x8a60d30f571eb42b lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfef3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12995a expref: 2276 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.200364:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913841 00000100:00100000:0.0:1721880422.200369:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b08d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:262d1f41-ba81-41c5-b215-67c74ea63f50+2276:2004:x1805522257655040:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.200377:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.200381:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880123b5dd40/0x8a60d30f571eb42b lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfef3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12995a expref: 2276 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.200388:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880123b5dd40/0x8a60d30f571eb42b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfef3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12995a expref: 2276 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.200399:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.200401:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.200402:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727b2de lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfef3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.200407:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727b2de lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfef3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.200415:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.200427:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b08d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:262d1f41-ba81-41c5-b215-67c74ea63f50+2276:2004:x1805522257655040:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 58us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.200430:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913841 00010000:00010000:0.0:1721880422.200450:0:16040:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123b5dd40/0x8a60d30f571eb42b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfef3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12995a expref: 2275 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.200459:0:16040:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b08ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_040:lustre-OST0001_UUID:16040:1805522011588096:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.200467:0:16040:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727b2de lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfef3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.200471:0:16040:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727b2de lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfef3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.200475:0:16040:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727b2de lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfef3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.200480:0:16040:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727b2de lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfef3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.200484:0:16040:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727b2de lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfef3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.200488:0:16040:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727b2de lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfef3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.200492:0:16040:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325df80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.200493:0:16040:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727b2de lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfef3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.200497:0:16040:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727b2de lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfef3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.200502:0:16040:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727b2de lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfef3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.200506:0:16040:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727b2de lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfef3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.200625:0:16040:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b08c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:lustre-MDT0000-mdtlov_UUID+1760:3688:x1805522011587712:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1066us (1104us total) trans 4296019820 rc 0/0 00000100:00100000:0.0:1721880422.200630:0:16040:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631649 00000004:00080000:0.0:1721880422.200749:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009bf68380/2, rc 0, transno 1094214 00000100:00100000:0.0:1721880422.200755:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009bf68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011583744:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.200782:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007b8bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011591552:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.200797:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.201505:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.201516:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257655168 00000100:00100000:0.0:1721880422.201519:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257655168 00010000:00010000:0.0:1721880422.201528:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f630d80/0x8a60d30f571eb52e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfef6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129a56 expref: 2275 pid: 16112 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.201541:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913842 00000100:00100000:0.0:1721880422.201544:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b08df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:262d1f41-ba81-41c5-b215-67c74ea63f50+2275:2005:x1805522257655168:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.201549:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.201552:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f630d80/0x8a60d30f571eb52e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfef6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129a56 expref: 2275 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.201558:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f630d80/0x8a60d30f571eb52e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfef6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129a56 expref: 2275 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.201570:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f630d80/0x8a60d30f571eb52e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfef6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129a56 expref: 2275 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.201582:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.201583:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.201586:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727b2f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfef6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.201593:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727b2f3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfef6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.201621:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.201648:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b08df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:262d1f41-ba81-41c5-b215-67c74ea63f50+2274:2005:x1805522257655168:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 102us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.201652:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913842 00000100:00100000:0.0:1721880422.201759:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.201958:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257655296 00000100:00100000:0.0:1721880422.201962:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257655296 00010000:00010000:0.0:1721880422.201975:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136391b00/0x8a60d30f571eb3de lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfef2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12990d expref: 2274 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.202059:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913843 00000100:00100000:0.0:1721880422.202062:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:262d1f41-ba81-41c5-b215-67c74ea63f50+2274:2005:x1805522257655296:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.202070:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.202073:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136391b00/0x8a60d30f571eb3de lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfef2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12990d expref: 2274 pid: 16098 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.202079:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136391b00/0x8a60d30f571eb3de lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfef2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12990d expref: 2274 pid: 16098 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.202087:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136391b00/0x8a60d30f571eb3de lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfef2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12990d expref: 2274 pid: 16098 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.202094:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.202095:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.202096:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106df80/0x8a60d30f5727b2d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfef2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.202101:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106df80/0x8a60d30f5727b2d7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfef2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.202116:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.202134:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:262d1f41-ba81-41c5-b215-67c74ea63f50+2273:2005:x1805522257655296:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 71us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.202138:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913843 00000100:00100000:0.0:1721880422.202146:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913844 00000100:00100000:0.0:1721880422.202149:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d123b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+480:2005:x1805522257655424:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.202154:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.202157:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d10b3c0/0x8a60d30f571e7f50 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe263:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127f9f expref: 480 pid: 16042 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.202163:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d10b3c0/0x8a60d30f571e7f50 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe263:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127f9f expref: 480 pid: 16042 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.202174:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d10b3c0/0x8a60d30f571e7f50 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe263:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127f9f expref: 480 pid: 16042 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.202186:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.202188:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.202190:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727b2ec lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe263:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.202197:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727b2ec lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe263:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.202212:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.202242:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d123b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+479:2005:x1805522257655424:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 90us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.202247:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913844 00010000:00010000:0.0:1721880422.202262:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727b2ec lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.202267:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727b2ec lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.202271:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727b2ec lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.202275:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727b2ec lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.202278:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727b2ec lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.202282:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352640 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.202283:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727b2ec lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.202287:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727b2ec lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.202296:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727b2ec lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.202301:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727b2ec lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.202630:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257656192 00000100:00100000:0.0:1721880422.202634:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257656192 00010000:00010000:0.0:1721880422.202643:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800913a3a80/0x8a60d30f571e8236 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe266:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128094 expref: 482 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.202675:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913849 00000100:00100000:0.0:1721880422.202679:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b087b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+481:2005:x1805522257656320:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.202684:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.202687:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097379440/0x8a60d30f571e8474 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe268:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128135 expref: 481 pid: 15497 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.202694:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097379440/0x8a60d30f571e8474 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe268:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128135 expref: 481 pid: 15497 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.202702:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.202703:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.202705:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136353180/0x8a60d30f5727b31d lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe268:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.202709:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136353180/0x8a60d30f5727b31d lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe268:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.202720:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.202757:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b087b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+480:2005:x1805522257656320:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 76us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.202763:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913849 00000100:00100000:0.0:1721880422.202981:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b9e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2577:3686:x1805522011587968:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3265us (3333us total) trans 4296061518 rc 0/0 00000100:00100000:0.0:1721880422.202987:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631651 00000100:00100000:0.0:1721880422.203007:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011592448 00000100:00100000:0.0:1721880422.203011:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011592448 00010000:00010000:0.0:1721880422.203070:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800913a3a80/0x8a60d30f571e8236 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe266:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128094 expref: 477 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.203141:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b08fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:15452:1805522011590272:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.203156:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325c000/0x8a60d30f5727b301 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.203187:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913852 00000100:00100000:0.0:1721880422.203194:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5276c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+477:2007:x1805522257656448:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.203202:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.203207:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801202a2400/0x8a60d30f571e854d lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe269:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128189 expref: 477 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.203216:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801202a2400/0x8a60d30f571e854d lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe269:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128189 expref: 477 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.203235:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801202a2400/0x8a60d30f571e854d lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe269:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128189 expref: 477 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.203245:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.203247:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.203250:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098aa86c0/0x8a60d30f5727b324 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe269:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.203257:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098aa86c0/0x8a60d30f5727b324 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe269:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.203273:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.203292:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5276c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+476:2007:x1805522257656448:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 99us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.203299:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913852 00010000:00010000:0.0:1721880422.203340:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325c000/0x8a60d30f5727b301 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.203347:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325c000/0x8a60d30f5727b301 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.203355:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325c000/0x8a60d30f5727b301 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.203362:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325c000/0x8a60d30f5727b301 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.203374:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325c000/0x8a60d30f5727b301 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.203380:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325c000 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.203383:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325c000/0x8a60d30f5727b301 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.203390:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325c000/0x8a60d30f5727b301 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.203400:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325c000/0x8a60d30f5727b301 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.203406:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325c000/0x8a60d30f5727b301 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.203504:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b08dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2579:3688:x1805522011588864:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3523us (3583us total) trans 4296061520 rc 0/0 00000100:00100000:0.0:1721880422.203511:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631654 00000100:00100000:0.0:1721880422.203535:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011592960 00000100:00100000:0.0:1721880422.203538:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011592960 00000100:00100000:0.0:1721880422.203566:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631670 00000100:00100000:0.0:1721880422.203571:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088db5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1765:3687:x1805522011592960:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.203582:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:65278 count 1 00010000:00010000:0.0:1721880422.203591:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727b371 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfefe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.203602:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c932d00/0x8a60d30f571eb765 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfefe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129c94 expref: 2267 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.203607:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.203608:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.203610:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727b371 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfefe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.203621:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c932d00/0x8a60d30f571eb765 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfefe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129c94 expref: 2267 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.203626:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c932d00/0x8a60d30f571eb765 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfefe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129c94 expref: 2267 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.203633:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088dc3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011593600:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.203646:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36000 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.203655:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011593472 00000100:00100000:0.0:1721880422.203657:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011593472 00000100:00100000:0.0:1721880422.203670:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631672 00000100:00100000:0.0:1721880422.203673:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088db7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2579:3688:x1805522011593472:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1721880422.203682:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:57965 count 1 00010000:00010000:0.0:1721880422.203691:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325e1c0/0x8a60d30f5727b37f lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe26d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.203700:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013572f180/0x8a60d30f571e894b lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe26d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1282fc expref: 474 pid: 16019 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.203712:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.203714:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.203716:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325e1c0/0x8a60d30f5727b37f lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe26d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.203755:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013572f180/0x8a60d30f571e894b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe26d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1282fc expref: 475 pid: 16019 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.203763:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013572f180/0x8a60d30f571e894b lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe26d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1282fc expref: 475 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.203771:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088dc3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:15452:1805522011593856:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.203787:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36840 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.203801:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098aa86c0/0x8a60d30f5727b324 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.203806:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098aa86c0/0x8a60d30f5727b324 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.203810:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098aa86c0/0x8a60d30f5727b324 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.203814:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098aa86c0/0x8a60d30f5727b324 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.203818:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098aa86c0/0x8a60d30f5727b324 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.203822:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa86c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.203825:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098aa86c0/0x8a60d30f5727b324 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.203832:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098aa86c0/0x8a60d30f5727b324 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.203842:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098aa86c0/0x8a60d30f5727b324 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.203848:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098aa86c0/0x8a60d30f5727b324 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.203954:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b8bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2581:3688:x1805522011590528:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3558us (3587us total) trans 4296061522 rc 0/0 00000100:00100000:0.0:1721880422.203959:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631659 00000100:00100000:0.0:1721880422.203988:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.203997:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257657088 00000100:00100000:0.0:1721880422.203999:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257657088 00010000:00010000:0.0:1721880422.204008:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d105b00/0x8a60d30f571eb65b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfefa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129b8a expref: 2268 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.204037:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913857 00000100:00100000:0.0:1721880422.204040:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:262d1f41-ba81-41c5-b215-67c74ea63f50+2268:2004:x1805522257657088:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.204046:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.204050:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d105b00/0x8a60d30f571eb65b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfefa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129b8a expref: 2268 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.204056:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d105b00/0x8a60d30f571eb65b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfefa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129b8a expref: 2268 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.204064:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d105b00/0x8a60d30f571eb65b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfefa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129b8a expref: 2268 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.204074:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.204075:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.204078:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727b340 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfefa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.204085:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727b340 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfefa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.204099:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.204116:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:262d1f41-ba81-41c5-b215-67c74ea63f50+2267:2004:x1805522257657088:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 73us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.204122:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913857 00000100:00100000:0.0:1721880422.204148:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011594240 00000100:00100000:0.0:1721880422.204150:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011594240 00000100:00100000:0.0:1721880422.204166:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631675 00000100:00100000:0.0:1721880422.204169:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fde0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+1767:3687:x1805522011594240:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.204179:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:65281 count 1 00010000:00010000:0.0:1721880422.204187:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727b38d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xff01:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.204197:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801353421c0/0x8a60d30f571eb80d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129d3c expref: 2266 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.204202:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.204203:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.204204:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727b38d lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xff01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.204215:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801353421c0/0x8a60d30f571eb80d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129d3c expref: 2266 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.204221:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801353421c0/0x8a60d30f571eb80d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129d3c expref: 2266 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.204227:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088dc0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011594624:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.204240:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36900 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.204281:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.204287:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257657216 00000100:00100000:0.0:1721880422.204289:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257657216 00010000:00010000:0.0:1721880422.204297:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c644b40/0x8a60d30f571eb6a8 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfefb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129bd7 expref: 2267 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.204314:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913858 00000100:00100000:0.0:1721880422.204318:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:262d1f41-ba81-41c5-b215-67c74ea63f50+2267:2005:x1805522257657216:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.204326:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.204330:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c644b40/0x8a60d30f571eb6a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfefb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129bd7 expref: 2267 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.204339:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c644b40/0x8a60d30f571eb6a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfefb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129bd7 expref: 2267 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.204352:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c644b40/0x8a60d30f571eb6a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfefb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129bd7 expref: 2267 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.204363:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.204365:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.204368:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727b34e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfefb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.204374:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727b34e lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfefb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.204386:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.204396:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:262d1f41-ba81-41c5-b215-67c74ea63f50+2266:2005:x1805522257657216:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 78us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.204401:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913858 00010000:00010000:0.0:1721880422.204416:0:16113:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727b34e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfefb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.204421:0:16113:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727b34e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfefb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.204425:0:16113:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727b34e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfefb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.204431:0:16113:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727b34e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfefb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.204435:0:16113:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727b34e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfefb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.204438:0:16113:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa9d40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.204440:0:16113:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727b34e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfefb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.204444:0:16113:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727b34e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfefb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.204449:0:16113:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727b34e lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfefb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.204452:0:16113:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727b34e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfefb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.204539:0:16113:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880084310000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0000-mdtlov_UUID+1768:3688:x1805522011591936:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2566us (2599us total) trans 4296019829 rc 0/0 00000100:00100000:0.0:1721880422.204543:0:16113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631665 00000100:00100000:0.0:1721880422.204558:0:16113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631679 00000100:00100000:0.0:1721880422.204561:0:16113:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cd22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0000-mdtlov_UUID+2583:3688:x1805522011594368:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1721880422.204570:0:16113:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:57967 count 1 00010000:00010000:0.0:1721880422.204577:0:16113:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325ed00/0x8a60d30f5727b3b0 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe26f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.204585:0:16113:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013572cfc0/0x8a60d30f571e8afd lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe26f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1283b2 expref: 471 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.204589:0:16113:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.204590:0:16113:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.204591:0:16113:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325ed00/0x8a60d30f5727b3b0 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe26f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.204601:0:16113:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013572cfc0/0x8a60d30f571e8afd lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe26f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1283b2 expref: 471 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.204607:0:16113:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013572cfc0/0x8a60d30f571e8afd lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe26f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1283b2 expref: 471 pid: 16075 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.204613:0:16113:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088dc0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0000_UUID:16113:1805522011595904:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.204624:0:16113:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36600 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.204634:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257657344 00000100:00100000:0.0:1721880422.204636:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257657344 00010000:00010000:0.0:1721880422.204643:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011f854240/0x8a60d30f571eb6d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfefc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129c08 expref: 2266 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.204665:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913859 00000100:00100000:0.0:1721880422.204668:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e195850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:262d1f41-ba81-41c5-b215-67c74ea63f50+2266:2004:x1805522257657344:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.204673:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.204676:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011f854240/0x8a60d30f571eb6d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfefc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129c08 expref: 2266 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.204683:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011f854240/0x8a60d30f571eb6d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfefc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129c08 expref: 2266 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.204686:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631681 00000100:00100000:1.0:1721880422.204689:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cd21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+1769:3688:x1805522011595648:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.204695:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011f854240/0x8a60d30f571eb6d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfefc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129c08 expref: 2266 pid: 16130 timeout: 887 lvb_type: 0 00002000:00080000:1.0:1721880422.204698:0:16088:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:65283 count 1 00010000:00010000:0.0:1721880422.204705:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.204706:0:16088:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727b3be lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xff03:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.204707:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.204709:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106d200/0x8a60d30f5727b355 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfefc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.204713:0:16088:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009727e1c0/0x8a60d30f571eb88b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129dba expref: 2265 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.204716:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106d200/0x8a60d30f5727b355 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfefc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.204717:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.204718:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.204719:0:16088:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727b3be lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xff03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.204754:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.204757:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106d200/0x8a60d30f5727b355 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfefc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.204761:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106d200/0x8a60d30f5727b355 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfefc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.204766:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106d200/0x8a60d30f5727b355 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfefc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.204768:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e195850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:262d1f41-ba81-41c5-b215-67c74ea63f50+2265:2004:x1805522257657344:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 98us (331us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.204771:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106d200/0x8a60d30f5727b355 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfefc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.204772:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913859 00010000:00010000:1.0:1721880422.204775:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106d200/0x8a60d30f5727b355 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfefc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.204781:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106d200 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.204783:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106d200/0x8a60d30f5727b355 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfefc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.204787:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106d200/0x8a60d30f5727b355 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfefc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.204793:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106d200/0x8a60d30f5727b355 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfefc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.204797:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106d200/0x8a60d30f5727b355 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfefc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.205044:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b8bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+1770:3687:x1805522011592192:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2630us (2663us total) trans 4296019830 rc 0/0 00000100:00100000:1.0:1721880422.205050:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631666 00010000:00010000:1.0:1721880422.205069:0:16088:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009727e1c0/0x8a60d30f571eb88b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129dba expref: 2264 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.205079:0:16088:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009727e1c0/0x8a60d30f571eb88b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129dba expref: 2264 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.205086:0:16088:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008cd20000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011596160:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.205112:0:16088:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302ebb40 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.205210:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011596288 00000100:00100000:1.0:1721880422.205213:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011596288 00000100:00100000:1.0:1721880422.205227:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631682 00000100:00100000:1.0:1721880422.205229:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bd88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+1770:3686:x1805522011596288:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.205238:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:65284 count 1 00010000:00010000:1.0:1721880422.205245:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106dd40/0x8a60d30f5727b3c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xff04:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.205253:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009727ed00/0x8a60d30f571eb8d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff04:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129e07 expref: 2264 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.205257:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.205259:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.205260:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106dd40/0x8a60d30f5727b3c5 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xff04:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.205270:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009727ed00/0x8a60d30f571eb8d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff04:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129e07 expref: 2264 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.205275:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009727ed00/0x8a60d30f571eb8d8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff04:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129e07 expref: 2264 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.205280:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008cd22300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011596416:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.205309:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb840 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.205818:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.205849:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.205859:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257657472 00000100:00100000:0.0:1721880422.205862:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257657600 00000100:00100000:1.0:1721880422.205862:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257657472 00000100:00100000:0.0:1721880422.205866:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257657600 00010000:00010000:1.0:1721880422.205873:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800971c58c0/0x8a60d30f571eb71f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfefd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129c4e expref: 2265 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.205878:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a538cb40/0x8a60d30f571e86dc lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe26b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128246 expref: 472 pid: 9459 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.205894:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913860 00000100:00100000:1.0:1721880422.205898:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:262d1f41-ba81-41c5-b215-67c74ea63f50+2265:2005:x1805522257657472:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.205919:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.205922:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800971c58c0/0x8a60d30f571eb71f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfefd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129c4e expref: 2265 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.205928:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800971c58c0/0x8a60d30f571eb71f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfefd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129c4e expref: 2265 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.205937:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800971c58c0/0x8a60d30f571eb71f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfefd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129c4e expref: 2265 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.205945:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.205946:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.205948:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727b35c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfefd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.205953:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727b35c lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfefd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.205964:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.205982:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:262d1f41-ba81-41c5-b215-67c74ea63f50+2264:2005:x1805522257657472:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 84us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.205985:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913860 00000100:00100000:1.0:1721880422.206005:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088db6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:15466:1805522011593216:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.206031:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009106ed00/0x8a60d30f5727b363 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe26c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.206034:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.206083:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088dc3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011593600:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.206094:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727b371 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfefe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.206207:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d121880/2, rc 0, transno 1094230 00000100:00100000:1.0:1721880422.206222:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d121880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011592576:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.206274:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1721880422.206282:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011596544:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.206303:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.206391:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.206401:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.206402:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088dc3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:15452:1805522011593856:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.206423:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325e1c0/0x8a60d30f5727b37f lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe26d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.206438:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.206438:0:8271:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257657856 00000100:00100000:1.0:1721880422.206441:0:8271:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257657856 00000100:00100000:0.0:1721880422.206446:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257657728 00000100:00100000:0.0:1721880422.206449:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257657728 00010000:00010000:1.0:1721880422.206451:0:8271:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880072b3cb40/0x8a60d30f571eb79d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfeff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129ccc expref: 2264 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.206459:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011f854d80/0x8a60d30f571e881e lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe26c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1282a1 expref: 471 pid: 16053 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.206467:0:8271:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257657984 00000100:00100000:1.0:1721880422.206470:0:8271:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257657984 00000100:00100000:0.0:1721880422.206471:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257658112 00000100:00100000:0.0:1721880422.206473:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257658112 00010000:00010000:0.0:1721880422.206478:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013572f180/0x8a60d30f571e894b lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe26d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1282fc expref: 472 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.206478:0:8271:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c932d00/0x8a60d30f571eb765 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfefe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129c94 expref: 2265 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.206488:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913863 00000100:00100000:0.0:1721880422.206491:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+472:2005:x1805522257657728:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.206496:0:8271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913864 00000100:00100000:1.0:1721880422.206501:0:8271:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+472:2005:x1805522257658112:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.206509:0:8271:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.206513:0:8271:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013572f180/0x8a60d30f571e894b lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe26d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1282fc expref: 472 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.206523:0:8271:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013572f180/0x8a60d30f571e894b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe26d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1282fc expref: 472 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.206535:0:8271:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013572f180/0x8a60d30f571e894b lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe26d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1282fc expref: 472 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.206545:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.206547:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.206550:0:8271:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009325e1c0/0x8a60d30f5727b37f lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe26d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.206553:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.206556:0:8271:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325e1c0/0x8a60d30f5727b37f lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe26d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.206557:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011f854d80/0x8a60d30f571e881e lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe26c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1282a1 expref: 471 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.206563:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011f854d80/0x8a60d30f571e881e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe26c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1282a1 expref: 471 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.206567:0:8271:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.206572:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011f854d80/0x8a60d30f571e881e lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe26c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1282a1 expref: 471 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.206580:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.206581:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.206583:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009106ed00/0x8a60d30f5727b363 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe26c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.206583:0:8271:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+470:2005:x1805522257658112:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 81us (144us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.206588:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009106ed00/0x8a60d30f5727b363 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe26c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.206589:0:8271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913864 00010000:00010000:0.0:1721880422.206598:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.206612:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+469:2005:x1805522257657728:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 119us (222us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.206615:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325e1c0/0x8a60d30f5727b37f lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.206616:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913863 00010000:00010000:1.0:1721880422.206622:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325e1c0/0x8a60d30f5727b37f lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.206629:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325e1c0/0x8a60d30f5727b37f lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.206636:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009106ed00/0x8a60d30f5727b363 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.206640:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325e1c0/0x8a60d30f5727b37f lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.206643:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009106ed00/0x8a60d30f5727b363 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.206647:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325e1c0/0x8a60d30f5727b37f lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.206651:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009106ed00/0x8a60d30f5727b363 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.206653:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325e1c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.206656:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325e1c0/0x8a60d30f5727b37f lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.206657:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009106ed00/0x8a60d30f5727b363 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.206662:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325e1c0/0x8a60d30f5727b37f lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.206665:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009106ed00/0x8a60d30f5727b363 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.206671:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325e1c0/0x8a60d30f5727b37f lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.206676:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106ed00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.206678:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325e1c0/0x8a60d30f5727b37f lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.206679:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009106ed00/0x8a60d30f5727b363 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.206685:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009106ed00/0x8a60d30f5727b363 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.206695:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009106ed00/0x8a60d30f5727b363 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.206702:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009106ed00/0x8a60d30f5727b363 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.206812:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088db7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2587:3688:x1805522011593472:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3136us (3169us total) trans 4296061527 rc 0/0 00000100:00100000:1.0:1721880422.206818:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631672 00000100:00100000:0.0:1721880422.206834:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2586:3689:x1805522011592704:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3423us (3747us total) trans 4296061528 rc 0/0 00000100:00100000:0.0:1721880422.206839:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631668 00000100:00100000:1.0:1721880422.206841:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009bd89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011596800:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.206862:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.206863:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088dc0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011594624:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.206873:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727b38d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xff01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.206883:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088db6d80/2, rc 0, transno 1094231 00000100:00100000:1.0:1721880422.206898:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088db6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011593472:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.206906:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1721880422.206912:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009bd8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011596928:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.206932:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.206934:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.206945:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257658240 00000100:00100000:0.0:1721880422.206947:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257658240 00000100:00100000:1.0:1721880422.206953:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011596928 00010000:00010000:0.0:1721880422.206954:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134a69d40/0x8a60d30f571eb7c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129cf6 expref: 2262 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.206956:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011596928 00000100:00100000:0.0:1721880422.206970:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913866 00000100:00100000:0.0:1721880422.206972:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129d20850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:262d1f41-ba81-41c5-b215-67c74ea63f50+2262:2005:x1805522257658240:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.206978:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.206978:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631684 00010000:00010000:0.0:1721880422.206980:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134a69d40/0x8a60d30f571eb7c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff00:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129cf6 expref: 2262 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.206983:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cd22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1772:3688:x1805522011596800:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.206986:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134a69d40/0x8a60d30f571eb7c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff00:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129cf6 expref: 2262 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.206994:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134a69d40/0x8a60d30f571eb7c7 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff00:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129cf6 expref: 2262 pid: 16126 timeout: 887 lvb_type: 0 00002000:00080000:1.0:1721880422.206995:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:65285 count 1 00010000:00010000:0.0:1721880422.207000:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.207001:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.207003:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727b386 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.207005:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727b3d3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xff05:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.207008:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727b386 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xff00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.207032:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.207032:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa00900/0x8a60d30f571eb917 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129e46 expref: 2261 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.207039:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.207040:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.207043:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727b3d3 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xff05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.207046:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880129d20850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:262d1f41-ba81-41c5-b215-67c74ea63f50+2261:2005:x1805522257658240:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 72us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.207050:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913866 00010000:00010000:1.0:1721880422.207060:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa00900/0x8a60d30f571eb917 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129e46 expref: 2260 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.207068:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa00900/0x8a60d30f571eb917 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129e46 expref: 2260 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.207073:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727b386 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.207075:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088db6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011597440:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.207079:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727b386 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.207083:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727b386 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.207088:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727b386 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.207091:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb540 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.207094:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727b386 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.207099:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4900 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.207102:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727b386 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.207108:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727b386 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.207118:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727b386 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xff00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.207124:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727b386 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.207238:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+1774:3689:x1805522011593984:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3108us (3160us total) trans 4296019834 rc 0/0 00000100:00100000:0.0:1721880422.207243:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631673 00000100:00100000:0.0:1721880422.207280:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.207292:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257658368 00000100:00100000:1.0:1721880422.207295:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257658368 00010000:00010000:1.0:1721880422.207305:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801353421c0/0x8a60d30f571eb80d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129d3c expref: 2261 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.207321:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913867 00000100:00100000:1.0:1721880422.207325:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:262d1f41-ba81-41c5-b215-67c74ea63f50+2261:2004:x1805522257658368:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.207330:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.207333:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801353421c0/0x8a60d30f571eb80d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff01:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129d3c expref: 2261 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.207339:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801353421c0/0x8a60d30f571eb80d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff01:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129d3c expref: 2261 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.207350:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.207352:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801353421c0/0x8a60d30f571eb80d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff01:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129d3c expref: 2261 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.207356:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257658496 00000100:00100000:0.0:1721880422.207358:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257658496 00010000:00010000:1.0:1721880422.207364:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.207365:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.207366:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800929fbcc0/0x8a60d30f571e8a24 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe26e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128365 expref: 469 pid: 16028 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.207368:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727b38d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.207374:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727b38d lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xff01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.207385:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913868 00000100:00100000:0.0:1721880422.207388:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+469:2005:x1805522257658496:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.207393:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.207395:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800929fbcc0/0x8a60d30f571e8a24 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe26e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128365 expref: 469 pid: 16028 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.207399:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.207402:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800929fbcc0/0x8a60d30f571e8a24 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe26e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128365 expref: 469 pid: 16028 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.207409:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.207410:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.207412:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009106f840/0x8a60d30f5727b394 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe26e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.207416:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009106f840/0x8a60d30f5727b394 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe26e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.207418:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:262d1f41-ba81-41c5-b215-67c74ea63f50+2260:2004:x1805522257658368:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 90us (135us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.207423:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.207428:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913867 00000100:00100000:0.0:1721880422.207433:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+469:2005:x1805522257658496:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 44us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.207437:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913868 00010000:00010000:1.0:1721880422.207459:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800929fbcc0/0x8a60d30f571e8a24 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe26e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128365 expref: 468 pid: 16028 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.207465:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.207470:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008cd22680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0000_UUID:16060:1805522011594752:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.207481:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009106f840/0x8a60d30f5727b394 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.207486:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009106f840/0x8a60d30f5727b394 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.207490:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009106f840/0x8a60d30f5727b394 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.207491:0:16113:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088dc0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0000_UUID:16113:1805522011595904:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.207494:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009106f840/0x8a60d30f5727b394 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.207498:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009106f840/0x8a60d30f5727b394 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.207499:0:16113:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325ed00/0x8a60d30f5727b3b0 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe26f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.207501:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009106f840/0x8a60d30f5727b394 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.207505:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106f840 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.207507:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009106f840/0x8a60d30f5727b394 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.207515:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009106f840/0x8a60d30f5727b394 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.207521:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009106f840/0x8a60d30f5727b394 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.207525:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009106f840/0x8a60d30f5727b394 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.207592:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.207624:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fde1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2588:3687:x1805522011594112:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3457us (3524us total) trans 4296061529 rc 0/0 00000100:00100000:1.0:1721880422.207629:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631674 00000100:00100000:0.0:1721880422.207631:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.207651:0:16088:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008cd20000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011596160:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.207660:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.207660:0:16088:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727b3be lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xff03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.207680:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257659136 00000100:00100000:1.0:1721880422.207683:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257659136 00010000:00010000:1.0:1721880422.207696:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130659200/0x8a60d30f571e8ea0 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe272:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1284a0 expref: 468 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.207703:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.207714:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257659008 00000100:00100000:1.0:1721880422.207717:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257659008 00010000:00010000:1.0:1721880422.207725:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0dd8900/0x8a60d30f571eb845 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129d74 expref: 2261 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.207743:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913872 00000100:00100000:0.0:1721880422.207750:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+467:2006:x1805522257659136:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.207759:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.207764:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130659200/0x8a60d30f571e8ea0 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe272:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1284a0 expref: 467 pid: 16098 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.207774:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130659200/0x8a60d30f571e8ea0 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe272:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1284a0 expref: 467 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.207775:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913873 00000100:00100000:1.0:1721880422.207780:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e197850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:262d1f41-ba81-41c5-b215-67c74ea63f50+2260:2004:x1805522257659008:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.207786:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130659200/0x8a60d30f571e8ea0 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe272:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1284a0 expref: 467 pid: 16098 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.207788:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.207792:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0dd8900/0x8a60d30f571eb845 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff02:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129d74 expref: 2260 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.207798:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.207799:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.207801:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0dd8900/0x8a60d30f571eb845 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff02:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129d74 expref: 2260 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.207802:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136353840/0x8a60d30f5727b3b7 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe272:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.207810:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136353840/0x8a60d30f5727b3b7 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe272:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.207813:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0dd8900/0x8a60d30f571eb845 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff02:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129d74 expref: 2260 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.207822:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.207823:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.207825:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727b3a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.207827:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.207832:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727b3a9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xff02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.207844:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+465:2006:x1805522257659136:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 94us (183us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.207846:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.207850:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913872 00000100:00100000:1.0:1721880422.207863:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e197850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:262d1f41-ba81-41c5-b215-67c74ea63f50+2258:2004:x1805522257659008:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 82us (160us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.207867:0:16113:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325ed00/0x8a60d30f5727b3b0 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.207869:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913873 00010000:00010000:0.0:1721880422.207873:0:16113:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325ed00/0x8a60d30f5727b3b0 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.207880:0:16113:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325ed00/0x8a60d30f5727b3b0 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.207886:0:16113:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325ed00/0x8a60d30f5727b3b0 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.207892:0:16113:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325ed00/0x8a60d30f5727b3b0 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.207897:0:16113:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325ed00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.207900:0:16113:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325ed00/0x8a60d30f5727b3b0 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.207914:0:16113:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325ed00/0x8a60d30f5727b3b0 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.207923:0:16113:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325ed00/0x8a60d30f5727b3b0 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.207926:0:16088:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727b3be lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.207930:0:16113:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325ed00/0x8a60d30f5727b3b0 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.207931:0:16088:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727b3be lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.207936:0:16088:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727b3be lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.207940:0:16088:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727b3be lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.207943:0:16088:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727b3be lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.207947:0:16088:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106eac0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.207948:0:16088:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727b3be lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.207952:0:16088:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727b3be lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.207958:0:16088:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727b3be lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xff03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.207962:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727b3be lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.208066:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cd21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+1775:3688:x1805522011595648:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3375us (3420us total) trans 4296019836 rc 0/0 00000100:00100000:1.0:1721880422.208071:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631681 00010000:00010000:1.0:1721880422.208085:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727b38d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.208090:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727b38d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.208094:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727b38d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.208098:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727b38d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.208101:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727b38d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.208104:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325cb40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.208106:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727b38d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.208110:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727b38d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.208115:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727b38d lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xff01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.208119:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727b38d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.208148:0:16113:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cd22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0000-mdtlov_UUID+2588:3688:x1805522011594368:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3586us (3638us total) trans 4296061532 rc 0/0 00000100:00100000:0.0:1721880422.208153:0:16113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631679 00000100:00100000:0.0:1721880422.208168:0:16113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631690 00000100:00100000:0.0:1721880422.208171:0:16113:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b9e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0000-mdtlov_UUID+2588:3686:x1805522011598336:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1721880422.208180:0:16113:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:57974 count 1 00010000:00010000:0.0:1721880422.208188:0:16113:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325fa80/0x8a60d30f5727b3fd lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe276:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.208193:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fde0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+1776:3687:x1805522011594240:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4023us (4065us total) trans 4296019837 rc 0/0 00010000:00010000:0.0:1721880422.208196:0:16113:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801353ec480/0x8a60d30f571e911d lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe276:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128605 expref: 464 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.208198:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631675 00010000:00010000:0.0:1721880422.208200:0:16113:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.208201:0:16113:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.208203:0:16113:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325fa80/0x8a60d30f5727b3fd lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe276:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.208216:0:16113:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801353ec480/0x8a60d30f571e911d lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe276:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128605 expref: 464 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.208222:0:16113:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801353ec480/0x8a60d30f571e911d lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe276:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128605 expref: 464 pid: 16098 timeout: 887 lvb_type: 0 00000004:00080000:1.0:1721880422.208222:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009b08df80/2, rc 0, transno 1052540 00000100:00100000:0.0:1721880422.208228:0:16113:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088dc0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0000_UUID:16113:1805522011598720:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.208228:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b08df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011595648:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.208243:0:16113:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36600 going to sleep for 11 seconds 00000004:00080000:1.0:1721880422.208273:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008cd21180/2, rc 0, transno 1094235 00000100:00100000:0.0:1721880422.208275:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.208285:0:15455:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257658752 00000100:00100000:0.0:1721880422.208288:0:15455:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257658752 00000100:00100000:1.0:1721880422.208289:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008cd21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011595520:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.208296:0:15455:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131b59d40/0x8a60d30f571e8d65 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe271:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12843e expref: 465 pid: 15497 timeout: 887 lvb_type: 0 00000004:00080000:1.0:1721880422.208301:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008cd21880/2, rc 0, transno 1094236 00000100:00100000:0.0:1721880422.208308:0:15455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913874 00000100:00100000:0.0:1721880422.208311:0:15455:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+465:2005:x1805522257658752:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.208314:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008cd21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011594368:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.208316:0:15455:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.208318:0:15455:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131b59d40/0x8a60d30f571e8d65 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe271:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12843e expref: 465 pid: 15497 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.208324:0:15455:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131b59d40/0x8a60d30f571e8d65 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe271:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12843e expref: 465 pid: 15497 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.208330:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011599104 00010000:00010000:0.0:1721880422.208332:0:15455:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131b59d40/0x8a60d30f571e8d65 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe271:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12843e expref: 465 pid: 15497 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.208333:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011599104 00010000:00010000:0.0:1721880422.208343:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.208344:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.208346:0:15455:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136351b00/0x8a60d30f5727b3a2 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe271:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.208351:0:15455:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136351b00/0x8a60d30f5727b3a2 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe271:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.208356:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631694 00010000:00010000:0.0:1721880422.208359:0:15455:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.208361:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b08ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+1777:3686:x1805522011599104:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.208368:0:15455:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+464:2005:x1805522257658752:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 56us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.208371:0:15455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913874 00002000:00080000:1.0:1721880422.208374:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:65291 count 1 00010000:00010000:0.0:1721880422.208384:0:16100:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136351b00/0x8a60d30f5727b3a2 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.208385:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106c900/0x8a60d30f5727b419 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xff0b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.208391:0:16100:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136351b00/0x8a60d30f5727b3a2 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.208396:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009297b840/0x8a60d30f571ebac9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129ff8 expref: 2257 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.208399:0:16100:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136351b00/0x8a60d30f5727b3a2 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.208402:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.208404:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.208405:0:16100:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136351b00/0x8a60d30f5727b3a2 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.208406:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106c900/0x8a60d30f5727b419 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xff0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.208411:0:16100:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136351b00/0x8a60d30f5727b3a2 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.208423:0:16100:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136351b00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.208426:0:16100:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136351b00/0x8a60d30f5727b3a2 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.208427:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009297b840/0x8a60d30f571ebac9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129ff8 expref: 2257 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.208433:0:16100:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136351b00/0x8a60d30f5727b3a2 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.208434:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009297b840/0x8a60d30f571ebac9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129ff8 expref: 2257 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.208440:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088db4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011599744:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.208442:0:16100:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136351b00/0x8a60d30f5727b3a2 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.208449:0:16100:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136351b00/0x8a60d30f5727b3a2 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.208454:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb780 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.208470:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008cd22300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011596416:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.208479:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106dd40/0x8a60d30f5727b3c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xff04:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.208493:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b08dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011599488:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.208510:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.208536:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011599232 00000100:00100000:1.0:1721880422.208538:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011599232 00000100:00100000:1.0:1721880422.208548:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011599488 00000100:00100000:1.0:1721880422.208550:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011599488 00000100:00100000:0.0:1721880422.208562:0:16100:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b08f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:lustre-MDT0000-mdtlov_UUID+2592:3687:x1805522011595136:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4085us (4116us total) trans 4296061533 rc 0/0 00000100:00100000:1.0:1721880422.208563:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631696 00000100:00100000:1.0:1721880422.208566:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096c9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2592:3688:x1805522011599488:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.208570:0:16100:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631677 00002000:00080000:1.0:1721880422.208575:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:57977 count 1 00010000:00010000:1.0:1721880422.208585:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009106e400/0x8a60d30f5727b420 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe279:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.208594:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b650b40/0x8a60d30f571e92dd lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe279:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1286d0 expref: 463 pid: 16042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.208600:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.208602:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.208604:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009106e400/0x8a60d30f5727b420 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe279:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.208612:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.208619:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b650b40/0x8a60d30f571e92dd lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe279:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1286d0 expref: 463 pid: 16042 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.208624:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257659392 00000100:00100000:0.0:1721880422.208627:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257659392 00010000:00010000:1.0:1721880422.208628:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b650b40/0x8a60d30f571e92dd lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe279:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1286d0 expref: 463 pid: 16042 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.208637:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088db4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0000_UUID:16028:1805522011600000:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.208638:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009727ed00/0x8a60d30f571eb8d8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff04:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129e07 expref: 2258 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.208653:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb840 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.208654:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913875 00000100:00100000:0.0:1721880422.208657:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:262d1f41-ba81-41c5-b215-67c74ea63f50+2258:2005:x1805522257659392:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.208662:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.208665:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009727ed00/0x8a60d30f571eb8d8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff04:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129e07 expref: 2258 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.208671:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009727ed00/0x8a60d30f571eb8d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff04:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129e07 expref: 2258 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.208679:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009727ed00/0x8a60d30f571eb8d8 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff04:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129e07 expref: 2258 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.208696:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.208697:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.208699:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106dd40/0x8a60d30f5727b3c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff04:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.208704:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106dd40/0x8a60d30f5727b3c5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xff04:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.208712:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.208722:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:262d1f41-ba81-41c5-b215-67c74ea63f50+2257:2005:x1805522257659392:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 65us (112us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.208723:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106dd40/0x8a60d30f5727b3c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.208726:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913875 00010000:00010000:1.0:1721880422.208752:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106dd40/0x8a60d30f5727b3c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.208759:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106dd40/0x8a60d30f5727b3c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.208765:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106dd40/0x8a60d30f5727b3c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.208770:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106dd40/0x8a60d30f5727b3c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.208776:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106dd40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.208779:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106dd40/0x8a60d30f5727b3c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.208785:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106dd40/0x8a60d30f5727b3c5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.208794:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106dd40/0x8a60d30f5727b3c5 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xff04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.208800:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106dd40/0x8a60d30f5727b3c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.208915:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bd88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+1778:3686:x1805522011596288:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3683us (3737us total) trans 4296019838 rc 0/0 00000100:00100000:1.0:1721880422.208921:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631682 00000100:00100000:1.0:1721880422.209000:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011600384 00000100:00100000:1.0:1721880422.209003:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011600384 00000100:00100000:1.0:1721880422.209033:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631698 00000100:00100000:1.0:1721880422.209037:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084313b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+1778:3686:x1805522011600384:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.209047:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:65292 count 1 00010000:00010000:1.0:1721880422.209056:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106f600/0x8a60d30f5727b435 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xff0c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.209065:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0e3a1c0/0x8a60d30f571ebb0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff0c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a03e expref: 2256 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.209075:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.209076:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.209078:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106f600/0x8a60d30f5727b435 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xff0c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.209092:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0e3a1c0/0x8a60d30f571ebb0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff0c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a03e expref: 2256 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.209099:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0e3a1c0/0x8a60d30f571ebb0f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff0c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a03e expref: 2256 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.209107:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008cd20000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011600512:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.209137:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb480 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.209928:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.209971:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.209981:0:15455:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257659520 00000100:00100000:1.0:1721880422.209985:0:15455:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257659520 00000100:00100000:0.0:1721880422.209987:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257659648 00000100:00100000:0.0:1721880422.209990:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257659648 00010000:00010000:1.0:1721880422.209999:0:15455:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c8cd680/0x8a60d30f571e8f25 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe273:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1284f4 expref: 464 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.210002:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800942121c0/0x8a60d30f571eb96b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff06:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129e93 expref: 2257 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.210032:0:15455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913876 00000100:00100000:1.0:1721880422.210035:0:15455:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+464:2004:x1805522257659520:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.210042:0:15455:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.210045:0:15455:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c8cd680/0x8a60d30f571e8f25 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe273:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1284f4 expref: 464 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.210051:0:15455:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c8cd680/0x8a60d30f571e8f25 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe273:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1284f4 expref: 464 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.210059:0:15455:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c8cd680/0x8a60d30f571e8f25 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe273:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1284f4 expref: 464 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.210067:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.210068:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.210070:0:15455:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136352400/0x8a60d30f5727b3cc lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe273:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.210074:0:15455:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136352400/0x8a60d30f5727b3cc lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe273:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.210077:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913877 00000100:00100000:0.0:1721880422.210083:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:262d1f41-ba81-41c5-b215-67c74ea63f50+2257:2005:x1805522257659648:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.210084:0:15455:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.210089:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.210092:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800942121c0/0x8a60d30f571eb96b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff06:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129e93 expref: 2257 pid: 16098 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.210098:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800942121c0/0x8a60d30f571eb96b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff06:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129e93 expref: 2257 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.210102:0:15455:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+463:2004:x1805522257659520:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 65us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.210105:0:15455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913876 00010000:00010000:0.0:1721880422.210107:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800942121c0/0x8a60d30f571eb96b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff06:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129e93 expref: 2257 pid: 16098 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.210113:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.210114:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.210116:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727b3da lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff06:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.210121:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727b3da lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xff06:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.210126:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088db6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011597440:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.210130:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.210135:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727b3d3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xff05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.210143:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:262d1f41-ba81-41c5-b215-67c74ea63f50+2256:2005:x1805522257659648:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 60us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.210147:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913877 00000100:00100000:1.0:1721880422.210187:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.210217:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257659776 00000100:00100000:0.0:1721880422.210220:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257659776 00000100:00100000:1.0:1721880422.210221:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.210228:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa00900/0x8a60d30f571eb917 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129e46 expref: 2256 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.210232:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257659904 00000100:00100000:1.0:1721880422.210235:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257659904 00010000:00010000:1.0:1721880422.210243:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013572c900/0x8a60d30f571e8fd4 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe274:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128564 expref: 463 pid: 16087 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.210244:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913878 00000100:00100000:0.0:1721880422.210247:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cd22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:262d1f41-ba81-41c5-b215-67c74ea63f50+2256:2005:x1805522257659776:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.210252:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.210254:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa00900/0x8a60d30f571eb917 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff05:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129e46 expref: 2256 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.210258:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913879 00010000:00010000:0.0:1721880422.210260:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa00900/0x8a60d30f571eb917 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff05:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129e46 expref: 2256 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.210261:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088db6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+463:2005:x1805522257659904:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.210265:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.210268:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa00900/0x8a60d30f571eb917 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff05:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129e46 expref: 2256 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.210268:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013572c900/0x8a60d30f571e8fd4 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe274:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128564 expref: 463 pid: 16087 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.210274:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013572c900/0x8a60d30f571e8fd4 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe274:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128564 expref: 463 pid: 16087 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.210277:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.210277:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.210279:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727b3d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.210282:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013572c900/0x8a60d30f571e8fd4 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe274:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128564 expref: 463 pid: 16087 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.210283:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727b3d3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xff05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.210290:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.210291:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.210292:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.210293:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136350fc0/0x8a60d30f5727b3e1 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe274:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.210297:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136350fc0/0x8a60d30f5727b3e1 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe274:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.210305:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cd22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:262d1f41-ba81-41c5-b215-67c74ea63f50+2255:2005:x1805522257659776:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 57us (119us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.210307:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.210309:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913878 00000100:00100000:1.0:1721880422.210318:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088db6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+462:2005:x1805522257659904:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 57us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.210322:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913879 00000100:00100000:0.0:1721880422.210333:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.210338:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727b3d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.210345:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727b3d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.210349:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727b3d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.210353:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727b3d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.210357:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727b3d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.210360:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106e1c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.210361:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727b3d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.210365:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727b3d3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.210370:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727b3d3 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xff05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.210374:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727b3d3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.210391:0:15455:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257660032 00000100:00100000:1.0:1721880422.210393:0:15455:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257660032 00010000:00010000:1.0:1721880422.210398:0:15455:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800942133c0/0x8a60d30f571eb9bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129eee expref: 2255 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.210407:0:15455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913880 00000100:00100000:1.0:1721880422.210409:0:15455:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ab4d7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:262d1f41-ba81-41c5-b215-67c74ea63f50+2255:2005:x1805522257660032:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.210414:0:15455:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.210416:0:15455:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800942133c0/0x8a60d30f571eb9bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff07:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129eee expref: 2255 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.210421:0:15455:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800942133c0/0x8a60d30f571eb9bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff07:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129eee expref: 2255 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.210427:0:15455:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800942133c0/0x8a60d30f571eb9bf lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff07:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129eee expref: 2255 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.210433:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.210433:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.210435:0:15455:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727b3e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.210439:0:15455:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727b3e8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xff07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.210447:0:15455:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.210457:0:15455:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ab4d7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:262d1f41-ba81-41c5-b215-67c74ea63f50+2254:2005:x1805522257660032:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 47us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.210460:0:15455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913880 00000100:00100000:0.0:1721880422.210499:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.210517:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257660160 00000100:00100000:1.0:1721880422.210520:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257660160 00010000:00010000:1.0:1721880422.210529:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801348d4900/0x8a60d30f571e9075 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe275:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1285b8 expref: 462 pid: 16037 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.210544:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913881 00000100:00100000:1.0:1721880422.210547:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+462:2004:x1805522257660160:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.210554:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.210558:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801348d4900/0x8a60d30f571e9075 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe275:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1285b8 expref: 462 pid: 16037 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.210566:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801348d4900/0x8a60d30f571e9075 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe275:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1285b8 expref: 462 pid: 16037 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.210578:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801348d4900/0x8a60d30f571e9075 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe275:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1285b8 expref: 462 pid: 16037 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.210587:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.210588:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.210591:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727b3ef lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe275:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.210597:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727b3ef lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe275:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.210603:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.210605:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727b44a lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe27c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.210611:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.210614:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257660288 00000100:00100000:0.0:1721880422.210617:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257660288 00010000:00010000:2.0:1721880422.210623:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880123a6ad00/0x8a60d30f571e951b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe27c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1287f6 expref: 461 pid: 15497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.210626:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007c9c5200/0x8a60d30f571eb9f0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xff08:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129f1f expref: 2254 pid: 16112 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.210627:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+461:2004:x1805522257660160:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 79us (130us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.210633:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880123a6ad00/0x8a60d30f571e951b lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe27c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1287f6 expref: 461 pid: 15497 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.210634:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913881 00000100:00100000:2.0:1721880422.210642:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094634380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0000_UUID:16017:1805522011601280:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.210646:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913882 00000100:00100000:0.0:1721880422.210652:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:262d1f41-ba81-41c5-b215-67c74ea63f50+2254:2005:x1805522257660288:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.210660:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.210663:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03d80 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.210664:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007c9c5200/0x8a60d30f571eb9f0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xff08:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129f1f expref: 2254 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.210673:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007c9c5200/0x8a60d30f571eb9f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff08:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129f1f expref: 2254 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.210675:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727b3ef lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.210680:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727b3ef lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.210685:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.210685:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727b3ef lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.210686:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.210689:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727b3f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff08:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.210689:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727b3ef lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.210693:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727b3ef lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.210696:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727b3f6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xff08:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.210696:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353cc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.210698:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727b3ef lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.210702:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727b3ef lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.210708:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.210709:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727b3ef lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.210713:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727b3ef lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.210714:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cd22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1780:3688:x1805522011596800:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3731us (3852us total) trans 4296019841 rc 0/0 00000100:00100000:1.0:1721880422.210719:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631684 00000100:00100000:0.0:1721880422.210725:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:262d1f41-ba81-41c5-b215-67c74ea63f50+2254:2005:x1805522257660288:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 73us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.210746:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913882 00010000:00010000:0.0:1721880422.210773:0:16040:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007c9c5200/0x8a60d30f571eb9f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff08:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129f1f expref: 2253 pid: 16112 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.210814:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b08c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011599616:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.210820:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2595:3689:x1805522011597824:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3525us (3593us total) trans 4296061536 rc 0/0 00010000:00010000:1.0:1721880422.210825:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727b412 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xff0a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.210826:0:16040:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e9c9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_040:lustre-OST0001_UUID:16040:1805522011598208:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.210826:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631688 00000100:00100000:1.0:1721880422.210835:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011601408 00010000:00010000:0.0:1721880422.210837:0:16040:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727b3f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.210837:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011601408 00000100:00100000:1.0:1721880422.210849:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631702 00000100:00100000:1.0:1721880422.210851:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ebdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1780:3686:x1805522011601408:12345-0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1721880422.210853:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b9e8000/2, rc 0, transno 1094240 00000100:00100000:0.0:1721880422.210855:0:16113:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088dc0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0000_UUID:16113:1805522011598720:192.168.201.24@tcp:104: 00002000:00080000:1.0:1721880422.210859:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:65294 count 1 00000100:00100000:2.0:1721880422.210861:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007b9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011597824:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.210863:0:16113:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325fa80/0x8a60d30f5727b3fd lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe276:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.210866:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727b451 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xff0e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.210870:0:16040:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727b3f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.210872:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094319f80/0x8a60d30f571ebb7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff0e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a0ae expref: 2252 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.210876:0:16040:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727b3f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.210876:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.210877:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.210878:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727b451 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xff0e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.210881:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009bd8b100/2, rc 0, transno 1052544 00010000:00010000:0.0:1721880422.210883:0:16040:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727b3f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.210890:0:16040:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727b3f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.210891:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094319f80/0x8a60d30f571ebb7f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff0e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a0ae expref: 2252 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.210897:0:16040:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727b3f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.210897:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009bd8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011597184:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.210903:0:16040:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b5680 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.210903:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094319f80/0x8a60d30f571ebb7f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff0e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a0ae expref: 2252 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.210912:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088db6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011601664:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.210927:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1721880422.210932:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb900 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.210934:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009ebda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011601792:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.210948:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011601536 00000100:00100000:1.0:1721880422.210951:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011601536 00010000:00010000:0.0:1721880422.210956:0:16040:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727b3f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.210956:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.210963:0:16040:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727b3f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.210968:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011601792 00000100:00100000:1.0:1721880422.210970:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011601792 00010000:00010000:0.0:1721880422.210972:0:16040:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727b3f6 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xff08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.210978:0:16040:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727b3f6 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.210982:0:9458:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631704 00000100:00100000:2.0:1721880422.210987:0:9458:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1781:3689:x1805522011601792:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.211002:0:9458:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:65295 count 1 00000100:00100000:1.0:1721880422.211006:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.211028:0:9458:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727b45f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xff0f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.211040:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257660544 00000100:00100000:1.0:1721880422.211043:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257660544 00010000:00010000:2.0:1721880422.211046:0:9458:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d7b4fc0/0x8a60d30f571ebbe1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a110 expref: 2253 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.211053:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.211054:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a07ddd40/0x8a60d30f571eba36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129f65 expref: 2253 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.211055:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.211057:0:9458:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727b45f lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xff0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.211070:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913883 00000100:00100000:1.0:1721880422.211075:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b08c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:262d1f41-ba81-41c5-b215-67c74ea63f50+2253:2004:x1805522257660544:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.211075:0:9458:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d7b4fc0/0x8a60d30f571ebbe1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a110 expref: 2253 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.211083:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.211085:0:9458:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d7b4fc0/0x8a60d30f571ebbe1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a110 expref: 2253 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.211087:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a07ddd40/0x8a60d30f571eba36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff09:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129f65 expref: 2253 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.211093:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a07ddd40/0x8a60d30f571eba36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff09:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129f65 expref: 2253 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.211095:0:9458:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094636a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011602048:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.211101:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a07ddd40/0x8a60d30f571eba36 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff09:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129f65 expref: 2253 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.211109:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.211110:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.211112:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727b404 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.211114:0:9458:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03a80 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.211117:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727b404 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xff09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.211126:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.211139:0:16040:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:lustre-MDT0000-mdtlov_UUID+1782:3689:x1805522011597952:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3815us (3848us total) trans 4296019842 rc 0/0 00000100:00100000:1.0:1721880422.211140:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b08c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:262d1f41-ba81-41c5-b215-67c74ea63f50+2252:2004:x1805522257660544:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 66us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.211144:0:16040:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631689 00000100:00100000:1.0:1721880422.211145:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913883 00000004:00080000:2.0:1721880422.211152:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b9e8a80/2, rc 0, transno 1052546 00000100:00100000:2.0:1721880422.211165:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007b9e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011597952:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.211192:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.211200:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257660416 00000100:00100000:1.0:1721880422.211202:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257660416 00000100:00100000:2.0:1721880422.211203:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009ebd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011602176:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.211209:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801353ec480/0x8a60d30f571e911d lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe276:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128605 expref: 461 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.211211:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.211219:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257660672 00000100:00100000:1.0:1721880422.211220:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257660672 00000100:00100000:2.0:1721880422.211225:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.211226:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801239386c0/0x8a60d30f571e91cc lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe277:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128652 expref: 462 pid: 16128 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.211234:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913884 00000100:00100000:1.0:1721880422.211236:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cd22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+462:2005:x1805522257660416:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.211241:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.211243:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801353ec480/0x8a60d30f571e911d lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe276:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128605 expref: 462 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.211244:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.211248:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801353ec480/0x8a60d30f571e911d lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe276:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128605 expref: 462 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.211249:0:16040:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011602176 00000100:00100000:2.0:1721880422.211254:0:16040:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011602176 00010000:00010000:1.0:1721880422.211255:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801353ec480/0x8a60d30f571e911d lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe276:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128605 expref: 462 pid: 16098 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.211261:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.211262:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.211263:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009325fa80/0x8a60d30f5727b3fd lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe276:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.211263:0:8271:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257660800 00000100:00100000:2.0:1721880422.211266:0:8271:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257660800 00010000:00010000:1.0:1721880422.211270:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325fa80/0x8a60d30f5727b3fd lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe276:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.211276:0:8271:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d3f3600/0x8a60d30f571eba7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff0a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129fab expref: 2252 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.211289:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.211296:0:16113:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325fa80/0x8a60d30f5727b3fd lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.211299:0:8271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913885 00010000:00010000:0.0:1721880422.211304:0:16113:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325fa80/0x8a60d30f5727b3fd lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.211305:0:8271:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+461:2005:x1805522257660672:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.211308:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cd22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+461:2005:x1805522257660416:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 70us (115us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.211311:0:16113:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325fa80/0x8a60d30f5727b3fd lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.211313:0:8271:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.211315:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913884 00010000:00010000:2.0:1721880422.211317:0:8271:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801239386c0/0x8a60d30f571e91cc lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe277:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128652 expref: 461 pid: 16128 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.211318:0:16113:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325fa80/0x8a60d30f5727b3fd lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.211327:0:8271:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801239386c0/0x8a60d30f571e91cc lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe277:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128652 expref: 460 pid: 16128 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.211328:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913886 00010000:00010000:0.0:1721880422.211330:0:16113:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325fa80/0x8a60d30f5727b3fd lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.211333:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:262d1f41-ba81-41c5-b215-67c74ea63f50+2252:2005:x1805522257660800:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.211337:0:16113:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325fa80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.211339:0:16113:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325fa80/0x8a60d30f5727b3fd lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.211340:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.211340:0:8271:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801239386c0/0x8a60d30f571e91cc lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe277:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128652 expref: 460 pid: 16128 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.211344:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d3f3600/0x8a60d30f571eba7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff0a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129fab expref: 2252 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.211346:0:16113:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325fa80/0x8a60d30f5727b3fd lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.211354:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.211355:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.211356:0:16113:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325fa80/0x8a60d30f5727b3fd lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.211358:0:8271:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b46c0/0x8a60d30f5727b40b lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe277:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.211359:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d3f3600/0x8a60d30f571eba7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff0a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129fab expref: 2252 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.211363:0:16113:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325fa80/0x8a60d30f5727b3fd lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.211365:0:8271:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b46c0/0x8a60d30f5727b40b lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe277:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.211371:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d3f3600/0x8a60d30f571eba7c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff0a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129fab expref: 2252 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.211380:0:8271:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.211381:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.211382:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.211385:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727b412 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff0a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.211391:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727b412 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xff0a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.211397:0:8271:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+459:2005:x1805522257660672:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 92us (186us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.211404:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.211404:0:8271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913885 00000100:00100000:1.0:1721880422.211418:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:262d1f41-ba81-41c5-b215-67c74ea63f50+2251:2005:x1805522257660800:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 85us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.211425:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913886 00000100:00100000:2.0:1721880422.211434:0:16040:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631706 00000100:00100000:2.0:1721880422.211439:0:16040:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:lustre-MDT0000-mdtlov_UUID+1783:3689:x1805522011602176:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.211444:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727b412 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.211450:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727b412 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.211451:0:16040:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:65296 count 1 00010000:00010000:1.0:1721880422.211457:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727b412 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.211461:0:16040:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727b46d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xff10:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.211469:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727b412 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.211472:0:16040:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800932ce1c0/0x8a60d30f571ebc27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a156 expref: 2250 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.211473:0:16113:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b9e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0000-mdtlov_UUID+2596:3686:x1805522011598336:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3299us (3335us total) trans 4296061537 rc 0/0 00010000:00010000:1.0:1721880422.211475:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727b412 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.211479:0:16113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631690 00010000:00010000:2.0:1721880422.211479:0:16040:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.211480:0:16040:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.211481:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136351680 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.211483:0:16040:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727b46d lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xff10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.211484:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727b412 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.211491:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727b412 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.211498:0:16040:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800932ce1c0/0x8a60d30f571ebc27 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a156 expref: 2250 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.211499:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727b412 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xff0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.211506:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727b412 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.211508:0:16040:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800932ce1c0/0x8a60d30f571ebc27 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a156 expref: 2250 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.211512:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088db4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011599744:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.211519:0:16040:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094635880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_040:lustre-OST0001_UUID:16040:1805522011602560:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.211529:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106c900/0x8a60d30f5727b419 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xff0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.211536:0:16040:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03f00 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.211585:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000004:00080000:2.0:1721880422.211606:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009b08d180/2, rc 0, transno 1094242 00000100:00100000:0.0:1721880422.211612:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.211614:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b08f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+1784:3689:x1805522011598976:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3264us (3348us total) trans 4296019844 rc 0/0 00000100:00100000:2.0:1721880422.211615:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b08d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011598592:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.211621:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631693 00000100:00100000:0.0:1721880422.211626:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257660928 00000100:00100000:0.0:1721880422.211629:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257660928 00010000:00010000:0.0:1721880422.211640:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009297b840/0x8a60d30f571ebac9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129ff8 expref: 2251 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.211649:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088db4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0000_UUID:16028:1805522011600000:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.211663:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257661056 00010000:00010000:1.0:1721880422.211663:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009106e400/0x8a60d30f5727b420 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe279:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.211664:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088db5f80/2, rc 0, transno 1052548 00000100:00100000:0.0:1721880422.211666:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257661056 00000100:00100000:2.0:1721880422.211670:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088db5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011598976:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.211674:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fc1f600/0x8a60d30f571e9258 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe278:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12868a expref: 459 pid: 16112 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.211675:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1721880422.211686:0:15455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913887 00000100:00100000:1.0:1721880422.211691:0:15455:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a70ef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:262d1f41-ba81-41c5-b215-67c74ea63f50+2251:2005:x1805522257660928:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.211693:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913888 00000100:00100000:0.0:1721880422.211698:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+459:2004:x1805522257661056:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.211699:0:15455:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.211700:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011602816:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.211703:0:15455:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009297b840/0x8a60d30f571ebac9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff0b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129ff8 expref: 2251 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.211705:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.211709:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fc1f600/0x8a60d30f571e9258 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe278:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12868a expref: 459 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.211712:0:15455:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009297b840/0x8a60d30f571ebac9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff0b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129ff8 expref: 2251 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.211718:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fc1f600/0x8a60d30f571e9258 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe278:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12868a expref: 459 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.211724:0:15455:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009297b840/0x8a60d30f571ebac9 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff0b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129ff8 expref: 2251 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.211749:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fc1f600/0x8a60d30f571e9258 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe278:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12868a expref: 459 pid: 16112 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.211750:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.211752:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.211754:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.211756:0:15455:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106c900/0x8a60d30f5727b419 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.211761:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.211762:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.211763:0:15455:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106c900/0x8a60d30f5727b419 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xff0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.211765:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5200/0x8a60d30f5727b427 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe278:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.211772:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5200/0x8a60d30f5727b427 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe278:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.211777:0:15455:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.211794:0:15455:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a70ef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:262d1f41-ba81-41c5-b215-67c74ea63f50+2250:2005:x1805522257660928:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 102us (208us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.211797:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.211800:0:15455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913887 00000100:00100000:0.0:1721880422.211811:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+458:2004:x1805522257661056:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 113us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.211816:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913888 00010000:00010000:0.0:1721880422.211834:0:16110:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5200/0x8a60d30f5727b427 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.211840:0:16110:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5200/0x8a60d30f5727b427 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.211844:0:16110:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5200/0x8a60d30f5727b427 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.211848:0:16110:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5200/0x8a60d30f5727b427 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.211852:0:16110:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5200/0x8a60d30f5727b427 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.211855:0:16110:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b5200 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.211856:0:16110:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5200/0x8a60d30f5727b427 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.211860:0:16110:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5200/0x8a60d30f5727b427 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.211869:0:16110:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5200/0x8a60d30f5727b427 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.211873:0:16110:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5200/0x8a60d30f5727b427 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.211930:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631709 00000100:00100000:2.0:1721880422.211936:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2598:3689:x1805522011602816:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1721880422.211950:0:16088:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:57983 count 1 00000100:00100000:0.0:1721880422.211961:0:16110:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b08ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_094:lustre-MDT0000-mdtlov_UUID+2598:3686:x1805522011599232:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3396us (3475us total) trans 4296061539 rc 0/0 00010000:00010000:2.0:1721880422.211961:0:16088:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136350240/0x8a60d30f5727b482 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe27f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.211965:0:16110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631695 00010000:00010000:2.0:1721880422.211974:0:16088:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880123a69f80/0x8a60d30f571e9783 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe27f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128915 expref: 457 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.211980:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106c900/0x8a60d30f5727b419 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.211981:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.211982:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.211984:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106c900/0x8a60d30f5727b419 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.211985:0:16088:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136350240/0x8a60d30f5727b482 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe27f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.211989:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106c900/0x8a60d30f5727b419 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.211993:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106c900/0x8a60d30f5727b419 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.211996:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106c900/0x8a60d30f5727b419 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.211999:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106c900 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.212001:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106c900/0x8a60d30f5727b419 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.212002:0:16088:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880123a69f80/0x8a60d30f571e9783 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe27f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128915 expref: 457 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.212006:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106c900/0x8a60d30f5727b419 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.212012:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106c900/0x8a60d30f5727b419 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xff0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.212012:0:16088:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880123a69f80/0x8a60d30f571e9783 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe27f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128915 expref: 457 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.212029:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106c900/0x8a60d30f5727b419 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.212036:0:16088:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094634000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0000_UUID:16088:1805522011603456:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.212038:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011603328 00000100:00100000:1.0:1721880422.212042:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011603328 00000100:00100000:2.0:1721880422.212058:0:16088:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03300 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.212061:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631710 00000100:00100000:1.0:1721880422.212065:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2598:3686:x1805522011603328:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1721880422.212076:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:57984 count 1 00010000:00010000:1.0:1721880422.212086:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009106c6c0/0x8a60d30f5727b489 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe280:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.212096:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880134d2aac0/0x8a60d30f571e9847 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe280:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128970 expref: 457 pid: 16091 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.212102:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.212104:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.212106:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009106c6c0/0x8a60d30f5727b489 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe280:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.212122:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880134d2aac0/0x8a60d30f571e9847 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe280:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128970 expref: 457 pid: 16091 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.212131:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880134d2aac0/0x8a60d30f571e9847 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe280:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128970 expref: 457 pid: 16091 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.212140:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008cd22680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0000_UUID:16101:1805522011603584:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.212148:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b08ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+1785:3686:x1805522011599104:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3786us (3840us total) trans 4296019845 rc 0/0 00000100:00100000:0.0:1721880422.212154:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631694 00000100:00100000:1.0:1721880422.212158:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb840 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.212235:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008cd20000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011600512:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.212248:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106f600/0x8a60d30f5727b435 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xff0c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.212257:0:16110:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011603712 00000100:00100000:0.0:1721880422.212261:0:16110:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011603712 00000100:00100000:1.0:1721880422.212277:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.212285:0:16110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631711 00000100:00100000:0.0:1721880422.212290:0:16110:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_094:lustre-MDT0000-mdtlov_UUID+1785:3686:x1805522011603712:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.212291:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257661184 00000100:00100000:1.0:1721880422.212293:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257661184 00002000:00080000:0.0:1721880422.212301:0:16110:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:65299 count 1 00010000:00010000:1.0:1721880422.212302:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b650b40/0x8a60d30f571e92dd lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe279:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1286d0 expref: 458 pid: 16042 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.212312:0:16110:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727b490 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xff13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.212314:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913889 00000100:00100000:1.0:1721880422.212318:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cd20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+458:2004:x1805522257661184:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.212322:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.212323:0:16110:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d5acfc0/0x8a60d30f571ebce4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a213 expref: 2249 pid: 16019 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.212325:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b650b40/0x8a60d30f571e92dd lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe279:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1286d0 expref: 458 pid: 16042 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.212327:0:16110:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.212328:0:16110:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.212330:0:16110:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727b490 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xff13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.212331:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b650b40/0x8a60d30f571e92dd lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe279:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1286d0 expref: 458 pid: 16042 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.212339:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b650b40/0x8a60d30f571e92dd lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe279:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1286d0 expref: 458 pid: 16042 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.212344:0:16110:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d5acfc0/0x8a60d30f571ebce4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a213 expref: 2249 pid: 16019 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.212347:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.212348:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.212350:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009106e400/0x8a60d30f5727b420 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe279:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.212351:0:16110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d5acfc0/0x8a60d30f571ebce4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a213 expref: 2249 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.212354:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009106e400/0x8a60d30f5727b420 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe279:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.212357:0:16110:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088dc1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_094:lustre-OST0001_UUID:16110:1805522011603840:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.212366:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.212373:0:16110:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36000 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.212374:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009106e400/0x8a60d30f5727b420 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.212378:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cd20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+457:2004:x1805522257661184:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 59us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.212382:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913889 00010000:00010000:2.0:1721880422.212383:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009106e400/0x8a60d30f5727b420 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.212388:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009106e400/0x8a60d30f5727b420 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.212392:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009106e400/0x8a60d30f5727b420 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.212393:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.212395:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009106e400/0x8a60d30f5727b420 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.212398:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106e400 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.212400:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009106e400/0x8a60d30f5727b420 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.212404:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009106e400/0x8a60d30f5727b420 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.212408:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.212410:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009106e400/0x8a60d30f5727b420 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.212415:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009106e400/0x8a60d30f5727b420 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.212431:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257661312 00000100:00100000:1.0:1721880422.212433:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257661312 00010000:00010000:1.0:1721880422.212442:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880123a6a640/0x8a60d30f571e93c4 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe27a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128740 expref: 457 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.212459:0:15455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913890 00000100:00100000:1.0:1721880422.212463:0:15455:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+457:2004:x1805522257661312:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.212469:0:15455:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.212472:0:15455:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880123a6a640/0x8a60d30f571e93c4 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe27a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128740 expref: 457 pid: 16098 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.212481:0:15455:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880123a6a640/0x8a60d30f571e93c4 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe27a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128740 expref: 457 pid: 16098 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.212493:0:15455:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880123a6a640/0x8a60d30f571e93c4 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe27a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128740 expref: 457 pid: 16098 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.212503:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.212504:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880096c9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2599:3688:x1805522011599488:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3936us (3993us total) trans 4296061540 rc 0/0 00000100:00100000:0.0:1721880422.212505:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.212505:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.212507:0:15455:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136350480/0x8a60d30f5727b42e lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe27a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.212510:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631696 00010000:00010000:1.0:1721880422.212519:0:15455:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136350480/0x8a60d30f5727b42e lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe27a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.212520:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257661568 00000100:00100000:0.0:1721880422.212523:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257661568 00010000:00010000:0.0:1721880422.212532:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880123a6bcc0/0x8a60d30f571e947a lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe27b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128794 expref: 457 pid: 16037 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.212533:0:15455:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.212545:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913892 00000100:00100000:0.0:1721880422.212548:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+457:2005:x1805522257661568:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.212550:0:15455:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+457:2004:x1805522257661312:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 85us (155us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.212554:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.212557:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880123a6bcc0/0x8a60d30f571e947a lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe27b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128794 expref: 457 pid: 16037 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.212557:0:15455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913890 00010000:00010000:0.0:1721880422.212564:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880123a6bcc0/0x8a60d30f571e947a lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe27b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128794 expref: 457 pid: 16037 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.212577:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106f600/0x8a60d30f5727b435 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.212582:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880123a6bcc0/0x8a60d30f571e947a lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe27b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128794 expref: 456 pid: 16037 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.212582:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106f600/0x8a60d30f5727b435 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.212586:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106f600/0x8a60d30f5727b435 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.212590:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106f600/0x8a60d30f5727b435 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.212594:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106f600/0x8a60d30f5727b435 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.212595:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.212596:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.212597:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106f600 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.212599:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6f40/0x8a60d30f5727b43c lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe27b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.212599:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106f600/0x8a60d30f5727b435 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.212606:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6f40/0x8a60d30f5727b43c lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe27b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.212606:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106f600/0x8a60d30f5727b435 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.212612:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106f600/0x8a60d30f5727b435 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xff0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.212616:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106f600/0x8a60d30f5727b435 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.212627:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:2.0:1721880422.212627:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009b08dc00/2, rc 0, transno 1094244 00000100:00100000:2.0:1721880422.212633:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b08dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011599488:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.212645:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+455:2005:x1805522257661568:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 94us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.212650:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1721880422.212651:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913892 00000100:00100000:2.0:1721880422.212654:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011603968:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.212667:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.212679:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011603968 00000100:00100000:2.0:1721880422.212681:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011603968 00000100:00100000:2.0:1721880422.212691:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631712 00000100:00100000:2.0:1721880422.212694:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fde1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2599:3689:x1805522011603968:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1721880422.212701:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:57985 count 1 00000100:00100000:1.0:1721880422.212708:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880084313b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+1786:3686:x1805522011600384:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3670us (3720us total) trans 4296019846 rc 0/0 00010000:00010000:2.0:1721880422.212709:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136351200/0x8a60d30f5727b497 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe281:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.212713:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631698 00010000:00010000:2.0:1721880422.212717:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096629680/0x8a60d30f571e98e1 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe281:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1289bd expref: 454 pid: 16128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.212722:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.212723:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.212724:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136351200/0x8a60d30f5727b497 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe281:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.212756:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096629680/0x8a60d30f571e98e1 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe281:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1289bd expref: 454 pid: 16128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.212762:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096629680/0x8a60d30f571e98e1 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe281:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1289bd expref: 454 pid: 16128 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.212773:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fde0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0000_UUID:16028:1805522011604096:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.212789:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03900 going to sleep for 11 seconds 00000004:00080000:2.0:1721880422.212908:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008fde3b80/2, rc 0, transno 1094246 00000100:00100000:2.0:1721880422.212913:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fde3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011599872:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.212958:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1721880422.212965:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011604224:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.212985:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.212994:0:16100:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011604480 00000100:00100000:0.0:1721880422.212998:0:16100:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011604480 00000100:00100000:2.0:1721880422.213003:0:16098:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011604224 00000100:00100000:2.0:1721880422.213005:0:16098:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011604224 00000100:00100000:0.0:1721880422.213034:0:16100:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011604352 00000100:00100000:0.0:1721880422.213037:0:16100:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011604352 00000100:00100000:2.0:1721880422.213042:0:16098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631713 00000100:00100000:2.0:1721880422.213048:0:16098:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0000-mdtlov_UUID+2601:3687:x1805522011604480:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.213055:0:16100:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631715 00000100:00100000:0.0:1721880422.213059:0:16100:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:lustre-MDT0000-mdtlov_UUID+1786:3687:x1805522011604352:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.213061:0:16098:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:57987 count 1 00002000:00080000:0.0:1721880422.213071:0:16100:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:65300 count 1 00010000:00010000:2.0:1721880422.213072:0:16098:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136353180/0x8a60d30f5727b49e lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe283:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.213080:0:16100:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727b4ac lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xff14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.213083:0:16098:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c2fcfc0/0x8a60d30f571e9a23 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe283:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128a65 expref: 454 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.213088:0:16100:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099ae1440/0x8a60d30f571ebd2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a259 expref: 2248 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.213090:0:16098:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.213092:0:16098:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.213094:0:16098:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136353180/0x8a60d30f5727b49e lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe283:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.213096:0:16100:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.213097:0:16100:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.213099:0:16100:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727b4ac lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xff14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.213110:0:16100:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099ae1440/0x8a60d30f571ebd2a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a259 expref: 2248 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.213112:0:16098:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c2fcfc0/0x8a60d30f571e9a23 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe283:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128a65 expref: 454 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.213116:0:16100:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099ae1440/0x8a60d30f571ebd2a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a259 expref: 2248 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.213122:0:16100:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088dc0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_087:lustre-OST0001_UUID:16100:1805522011604736:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.213122:0:16098:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c2fcfc0/0x8a60d30f571e9a23 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe283:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128a65 expref: 454 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.213128:0:16098:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009bd88380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0000_UUID:16098:1805522011604864:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.213139:0:16100:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec366c0 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.213144:0:16098:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03480 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.214685:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.214687:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094634380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0000_UUID:16017:1805522011601280:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.214701:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727b44a lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe27c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.214702:0:8271:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257661696 00000100:00100000:1.0:1721880422.214703:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088db6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011601664:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.214706:0:8271:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257661696 00010000:00010000:1.0:1721880422.214717:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727b451 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xff0e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.214719:0:8271:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094319f80/0x8a60d30f571ebb7f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff0e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a0ae expref: 2249 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.214752:0:8271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913893 00000100:00100000:0.0:1721880422.214756:0:8271:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:262d1f41-ba81-41c5-b215-67c74ea63f50+2249:2006:x1805522257661696:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.214762:0:8271:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.214765:0:8271:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094319f80/0x8a60d30f571ebb7f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff0e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a0ae expref: 2249 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.214775:0:8271:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094319f80/0x8a60d30f571ebb7f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff0e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a0ae expref: 2249 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.214784:0:8271:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094319f80/0x8a60d30f571ebb7f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff0e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a0ae expref: 2249 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.214792:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.214793:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.214795:0:8271:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727b451 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff0e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.214800:0:8271:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727b451 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xff0e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.214816:0:8271:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.214831:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727b451 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.214835:0:8271:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:262d1f41-ba81-41c5-b215-67c74ea63f50+2248:2006:x1805522257661696:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 78us (153us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.214837:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727b451 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.214839:0:8271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913893 00010000:00010000:1.0:1721880422.214842:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727b451 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.214849:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727b451 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.214853:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727b451 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.214856:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106c480 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.214858:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727b451 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.214862:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727b451 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.214869:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727b451 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xff0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.214872:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727b451 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.214903:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.214914:0:8271:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257661952 00000100:00100000:0.0:1721880422.214917:0:8271:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257661952 00000100:00100000:2.0:1721880422.214925:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.214926:0:8271:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f51a640/0x8a60d30f571e9609 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe27d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12885f expref: 455 pid: 16028 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.214946:0:8271:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257662080 00000100:00100000:0.0:1721880422.214948:0:8271:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257662080 00000100:00100000:2.0:1721880422.214950:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.214952:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913894 00010000:00010000:0.0:1721880422.214954:0:8271:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094318000/0x8a60d30f571ebb40 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff0d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a06f expref: 2248 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.214957:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e195050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+455:2006:x1805522257661952:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.214963:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257661824 00010000:00010000:1.0:1721880422.214964:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.214967:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257661824 00010000:00010000:1.0:1721880422.214968:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f51a640/0x8a60d30f571e9609 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe27d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12885f expref: 455 pid: 16028 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.214978:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f51a640/0x8a60d30f571e9609 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe27d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12885f expref: 456 pid: 16028 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.214981:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880123a6ad00/0x8a60d30f571e951b lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe27c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1287f6 expref: 456 pid: 15497 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.214988:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f51a640/0x8a60d30f571e9609 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe27d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12885f expref: 456 pid: 16028 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.214995:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.214996:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.214998:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b58c0/0x8a60d30f5727b458 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe27d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.214998:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913896 00010000:00010000:1.0:1721880422.215002:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b58c0/0x8a60d30f5727b458 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe27d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.215003:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b9e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+455:2005:x1805522257661824:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.215011:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.215028:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.215030:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880123a6ad00/0x8a60d30f571e951b lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe27c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1287f6 expref: 455 pid: 15497 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.215040:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880123a6ad00/0x8a60d30f571e951b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe27c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1287f6 expref: 455 pid: 15497 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.215050:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e195050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+455:2006:x1805522257661952:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 93us (148us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.215054:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880123a6ad00/0x8a60d30f571e951b lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe27c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1287f6 expref: 455 pid: 15497 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.215055:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913894 00010000:00010000:2.0:1721880422.215065:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.215067:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.215069:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727b44a lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe27c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.215077:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727b44a lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe27c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.215091:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.215108:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b9e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+453:2005:x1805522257661824:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 103us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.215115:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913896 00010000:00010000:2.0:1721880422.215131:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727b44a lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.215136:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.215138:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727b44a lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.215146:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727b44a lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.215152:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ebdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1787:3686:x1805522011601408:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4298us (4371us total) trans 4296019847 rc 0/0 00010000:00010000:2.0:1721880422.215154:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727b44a lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.215159:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631702 00010000:00010000:2.0:1721880422.215166:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727b44a lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.215173:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352880 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.215175:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727b44a lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.215182:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727b44a lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.215189:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000004:00080000:1.0:1721880422.215190:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009ebdad80/2, rc 0, transno 1052551 00010000:00010000:2.0:1721880422.215191:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727b44a lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.215198:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727b44a lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.215206:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009ebdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011601408:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.215218:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257662336 00000100:00100000:1.0:1721880422.215222:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257662336 00010000:00010000:1.0:1721880422.215235:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a599b840/0x8a60d30f571ebc5f lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xff11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a195 expref: 2247 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.215251:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257662208 00000100:00100000:1.0:1721880422.215253:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257662208 00010000:00010000:1.0:1721880422.215262:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d7b4fc0/0x8a60d30f571ebbe1 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xff0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a110 expref: 2248 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.215275:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.215283:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257662464 00000100:00100000:1.0:1721880422.215286:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257662464 00000100:00100000:0.0:1721880422.215295:0:15455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913897 00010000:00010000:1.0:1721880422.215296:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800932ce1c0/0x8a60d30f571ebc27 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xff10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a156 expref: 2249 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.215301:0:15455:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:262d1f41-ba81-41c5-b215-67c74ea63f50+2249:2004:x1805522257662336:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.215309:0:15455:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.215312:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913898 00010000:00010000:0.0:1721880422.215315:0:15455:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a599b840/0x8a60d30f571ebc5f lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xff11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a195 expref: 2249 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.215316:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:262d1f41-ba81-41c5-b215-67c74ea63f50+2249:2005:x1805522257662208:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.215321:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.215323:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2603:3689:x1805522011601152:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4762us (4791us total) trans 4296061543 rc 0/0 00010000:00010000:0.0:1721880422.215324:0:15455:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a599b840/0x8a60d30f571ebc5f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a195 expref: 2249 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.215324:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d7b4fc0/0x8a60d30f571ebbe1 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xff0f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a110 expref: 2249 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.215330:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d7b4fc0/0x8a60d30f571ebbe1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff0f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a110 expref: 2249 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.215331:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631701 00010000:00010000:0.0:1721880422.215335:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.215337:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.215338:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.215339:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.215340:0:15455:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727b466 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.215341:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727b45f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff0f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.215346:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727b45f lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xff0f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.215347:0:15455:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727b466 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xff11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.215357:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.215358:0:15455:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:2.0:1721880422.215362:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e9caa00/2, rc 0, transno 1052552 00000100:00100000:2.0:1721880422.215366:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e9caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011600768:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.215376:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:262d1f41-ba81-41c5-b215-67c74ea63f50+2249:2005:x1805522257662208:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 60us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.215379:0:15455:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:262d1f41-ba81-41c5-b215-67c74ea63f50+2249:2004:x1805522257662336:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 78us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.215380:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913898 00000100:00100000:0.0:1721880422.215385:0:15455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913897 00000100:00100000:2.0:1721880422.215394:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.215401:0:15455:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257662720 00000100:00100000:0.0:1721880422.215405:0:15455:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257662720 00010000:00010000:0.0:1721880422.215415:0:15455:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd721c0/0x8a60d30f571ebcac lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xff12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a1db expref: 2247 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.215420:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008cd20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011604992:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.215439:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008cd22680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0000_UUID:16101:1805522011603584:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.215443:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.215455:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009106c6c0/0x8a60d30f5727b489 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe280:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.215456:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1721880422.215462:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008cd21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011605120:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.215476:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.215490:0:15455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913900 00000100:00100000:0.0:1721880422.215496:0:15455:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f52d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:262d1f41-ba81-41c5-b215-67c74ea63f50+2247:2005:x1805522257662720:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.215501:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011605120 00010000:00010000:0.0:1721880422.215504:0:15455:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.215504:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011605120 00010000:00010000:0.0:1721880422.215508:0:15455:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fd721c0/0x8a60d30f571ebcac lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a1db expref: 2247 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.215517:0:15455:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fd721c0/0x8a60d30f571ebcac lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a1db expref: 2247 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.215520:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.215528:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631717 00010000:00010000:0.0:1721880422.215530:0:15455:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fd721c0/0x8a60d30f571ebcac lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a1db expref: 2247 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.215530:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257662592 00000100:00100000:1.0:1721880422.215532:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257662592 00000100:00100000:2.0:1721880422.215533:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f52ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+1788:3688:x1805522011605120:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.215540:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.215541:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.215543:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136093600/0x8a60d30f571e96b1 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe27e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1288ac expref: 453 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.215544:0:15455:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727b47b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.215547:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:65302 count 1 00010000:00010000:0.0:1721880422.215551:0:15455:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727b47b lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xff12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.215555:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913901 00010000:00010000:2.0:1721880422.215558:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727b4ba lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xff16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.215559:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129d21c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+453:2005:x1805522257662592:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.215564:0:15455:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.215564:0:15473:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.215567:0:15473:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136093600/0x8a60d30f571e96b1 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe27e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1288ac expref: 453 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.215569:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099ad9440/0x8a60d30f571ebdb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a2e5 expref: 2246 pid: 16019 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.215573:0:15473:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136093600/0x8a60d30f571e96b1 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe27e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1288ac expref: 453 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.215576:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.215577:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.215580:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727b4ba lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xff16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.215581:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136093600/0x8a60d30f571e96b1 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe27e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1288ac expref: 453 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.215582:0:15455:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f52d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:262d1f41-ba81-41c5-b215-67c74ea63f50+2246:2005:x1805522257662720:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 86us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.215587:0:15455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913900 00010000:00010000:1.0:1721880422.215591:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.215592:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.215594:0:15473:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5f80/0x8a60d30f5727b474 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe27e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.215597:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099ad9440/0x8a60d30f571ebdb6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a2e5 expref: 2245 pid: 16019 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.215598:0:15473:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5f80/0x8a60d30f5727b474 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe27e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.215606:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099ad9440/0x8a60d30f571ebdb6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a2e5 expref: 2245 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.215608:0:15473:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.215616:0:16040:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800932ce1c0/0x8a60d30f571ebc27 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a156 expref: 2245 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.215616:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009f52c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011605376:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.215620:0:15473:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880129d21c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+452:2005:x1805522257662592:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 61us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.215624:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913901 00000100:00100000:0.0:1721880422.215627:0:16040:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094635880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_040:lustre-OST0001_UUID:16040:1805522011602560:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.215636:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03d80 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.215638:0:16040:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727b46d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.215646:0:16040:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727b46d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.215653:0:16040:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727b46d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.215659:0:16040:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727b46d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.215661:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b9eb480/2, rc 0, transno 1094247 00010000:00010000:0.0:1721880422.215663:0:16040:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727b46d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.215667:0:16040:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727b46d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.215667:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.215669:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007b9eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011601152:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.215670:0:16040:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350b40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.215672:0:16040:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727b46d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.215675:0:16040:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727b46d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.215675:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257662848 00000100:00100000:1.0:1721880422.215676:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257662848 00010000:00010000:1.0:1721880422.215682:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880123a69f80/0x8a60d30f571e9783 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe27f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128915 expref: 452 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.215683:0:16040:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727b46d lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xff10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.215687:0:16040:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727b46d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.215690:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913902 00000100:00100000:1.0:1721880422.215693:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cd22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+452:2005:x1805522257662848:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.215697:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.215699:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880123a69f80/0x8a60d30f571e9783 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe27f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128915 expref: 452 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.215704:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880123a69f80/0x8a60d30f571e9783 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe27f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128915 expref: 452 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.215704:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1721880422.215711:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009f52c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011605504:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.215714:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.215715:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.215717:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136350240/0x8a60d30f5727b482 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe27f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.215721:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136350240/0x8a60d30f5727b482 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe27f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.215746:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.215756:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cd22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+452:2005:x1805522257662848:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 62us (89us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.215758:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.215760:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913902 00000100:00100000:1.0:1721880422.215774:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011605504 00000100:00100000:1.0:1721880422.215775:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011605504 00000100:00100000:1.0:1721880422.215785:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631718 00000100:00100000:1.0:1721880422.215788:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f52d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2603:3687:x1805522011605504:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1721880422.215796:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:57988 count 1 00010000:00010000:1.0:1721880422.215804:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009106fa80/0x8a60d30f5727b4c1 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe284:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.215810:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007b89eac0/0x8a60d30f571e9ae0 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe284:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128ac0 expref: 451 pid: 16053 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.215814:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.215815:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.215816:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009106fa80/0x8a60d30f5727b4c1 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe284:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.215829:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007b89eac0/0x8a60d30f571e9ae0 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe284:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128ac0 expref: 451 pid: 16053 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.215835:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007b89eac0/0x8a60d30f571e9ae0 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe284:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128ac0 expref: 451 pid: 16053 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.215841:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008cd23800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:15452:1805522011605632:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.215851:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb480 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.215879:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.215887:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257662976 00000100:00100000:1.0:1721880422.215888:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257662976 00010000:00010000:1.0:1721880422.215895:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134d2aac0/0x8a60d30f571e9847 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe280:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128970 expref: 452 pid: 16091 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.215899:0:16040:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:lustre-MDT0000-mdtlov_UUID+1789:3689:x1805522011602176:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4458us (4673us total) trans 4296019849 rc 0/0 00000100:00100000:0.0:1721880422.215903:0:16040:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631706 00000100:00100000:1.0:1721880422.215904:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913903 00000100:00100000:1.0:1721880422.215907:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cd22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+452:2007:x1805522257662976:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.215911:0:15473:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.215913:0:15473:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134d2aac0/0x8a60d30f571e9847 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe280:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128970 expref: 452 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.215918:0:15473:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134d2aac0/0x8a60d30f571e9847 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe280:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128970 expref: 452 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.215924:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134d2aac0/0x8a60d30f571e9847 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe280:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128970 expref: 452 pid: 16091 timeout: 887 lvb_type: 0 00000004:00080000:2.0:1721880422.215926:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880094635500/2, rc 0, transno 1052554 00010000:00010000:0.0:1721880422.215932:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880123a69f80/0x8a60d30f571e9783 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe27f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128915 expref: 451 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.215935:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.215936:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.215936:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011602944:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.215937:0:15473:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009106c6c0/0x8a60d30f5727b489 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe280:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.215941:0:16088:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094634000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0000_UUID:16088:1805522011603456:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.215942:0:15473:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009106c6c0/0x8a60d30f5727b489 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe280:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.215950:0:16088:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136350240/0x8a60d30f5727b482 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.215950:0:15473:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.215957:0:15473:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cd22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+450:2007:x1805522257662976:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 49us (78us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.215960:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913903 00010000:00010000:0.0:1721880422.215966:0:16088:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136350240/0x8a60d30f5727b482 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.215976:0:16088:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136350240/0x8a60d30f5727b482 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.215984:0:16088:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136350240/0x8a60d30f5727b482 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.215988:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009106c6c0/0x8a60d30f5727b489 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.215993:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009106c6c0/0x8a60d30f5727b489 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.215996:0:16088:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136350240/0x8a60d30f5727b482 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.215997:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009106c6c0/0x8a60d30f5727b489 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.216001:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009106c6c0/0x8a60d30f5727b489 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.216005:0:16088:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136350240/0x8a60d30f5727b482 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.216005:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009106c6c0/0x8a60d30f5727b489 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.216010:0:16088:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350240 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.216011:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106c6c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.216025:0:16088:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136350240/0x8a60d30f5727b482 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.216028:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009106c6c0/0x8a60d30f5727b489 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.216032:0:16088:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136350240/0x8a60d30f5727b482 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.216033:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009106c6c0/0x8a60d30f5727b489 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.216039:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009106c6c0/0x8a60d30f5727b489 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.216043:0:16088:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136350240/0x8a60d30f5727b482 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.216043:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009106c6c0/0x8a60d30f5727b489 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.216050:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136350240/0x8a60d30f5727b482 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.216050:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.216069:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257663104 00000100:00100000:1.0:1721880422.216071:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257663104 00010000:00010000:1.0:1721880422.216079:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d5acfc0/0x8a60d30f571ebce4 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xff13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a213 expref: 2245 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.216086:0:16110:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088dc1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_094:lustre-OST0001_UUID:16110:1805522011603840:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.216089:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913904 00000100:00100000:1.0:1721880422.216091:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f52fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:262d1f41-ba81-41c5-b215-67c74ea63f50+2245:2005:x1805522257663104:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.216096:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.216098:0:16110:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727b490 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xff13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.216099:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d5acfc0/0x8a60d30f571ebce4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff13:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a213 expref: 2245 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.216104:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d5acfc0/0x8a60d30f571ebce4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff13:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a213 expref: 2245 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.216114:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d5acfc0/0x8a60d30f571ebce4 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a213 expref: 2245 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.216121:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.216122:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.216124:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727b490 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.216128:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727b490 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xff13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.216143:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.216149:0:16110:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727b490 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.216157:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f52fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:262d1f41-ba81-41c5-b215-67c74ea63f50+2243:2005:x1805522257663104:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 65us (109us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.216160:0:16110:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727b490 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.216161:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913904 00010000:00010000:0.0:1721880422.216165:0:16110:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727b490 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.216168:0:16110:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727b490 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.216172:0:16110:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727b490 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.216175:0:16110:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325df80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.216177:0:16110:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727b490 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.216179:0:16098:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009bd88380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0000_UUID:16098:1805522011604864:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.216181:0:16110:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727b490 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.216188:0:16110:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727b490 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xff13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.216192:0:16110:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727b490 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.216195:0:16098:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136353180/0x8a60d30f5727b49e lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe283:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.216217:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fde0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0000_UUID:16028:1805522011604096:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.216242:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136351200/0x8a60d30f5727b497 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe281:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.216245:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2603:3686:x1805522011603328:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4179us (4236us total) trans 4296061546 rc 0/0 00000100:00100000:1.0:1721880422.216249:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631710 00000100:00100000:2.0:1721880422.216262:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008cd20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011605760:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1721880422.216268:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e9c9f80/2, rc 0, transno 1094250 00000100:00100000:1.0:1721880422.216273:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e9c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011603328:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.216288:0:16110:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_094:lustre-MDT0000-mdtlov_UUID+1789:3686:x1805522011603712:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3997us (4050us total) trans 4296019852 rc 0/0 00000100:00100000:2.0:1721880422.216288:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.216293:0:16110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631711 00000004:00080000:1.0:1721880422.216296:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880094634700/2, rc 0, transno 1094249 00000100:00100000:1.0:1721880422.216300:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011602688:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.216305:0:16110:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011605760 00000100:00100000:0.0:1721880422.216307:0:16110:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011605760 00000100:00100000:2.0:1721880422.216312:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008cd23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011605888:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1721880422.216313:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009ebd9180/2, rc 0, transno 1052555 00000100:00100000:1.0:1721880422.216317:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009ebd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011602304:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.216319:0:16110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631719 00000100:00100000:0.0:1721880422.216322:0:16110:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f52ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_094:lustre-MDT0000-mdtlov_UUID+1789:3687:x1805522011605760:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.216322:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1721880422.216330:0:16110:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:65303 count 1 00000100:00100000:2.0:1721880422.216331:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1721880422.216335:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008cd22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011606016:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1721880422.216338:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009ebdbb80/2, rc 0, transno 1094248 00010000:00010000:0.0:1721880422.216339:0:16110:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727b4c8 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xff17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.216341:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009ebdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011601536:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.216345:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.216346:0:16110:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095fb1680/0x8a60d30f571ebdfc lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a32b expref: 2242 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.216350:0:16110:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.216351:0:16110:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.216353:0:16110:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727b4c8 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xff17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.216356:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007b9e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011606144:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1721880422.216362:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009ebd8380/2, rc 0, transno 1052553 00010000:00010000:0.0:1721880422.216363:0:16110:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095fb1680/0x8a60d30f571ebdfc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a32b expref: 2242 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.216368:0:16110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095fb1680/0x8a60d30f571ebdfc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a32b expref: 2242 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.216375:0:16110:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088dc1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_094:lustre-OST0001_UUID:16110:1805522011606400:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.216375:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009ebd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011602176:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.216386:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b08fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011606272:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.216389:0:16110:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36000 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.216392:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.216403:0:16100:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088dc0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_087:lustre-OST0001_UUID:16100:1805522011604736:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.216403:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1721880422.216408:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880094635c00/2, rc 0, transno 1052556 00000100:00100000:1.0:1721880422.216411:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011603712:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.216414:0:16100:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727b4ac lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xff14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.216417:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1721880422.216422:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b08f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011606528:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.216428:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011606144 00000100:00100000:1.0:1721880422.216430:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011606144 00000100:00100000:2.0:1721880422.216433:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.216444:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011606272 00000100:00100000:1.0:1721880422.216447:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011606272 00000100:00100000:2.0:1721880422.216449:0:16113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631721 00000100:00100000:2.0:1721880422.216452:0:16113:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f52f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0000-mdtlov_UUID+2606:3688:x1805522011606016:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.216463:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631723 00002000:00080000:2.0:1721880422.216463:0:16113:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:57990 count 1 00000100:00100000:1.0:1721880422.216466:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f52df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+1791:3689:x1805522011606528:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.216472:0:16113:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727b4d6 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe286:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.216479:0:16113:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c336ac0/0x8a60d30f571e9bf8 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe286:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128b53 expref: 449 pid: 16028 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.216480:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:65305 count 1 00010000:00010000:2.0:1721880422.216484:0:16113:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.216485:0:16113:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.216487:0:16113:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727b4d6 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe286:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.216489:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2606:3689:x1805522011602816:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4553us (4740us total) trans 4296061547 rc 0/0 00010000:00010000:1.0:1721880422.216490:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727b4e4 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xff19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.216493:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631709 00010000:00010000:2.0:1721880422.216498:0:16113:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c336ac0/0x8a60d30f571e9bf8 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe286:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128b53 expref: 449 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.216500:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801239a0fc0/0x8a60d30f571ebe88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a3b7 expref: 2242 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.216505:0:16113:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c336ac0/0x8a60d30f571e9bf8 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe286:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128b53 expref: 449 pid: 16028 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.216506:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631724 00010000:00010000:1.0:1721880422.216506:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.216507:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1721880422.216509:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f52f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2605:3687:x1805522011606272:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.216509:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727b4e4 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xff19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.216511:0:16113:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009f52ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0000_UUID:16113:1805522011606912:192.168.201.24@tcp:104: 00002000:00080000:0.0:1721880422.216516:0:16088:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:57991 count 1 00010000:00010000:0.0:1721880422.216524:0:16088:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727b4eb lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe287:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.216524:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801239a0fc0/0x8a60d30f571ebe88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a3b7 expref: 2242 pid: 16039 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.216524:0:16113:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03900 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.216531:0:16088:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097924000/0x8a60d30f571e9c84 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128ba7 expref: 449 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.216532:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801239a0fc0/0x8a60d30f571ebe88 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a3b7 expref: 2242 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.216533:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1721880422.216535:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.216536:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.216537:0:16088:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727b4eb lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.216538:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b08c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011606784:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.216542:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b08f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011607168:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.216547:0:16088:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097924000/0x8a60d30f571e9c84 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128ba7 expref: 449 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.216552:0:16088:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097924000/0x8a60d30f571e9c84 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128ba7 expref: 449 pid: 16028 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.216554:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.216560:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb000 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.216561:0:16088:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088dc0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0000_UUID:16088:1805522011607296:192.168.201.24@tcp:104: 00000004:00080000:2.0:1721880422.216572:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880094636680/2, rc 0, transno 1094251 00000100:00100000:2.0:1721880422.216576:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011602816:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.216578:0:16088:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec366c0 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.216599:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1721880422.216601:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d7b4fc0/0x8a60d30f571ebbe1 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a110 expref: 2242 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.216602:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.216603:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009f52dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011607424:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.216614:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257663232 00000100:00100000:0.0:1721880422.216615:0:9458:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094636a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011602048:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.216615:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.216616:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257663232 00010000:00010000:1.0:1721880422.216626:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099ee3a80/0x8a60d30f571e9989 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128a18 expref: 450 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.216628:0:9458:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727b45f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.216629:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011607424 00000100:00100000:2.0:1721880422.216631:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011607424 00010000:00010000:0.0:1721880422.216635:0:9458:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727b45f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.216637:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913905 00000100:00100000:1.0:1721880422.216640:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b08ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+450:2004:x1805522257663232:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.216642:0:9458:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727b45f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.216643:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631726 00010000:00010000:1.0:1721880422.216645:0:15473:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.216646:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f52ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2606:3687:x1805522011607424:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.216647:0:15473:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099ee3a80/0x8a60d30f571e9989 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe282:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128a18 expref: 450 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.216648:0:9458:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727b45f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.216653:0:15473:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099ee3a80/0x8a60d30f571e9989 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe282:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128a18 expref: 450 pid: 16053 timeout: 887 lvb_type: 0 00002000:00080000:2.0:1721880422.216653:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:57992 count 1 00010000:00010000:0.0:1721880422.216654:0:9458:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727b45f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.216659:0:9458:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727b45f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.216661:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099ee3a80/0x8a60d30f571e9989 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe282:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128a18 expref: 450 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.216661:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136350000/0x8a60d30f5727b4f9 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe288:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.216665:0:9458:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136351440 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.216668:0:9458:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727b45f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.216668:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.216668:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.216668:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013065df80/0x8a60d30f571e9d33 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe288:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128bed expref: 449 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.216670:0:15473:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5d40/0x8a60d30f5727b4a5 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.216673:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.216674:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.216675:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136350000/0x8a60d30f5727b4f9 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe288:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.216677:0:9458:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727b45f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.216677:0:15473:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5d40/0x8a60d30f5727b4a5 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.216683:0:9458:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727b45f lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xff0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.216685:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013065df80/0x8a60d30f571e9d33 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe288:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128bed expref: 449 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.216686:0:15473:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.216687:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727b45f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.216691:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013065df80/0x8a60d30f571e9d33 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe288:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128bed expref: 449 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.216695:0:15473:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b08ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+449:2004:x1805522257663232:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 54us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.216699:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913905 00000100:00100000:2.0:1721880422.216701:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009f52d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:15466:1805522011607680:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.216711:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03480 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.216764:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.216773:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257663360 00000100:00100000:1.0:1721880422.216775:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257663360 00000100:00100000:2.0:1721880422.216783:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.216786:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099ae1440/0x8a60d30f571ebd2a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a259 expref: 2242 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.216799:0:9458:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1793:3689:x1805522011601792:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5810us (5841us total) trans 4296019853 rc 0/0 00000100:00100000:0.0:1721880422.216805:0:9458:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631704 00000100:00100000:1.0:1721880422.216808:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257663616 00000100:00100000:1.0:1721880422.216811:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257663616 00010000:00010000:1.0:1721880422.216821:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c2fcfc0/0x8a60d30f571e9a23 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe283:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128a65 expref: 449 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.216822:0:8271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913906 00000100:00100000:0.0:1721880422.216826:0:8271:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b08ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:262d1f41-ba81-41c5-b215-67c74ea63f50+2242:2005:x1805522257663360:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.216832:0:8271:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.216836:0:8271:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099ae1440/0x8a60d30f571ebd2a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a259 expref: 2242 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.216836:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.216838:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913907 00010000:00010000:0.0:1721880422.216842:0:8271:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099ae1440/0x8a60d30f571ebd2a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a259 expref: 2242 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.216843:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fde0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+449:2006:x1805522257663616:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.216850:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.216852:0:8271:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099ae1440/0x8a60d30f571ebd2a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a259 expref: 2242 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.216854:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c2fcfc0/0x8a60d30f571e9a23 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe283:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128a65 expref: 449 pid: 16098 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.216861:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.216862:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.216862:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c2fcfc0/0x8a60d30f571e9a23 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe283:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128a65 expref: 449 pid: 16098 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.216864:0:8271:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727b4ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.216869:0:8271:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727b4ac lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xff14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.216874:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c2fcfc0/0x8a60d30f571e9a23 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe283:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128a65 expref: 449 pid: 16098 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.216878:0:8271:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.216883:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.216885:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.216887:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136353180/0x8a60d30f5727b49e lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe283:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.216889:0:8271:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b08ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:262d1f41-ba81-41c5-b215-67c74ea63f50+2241:2005:x1805522257663360:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 63us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.216892:0:8271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913906 00010000:00010000:1.0:1721880422.216893:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136353180/0x8a60d30f5727b49e lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe283:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.216905:0:16100:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727b4ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.216909:0:16100:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727b4ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.216914:0:16100:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727b4ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.216914:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.216918:0:16100:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727b4ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.216921:0:16100:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727b4ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.216924:0:16100:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325c240 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.216926:0:16100:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727b4ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.216930:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fde0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+449:2006:x1805522257663616:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 87us (147us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.216932:0:16100:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727b4ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.216934:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913907 00010000:00010000:2.0:1721880422.216936:0:16098:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136353180/0x8a60d30f5727b49e lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.216940:0:16100:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727b4ac lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xff14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.216941:0:16098:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136353180/0x8a60d30f5727b49e lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.216946:0:16098:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136353180/0x8a60d30f5727b49e lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.216947:0:16100:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727b4ac lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.216950:0:16098:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136353180/0x8a60d30f5727b49e lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.216953:0:16098:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136353180/0x8a60d30f5727b49e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.216957:0:16098:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353180 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.216958:0:16098:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136353180/0x8a60d30f5727b49e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.216962:0:16098:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136353180/0x8a60d30f5727b49e lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.216973:0:16098:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136353180/0x8a60d30f5727b49e lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.216977:0:16098:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136353180/0x8a60d30f5727b49e lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.217082:0:16100:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:lustre-MDT0000-mdtlov_UUID+1793:3687:x1805522011604352:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4021us (4081us total) trans 4296019854 rc 0/0 00000100:00100000:2.0:1721880422.217087:0:16098:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0000-mdtlov_UUID+2607:3687:x1805522011604480:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4039us (4111us total) trans 4296061549 rc 0/0 00000100:00100000:0.0:1721880422.217089:0:16100:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631715 00000100:00100000:2.0:1721880422.217092:0:16098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631713 00000004:00080000:1.0:1721880422.217099:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088dc0380/2, rc 0, transno 1094253 00000100:00100000:1.0:1721880422.217108:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088dc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011604480:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1721880422.217109:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136351200/0x8a60d30f5727b497 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.217114:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136351200/0x8a60d30f5727b497 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.217118:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136351200/0x8a60d30f5727b497 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.217122:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136351200/0x8a60d30f5727b497 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.217125:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136351200/0x8a60d30f5727b497 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.217128:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136351200 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.217131:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136351200/0x8a60d30f5727b497 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.217138:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136351200/0x8a60d30f5727b497 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.217142:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009bd88a80/2, rc 0, transno 1052558 00000100:00100000:0.0:1721880422.217143:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1721880422.217147:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136351200/0x8a60d30f5727b497 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.217148:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009bd88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011604352:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.217152:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b08c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011607808:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1721880422.217153:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136351200/0x8a60d30f5727b497 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.217174:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.217196:0:9458:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011607808 00000100:00100000:1.0:1721880422.217200:0:9458:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011607808 00000100:00100000:1.0:1721880422.217221:0:9458:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631727 00000100:00100000:1.0:1721880422.217225:0:9458:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2608:3686:x1805522011607808:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1721880422.217236:0:9458:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:57993 count 1 00010000:00010000:1.0:1721880422.217246:0:9458:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009106e640/0x8a60d30f5727b500 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe289:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.217255:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fde1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2608:3689:x1805522011603968:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4558us (4585us total) trans 4296061550 rc 0/0 00010000:00010000:1.0:1721880422.217257:0:9458:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092943180/0x8a60d30f571e9de2 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe289:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128c48 expref: 446 pid: 16087 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.217261:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631712 00010000:00010000:1.0:1721880422.217264:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.217265:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.217267:0:9458:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009106e640/0x8a60d30f5727b500 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe289:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.217278:0:9458:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092943180/0x8a60d30f571e9de2 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe289:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128c48 expref: 446 pid: 16087 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.217284:0:9458:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092943180/0x8a60d30f571e9de2 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe289:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128c48 expref: 446 pid: 16087 timeout: 887 lvb_type: 0 00000004:00080000:2.0:1721880422.217288:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880094634a80/2, rc 0, transno 1094254 00000100:00100000:1.0:1721880422.217291:0:9458:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b08ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9458:1805522011608064:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.217305:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011603968:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.217308:0:9458:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb600 going to sleep for 11 seconds 00000004:00080000:2.0:1721880422.217316:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009ebda300/2, rc 0, transno 1052557 00000100:00100000:2.0:1721880422.217329:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009ebda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011601792:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.217333:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1721880422.217340:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088dc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011608192:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.217361:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.217380:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a052c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011608320:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.217383:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b08ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011607936:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.217402:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1721880422.217414:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088dc0e00/2, rc 0, transno 1094252 00000100:00100000:1.0:1721880422.217421:0:16098:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011608320 00000100:00100000:1.0:1721880422.217424:0:16098:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011608320 00000100:00100000:2.0:1721880422.217427:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011604224:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.217445:0:16098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631729 00000100:00100000:1.0:1721880422.217449:0:16098:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0000-mdtlov_UUID+1793:3686:x1805522011608320:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.217453:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:1.0:1721880422.217459:0:16098:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:65308 count 1 00010000:00010000:1.0:1721880422.217468:0:16098:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727b50e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xff1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.217469:0:16040:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011607936 00000100:00100000:0.0:1721880422.217471:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1721880422.217473:0:16040:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011607936 00000100:00100000:0.0:1721880422.217476:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088dc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011608448:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.217478:0:16098:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ff74480/0x8a60d30f571ebf4c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a47b expref: 2240 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.217487:0:16098:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.217488:0:16098:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.217490:0:16098:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727b50e lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xff1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.217490:0:16040:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631730 00000100:00100000:0.0:1721880422.217492:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.217494:0:16040:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:lustre-MDT0000-mdtlov_UUID+1794:3689:x1805522011607936:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.217501:0:16098:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ff74480/0x8a60d30f571ebf4c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a47b expref: 2240 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.217506:0:16098:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ff74480/0x8a60d30f571ebf4c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a47b expref: 2240 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.217507:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011608448 00002000:00080000:2.0:1721880422.217507:0:16040:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:65307 count 1 00000100:00100000:0.0:1721880422.217509:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011608448 00000100:00100000:1.0:1721880422.217512:0:16098:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a052c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0001_UUID:16098:1805522011608704:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.217519:0:16040:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727b515 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xff1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.217524:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631731 00000100:00100000:0.0:1721880422.217528:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2609:3686:x1805522011608448:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.217529:0:16098:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb240 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.217530:0:16040:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f1b3c0/0x8a60d30f571ebf06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a435 expref: 2240 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.217536:0:16040:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.217538:0:16040:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.217540:0:16040:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727b515 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xff1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1721880422.217541:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:57995 count 1 00010000:00010000:0.0:1721880422.217550:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b51c lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe28b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.217556:0:16040:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f1b3c0/0x8a60d30f571ebf06 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a435 expref: 2240 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.217561:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880072982d00/0x8a60d30f571e9f2b lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe28b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128cf0 expref: 446 pid: 16087 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.217565:0:16040:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f1b3c0/0x8a60d30f571ebf06 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a435 expref: 2240 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.217568:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.217569:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.217571:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b51c lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe28b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.217574:0:16040:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009bd88380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_040:lustre-OST0001_UUID:16040:1805522011608832:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.217583:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880072982d00/0x8a60d30f571e9f2b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe28b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128cf0 expref: 446 pid: 16087 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.217589:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880072982d00/0x8a60d30f571e9f2b lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe28b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128cf0 expref: 446 pid: 16087 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.217595:0:16040:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03e40 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.217596:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088dc1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:15453:1805522011608960:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.217611:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36780 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.218684:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.218693:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.218704:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257663872 00000100:00100000:2.0:1721880422.218706:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009f52c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011605376:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.218707:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257663872 00010000:00010000:0.0:1721880422.218716:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099ad9440/0x8a60d30f571ebdb6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a2e5 expref: 2241 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.218722:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727b4ba lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xff16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.218747:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008cd23800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:15452:1805522011605632:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.218748:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913909 00000100:00100000:0.0:1721880422.218752:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:262d1f41-ba81-41c5-b215-67c74ea63f50+2242:2007:x1805522257663872:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.218758:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.218761:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099ad9440/0x8a60d30f571ebdb6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a2e5 expref: 2242 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.218761:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009106fa80/0x8a60d30f5727b4c1 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe284:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.218768:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099ad9440/0x8a60d30f571ebdb6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a2e5 expref: 2242 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.218776:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099ad9440/0x8a60d30f571ebdb6 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a2e5 expref: 2242 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.218783:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.218784:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.218786:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727b4ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.218791:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727b4ba lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xff16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.218804:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.218813:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727b4ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.218817:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:262d1f41-ba81-41c5-b215-67c74ea63f50+2241:2007:x1805522257663872:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 65us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.218821:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913909 00010000:00010000:2.0:1721880422.218821:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727b4ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.218829:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727b4ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.218837:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727b4ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.218843:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727b4ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.218844:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.218849:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136351f80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.218852:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727b4ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.218858:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727b4ba lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.218868:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727b4ba lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xff16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.218875:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727b4ba lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.218905:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.218908:0:16110:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088dc1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_094:lustre-OST0001_UUID:16110:1805522011606400:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.218912:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257664000 00000100:00100000:0.0:1721880422.218915:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257664000 00010000:00010000:0.0:1721880422.218923:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007b89eac0/0x8a60d30f571e9ae0 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe284:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128ac0 expref: 447 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.218925:0:16110:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727b4c8 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xff17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.218933:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257664128 00000100:00100000:0.0:1721880422.218934:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257664128 00010000:00010000:0.0:1721880422.218939:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095fb1680/0x8a60d30f571ebdfc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a32b expref: 2239 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.218949:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913911 00000100:00100000:1.0:1721880422.218955:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094634000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+447:2004:x1805522257664000:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.218957:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913912 00000100:00100000:0.0:1721880422.218960:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094634380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:262d1f41-ba81-41c5-b215-67c74ea63f50+2239:2005:x1805522257664128:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.218965:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.218966:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.218969:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095fb1680/0x8a60d30f571ebdfc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a32b expref: 2239 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.218971:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007b89eac0/0x8a60d30f571e9ae0 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe284:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128ac0 expref: 447 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.218975:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095fb1680/0x8a60d30f571ebdfc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a32b expref: 2239 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.218981:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007b89eac0/0x8a60d30f571e9ae0 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe284:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128ac0 expref: 447 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.218984:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095fb1680/0x8a60d30f571ebdfc lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a32b expref: 2239 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.218992:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.218993:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.218994:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007b89eac0/0x8a60d30f571e9ae0 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe284:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128ac0 expref: 447 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.218995:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727b4c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.218999:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727b4c8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xff17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.219001:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f52ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+1796:3688:x1805522011605120:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3466us (3522us total) trans 4296019855 rc 0/0 00010000:00010000:1.0:1721880422.219005:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.219006:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.219008:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631717 00010000:00010000:1.0:1721880422.219009:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009106fa80/0x8a60d30f5727b4c1 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe284:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.219012:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.219034:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009106fa80/0x8a60d30f5727b4c1 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe284:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.219044:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094634380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:262d1f41-ba81-41c5-b215-67c74ea63f50+2238:2005:x1805522257664128:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 82us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.219048:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913912 00010000:00010000:1.0:1721880422.219051:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:2.0:1721880422.219051:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008cd21f80/2, rc 0, transno 1052559 00000100:00100000:2.0:1721880422.219060:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008cd21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011605120:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.219072:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094634000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+446:2004:x1805522257664000:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 117us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.219079:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913911 00000004:00080000:2.0:1721880422.219096:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008cd20000/2, rc 0, transno 1052560 00010000:00010000:1.0:1721880422.219101:0:16110:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727b4c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.219101:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008cd20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011604992:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.219105:0:16110:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727b4c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.219110:0:16110:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727b4c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.219114:0:16110:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727b4c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.219118:0:16110:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727b4c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.219121:0:16110:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325e1c0 already unused, calling callback (ffffffffa084e330) 00000100:00100000:2.0:1721880422.219121:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011609088:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.219123:0:16110:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727b4c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.219127:0:16110:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727b4c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.219133:0:16110:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727b4c8 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xff17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.219136:0:16110:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727b4c8 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.219142:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.219157:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1721880422.219162:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b175180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011609216:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.219167:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.219176:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.219189:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257664256 00000100:00100000:0.0:1721880422.219190:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.219192:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257664256 00000100:00100000:2.0:1721880422.219200:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631733 00010000:00010000:1.0:1721880422.219201:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800993f5b00/0x8a60d30f571e9b65 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe285:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128b0d expref: 446 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.219206:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b174e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+1796:3688:x1805522011609216:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.219211:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.219221:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257664640 00002000:00080000:2.0:1721880422.219222:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:65310 count 1 00000100:00100000:1.0:1721880422.219223:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257664640 00010000:00010000:1.0:1721880422.219229:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097924000/0x8a60d30f571e9c84 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128ba7 expref: 447 pid: 16028 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.219230:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257664512 00000100:00100000:0.0:1721880422.219233:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257664512 00010000:00010000:2.0:1721880422.219233:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727b52a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xff1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.219244:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096cddb00/0x8a60d30f571ebfae lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a4dd expref: 2238 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.219246:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097303840/0x8a60d30f571ebe42 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a371 expref: 2238 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.219249:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913913 00010000:00010000:2.0:1721880422.219251:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.219253:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1721880422.219254:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094635880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+447:2004:x1805522257664256:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.219255:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727b52a lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xff1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.219263:0:15473:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.219267:0:15473:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800993f5b00/0x8a60d30f571e9b65 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe285:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128b0d expref: 447 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.219268:0:8271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913914 00000100:00100000:0.0:1721880422.219272:0:8271:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088db6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+447:2007:x1805522257664640:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.219272:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096cddb00/0x8a60d30f571ebfae lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a4dd expref: 2238 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.219275:0:15473:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800993f5b00/0x8a60d30f571e9b65 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe285:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128b0d expref: 447 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.219280:0:8271:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.219284:0:8271:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097924000/0x8a60d30f571e9c84 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe287:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128ba7 expref: 447 pid: 16028 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.219287:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800993f5b00/0x8a60d30f571e9b65 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe285:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128b0d expref: 447 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.219288:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096cddb00/0x8a60d30f571ebfae lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a4dd expref: 2238 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.219293:0:8271:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097924000/0x8a60d30f571e9c84 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe287:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128ba7 expref: 447 pid: 16028 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.219297:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.219298:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.219298:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b174380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011609472:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.219301:0:15473:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727b4cf lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe285:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.219306:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.219307:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.219307:0:15473:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727b4cf lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe285:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.219308:0:8271:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727b4eb lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe287:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.219317:0:8271:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727b4eb lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe287:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.219317:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03d80 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.219324:0:8271:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.219330:0:15473:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.219337:0:8271:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088db6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+446:2007:x1805522257664640:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 64us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.219341:0:8271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913914 00000100:00100000:1.0:1721880422.219350:0:15473:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094635880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+445:2004:x1805522257664256:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 95us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.219355:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.219357:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913913 00010000:00010000:0.0:1721880422.219367:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097924000/0x8a60d30f571e9c84 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe287:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128ba7 expref: 445 pid: 16028 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.219370:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257664384 00000100:00100000:2.0:1721880422.219373:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257664384 00000100:00100000:0.0:1721880422.219379:0:16088:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088dc0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0000_UUID:16088:1805522011607296:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.219385:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c336ac0/0x8a60d30f571e9bf8 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe286:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128b53 expref: 444 pid: 16028 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.219390:0:16088:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727b4eb lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.219403:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913916 00000100:00100000:2.0:1721880422.219408:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b174a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+444:2005:x1805522257664384:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.219415:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.219419:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c336ac0/0x8a60d30f571e9bf8 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe286:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128b53 expref: 444 pid: 16028 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.219428:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c336ac0/0x8a60d30f571e9bf8 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe286:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128b53 expref: 444 pid: 16028 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.219440:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c336ac0/0x8a60d30f571e9bf8 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe286:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128b53 expref: 444 pid: 16028 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.219451:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1721880422.219452:0:16110:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f52ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_094:lustre-MDT0000-mdtlov_UUID+1797:3687:x1805522011605760:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3128us (3163us total) trans 4296019857 rc 0/0 00010000:00010000:0.0:1721880422.219453:0:16088:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727b4eb lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.219453:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1721880422.219456:0:16110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631719 00010000:00010000:2.0:1721880422.219456:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727b4d6 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe286:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.219458:0:16088:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727b4eb lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.219463:0:16088:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727b4eb lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.219463:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727b4d6 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe286:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.219466:0:16088:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727b4eb lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.219470:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009106fa80/0x8a60d30f5727b4c1 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.219474:0:16088:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727b4eb lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.219474:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009106fa80/0x8a60d30f5727b4c1 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.219478:0:16088:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325c6c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.219478:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.219479:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009106fa80/0x8a60d30f5727b4c1 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.219480:0:16088:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727b4eb lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.219482:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009106fa80/0x8a60d30f5727b4c1 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.219484:0:16088:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727b4eb lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.219486:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009106fa80/0x8a60d30f5727b4c1 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.219489:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106fa80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.219490:0:16088:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727b4eb lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.219491:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009106fa80/0x8a60d30f5727b4c1 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.219493:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727b4eb lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.219495:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009106fa80/0x8a60d30f5727b4c1 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.219495:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b174a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+443:2005:x1805522257664384:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 87us (141us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.219501:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009106fa80/0x8a60d30f5727b4c1 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.219502:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913916 00010000:00010000:1.0:1721880422.219508:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009106fa80/0x8a60d30f5727b4c1 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.219546:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.219559:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257664768 00000100:00100000:2.0:1721880422.219562:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257664768 00010000:00010000:2.0:1721880422.219572:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801239a0fc0/0x8a60d30f571ebe88 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xff19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a3b7 expref: 2237 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.219586:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913917 00000100:00100000:2.0:1721880422.219590:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b176a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:262d1f41-ba81-41c5-b215-67c74ea63f50+2237:2005:x1805522257664768:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.219593:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f52f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2611:3687:x1805522011606272:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3082us (3188us total) trans 4296061551 rc 0/0 00000100:00100000:0.0:1721880422.219597:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631724 00010000:00010000:2.0:1721880422.219598:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.219601:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801239a0fc0/0x8a60d30f571ebe88 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xff19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a3b7 expref: 2237 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.219610:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801239a0fc0/0x8a60d30f571ebe88 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a3b7 expref: 2237 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.219611:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f52d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2610:3687:x1805522011605504:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3821us (3853us total) trans 4296061552 rc 0/0 00000100:00100000:1.0:1721880422.219617:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631718 00010000:00010000:2.0:1721880422.219622:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.219623:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.219626:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727b4e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.219629:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b9e9880/2, rc 0, transno 1052562 00010000:00010000:2.0:1721880422.219633:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727b4e4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xff19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.219634:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007b9e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011606144:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.219643:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.219650:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801239a0fc0/0x8a60d30f571ebe88 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a3b7 expref: 2237 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.219658:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b176a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:262d1f41-ba81-41c5-b215-67c74ea63f50+2236:2005:x1805522257664768:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 66us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.219661:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b08f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011607168:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.219664:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913917 00010000:00010000:1.0:1721880422.219673:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727b4e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.219695:0:16098:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a052c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0001_UUID:16098:1805522011608704:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.219705:0:16098:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727b50e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xff1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.219710:0:16040:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009bd88380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_040:lustre-OST0001_UUID:16040:1805522011608832:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.219712:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727b4e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.219716:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727b4e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.219721:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727b4e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.219724:0:16040:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727b515 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xff1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.219725:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.219725:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727b4e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.219756:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727b4e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.219759:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106f180 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.219761:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727b4e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.219765:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727b4e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.219772:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.219772:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727b4e4 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xff19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.219776:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727b4e4 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.219780:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257665536 00000100:00100000:0.0:1721880422.219782:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257665536 00010000:00010000:0.0:1721880422.219792:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801363cad00/0x8a60d30f571e9e98 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe28a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128c9c expref: 443 pid: 16053 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.219813:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257664896 00000100:00100000:0.0:1721880422.219816:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257664896 00010000:00010000:0.0:1721880422.219825:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b79f3c0/0x8a60d30f571ebec0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xff1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a3ef expref: 2236 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.219842:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913919 00000100:00100000:0.0:1721880422.219848:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088db4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:262d1f41-ba81-41c5-b215-67c74ea63f50+2236:2004:x1805522257664896:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.219856:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.219860:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b79f3c0/0x8a60d30f571ebec0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xff1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a3ef expref: 2236 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.219869:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b79f3c0/0x8a60d30f571ebec0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a3ef expref: 2236 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.219881:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.219882:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009f52d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:15466:1805522011607680:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.219883:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.219885:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727b4f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.219892:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727b4f2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xff1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.219896:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136350000/0x8a60d30f5727b4f9 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe288:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.219903:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.219917:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088db4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:262d1f41-ba81-41c5-b215-67c74ea63f50+2236:2004:x1805522257664896:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 69us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.219926:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913919 00000100:00100000:2.0:1721880422.219936:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.219942:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257665152 00000100:00100000:0.0:1721880422.219945:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257665152 00010000:00010000:0.0:1721880422.219955:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092943180/0x8a60d30f571e9de2 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe289:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128c48 expref: 443 pid: 16087 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.219960:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f52df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+1797:3689:x1805522011606528:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3492us (3525us total) trans 4296019859 rc 0/0 00000100:00100000:1.0:1721880422.219965:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631723 00000100:00100000:2.0:1721880422.219967:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.219990:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257665408 00000100:00100000:0.0:1721880422.219993:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257665408 00010000:00010000:0.0:1721880422.220002:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f1b3c0/0x8a60d30f571ebf06 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a435 expref: 2235 pid: 16099 timeout: 887 lvb_type: 0 00000004:00080000:1.0:1721880422.220011:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009b08f480/2, rc 0, transno 1052563 00000100:00100000:2.0:1721880422.220034:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.220039:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913921 00000100:00100000:1.0:1721880422.220041:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b08f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011606528:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.220044:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b176680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:262d1f41-ba81-41c5-b215-67c74ea63f50+2235:2004:x1805522257665408:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.220050:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257665024 00010000:00010000:0.0:1721880422.220052:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.220053:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257665024 00010000:00010000:0.0:1721880422.220056:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f1b3c0/0x8a60d30f571ebf06 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a435 expref: 2235 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.220063:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013065df80/0x8a60d30f571e9d33 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe288:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128bed expref: 444 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.220065:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f1b3c0/0x8a60d30f571ebf06 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a435 expref: 2235 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.220078:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f1b3c0/0x8a60d30f571ebf06 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a435 expref: 2235 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.220079:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913922 00000100:00100000:1.0:1721880422.220082:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e196850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+443:2005:x1805522257665024:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.220088:0:15473:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.220089:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.220090:0:15473:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013065df80/0x8a60d30f571e9d33 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe288:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128bed expref: 443 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.220091:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.220093:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727b515 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.220096:0:15473:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013065df80/0x8a60d30f571e9d33 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe288:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128bed expref: 443 pid: 16101 timeout: 887 lvb_type: 0 00000004:00080000:2.0:1721880422.220098:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008cd22d80/2, rc 0, transno 1094257 00010000:00010000:0.0:1721880422.220101:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727b515 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xff1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.220104:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013065df80/0x8a60d30f571e9d33 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe288:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128bed expref: 443 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.220106:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008cd22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011606016:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.220112:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.220113:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.220115:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.220115:0:15473:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136350000/0x8a60d30f5727b4f9 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe288:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.220119:0:15473:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136350000/0x8a60d30f5727b4f9 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe288:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.220129:0:15473:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.220132:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b176680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:262d1f41-ba81-41c5-b215-67c74ea63f50+2234:2004:x1805522257665408:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 88us (165us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.220135:0:16040:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727b515 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.220139:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913921 00000100:00100000:1.0:1721880422.220142:0:15473:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e196850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+442:2005:x1805522257665024:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 58us (109us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.220143:0:16040:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727b515 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.220145:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913922 00010000:00010000:2.0:1721880422.220150:0:16040:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727b515 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.220154:0:16040:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727b515 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.220158:0:16040:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727b515 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.220161:0:16040:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801363533c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.220163:0:16040:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727b515 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.220164:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088dc1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:15453:1805522011608960:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.220167:0:16040:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727b515 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.220173:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b51c lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe28b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.220173:0:16040:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727b515 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xff1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.220175:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1721880422.220177:0:16040:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727b515 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.220182:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b177800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011609856:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.220186:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b175f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011609600:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.220200:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.220209:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.220216:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011609856 00000100:00100000:1.0:1721880422.220218:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011609856 00000100:00100000:0.0:1721880422.220221:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1721880422.220224:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b176d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011609728:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.220230:0:16113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631734 00000100:00100000:1.0:1721880422.220232:0:16113:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a052c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0000-mdtlov_UUID+2610:3689:x1805522011609856:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.220233:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:1.0:1721880422.220241:0:16113:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:57996 count 1 00000100:00100000:0.0:1721880422.220247:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631735 00010000:00010000:1.0:1721880422.220248:0:16113:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009106cd80/0x8a60d30f5727b531 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe28c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.220251:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088db7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+1799:3686:x1805522011609600:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.220256:0:16113:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092369200/0x8a60d30f571e9fcc lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe28c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128d44 expref: 441 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.220260:0:16113:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00002000:00080000:0.0:1721880422.220261:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:65311 count 1 00010000:00010000:1.0:1721880422.220261:0:16113:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.220262:0:16113:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009106cd80/0x8a60d30f5727b531 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe28c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.220269:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727b538 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xff1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.220272:0:16113:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092369200/0x8a60d30f571e9fcc lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe28c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128d44 expref: 441 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.220277:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801239821c0/0x8a60d30f571ebfdf lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a50e expref: 2233 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.220278:0:16113:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092369200/0x8a60d30f571e9fcc lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe28c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128d44 expref: 441 pid: 16028 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.220284:0:16113:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a052f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0000_UUID:16113:1805522011609984:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.220285:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.220286:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.220287:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727b538 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xff1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.220293:0:16040:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:lustre-MDT0000-mdtlov_UUID+1799:3689:x1805522011607936:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2796us (2838us total) trans 4296019861 rc 0/0 00000100:00100000:1.0:1721880422.220295:0:16113:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb000 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.220298:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801239821c0/0x8a60d30f571ebfdf lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a50e expref: 2233 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.220298:0:16040:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631730 00010000:00010000:0.0:1721880422.220304:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801239821c0/0x8a60d30f571ebfdf lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a50e expref: 2233 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.220310:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088db4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011610112:192.168.201.24@tcp:104: 00000004:00080000:1.0:1721880422.220312:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009b08fb80/2, rc 0, transno 1094255 00010000:00010000:2.0:1721880422.220315:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136350000/0x8a60d30f5727b4f9 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.220317:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b08fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011606272:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.220321:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36780 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.220321:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136350000/0x8a60d30f5727b4f9 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.220326:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136350000/0x8a60d30f5727b4f9 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.220329:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136350000/0x8a60d30f5727b4f9 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.220333:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136350000/0x8a60d30f5727b4f9 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.220336:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350000 already unused, calling callback (ffffffffa084e330) 00000004:00080000:1.0:1721880422.220337:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008cd20e00/2, rc 0, transno 1052561 00010000:00010000:2.0:1721880422.220337:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136350000/0x8a60d30f5727b4f9 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.220341:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008cd20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011605760:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.220341:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136350000/0x8a60d30f5727b4f9 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.220346:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.220347:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136350000/0x8a60d30f5727b4f9 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.220351:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136350000/0x8a60d30f5727b4f9 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.220361:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257665280 00000100:00100000:1.0:1721880422.220363:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257665280 00010000:00010000:1.0:1721880422.220370:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff74480/0x8a60d30f571ebf4c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a47b expref: 2234 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.220387:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913923 00000100:00100000:0.0:1721880422.220390:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.220390:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088db4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:262d1f41-ba81-41c5-b215-67c74ea63f50+2234:2004:x1805522257665280:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.220395:0:15473:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.220398:0:15473:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ff74480/0x8a60d30f571ebf4c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a47b expref: 2234 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.220403:0:15473:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ff74480/0x8a60d30f571ebf4c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a47b expref: 2234 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.220410:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257665664 00010000:00010000:1.0:1721880422.220411:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ff74480/0x8a60d30f571ebf4c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a47b expref: 2234 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.220413:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257665664 00010000:00010000:1.0:1721880422.220419:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.220419:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1721880422.220421:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a052ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011610496:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.220421:0:15473:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727b50e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.220422:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880072982d00/0x8a60d30f571e9f2b lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe28b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128cf0 expref: 442 pid: 16087 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.220425:0:15473:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727b50e lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xff1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.220437:0:15473:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.220441:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913924 00000100:00100000:2.0:1721880422.220445:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088db5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+442:2004:x1805522257665664:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.220446:0:15473:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088db4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:262d1f41-ba81-41c5-b215-67c74ea63f50+2233:2004:x1805522257665280:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 56us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.220450:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913923 00010000:00010000:2.0:1721880422.220452:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.220455:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880072982d00/0x8a60d30f571e9f2b lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe28b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128cf0 expref: 442 pid: 16087 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.220460:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.220461:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880072982d00/0x8a60d30f571e9f2b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe28b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128cf0 expref: 442 pid: 16087 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.220462:0:16098:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727b50e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.220466:0:16098:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727b50e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.220469:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880072982d00/0x8a60d30f571e9f2b lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe28b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128cf0 expref: 442 pid: 16087 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.220470:0:16098:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727b50e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.220474:0:16098:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727b50e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.220477:0:16098:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727b50e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.220477:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.220478:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.220480:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b51c lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe28b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.220481:0:16098:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106cb40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.220482:0:16098:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727b50e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.220484:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b51c lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe28b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.220486:0:16098:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727b50e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.220494:0:16098:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727b50e lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xff1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.220496:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.220498:0:16098:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727b50e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.220501:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b51c lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.220506:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b51c lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.220506:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088db5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+441:2004:x1805522257665664:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 61us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.220510:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913924 00010000:00010000:0.0:1721880422.220511:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b51c lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.220519:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b51c lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.220523:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b51c lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.220526:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325cd80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.220528:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b51c lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.220532:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b51c lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.220538:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b51c lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.220541:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b51c lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.220581:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f52ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2611:3687:x1805522011607424:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3934us (3965us total) trans 4296061554 rc 0/0 00000100:00100000:2.0:1721880422.220586:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631726 00000100:00100000:1.0:1721880422.220588:0:16098:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0000-mdtlov_UUID+1800:3686:x1805522011608320:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3138us (3185us total) trans 4296019862 rc 0/0 00000100:00100000:1.0:1721880422.220592:0:16098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631729 00000004:00080000:2.0:1721880422.220606:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008cd23b80/2, rc 0, transno 1094259 00000004:00080000:1.0:1721880422.220612:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009f52c000/2, rc 0, transno 1094256 00000100:00100000:2.0:1721880422.220618:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008cd23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011605888:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.220619:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009f52c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011605504:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.220623:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1721880422.220629:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a052d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011610368:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.220631:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2611:3686:x1805522011608448:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3102us (3138us total) trans 4296061556 rc 0/0 00000100:00100000:0.0:1721880422.220636:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631731 00000100:00100000:2.0:1721880422.220644:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1721880422.220649:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009f52dc00/2, rc 0, transno 1094258 00000100:00100000:0.0:1721880422.220652:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011610368 00000100:00100000:1.0:1721880422.220653:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009f52dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011607424:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.220654:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011610368 00000004:00080000:2.0:1721880422.220659:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009b08c380/2, rc 0, transno 1052564 00000100:00100000:2.0:1721880422.220665:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b08c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011606784:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.220669:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631738 00000100:00100000:2.0:1721880422.220671:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a052e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011610880:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.220673:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b174a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2611:3688:x1805522011610368:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.220677:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a052c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011610752:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.220681:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1721880422.220686:0:16088:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:57997 count 1 00000100:00100000:1.0:1721880422.220694:0:16098:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011610880 00000100:00100000:2.0:1721880422.220694:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1721880422.220696:0:16098:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011610880 00010000:00010000:0.0:1721880422.220697:0:16088:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325d440/0x8a60d30f5727b54d lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe28d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.220698:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a052d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011611008:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.220707:0:16088:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092961d40/0x8a60d30f571ea090 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe28d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128d98 expref: 439 pid: 16091 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.220708:0:16098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631739 00000100:00100000:2.0:1721880422.220709:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.220710:0:16098:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b176a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0000-mdtlov_UUID+2612:3688:x1805522011610880:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.220714:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.220716:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.220718:0:16088:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325d440/0x8a60d30f5727b54d lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe28d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.220718:0:16098:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:57999 count 1 00000100:00100000:2.0:1721880422.220721:0:16040:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011611008 00000100:00100000:2.0:1721880422.220723:0:16040:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011611008 00010000:00010000:1.0:1721880422.220725:0:16098:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009106c240/0x8a60d30f5727b554 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe28f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.220750:0:16098:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f1458c0/0x8a60d30f571ea22d lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe28f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128e6a expref: 439 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.220750:0:16040:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631740 00010000:00010000:0.0:1721880422.220752:0:16088:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092961d40/0x8a60d30f571ea090 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe28d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128d98 expref: 439 pid: 16091 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.220753:0:16040:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b177b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:lustre-MDT0000-mdtlov_UUID+2614:3688:x1805522011611008:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.220757:0:16098:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.220758:0:16098:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.220759:0:16098:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009106c240/0x8a60d30f5727b554 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe28f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.220762:0:16088:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092961d40/0x8a60d30f571ea090 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe28d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128d98 expref: 439 pid: 16091 timeout: 887 lvb_type: 0 00002000:00080000:2.0:1721880422.220763:0:16040:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58000 count 1 00010000:00010000:1.0:1721880422.220770:0:16098:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f1458c0/0x8a60d30f571ea22d lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe28f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128e6a expref: 439 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.220771:0:16040:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727b55b lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe290:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.220772:0:16088:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088db6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0000_UUID:16088:1805522011611264:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.220775:0:16098:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f1458c0/0x8a60d30f571ea22d lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe28f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128e6a expref: 439 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.220779:0:16040:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801239a98c0/0x8a60d30f571ea2f1 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe290:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128ebe expref: 439 pid: 16087 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.220781:0:16098:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a052d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0000_UUID:16098:1805522011611392:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.220787:0:16040:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.220788:0:16040:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1721880422.220789:0:16088:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec366c0 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.220790:0:16040:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727b55b lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe290:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.220793:0:16098:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb480 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.220800:0:16040:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801239a98c0/0x8a60d30f571ea2f1 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe290:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128ebe expref: 439 pid: 16087 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.220806:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a052df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011611136:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.220806:0:16040:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801239a98c0/0x8a60d30f571ea2f1 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe290:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128ebe expref: 439 pid: 16087 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.220808:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.220815:0:16040:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b176680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_040:lustre-OST0000_UUID:16040:1805522011611520:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.220830:0:16040:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03480 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.220835:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.220838:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092943180/0x8a60d30f571e9de2 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe289:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128c48 expref: 439 pid: 16087 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.220845:0:9458:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b08ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9458:1805522011608064:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.220845:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011611136 00000100:00100000:2.0:1721880422.220848:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011611136 00010000:00010000:1.0:1721880422.220854:0:9458:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009106e640/0x8a60d30f5727b500 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.220860:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088dc2680/2, rc 0, transno 1094260 00010000:00010000:1.0:1721880422.220860:0:9458:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009106e640/0x8a60d30f5727b500 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.220863:0:9458:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009106e640/0x8a60d30f5727b500 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.220865:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631742 00010000:00010000:1.0:1721880422.220868:0:9458:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009106e640/0x8a60d30f5727b500 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.220869:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088dc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011608448:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.220870:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b8bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1800:3686:x1805522011611136:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.220872:0:9458:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009106e640/0x8a60d30f5727b500 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.220876:0:9458:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009106e640/0x8a60d30f5727b500 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.220879:0:9458:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106e640 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.220880:0:9458:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009106e640/0x8a60d30f5727b500 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.220882:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:65314 count 1 00010000:00010000:1.0:1721880422.220884:0:9458:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009106e640/0x8a60d30f5727b500 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.220889:0:9458:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009106e640/0x8a60d30f5727b500 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.220893:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009106e640/0x8a60d30f5727b500 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.220893:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727b569 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xff22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.220905:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009122e640/0x8a60d30f571ec056 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a585 expref: 2232 pid: 16019 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.220909:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a052c380/2, rc 0, transno 1052566 00010000:00010000:2.0:1721880422.220911:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.220912:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.220915:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727b569 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xff22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.220917:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a052c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011608320:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.220933:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009122e640/0x8a60d30f571ec056 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a585 expref: 2232 pid: 16019 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.220941:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007b8bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011612032:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.220943:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009122e640/0x8a60d30f571ec056 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a585 expref: 2232 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.220952:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009bd8aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011611904:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.220955:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.220965:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03e40 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.220974:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011612032 00000100:00100000:0.0:1721880422.220976:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011612032 00000100:00100000:1.0:1721880422.220981:0:9458:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2615:3686:x1805522011607808:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3754us (3805us total) trans 4296061558 rc 0/0 00000004:00080000:2.0:1721880422.220983:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088dc1f80/2, rc 0, transno 1094261 00000100:00100000:1.0:1721880422.220987:0:9458:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631727 00000100:00100000:2.0:1721880422.220995:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088dc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011608192:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.221001:0:9458:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631743 00000004:00080000:2.0:1721880422.221002:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009b08ed80/2, rc 0, transno 1052565 00000100:00100000:2.0:1721880422.221006:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b08ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011607936:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.221007:0:9458:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b8bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1801:3688:x1805522011612032:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.221034:0:9458:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:65315 count 1 00000100:00100000:2.0:1721880422.221041:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007b8bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011612160:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.221045:0:9458:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727b570 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xff23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.221047:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009b08c700/2, rc 0, transno 1094262 00000100:00100000:0.0:1721880422.221053:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b08c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011607808:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.221054:0:9458:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007ca8d8c0/0x8a60d30f571ec079 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a5a8 expref: 2232 pid: 16019 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.221056:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.221061:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.221063:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.221065:0:9458:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727b570 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xff23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.221078:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011612160 00000100:00100000:0.0:1721880422.221080:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011612160 00010000:00010000:1.0:1721880422.221081:0:9458:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007ca8d8c0/0x8a60d30f571ec079 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a5a8 expref: 2232 pid: 16019 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.221091:0:9458:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007ca8d8c0/0x8a60d30f571ec079 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a5a8 expref: 2232 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.221100:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631744 00000100:00100000:1.0:1721880422.221100:0:9458:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a052e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011612544:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.221103:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bd88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2615:3689:x1805522011612160:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1721880422.221111:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58002 count 1 00000100:00100000:1.0:1721880422.221117:0:9458:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb600 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.221119:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727b577 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe292:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.221127:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091018fc0/0x8a60d30f571ea441 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe292:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128f58 expref: 438 pid: 9459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.221131:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.221133:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.221135:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727b577 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe292:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.221135:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007b8bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011611776:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.221151:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.221152:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091018fc0/0x8a60d30f571ea441 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe292:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128f58 expref: 438 pid: 9459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.221161:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091018fc0/0x8a60d30f571ea441 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe292:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128f58 expref: 438 pid: 9459 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.221161:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007b8be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011612416:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.221169:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.221176:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007b8bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:15453:1805522011612672:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.221181:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011611776 00000100:00100000:1.0:1721880422.221183:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011611776 00000100:00100000:0.0:1721880422.221194:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36a80 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.221199:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011612416 00000100:00100000:1.0:1721880422.221201:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011612416 00000100:00100000:0.0:1721880422.221204:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009bd8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011612288:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.221207:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631745 00000100:00100000:1.0:1721880422.221210:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b08ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2617:3687:x1805522011611776:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1721880422.221217:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58001 count 1 00000100:00100000:0.0:1721880422.221220:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.221224:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009106ed00/0x8a60d30f5727b57e lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe291:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.221230:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801363c9f80/0x8a60d30f571ea3ae lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe291:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128f12 expref: 438 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.221234:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.221235:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.221236:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009106ed00/0x8a60d30f5727b57e lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe291:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.221246:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801363c9f80/0x8a60d30f571ea3ae lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe291:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128f12 expref: 438 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.221251:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801363c9f80/0x8a60d30f571ea3ae lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe291:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128f12 expref: 438 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.221257:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b08f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:15452:1805522011612800:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.221270:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eba80 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.221281:0:16110:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011612288 00000100:00100000:1.0:1721880422.221282:0:16110:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011612288 00000100:00100000:1.0:1721880422.221295:0:16110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631747 00000100:00100000:1.0:1721880422.221298:0:16110:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b8bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_094:lustre-MDT0000-mdtlov_UUID+1802:3686:x1805522011612288:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.221308:0:16110:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:65316 count 1 00010000:00010000:1.0:1721880422.221317:0:16110:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727b58c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xff24:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.221326:0:16110:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880123981440/0x8a60d30f571ec09c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a5cb expref: 2232 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.221332:0:16110:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.221334:0:16110:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.221336:0:16110:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727b58c lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xff24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.221352:0:16110:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880123981440/0x8a60d30f571ec09c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a5cb expref: 2232 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.221360:0:16110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880123981440/0x8a60d30f571ec09c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a5cb expref: 2232 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.221368:0:16110:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088dc1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_094:lustre-OST0001_UUID:16110:1805522011613056:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.221399:0:16110:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.222039:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.222054:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257665792 00000100:00100000:2.0:1721880422.222059:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257665792 00010000:00010000:2.0:1721880422.222073:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013517db00/0x8a60d30f571ebf84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a4b3 expref: 2233 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.222080:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.222111:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257665920 00000100:00100000:2.0:1721880422.222114:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257665920 00010000:00010000:2.0:1721880422.222123:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096cddb00/0x8a60d30f571ebfae lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xff1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a4dd expref: 2234 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.222125:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913925 00000100:00100000:0.0:1721880422.222131:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d122300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:262d1f41-ba81-41c5-b215-67c74ea63f50+2234:2004:x1805522257665792:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.222140:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.222146:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013517db00/0x8a60d30f571ebf84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a4b3 expref: 2234 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.222146:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913926 00000100:00100000:2.0:1721880422.222152:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d123480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:262d1f41-ba81-41c5-b215-67c74ea63f50+2234:2004:x1805522257665920:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.222156:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013517db00/0x8a60d30f571ebf84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a4b3 expref: 2234 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.222160:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.222164:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096cddb00/0x8a60d30f571ebfae lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xff1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a4dd expref: 2234 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.222169:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013517db00/0x8a60d30f571ebf84 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a4b3 expref: 2234 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.222173:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096cddb00/0x8a60d30f571ebfae lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a4dd expref: 2234 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.222181:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.222182:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.222185:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727b523 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.222186:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.222187:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.222190:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727b52a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.222192:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727b523 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xff1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.222195:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727b52a lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xff1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.222203:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.222216:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.222220:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d123480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:262d1f41-ba81-41c5-b215-67c74ea63f50+2233:2004:x1805522257665920:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 67us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.222226:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913926 00000100:00100000:0.0:1721880422.222233:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d122300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:262d1f41-ba81-41c5-b215-67c74ea63f50+2233:2004:x1805522257665792:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 101us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.222239:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913925 00010000:00010000:2.0:1721880422.222255:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096cddb00/0x8a60d30f571ebfae lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a4dd expref: 2231 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.222267:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b174380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011609472:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.222282:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727b52a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.222289:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727b52a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.222296:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727b52a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.222303:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727b52a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.222310:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727b52a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.222315:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727b52a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.222320:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353600 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.222323:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727b52a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.222330:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727b52a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.222338:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727b52a lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xff1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.222349:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727b52a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.222382:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088db4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011610112:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.222384:0:16113:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a052f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0000_UUID:16113:1805522011609984:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.222391:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727b538 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xff1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.222399:0:16113:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009106cd80/0x8a60d30f5727b531 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe28c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.222435:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009b177480/2, rc 0, transno 1052567 00000100:00100000:0.0:1721880422.222442:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011609088:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1721880422.222449:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009b175180/2, rc 0, transno 1052568 00000100:00100000:0.0:1721880422.222451:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b175180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011609216:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.222451:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b174e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+1803:3688:x1805522011609216:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3245us (3274us total) trans 4296019864 rc 0/0 00000100:00100000:2.0:1721880422.222456:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631733 00000100:00100000:0.0:1721880422.222481:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088dc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011613184:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.222497:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.222523:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011613184 00000100:00100000:2.0:1721880422.222526:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011613184 00000100:00100000:0.0:1721880422.222528:0:16130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011613312 00000100:00100000:0.0:1721880422.222530:0:16130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011613312 00000100:00100000:2.0:1721880422.222538:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631748 00000100:00100000:2.0:1721880422.222540:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+1804:3688:x1805522011613184:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.222549:0:16130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631749 00002000:00080000:2.0:1721880422.222552:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:65317 count 1 00000100:00100000:0.0:1721880422.222553:0:16130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0000-mdtlov_UUID+1804:3689:x1805522011613312:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.222560:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727b593 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xff25:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1721880422.222565:0:16130:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:65318 count 1 00010000:00010000:2.0:1721880422.222568:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800842a4b40/0x8a60d30f571ec0bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a5ee expref: 2230 pid: 16019 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.222573:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.222574:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.222575:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727b593 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xff25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.222577:0:16130:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727b59a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xff26:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.222585:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800842a4b40/0x8a60d30f571ec0bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a5ee expref: 2230 pid: 16019 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.222588:0:16130:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800992c3a80/0x8a60d30f571ec0e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a611 expref: 2230 pid: 16019 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.222590:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800842a4b40/0x8a60d30f571ec0bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a5ee expref: 2230 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.222597:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b174380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011613440:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.222599:0:16130:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.222600:0:16130:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.222603:0:16130:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727b59a lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xff26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.222614:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03d80 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.222670:0:16130:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800992c3a80/0x8a60d30f571ec0e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a611 expref: 2230 pid: 16019 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.222679:0:16130:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800992c3a80/0x8a60d30f571ec0e2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a611 expref: 2230 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.222688:0:16130:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d123b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0001_UUID:16130:1805522011613568:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.222742:0:16130:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36780 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.222801:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.222812:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257666048 00000100:00100000:2.0:1721880422.222812:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.222814:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257666048 00010000:00010000:0.0:1721880422.222823:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092369200/0x8a60d30f571e9fcc lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe28c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128d44 expref: 439 pid: 16028 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.222826:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.222841:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257666304 00000100:00100000:0.0:1721880422.222842:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257666304 00010000:00010000:0.0:1721880422.222849:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad1fa80/0x8a60d30f571ec010 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a53f expref: 2232 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.222875:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913928 00000100:00100000:0.0:1721880422.222880:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:262d1f41-ba81-41c5-b215-67c74ea63f50+2232:2005:x1805522257666176:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.222883:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913929 00000100:00100000:1.0:1721880422.222890:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ab4d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:262d1f41-ba81-41c5-b215-67c74ea63f50+2232:2006:x1805522257666304:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.222892:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.222896:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801239821c0/0x8a60d30f571ebfdf lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a50e expref: 2232 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.222902:0:15473:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.222906:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801239821c0/0x8a60d30f571ebfdf lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a50e expref: 2232 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.222907:0:15473:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ad1fa80/0x8a60d30f571ec010 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a53f expref: 2232 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.222917:0:15473:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ad1fa80/0x8a60d30f571ec010 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a53f expref: 2232 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.222918:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801239821c0/0x8a60d30f571ebfdf lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a50e expref: 2232 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.222931:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.222931:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ad1fa80/0x8a60d30f571ec010 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a53f expref: 2231 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.222932:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.222934:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727b538 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.222938:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727b538 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xff1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.222941:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.222943:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.222946:0:15473:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727b53f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.222951:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.222953:0:15473:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727b53f lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xff20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.222970:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:262d1f41-ba81-41c5-b215-67c74ea63f50+2230:2005:x1805522257666176:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 89us (156us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.222975:0:15473:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.222981:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913928 00010000:00010000:2.0:1721880422.222991:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727b53f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.222996:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727b53f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.223000:0:15473:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ab4d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:262d1f41-ba81-41c5-b215-67c74ea63f50+2229:2006:x1805522257666304:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 110us (171us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.223001:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727b53f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.223005:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727b53f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.223007:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913929 00010000:00010000:2.0:1721880422.223009:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727b53f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.223026:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b7840 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.223029:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727b53f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.223034:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727b53f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.223042:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727b53f lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xff20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.223046:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727b53f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.223078:0:16098:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a052d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0000_UUID:16098:1805522011611392:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.223091:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727b538 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.223092:0:16098:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009106c240/0x8a60d30f5727b554 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe28f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.223103:0:16113:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009106cd80/0x8a60d30f5727b531 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.223109:0:16113:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009106cd80/0x8a60d30f5727b531 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.223116:0:16113:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009106cd80/0x8a60d30f5727b531 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.223122:0:16113:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009106cd80/0x8a60d30f5727b531 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.223128:0:16113:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009106cd80/0x8a60d30f5727b531 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.223134:0:16113:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106cd80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.223136:0:16113:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009106cd80/0x8a60d30f5727b531 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.223139:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088db5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+1805:3686:x1805522011609728:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2878us (2903us total) trans 4296019865 rc 0/0 00010000:00010000:1.0:1721880422.223143:0:16113:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009106cd80/0x8a60d30f5727b531 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.223143:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631736 00010000:00010000:1.0:1721880422.223153:0:16113:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009106cd80/0x8a60d30f5727b531 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.223158:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727b538 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.223159:0:16113:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009106cd80/0x8a60d30f5727b531 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.223166:0:16040:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b176680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_040:lustre-OST0000_UUID:16040:1805522011611520:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.223178:0:16040:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727b55b lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe290:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.223209:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257666432 00000100:00100000:1.0:1721880422.223213:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257666432 00010000:00010000:0.0:1721880422.223220:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727b538 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.223223:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009bd8aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011611904:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.223225:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009eb8bcc0/0x8a60d30f571ec03a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a569 expref: 2229 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.223228:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727b538 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.223231:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727b569 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xff22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.223235:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727b538 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.223241:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325f600 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.223246:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727b538 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.223250:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257666560 00000100:00100000:1.0:1721880422.223252:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257666560 00010000:00010000:0.0:1721880422.223253:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727b538 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.223259:0:15455:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257666816 00000100:00100000:2.0:1721880422.223261:0:15455:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257666816 00010000:00010000:0.0:1721880422.223262:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727b538 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xff1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.223262:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f1458c0/0x8a60d30f571ea22d lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe28f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128e6a expref: 438 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.223268:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727b538 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.223270:0:15455:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092961d40/0x8a60d30f571ea090 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe28d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128d98 expref: 439 pid: 16091 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.223280:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913931 00000100:00100000:2.0:1721880422.223285:0:15455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913932 00000100:00100000:1.0:1721880422.223288:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+439:2004:x1805522257666560:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.223289:0:15455:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+439:2004:x1805522257666816:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.223295:0:15473:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.223297:0:15455:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.223299:0:15473:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f1458c0/0x8a60d30f571ea22d lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe28f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128e6a expref: 439 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.223299:0:15455:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092961d40/0x8a60d30f571ea090 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe28d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128d98 expref: 439 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.223306:0:15455:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092961d40/0x8a60d30f571ea090 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe28d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128d98 expref: 439 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.223308:0:15473:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f1458c0/0x8a60d30f571ea22d lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe28f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128e6a expref: 439 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.223313:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.223314:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.223316:0:15455:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009325d440/0x8a60d30f5727b54d lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe28d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.223320:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f1458c0/0x8a60d30f571ea22d lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe28f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128e6a expref: 439 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.223320:0:15455:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325d440/0x8a60d30f5727b54d lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe28d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.223327:0:15455:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.223330:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.223332:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.223335:0:15473:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009106c240/0x8a60d30f5727b554 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe28f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.223340:0:15455:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+438:2004:x1805522257666816:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 51us (85us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.223341:0:15473:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009106c240/0x8a60d30f5727b554 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe28f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.223346:0:15455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913932 00010000:00010000:1.0:1721880422.223360:0:15473:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.223372:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.223381:0:15473:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+437:2004:x1805522257666560:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 94us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.223382:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088db7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+1805:3686:x1805522011609600:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3129us (3171us total) trans 4296019866 rc 0/0 00000100:00100000:0.0:1721880422.223387:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631735 00000100:00100000:1.0:1721880422.223388:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913931 00000100:00100000:2.0:1721880422.223389:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257667072 00000100:00100000:2.0:1721880422.223392:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257667072 00010000:00010000:2.0:1721880422.223404:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091018fc0/0x8a60d30f571ea441 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe292:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128f58 expref: 437 pid: 9459 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.223407:0:16098:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009106c240/0x8a60d30f5727b554 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.223408:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007b8bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:15453:1805522011612672:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.223413:0:16098:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009106c240/0x8a60d30f5727b554 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.223420:0:16098:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009106c240/0x8a60d30f5727b554 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.223421:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913933 00010000:00010000:0.0:1721880422.223423:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727b577 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe292:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.223425:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099eb1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+437:2004:x1805522257667072:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.223426:0:16098:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009106c240/0x8a60d30f5727b554 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.223432:0:16098:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009106c240/0x8a60d30f5727b554 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.223436:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.223437:0:16098:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106c240 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.223440:0:16098:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009106c240/0x8a60d30f5727b554 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.223440:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091018fc0/0x8a60d30f571ea441 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe292:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128f58 expref: 437 pid: 9459 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.223446:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092961d40/0x8a60d30f571ea090 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe28d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128d98 expref: 437 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.223446:0:16098:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009106c240/0x8a60d30f5727b554 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.223449:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091018fc0/0x8a60d30f571ea441 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe292:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128f58 expref: 437 pid: 9459 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.223455:0:16088:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088db6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0000_UUID:16088:1805522011611264:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.223459:0:16098:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009106c240/0x8a60d30f5727b554 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.223461:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091018fc0/0x8a60d30f571ea441 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe292:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128f58 expref: 436 pid: 9459 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.223465:0:16098:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009106c240/0x8a60d30f5727b554 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.223467:0:16088:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325d440/0x8a60d30f5727b54d lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.223473:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.223474:0:16088:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325d440/0x8a60d30f5727b54d lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.223474:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.223477:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727b577 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe292:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.223481:0:16088:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325d440/0x8a60d30f5727b54d lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.223484:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727b577 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe292:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.223487:0:16088:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325d440/0x8a60d30f5727b54d lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.223493:0:16088:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325d440/0x8a60d30f5727b54d lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.223497:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.223499:0:16088:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325d440/0x8a60d30f5727b54d lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.223504:0:16088:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325d440 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.223507:0:16088:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325d440/0x8a60d30f5727b54d lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.223513:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099eb1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+435:2004:x1805522257667072:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 86us (140us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.223514:0:16088:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325d440/0x8a60d30f5727b54d lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.223519:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913933 00010000:00010000:0.0:1721880422.223523:0:16088:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325d440/0x8a60d30f5727b54d lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.223528:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325d440/0x8a60d30f5727b54d lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.223578:0:16098:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b176a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0000-mdtlov_UUID+2619:3688:x1805522011610880:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2865us (2894us total) trans 4296061559 rc 0/0 00000100:00100000:1.0:1721880422.223584:0:16098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631739 00000100:00100000:2.0:1721880422.223591:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257667328 00000100:00100000:2.0:1721880422.223595:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257667328 00010000:00010000:2.0:1721880422.223607:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a090dd40/0x8a60d30f571ea14d lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe28e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128e16 expref: 436 pid: 9459 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.223625:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913935 00000100:00100000:0.0:1721880422.223628:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b174a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2619:3688:x1805522011610368:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2953us (2982us total) trans 4296061560 rc 0/0 00000100:00100000:2.0:1721880422.223630:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+436:2004:x1805522257667328:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.223633:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631738 00010000:00010000:2.0:1721880422.223637:0:15473:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.223640:0:15473:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a090dd40/0x8a60d30f571ea14d lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe28e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128e16 expref: 436 pid: 9459 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.223647:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727b577 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.223649:0:15473:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a090dd40/0x8a60d30f571ea14d lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe28e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128e16 expref: 435 pid: 9459 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.223651:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727b577 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.223655:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727b577 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.223659:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727b577 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.223662:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a090dd40/0x8a60d30f571ea14d lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe28e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128e16 expref: 435 pid: 9459 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.223663:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727b577 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.223671:0:16113:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a052c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0000-mdtlov_UUID+2618:3689:x1805522011609856:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3436us (3469us total) trans 4296061561 rc 0/0 00010000:00010000:0.0:1721880422.223673:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325c480 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.223673:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.223674:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.223676:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727b577 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.223676:0:16113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631734 00010000:00010000:2.0:1721880422.223677:0:15473:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4b40/0x8a60d30f5727b562 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe28e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.223682:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727b577 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.223683:0:15473:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4b40/0x8a60d30f5727b562 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe28e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.223691:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727b577 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.223697:0:15473:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.223698:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727b577 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.223710:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.223717:0:15473:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+433:2004:x1805522257667328:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 85us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.223722:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257666944 00000100:00100000:1.0:1721880422.223724:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257666944 00000100:00100000:2.0:1721880422.223724:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913935 00010000:00010000:1.0:1721880422.223754:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009122e640/0x8a60d30f571ec056 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a585 expref: 2228 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.223767:0:16040:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727b55b lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.223774:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913936 00010000:00010000:2.0:1721880422.223776:0:16040:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727b55b lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.223779:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8066450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:262d1f41-ba81-41c5-b215-67c74ea63f50+2228:2005:x1805522257666944:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.223784:0:16040:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727b55b lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.223786:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.223790:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009122e640/0x8a60d30f571ec056 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a585 expref: 2228 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.223791:0:16040:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727b55b lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.223797:0:16040:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727b55b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.223799:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009122e640/0x8a60d30f571ec056 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a585 expref: 2228 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.223803:0:16040:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353cc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.223806:0:16040:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727b55b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.223811:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009122e640/0x8a60d30f571ec056 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a585 expref: 2228 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.223813:0:16040:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727b55b lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.223820:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.223822:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.223823:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727b569 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.223823:0:16040:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727b55b lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.223828:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727b569 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xff22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.223829:0:16040:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727b55b lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.223838:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.223851:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8066450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:262d1f41-ba81-41c5-b215-67c74ea63f50+2227:2005:x1805522257666944:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 72us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.223853:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bd88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2619:3689:x1805522011612160:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2748us (2795us total) trans 4296061562 rc 0/0 00000100:00100000:1.0:1721880422.223855:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913936 00000100:00100000:0.0:1721880422.223857:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631744 00000100:00100000:0.0:1721880422.223873:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d123480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011613696:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1721880422.223885:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a052c700/2, rc 0, transno 1094267 00000100:00100000:1.0:1721880422.223899:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a052c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011610752:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.223912:0:9458:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a052e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011612544:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.223922:0:9458:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727b570 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xff23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.223932:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257667200 00000100:00100000:1.0:1721880422.223933:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257667200 00010000:00010000:1.0:1721880422.223940:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007ca8d8c0/0x8a60d30f571ec079 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a5a8 expref: 2227 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.223945:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.223947:0:16040:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b177b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:lustre-MDT0000-mdtlov_UUID+2618:3688:x1805522011611008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3191us (3235us total) trans 4296061564 rc 0/0 00000100:00100000:2.0:1721880422.223956:0:16040:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631740 00000100:00100000:1.0:1721880422.223958:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913937 00000100:00100000:1.0:1721880422.223961:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:262d1f41-ba81-41c5-b215-67c74ea63f50+2227:2005:x1805522257667200:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.223966:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.223968:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007ca8d8c0/0x8a60d30f571ec079 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a5a8 expref: 2227 pid: 16019 timeout: 887 lvb_type: 0 00000004:00080000:0.0:1721880422.223971:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a052ce00/2, rc 0, transno 1052571 00010000:00010000:1.0:1721880422.223973:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007ca8d8c0/0x8a60d30f571ec079 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a5a8 expref: 2227 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.223977:0:16040:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011613696 00000100:00100000:0.0:1721880422.223979:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a052ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011610496:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.223980:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007ca8d8c0/0x8a60d30f571ec079 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a5a8 expref: 2227 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.223981:0:16040:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011613696 00010000:00010000:1.0:1721880422.223986:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.223987:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.223988:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727b570 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.223992:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727b570 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xff23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.223996:0:16040:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631750 00010000:00010000:1.0:1721880422.223998:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.224001:0:16040:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088db6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:lustre-MDT0000-mdtlov_UUID+2618:3686:x1805522011613696:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.224009:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007b8bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011613952:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.224009:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:262d1f41-ba81-41c5-b215-67c74ea63f50+2226:2005:x1805522257667200:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 47us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.224025:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913937 00002000:00080000:2.0:1721880422.224029:0:16040:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58004 count 1 00010000:00010000:2.0:1721880422.224040:0:16040:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136353840/0x8a60d30f5727b5a1 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe294:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.224042:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.224043:0:16110:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088dc1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_094:lustre-OST0001_UUID:16110:1805522011613056:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.224051:0:16110:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727b58c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xff24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.224052:0:16040:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f145680/0x8a60d30f571ea5d7 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe294:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12902a expref: 433 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.224059:0:16040:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000004:00080000:0.0:1721880422.224060:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a052d500/2, rc 0, transno 1094268 00010000:00010000:2.0:1721880422.224060:0:16040:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1721880422.224062:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b08f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:15452:1805522011612800:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.224062:0:16040:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136353840/0x8a60d30f5727b5a1 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe294:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.224066:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a052d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011611008:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.224068:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009106ed00/0x8a60d30f5727b57e lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe291:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.224081:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d122300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011613824:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1721880422.224081:0:16040:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f145680/0x8a60d30f571ea5d7 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe294:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12902a expref: 431 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.224088:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011613952 00000100:00100000:0.0:1721880422.224090:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011613952 00010000:00010000:2.0:1721880422.224090:0:16040:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f145680/0x8a60d30f571ea5d7 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe294:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12902a expref: 431 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.224097:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.224100:0:16040:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099eb2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_040:lustre-OST0000_UUID:16040:1805522011614208:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.224111:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011613824 00000100:00100000:0.0:1721880422.224113:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011613824 00000100:00100000:2.0:1721880422.224118:0:16040:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03e40 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.224121:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631751 00000100:00100000:0.0:1721880422.224124:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088db5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2620:3688:x1805522011613952:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1721880422.224130:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727b569 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1721880422.224132:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58006 count 1 00000100:00100000:1.0:1721880422.224132:0:16113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631752 00010000:00010000:2.0:1721880422.224135:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727b569 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.224137:0:16113:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0000-mdtlov_UUID+2620:3687:x1805522011613824:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.224140:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325f840/0x8a60d30f5727b5a8 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe296:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.224144:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727b569 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.224148:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801203e7840/0x8a60d30f571ea743 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1290cb expref: 431 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.224148:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727b569 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.224151:0:16113:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58005 count 1 00010000:00010000:2.0:1721880422.224152:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727b569 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.224153:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.224154:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.224155:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325f840/0x8a60d30f5727b5a8 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.224155:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350fc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.224157:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727b569 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.224160:0:16113:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009106d200/0x8a60d30f5727b5af lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe295:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.224161:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727b569 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.224165:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801203e7840/0x8a60d30f571ea743 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1290cb expref: 431 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.224167:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727b569 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xff22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.224170:0:16113:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c4ceac0/0x8a60d30f571ea694 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe295:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129077 expref: 431 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.224170:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727b569 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.224171:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801203e7840/0x8a60d30f571ea743 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1290cb expref: 431 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.224176:0:16113:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1721880422.224177:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008876c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:15453:1805522011614464:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.224178:0:16113:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.224180:0:16113:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009106d200/0x8a60d30f5727b5af lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe295:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.224189:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec366c0 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.224194:0:16113:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c4ceac0/0x8a60d30f571ea694 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe295:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129077 expref: 431 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.224200:0:16113:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c4ceac0/0x8a60d30f571ea694 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe295:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129077 expref: 431 pid: 16028 timeout: 887 lvb_type: 0 00000004:00080000:0.0:1721880422.224201:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009b176d80/2, rc 0, transno 1052569 00000100:00100000:0.0:1721880422.224205:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b176d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011609728:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.224207:0:16113:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088dc1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0000_UUID:16113:1805522011614592:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.224220:0:16113:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eba80 going to sleep for 11 seconds 00000004:00080000:0.0:1721880422.224222:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009b175f80/2, rc 0, transno 1052570 00000100:00100000:0.0:1721880422.224225:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b175f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011609600:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1721880422.224238:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b8be300/2, rc 0, transno 1094269 00000100:00100000:0.0:1721880422.224240:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088db4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011614336:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.224245:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007b8be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011612416:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.224260:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.224260:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b8bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1805:3686:x1805522011611136:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3389us (3425us total) trans 4296019868 rc 0/0 00000100:00100000:2.0:1721880422.224265:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631742 00000100:00100000:1.0:1721880422.224268:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011614080 00000100:00100000:1.0:1721880422.224270:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011614080 00000100:00100000:0.0:1721880422.224275:0:16098:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011614848 00000100:00100000:2.0:1721880422.224275:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011614336 00000100:00100000:0.0:1721880422.224277:0:16098:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011614848 00000100:00100000:2.0:1721880422.224277:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011614336 00000100:00100000:1.0:1721880422.224283:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631753 00000100:00100000:1.0:1721880422.224286:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+1806:3689:x1805522011614080:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.224290:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011614976 00000100:00100000:2.0:1721880422.224291:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011614976 00002000:00080000:1.0:1721880422.224294:0:16088:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64182 count 1 00000100:00100000:0.0:1721880422.224298:0:16098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631754 00000100:00100000:0.0:1721880422.224302:0:16098:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134dc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0000-mdtlov_UUID+2622:3686:x1805522011614336:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.224302:0:16088:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106db00/0x8a60d30f5727b5b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfab6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.224303:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631755 00000100:00100000:2.0:1721880422.224306:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1806:3689:x1805522011614848:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.224309:0:16098:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58007 count 1 00010000:00010000:1.0:1721880422.224310:0:16088:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d26a1c0/0x8a60d30f571eccf1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfab6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12b20b expref: 1446 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.224313:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.224314:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00002000:00080000:2.0:1721880422.224315:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64184 count 1 00010000:00010000:1.0:1721880422.224316:0:16088:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106db00/0x8a60d30f5727b5b6 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfab6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.224317:0:16098:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325e880/0x8a60d30f5727b5bd lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe297:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.224322:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727b5c4 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfab8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.224324:0:16098:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801203e7600/0x8a60d30f571ea7cf lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129118 expref: 431 pid: 16053 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.224324:0:16088:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d26a1c0/0x8a60d30f571eccf1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfab6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12b20b expref: 1446 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.224329:0:16098:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.224329:0:16098:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.224329:0:16088:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d26a1c0/0x8a60d30f571eccf1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfab6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12b20b expref: 1446 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.224330:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a7dad00/0x8a60d30f5716ca0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfab8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f8842 expref: 1446 pid: 16109 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.224331:0:16098:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325e880/0x8a60d30f5727b5bd lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.224334:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.224335:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.224336:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727b5c4 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfab8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.224338:0:16088:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a052e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011615104:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.224341:0:16098:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801203e7600/0x8a60d30f571ea7cf lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129118 expref: 431 pid: 16053 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.224346:0:16098:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801203e7600/0x8a60d30f571ea7cf lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129118 expref: 431 pid: 16053 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.224347:0:16088:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb0c0 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.224347:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a7dad00/0x8a60d30f5716ca0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfab8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f8842 expref: 1446 pid: 16109 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.224352:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a7dad00/0x8a60d30f5716ca0d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfab8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f8842 expref: 1446 pid: 16109 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.224353:0:16098:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b086a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0000_UUID:16098:1805522011615232:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.224357:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b087100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011614720:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.224359:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099eb2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011615360:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.224365:0:16098:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36a80 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.224370:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03480 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.224379:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1721880422.224380:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a052df80/2, rc 0, transno 1052572 00000100:00100000:0.0:1721880422.224384:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a052df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011611136:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.224394:0:9458:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727b570 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.224399:0:9458:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727b570 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.224403:0:9458:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727b570 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.224405:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.224407:0:9458:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727b570 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.224410:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a052e680/2, rc 0, transno 1094263 00010000:00010000:1.0:1721880422.224410:0:9458:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727b570 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.224414:0:9458:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106eac0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.224415:0:9458:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727b570 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.224415:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257667456 00000100:00100000:2.0:1721880422.224418:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257667456 00000100:00100000:0.0:1721880422.224421:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a052e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011610880:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.224421:0:9458:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727b570 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.224426:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a052d880/2, rc 0, transno 1094264 00010000:00010000:2.0:1721880422.224427:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801363c9f80/0x8a60d30f571ea3ae lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe291:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128f12 expref: 432 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.224429:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a052d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011610368:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.224430:0:9458:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727b570 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xff23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.224434:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727b570 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.224439:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913939 00000100:00100000:2.0:1721880422.224441:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099eb0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+432:2005:x1805522257667456:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.224444:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800919c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011615616:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.224446:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.224448:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801363c9f80/0x8a60d30f571ea3ae lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe291:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128f12 expref: 432 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.224454:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801363c9f80/0x8a60d30f571ea3ae lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe291:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128f12 expref: 432 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.224463:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801363c9f80/0x8a60d30f571ea3ae lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe291:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128f12 expref: 432 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.224468:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.224469:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.224470:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.224472:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009106ed00/0x8a60d30f5727b57e lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe291:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.224476:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009106ed00/0x8a60d30f5727b57e lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe291:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.224484:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a052f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011615872:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1721880422.224485:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.224493:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099eb0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+431:2005:x1805522257667456:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 51us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.224496:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e614e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011616000:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.224497:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913939 00000100:00100000:1.0:1721880422.224505:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.224513:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011615872 00000100:00100000:2.0:1721880422.224515:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011615872 00000100:00100000:0.0:1721880422.224518:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.224527:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011616000 00000100:00100000:2.0:1721880422.224529:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011616000 00010000:00010000:1.0:1721880422.224530:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009106ed00/0x8a60d30f5727b57e lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.224537:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009106ed00/0x8a60d30f5727b57e lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.224542:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631759 00010000:00010000:1.0:1721880422.224544:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009106ed00/0x8a60d30f5727b57e lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.224546:0:16120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631760 00000100:00100000:0.0:1721880422.224547:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e616300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2624:3687:x1805522011615872:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.224549:0:16120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+2624:3688:x1805522011616000:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.224551:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009106ed00/0x8a60d30f5727b57e lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.224557:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009106ed00/0x8a60d30f5727b57e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.224557:0:16120:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58010 count 1 00002000:00080000:0.0:1721880422.224560:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58009 count 1 00010000:00010000:1.0:1721880422.224563:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106ed00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.224564:0:16120:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136353a80/0x8a60d30f5727b5e0 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe29a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.224566:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009106ed00/0x8a60d30f5727b57e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.224570:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325e400/0x8a60d30f5727b5e7 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe299:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.224572:0:16120:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941821c0/0x8a60d30f571eaa30 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe29a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129229 expref: 430 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.224576:0:16120:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.224577:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009106ed00/0x8a60d30f5727b57e lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.224577:0:16120:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.224578:0:16120:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136353a80/0x8a60d30f5727b5e0 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe29a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.224581:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ea7c900/0x8a60d30f571ea981 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe299:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1291d5 expref: 430 pid: 16128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.224587:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.224587:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009106ed00/0x8a60d30f5727b57e lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.224588:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.224589:0:16120:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800941821c0/0x8a60d30f571eaa30 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe29a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129229 expref: 430 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.224591:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325e400/0x8a60d30f5727b5e7 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe299:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.224593:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009106ed00/0x8a60d30f5727b57e lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.224595:0:16120:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800941821c0/0x8a60d30f571eaa30 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe29a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129229 expref: 430 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.224601:0:16120:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099eb3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16120:1805522011616256:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.224608:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ea7c900/0x8a60d30f571ea981 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe299:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1291d5 expref: 430 pid: 16128 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.224611:0:16120:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03540 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.224618:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ea7c900/0x8a60d30f571ea981 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe299:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1291d5 expref: 430 pid: 16128 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.224626:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800919c2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0000_UUID:16089:1805522011616384:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.224637:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec363c0 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.224677:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b174380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011613440:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.224686:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727b593 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xff25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.224711:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b08ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2625:3687:x1805522011611776:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3499us (3558us total) trans 4296061566 rc 0/0 00000004:00080000:0.0:1721880422.224718:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b8bea00/2, rc 0, transno 1094270 00000100:00100000:1.0:1721880422.224719:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631745 00000100:00100000:0.0:1721880422.224743:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007b8bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011611776:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.224759:0:16110:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727b58c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.224767:0:16110:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727b58c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.224774:0:16110:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727b58c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.224781:0:16110:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727b58c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.224787:0:16110:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727b58c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.224797:0:16110:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106f840 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.224800:0:16110:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727b58c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.224805:0:16110:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727b58c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.224815:0:16110:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727b58c lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xff24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.224821:0:16110:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727b58c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.224893:0:16130:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d123b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0001_UUID:16130:1805522011613568:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.224907:0:16130:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727b59a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xff26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.224934:0:16110:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b8bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_094:lustre-MDT0000-mdtlov_UUID+1809:3686:x1805522011612288:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3635us (3713us total) trans 4296019869 rc 0/0 00000100:00100000:1.0:1721880422.224939:0:16110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631747 00000100:00100000:2.0:1721880422.224939:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000004:00080000:0.0:1721880422.224941:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009bd8a680/2, rc 0, transno 1052573 00000100:00100000:0.0:1721880422.224948:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009bd8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011612288:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.224948:0:16110:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011616512 00000100:00100000:1.0:1721880422.224950:0:16110:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011616512 00000100:00100000:2.0:1721880422.224957:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257667968 00000100:00100000:1.0:1721880422.224960:0:16110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631761 00000100:00100000:2.0:1721880422.224961:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257667968 00000100:00100000:1.0:1721880422.224962:0:16110:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fde2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_094:lustre-MDT0000-mdtlov_UUID+2625:3689:x1805522011616512:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1721880422.224972:0:16110:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58011 count 1 00000100:00100000:0.0:1721880422.224973:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1721880422.224974:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800992c3a80/0x8a60d30f571ec0e2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a611 expref: 2225 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.224979:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800919c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011616640:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.224979:0:16110:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009106df80/0x8a60d30f5727b5ee lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe29b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.224987:0:16110:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fc68fc0/0x8a60d30f571eaab5 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12926f expref: 430 pid: 15497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.224995:0:16110:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.224996:0:16110:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.224997:0:16110:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009106df80/0x8a60d30f5727b5ee lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.224998:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.225002:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913942 00010000:00010000:1.0:1721880422.225007:0:16110:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fc68fc0/0x8a60d30f571eaab5 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12926f expref: 430 pid: 15497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.225007:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:262d1f41-ba81-41c5-b215-67c74ea63f50+2224:2004:x1805522257667968:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.225027:0:16110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fc68fc0/0x8a60d30f571eaab5 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12926f expref: 430 pid: 15497 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.225028:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1721880422.225031:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011616640 00000100:00100000:0.0:1721880422.225033:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011616640 00010000:00010000:2.0:1721880422.225033:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800992c3a80/0x8a60d30f571ec0e2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a611 expref: 2224 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.225034:0:16110:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e616d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_094:lustre-OST0000_UUID:16110:1805522011616768:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.225042:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800992c3a80/0x8a60d30f571ec0e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a611 expref: 2224 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.225046:0:16110:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb600 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.225050:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631762 00010000:00010000:2.0:1721880422.225052:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800992c3a80/0x8a60d30f571ec0e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a611 expref: 2224 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.225054:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+1809:3687:x1805522011616640:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.225060:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.225061:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.225063:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727b59a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1721880422.225065:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64186 count 1 00010000:00010000:2.0:1721880422.225068:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727b59a lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xff26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.225076:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727b5f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfaba:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.225087:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.225093:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801313f2640/0x8a60d30f5716cee4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfaba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f897d expref: 1446 pid: 16127 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.225099:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.225099:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2004:x1805522257667968:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 91us (162us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.225100:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.225103:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727b5f5 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfaba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.225103:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913942 00010000:00010000:0.0:1721880422.225115:0:16130:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727b59a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.225118:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727b593 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.225121:0:9458:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b8bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1810:3688:x1805522011612032:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4115us (4165us total) trans 4296019870 rc 0/0 00010000:00010000:0.0:1721880422.225122:0:16130:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727b59a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.225123:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727b593 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.225126:0:9458:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631743 00010000:00010000:2.0:1721880422.225128:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727b593 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.225129:0:16130:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727b59a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xff26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.225131:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727b593 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.225135:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727b593 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.225136:0:16130:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727b59a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xff26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.225138:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352400 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.225140:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727b593 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.225142:0:16130:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727b59a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.225145:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727b593 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.225146:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b8bce00/2, rc 0, transno 1052574 00010000:00010000:0.0:1721880422.225148:0:16130:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325dd40 already unused, calling callback (ffffffffa084e330) 00000100:00100000:1.0:1721880422.225150:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007b8bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011612032:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.225151:0:16130:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727b59a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xff26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.225159:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727b593 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xff25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.225163:0:16130:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727b59a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xff26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.225165:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727b593 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.225174:0:16130:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727b59a lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xff26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.225175:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e617100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011616896:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.225180:0:16130:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727b59a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xff26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.225188:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.225211:0:9458:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011616896 00000100:00100000:1.0:1721880422.225214:0:9458:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011616896 00000100:00100000:1.0:1721880422.225228:0:9458:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631763 00000100:00100000:1.0:1721880422.225233:0:9458:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e617b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1812:3687:x1805522011616896:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.225244:0:9458:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64187 count 1 00010000:00010000:1.0:1721880422.225254:0:9458:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106fcc0/0x8a60d30f5727b5fc lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfabb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.225264:0:9458:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ee6f840/0x8a60d30f5716d14c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfabb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f8a1e expref: 1446 pid: 16127 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.225271:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.225272:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.225274:0:9458:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106fcc0/0x8a60d30f5727b5fc lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfabb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.225281:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+1812:3688:x1805522011613184:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2737us (2781us total) trans 4296019871 rc 0/0 00000100:00100000:2.0:1721880422.225288:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631748 00010000:00010000:1.0:1721880422.225291:0:9458:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ee6f840/0x8a60d30f5716d14c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfabb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f8a1e expref: 1446 pid: 16127 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.225296:0:16130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0000-mdtlov_UUID+1811:3689:x1805522011613312:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2742us (2783us total) trans 4296019872 rc 0/0 00010000:00010000:1.0:1721880422.225299:0:9458:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ee6f840/0x8a60d30f5716d14c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfabb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f8a1e expref: 1446 pid: 16127 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.225301:0:16130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631749 00000100:00100000:1.0:1721880422.225309:0:9458:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e617800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011617024:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.225329:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801313f2640/0x8a60d30f5716cee4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f897d expref: 1446 pid: 16127 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.225332:0:9458:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb300 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.225335:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801313f2640/0x8a60d30f5716cee4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f897d expref: 1446 pid: 16127 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.225342:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800919c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011617152:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.225357:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36780 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.225386:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011617280 00000100:00100000:2.0:1721880422.225390:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011617280 00000100:00100000:2.0:1721880422.225405:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631764 00000004:00080000:1.0:1721880422.225410:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088dc2a00/2, rc 0, transno 1052575 00000100:00100000:2.0:1721880422.225410:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+1811:3689:x1805522011617280:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.225419:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088dc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011613184:0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.225420:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64188 count 1 00010000:00010000:2.0:1721880422.225432:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727b603 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfabc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.225443:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801357e7840/0x8a60d30f5716d2f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfabc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f8aa3 expref: 1446 pid: 15545 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.225448:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011617408:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.225449:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.225451:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.225453:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727b603 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfabc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.225469:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.225469:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801357e7840/0x8a60d30f5716d2f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfabc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f8aa3 expref: 1446 pid: 15545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.225483:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801357e7840/0x8a60d30f5716d2f7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfabc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f8aa3 expref: 1446 pid: 15545 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.225488:0:15514:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011617408 00000100:00100000:1.0:1721880422.225491:0:15514:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011617408 00000100:00100000:2.0:1721880422.225492:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099eb0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011617536:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.225506:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631765 00000100:00100000:1.0:1721880422.225510:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+1812:3689:x1805522011617408:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.225514:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03d80 going to sleep for 11 seconds 00002000:00080000:1.0:1721880422.225519:0:15514:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64189 count 1 00010000:00010000:1.0:1721880422.225529:0:15514:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727b60a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfabd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.225539:0:15514:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012020c240/0x8a60d30f5716d59e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfabd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f8b52 expref: 1446 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.225545:0:15514:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.225546:0:15514:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.225548:0:15514:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727b60a lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfabd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.225565:0:15514:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012020c240/0x8a60d30f5716d59e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfabd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f8b52 expref: 1446 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.225574:0:15514:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012020c240/0x8a60d30f5716d59e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfabd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f8b52 expref: 1446 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.225584:0:15514:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e615180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:15514:1805522011617664:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.225617:0:15514:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302ebc00 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.226559:0:16098:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b086a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0000_UUID:16098:1805522011615232:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.226567:0:16040:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099eb2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_040:lustre-OST0000_UUID:16040:1805522011614208:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.226576:0:16113:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088dc1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0000_UUID:16113:1805522011614592:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.226579:0:16098:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325e880/0x8a60d30f5727b5bd lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.226584:0:16040:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136353840/0x8a60d30f5727b5a1 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe294:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.226592:0:16113:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009106d200/0x8a60d30f5727b5af lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe295:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.226607:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.226618:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008876c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:15453:1805522011614464:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.226622:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.226622:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257668096 00000100:00100000:2.0:1721880422.226625:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257668096 00010000:00010000:1.0:1721880422.226632:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325f840/0x8a60d30f5727b5a8 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.226642:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801203e7840/0x8a60d30f571ea743 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1290cb expref: 431 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.226650:0:16088:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a052e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011615104:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.226652:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.226662:0:16088:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106db00/0x8a60d30f5727b5b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfab6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.226669:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257668352 00000100:00100000:2.0:1721880422.226672:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257668352 00000100:00100000:1.0:1721880422.226677:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257668224 00000100:00100000:1.0:1721880422.226681:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257668224 00000100:00100000:0.0:1721880422.226682:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.226682:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913943 00000100:00100000:2.0:1721880422.226687:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8065450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+433:2005:x1805522257668096:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.226695:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f145680/0x8a60d30f571ea5d7 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe294:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12902a expref: 433 pid: 16098 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.226696:0:15473:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1721880422.226698:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.226699:0:15473:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801203e7840/0x8a60d30f571ea743 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe296:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1290cb expref: 433 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.226709:0:15473:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801203e7840/0x8a60d30f571ea743 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe296:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1290cb expref: 433 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.226713:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257668608 00000100:00100000:1.0:1721880422.226716:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257668608 00000100:00100000:0.0:1721880422.226723:0:8271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913944 00010000:00010000:1.0:1721880422.226725:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801203e7600/0x8a60d30f571ea7cf lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129118 expref: 434 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.226726:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801203e7840/0x8a60d30f571ea743 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe296:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1290cb expref: 434 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.226746:0:8271:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+434:2004:x1805522257668224:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.226752:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.226753:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.226754:0:8271:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.226755:0:15473:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009325f840/0x8a60d30f5727b5a8 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.226759:0:8271:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f145680/0x8a60d30f571ea5d7 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe294:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12902a expref: 433 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.226760:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913945 00010000:00010000:2.0:1721880422.226760:0:15473:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325f840/0x8a60d30f5727b5a8 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe296:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.226767:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+433:2006:x1805522257668608:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.226768:0:8271:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f145680/0x8a60d30f571ea5d7 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe294:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12902a expref: 433 pid: 16098 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.226771:0:15473:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.226787:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.226790:0:15473:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8065450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+433:2005:x1805522257668096:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 103us (184us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.226791:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801203e7600/0x8a60d30f571ea7cf lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe297:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129118 expref: 433 pid: 16053 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.226795:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913943 00010000:00010000:1.0:1721880422.226800:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801203e7600/0x8a60d30f571ea7cf lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe297:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129118 expref: 433 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.226813:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801203e7600/0x8a60d30f571ea7cf lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe297:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129118 expref: 432 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.226823:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.226825:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.226828:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009325e880/0x8a60d30f5727b5bd lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.226834:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325e880/0x8a60d30f5727b5bd lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe297:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.226839:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c4ceac0/0x8a60d30f571ea694 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe295:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129077 expref: 431 pid: 16028 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.226850:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.226869:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+431:2006:x1805522257668608:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 102us (170us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.226874:0:8271:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f145680/0x8a60d30f571ea5d7 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe294:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12902a expref: 431 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.226876:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913945 00010000:00010000:0.0:1721880422.226886:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.226888:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.226890:0:8271:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136353840/0x8a60d30f5727b5a1 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe294:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.226897:0:8271:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136353840/0x8a60d30f5727b5a1 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe294:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.226897:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325f840/0x8a60d30f5727b5a8 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.226905:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325f840/0x8a60d30f5727b5a8 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.226912:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325f840/0x8a60d30f5727b5a8 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.226918:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325f840/0x8a60d30f5727b5a8 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.226924:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325f840/0x8a60d30f5727b5a8 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.226930:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325f840 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.226933:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325f840/0x8a60d30f5727b5a8 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.226944:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325f840/0x8a60d30f5727b5a8 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.226952:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325f840/0x8a60d30f5727b5a8 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.226959:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325f840/0x8a60d30f5727b5a8 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.226969:0:8271:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.226974:0:16040:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136353840/0x8a60d30f5727b5a1 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.226981:0:16040:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136353840/0x8a60d30f5727b5a1 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.226988:0:16040:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136353840/0x8a60d30f5727b5a1 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.226990:0:8271:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+427:2004:x1805522257668224:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 261us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.226996:0:8271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913944 00010000:00010000:2.0:1721880422.226999:0:16040:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136353840/0x8a60d30f5727b5a1 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.227006:0:16040:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136353840/0x8a60d30f5727b5a1 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.227026:0:16040:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353840 already unused, calling callback (ffffffffa084e330) 00000100:00100000:0.0:1721880422.227029:0:8271:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257668736 00010000:00010000:2.0:1721880422.227030:0:16040:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136353840/0x8a60d30f5727b5a1 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.227033:0:8271:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257668736 00010000:00010000:2.0:1721880422.227037:0:16040:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136353840/0x8a60d30f5727b5a1 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.227045:0:8271:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a7dad00/0x8a60d30f5716ca0d lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfab8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f8842 expref: 1446 pid: 16109 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.227047:0:16040:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136353840/0x8a60d30f5727b5a1 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.227054:0:16040:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136353840/0x8a60d30f5727b5a1 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.227062:0:8271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913948 00000100:00100000:0.0:1721880422.227067:0:8271:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094636d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+1446:2005:x1805522257668736:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.227087:0:8271:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.227092:0:8271:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a7dad00/0x8a60d30f5716ca0d lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfab8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f8842 expref: 1446 pid: 16109 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.227103:0:8271:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a7dad00/0x8a60d30f5716ca0d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfab8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f8842 expref: 1446 pid: 16109 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.227104:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088db5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2626:3688:x1805522011613952:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2976us (3059us total) trans 4296061567 rc 0/0 00000100:00100000:1.0:1721880422.227111:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631751 00010000:00010000:0.0:1721880422.227114:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.227116:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.227119:0:8271:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727b5c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfab8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.227126:0:8271:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727b5c4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfab8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.227132:0:16113:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009106d200/0x8a60d30f5727b5af lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.227138:0:16113:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009106d200/0x8a60d30f5727b5af lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.227143:0:8271:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.227144:0:16113:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009106d200/0x8a60d30f5727b5af lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.227150:0:16113:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009106d200/0x8a60d30f5727b5af lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.227156:0:16113:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009106d200/0x8a60d30f5727b5af lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.227166:0:8271:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094636d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+1446:2005:x1805522257668736:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 99us (157us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.227166:0:16113:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106d200 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.227168:0:16113:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009106d200/0x8a60d30f5727b5af lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.227173:0:8271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913948 00010000:00010000:1.0:1721880422.227175:0:16113:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009106d200/0x8a60d30f5727b5af lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.227183:0:16040:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088db6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:lustre-MDT0000-mdtlov_UUID+2626:3686:x1805522011613696:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3180us (3237us total) trans 4296061568 rc 0/0 00010000:00010000:1.0:1721880422.227184:0:16113:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009106d200/0x8a60d30f5727b5af lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.227189:0:16040:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631750 00010000:00010000:1.0:1721880422.227190:0:16113:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009106d200/0x8a60d30f5727b5af lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.227194:0:16098:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325e880/0x8a60d30f5727b5bd lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.227202:0:16098:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325e880/0x8a60d30f5727b5bd lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.227209:0:16098:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325e880/0x8a60d30f5727b5bd lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.227216:0:16098:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325e880/0x8a60d30f5727b5bd lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.227220:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a7dad00/0x8a60d30f5716ca0d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfab8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f8842 expref: 1445 pid: 16109 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.227223:0:16098:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325e880/0x8a60d30f5727b5bd lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.227229:0:16098:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325e880 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.227232:0:16098:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325e880/0x8a60d30f5727b5bd lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.227232:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099eb2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011615360:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.227239:0:16098:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325e880/0x8a60d30f5727b5bd lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.227247:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727b5c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfab8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.227253:0:16098:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325e880/0x8a60d30f5727b5bd lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.227253:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727b5c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfab8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.227259:0:16098:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325e880/0x8a60d30f5727b5bd lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.227259:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727b5c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfab8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.227266:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727b5c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfab8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.227273:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727b5c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfab8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.227279:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727b5c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfab8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.227285:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801363521c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.227288:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727b5c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfab8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.227295:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727b5c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfab8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.227300:0:16113:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0000-mdtlov_UUID+2626:3687:x1805522011613824:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3161us (3201us total) trans 4296061569 rc 0/0 00010000:00010000:2.0:1721880422.227305:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727b5c4 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfab8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.227306:0:16113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631752 00010000:00010000:2.0:1721880422.227316:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727b5c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfab8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.227324:0:16088:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106db00/0x8a60d30f5727b5b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfab6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.227331:0:16088:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106db00/0x8a60d30f5727b5b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfab6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.227338:0:16088:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106db00/0x8a60d30f5727b5b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfab6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.227345:0:16088:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106db00/0x8a60d30f5727b5b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfab6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.227352:0:16088:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106db00/0x8a60d30f5727b5b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfab6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.227357:0:16088:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106db00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.227360:0:16088:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106db00/0x8a60d30f5727b5b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfab6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.227365:0:16088:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106db00/0x8a60d30f5727b5b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfab6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.227375:0:16088:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106db00/0x8a60d30f5727b5b6 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfab6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.227379:0:16098:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880134dc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0000-mdtlov_UUID+2627:3686:x1805522011614336:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3074us (3116us total) trans 4296061570 rc 0/0 00010000:00010000:1.0:1721880422.227380:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106db00/0x8a60d30f5727b5b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfab6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.227386:0:16098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631754 00000004:00080000:0.0:1721880422.227416:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088db4000/2, rc 0, transno 1094274 00000100:00100000:0.0:1721880422.227424:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088db4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011614336:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.227426:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1813:3689:x1805522011614848:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3117us (3159us total) trans 4296019873 rc 0/0 00000100:00100000:2.0:1721880422.227431:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631755 00000004:00080000:0.0:1721880422.227463:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009b087b80/2, rc 0, transno 1052577 00000100:00100000:2.0:1721880422.227472:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.227476:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b087b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011614848:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.227482:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257668992 00000100:00100000:2.0:1721880422.227485:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257668992 00000004:00080000:0.0:1721880422.227491:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d123480/2, rc 0, transno 1094272 00000100:00100000:0.0:1721880422.227496:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d123480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011613696:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1721880422.227497:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c9c4fc0/0x8a60d30f5716c6da lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfab7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f878c expref: 1444 pid: 16113 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.227515:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913951 00000100:00100000:0.0:1721880422.227516:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1721880422.227520:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099eb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1444:2005:x1805522257668992:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.227522:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800919c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011618048:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1721880422.227527:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.227531:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c9c4fc0/0x8a60d30f5716c6da lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfab7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f878c expref: 1444 pid: 16113 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.227539:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.227541:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c9c4fc0/0x8a60d30f5716c6da lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfab7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f878c expref: 1444 pid: 16113 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.227553:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c9c4fc0/0x8a60d30f5716c6da lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfab7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f878c expref: 1444 pid: 16113 timeout: 887 lvb_type: 0 00000004:00080000:0.0:1721880422.227554:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009b08f100/2, rc 0, transno 1094275 00000100:00100000:0.0:1721880422.227557:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b08f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011614976:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1721880422.227562:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1721880422.227563:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+1813:3689:x1805522011614080:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3274us (3322us total) trans 4296019874 rc 0/0 00010000:00010000:2.0:1721880422.227565:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.227567:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727b5d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfab7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.227570:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631753 00000004:00080000:0.0:1721880422.227574:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088db4700/2, rc 0, transno 1052578 00010000:00010000:2.0:1721880422.227574:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727b5d2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfab7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.227579:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088db4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011614080:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.227589:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.227594:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800919c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011618176:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.227606:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.227606:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099eb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1443:2005:x1805522257668992:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 85us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.227611:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913951 00000100:00100000:0.0:1721880422.227625:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800919c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011617792:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.227629:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011618176 00000100:00100000:2.0:1721880422.227632:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011618176 00000100:00100000:0.0:1721880422.227636:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.227643:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800919c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011618304:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.227645:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011617792 00000100:00100000:2.0:1721880422.227647:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011617792 00000100:00100000:0.0:1721880422.227651:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.227665:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011618304 00000100:00100000:2.0:1721880422.227668:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011618304 00000100:00100000:0.0:1721880422.227674:0:16130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631767 00000100:00100000:0.0:1721880422.227679:0:16130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0000-mdtlov_UUID+2628:3689:x1805522011618176:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.227688:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631768 00002000:00080000:0.0:1721880422.227692:0:16130:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58014 count 1 00000100:00100000:2.0:1721880422.227692:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2628:3686:x1805522011617792:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.227703:0:16130:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325cfc0/0x8a60d30f5727b618 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe29e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.227704:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58012 count 1 00010000:00010000:0.0:1721880422.227714:0:16130:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800929f9200/0x8a60d30f571eacb4 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe29e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129356 expref: 425 pid: 16019 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.227714:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011617920:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.227716:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136351b00/0x8a60d30f5727b61f lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe29c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.227720:0:16130:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.227722:0:16130:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.227724:0:16130:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325cfc0/0x8a60d30f5727b618 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe29e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.227747:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007bb15440/0x8a60d30f571eab2c lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe29c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1292ae expref: 425 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.227754:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.227754:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.227755:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.227756:0:16130:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800929f9200/0x8a60d30f571eacb4 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe29e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129356 expref: 425 pid: 16019 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.227758:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136351b00/0x8a60d30f5727b61f lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe29c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.227764:0:16130:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800929f9200/0x8a60d30f571eacb4 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe29e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129356 expref: 425 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.227773:0:16130:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b086a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0000_UUID:16130:1805522011618560:192.168.201.24@tcp:104: 00000004:00080000:1.0:1721880422.227776:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d122300/2, rc 0, transno 1094273 00000100:00100000:2.0:1721880422.227783:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011617920 00000100:00100000:1.0:1721880422.227784:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d122300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011613824:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.227787:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011617920 00000100:00100000:0.0:1721880422.227793:0:16130:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36a80 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.227805:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631770 00000100:00100000:2.0:1721880422.227809:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e616a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1814:3687:x1805522011617920:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.227814:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00002000:00080000:2.0:1721880422.227820:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64190 count 1 00000100:00100000:0.0:1721880422.227821:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e614380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011618816:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1721880422.227830:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727b62d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfabe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.227838:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b8bc000/2, rc 0, transno 1094271 00010000:00010000:2.0:1721880422.227840:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095d77840/0x8a60d30f5716d829 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfabe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f8bd7 expref: 1442 pid: 11675 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.227841:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.227845:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007b8bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011613952:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1721880422.227847:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.227848:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.227850:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727b62d lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfabe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.227867:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095d77840/0x8a60d30f5716d829 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfabe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f8bd7 expref: 1442 pid: 11675 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.227874:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011618816 00000100:00100000:1.0:1721880422.227877:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011618816 00010000:00010000:2.0:1721880422.227878:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095d77840/0x8a60d30f5716d829 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfabe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f8bd7 expref: 1442 pid: 11675 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.227888:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099eb0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011619072:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.227894:0:16113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631771 00000100:00100000:1.0:1721880422.227898:0:16113:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0000-mdtlov_UUID+2629:3686:x1805522011618816:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.227908:0:16120:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099eb3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16120:1805522011616256:192.168.201.24@tcp:104: 00002000:00080000:1.0:1721880422.227910:0:16113:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58015 count 1 00000100:00100000:0.0:1721880422.227919:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.227920:0:16113:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009106c900/0x8a60d30f5727b634 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe29f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.227920:0:16120:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136353a80/0x8a60d30f5727b5e0 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe29a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.227928:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257669376 00010000:00010000:1.0:1721880422.227930:0:16113:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880132b13180/0x8a60d30f571ead47 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe29f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1293a3 expref: 425 pid: 9459 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.227931:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257669376 00010000:00010000:1.0:1721880422.227936:0:16113:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.227937:0:16113:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.227939:0:16113:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009106c900/0x8a60d30f5727b634 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe29f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.227942:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800941821c0/0x8a60d30f571eaa30 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe29a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129229 expref: 426 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.227945:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03480 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.227955:0:16113:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880132b13180/0x8a60d30f571ead47 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe29f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1293a3 expref: 426 pid: 9459 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.227957:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913952 00000100:00100000:0.0:1721880422.227962:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d123b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+426:2004:x1805522257669376:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.227965:0:16113:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880132b13180/0x8a60d30f571ead47 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe29f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1293a3 expref: 426 pid: 9459 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.227968:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.227972:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800941821c0/0x8a60d30f571eaa30 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe29a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129229 expref: 426 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.227972:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007bb15440/0x8a60d30f571eab2c lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe29c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1292ae expref: 426 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.227976:0:16113:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b08ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0000_UUID:16113:1805522011619200:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.227981:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800941821c0/0x8a60d30f571eaa30 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe29a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129229 expref: 426 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.227982:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007bb15440/0x8a60d30f571eab2c lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe29c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1292ae expref: 426 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.227990:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099eb3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:15466:1805522011619328:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.227992:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941821c0/0x8a60d30f571eaa30 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe29a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129229 expref: 426 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.227992:0:16113:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb0c0 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.228001:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.228003:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.228003:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03540 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.228005:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136353a80/0x8a60d30f5727b5e0 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe29a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.228029:0:16110:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e616d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_094:lustre-OST0000_UUID:16110:1805522011616768:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.228031:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136353a80/0x8a60d30f5727b5e0 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe29a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.228046:0:16110:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009106df80/0x8a60d30f5727b5ee lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe29b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.228047:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.228051:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.228063:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d123b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+425:2004:x1805522257669376:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 100us (143us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.228063:0:16120:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136353a80/0x8a60d30f5727b5e0 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.228069:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913952 00010000:00010000:2.0:1721880422.228069:0:16120:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136353a80/0x8a60d30f5727b5e0 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.228071:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b08f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011618944:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1721880422.228077:0:16120:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136353a80/0x8a60d30f5727b5e0 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.228079:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257669248 00000100:00100000:0.0:1721880422.228081:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257669248 00010000:00010000:2.0:1721880422.228084:0:16120:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136353a80/0x8a60d30f5727b5e0 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.228089:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ea7c900/0x8a60d30f571ea981 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe299:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1291d5 expref: 425 pid: 16128 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.228091:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.228091:0:16120:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136353a80/0x8a60d30f5727b5e0 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.228101:0:16120:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353a80 already unused, calling callback (ffffffffa084e330) 00000100:00100000:0.0:1721880422.228102:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913953 00010000:00010000:2.0:1721880422.228104:0:16120:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136353a80/0x8a60d30f5727b5e0 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.228106:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+425:2005:x1805522257669248:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.228110:0:16120:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136353a80/0x8a60d30f5727b5e0 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.228111:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.228111:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011618944 00010000:00010000:0.0:1721880422.228114:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ea7c900/0x8a60d30f571ea981 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe299:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1291d5 expref: 425 pid: 16128 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.228114:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011618944 00010000:00010000:2.0:1721880422.228120:0:16120:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136353a80/0x8a60d30f5727b5e0 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.228122:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ea7c900/0x8a60d30f571ea981 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe299:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1291d5 expref: 425 pid: 16128 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.228126:0:16120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136353a80/0x8a60d30f5727b5e0 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.228128:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631772 00010000:00010000:0.0:1721880422.228131:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.228132:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1721880422.228132:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e616d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2630:3688:x1805522011618944:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.228135:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009325e400/0x8a60d30f5727b5e7 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe299:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.228143:0:16088:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58016 count 1 00010000:00010000:0.0:1721880422.228145:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325e400/0x8a60d30f5727b5e7 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe299:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.228152:0:16088:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009106f600/0x8a60d30f5727b63b lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2a0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.228154:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.228162:0:16088:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ed8cfc0/0x8a60d30f571eae0b lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1293f7 expref: 425 pid: 9459 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.228163:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+425:2005:x1805522257669248:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 56us (118us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.228168:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1721880422.228169:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913953 00010000:00010000:1.0:1721880422.228170:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.228172:0:16088:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009106f600/0x8a60d30f5727b63b lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.228187:0:16088:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ed8cfc0/0x8a60d30f571eae0b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1293f7 expref: 424 pid: 9459 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.228196:0:16088:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ed8cfc0/0x8a60d30f571eae0b lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1293f7 expref: 424 pid: 9459 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.228204:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ea7c900/0x8a60d30f571ea981 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe299:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1291d5 expref: 424 pid: 16128 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.228206:0:16088:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007b8bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0000_UUID:16088:1805522011619456:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.228214:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800919c2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0000_UUID:16089:1805522011616384:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.228224:0:16088:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb600 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.228228:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325e400/0x8a60d30f5727b5e7 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.228236:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325e400/0x8a60d30f5727b5e7 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.228242:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325e400/0x8a60d30f5727b5e7 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.228247:0:9458:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e617800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011617024:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.228250:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325e400/0x8a60d30f5727b5e7 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.228257:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325e400/0x8a60d30f5727b5e7 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.228260:0:9458:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106fcc0/0x8a60d30f5727b5fc lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfabb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.228263:0:16120:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+2631:3688:x1805522011616000:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3711us (3742us total) trans 4296061572 rc 0/0 00010000:00010000:0.0:1721880422.228269:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325e400/0x8a60d30f5727b5e7 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.228270:0:16120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631760 00010000:00010000:0.0:1721880422.228275:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325e400 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.228278:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325e400/0x8a60d30f5727b5e7 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.228282:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e614e00/2, rc 0, transno 1094276 00010000:00010000:0.0:1721880422.228284:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325e400/0x8a60d30f5727b5e7 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.228288:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e614e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011616000:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.228290:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257669632 00000100:00100000:1.0:1721880422.228292:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1721880422.228294:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325e400/0x8a60d30f5727b5e7 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.228294:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257669632 00010000:00010000:0.0:1721880422.228299:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325e400/0x8a60d30f5727b5e7 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.228307:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee6f840/0x8a60d30f5716d14c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfabb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f8a1e expref: 1443 pid: 16127 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.228314:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011619584:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.228325:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913954 00000100:00100000:2.0:1721880422.228329:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094634000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1443:2004:x1805522257669632:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.228333:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.228336:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.228340:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ee6f840/0x8a60d30f5716d14c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfabb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f8a1e expref: 1443 pid: 16127 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.228350:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ee6f840/0x8a60d30f5716d14c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfabb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f8a1e expref: 1443 pid: 16127 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.228363:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee6f840/0x8a60d30f5716d14c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfabb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f8a1e expref: 1443 pid: 16127 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.228372:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.228374:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.228376:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106fcc0/0x8a60d30f5727b5fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfabb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.228383:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106fcc0/0x8a60d30f5727b5fc lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfabb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.228397:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.228402:0:16110:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009106df80/0x8a60d30f5727b5ee lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.228409:0:16110:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009106df80/0x8a60d30f5727b5ee lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.228411:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094634000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1442:2004:x1805522257669632:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 81us (126us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.228415:0:16110:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009106df80/0x8a60d30f5727b5ee lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.228417:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913954 00010000:00010000:1.0:1721880422.228421:0:16110:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009106df80/0x8a60d30f5727b5ee lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.228427:0:16110:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009106df80/0x8a60d30f5727b5ee lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.228432:0:16110:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106df80 already unused, calling callback (ffffffffa084e330) 00000100:00100000:0.0:1721880422.228435:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e616300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2631:3687:x1805522011615872:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3886us (3928us total) trans 4296061573 rc 0/0 00010000:00010000:1.0:1721880422.228435:0:16110:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009106df80/0x8a60d30f5727b5ee lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.228441:0:16120:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011619584 00000100:00100000:0.0:1721880422.228442:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631759 00010000:00010000:1.0:1721880422.228442:0:16110:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009106df80/0x8a60d30f5727b5ee lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.228445:0:16120:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011619584 00010000:00010000:1.0:1721880422.228451:0:16110:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009106df80/0x8a60d30f5727b5ee lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.228454:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011619712 00010000:00010000:1.0:1721880422.228456:0:16110:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009106df80/0x8a60d30f5727b5ee lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.228457:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011619712 00000100:00100000:2.0:1721880422.228462:0:16120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631773 00000100:00100000:2.0:1721880422.228466:0:16120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b8bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+1815:3688:x1805522011619584:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.228473:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631774 00000100:00100000:0.0:1721880422.228477:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cd23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2631:3687:x1805522011619712:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1721880422.228477:0:16120:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64192 count 1 00002000:00080000:0.0:1721880422.228488:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58017 count 1 00010000:00010000:2.0:1721880422.228488:0:16120:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727b642 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfac0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.228498:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325db00/0x8a60d30f5727b649 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2a1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.228504:0:16120:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0629680/0x8a60d30f5716de1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfac0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f8d74 expref: 1441 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.228510:0:16120:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.228511:0:16120:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.228514:0:16120:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727b642 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfac0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.228515:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008425fcc0/0x8a60d30f571eaeac lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129452 expref: 422 pid: 15497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.228521:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.228522:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.228525:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325db00/0x8a60d30f5727b649 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.228529:0:16120:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0629680/0x8a60d30f5716de1f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfac0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f8d74 expref: 1441 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.228538:0:16120:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0629680/0x8a60d30f5716de1f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfac0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f8d74 expref: 1441 pid: 16125 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.228541:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008425fcc0/0x8a60d30f571eaeac lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129452 expref: 422 pid: 15497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.228547:0:16110:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fde2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_094:lustre-MDT0000-mdtlov_UUID+2633:3689:x1805522011616512:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3583us (3732us total) trans 4296061574 rc 0/0 00000100:00100000:2.0:1721880422.228548:0:16120:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099eb2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0001_UUID:16120:1805522011619968:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.228551:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008425fcc0/0x8a60d30f571eaeac lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129452 expref: 422 pid: 15497 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.228552:0:16110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631761 00000100:00100000:0.0:1721880422.228561:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800919c2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0000_UUID:16089:1805522011620096:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.228564:0:16120:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.228566:0:9458:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106fcc0/0x8a60d30f5727b5fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfabb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.228571:0:9458:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106fcc0/0x8a60d30f5727b5fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfabb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.228575:0:9458:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106fcc0/0x8a60d30f5727b5fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfabb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.228579:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec363c0 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.228579:0:9458:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106fcc0/0x8a60d30f5727b5fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfabb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.228582:0:9458:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106fcc0/0x8a60d30f5727b5fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfabb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.228586:0:9458:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106fcc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.228588:0:9458:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106fcc0/0x8a60d30f5727b5fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfabb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.228592:0:9458:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106fcc0/0x8a60d30f5727b5fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfabb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.228597:0:9458:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106fcc0/0x8a60d30f5727b5fc lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfabb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.228601:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800919c3100/2, rc 0, transno 1094278 00010000:00010000:1.0:1721880422.228601:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106fcc0/0x8a60d30f5727b5fc lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfabb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.228610:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800919c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011616512:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1721880422.228629:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800919c0a80/2, rc 0, transno 1052580 00000100:00100000:0.0:1721880422.228637:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800919c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011615616:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.228640:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.228652:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257669760 00000100:00100000:0.0:1721880422.228653:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800919c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011617152:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.228654:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257669760 00010000:00010000:0.0:1721880422.228666:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727b5f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfaba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.228666:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801313f2640/0x8a60d30f5716cee4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f897d expref: 1442 pid: 16127 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.228682:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913956 00000100:00100000:2.0:1721880422.228687:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099eb1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1442:2005:x1805522257669760:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.228695:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.228699:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801313f2640/0x8a60d30f5716cee4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f897d expref: 1442 pid: 16127 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.228702:0:9458:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e617b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1816:3687:x1805522011616896:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3467us (3512us total) trans 4296019877 rc 0/0 00010000:00010000:2.0:1721880422.228708:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801313f2640/0x8a60d30f5716cee4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f897d expref: 1442 pid: 16127 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.228710:0:9458:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631763 00010000:00010000:2.0:1721880422.228721:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801313f2640/0x8a60d30f5716cee4 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfaba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f897d expref: 1442 pid: 16127 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.228749:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.228750:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.228752:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.228755:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727b5f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.228762:0:15514:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e615180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:15514:1805522011617664:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.228762:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727b5f5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfaba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.228764:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257669888 00000100:00100000:0.0:1721880422.228767:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257669888 00010000:00010000:1.0:1721880422.228776:0:15514:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727b60a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfabd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.228776:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.228779:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801357e7840/0x8a60d30f5716d2f7 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfabc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f8aa3 expref: 1442 pid: 15545 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.228790:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099eb1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1442:2005:x1805522257669760:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 102us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.228797:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913956 00000100:00100000:0.0:1721880422.228803:0:8271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913957 00000100:00100000:0.0:1721880422.228807:0:8271:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ab4d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+1442:2004:x1805522257669888:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.228815:0:8271:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.228819:0:8271:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801357e7840/0x8a60d30f5716d2f7 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfabc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f8aa3 expref: 1441 pid: 15545 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.228829:0:8271:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801357e7840/0x8a60d30f5716d2f7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfabc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f8aa3 expref: 1441 pid: 15545 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.228840:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.228842:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.228845:0:8271:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727b603 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfabc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.228852:0:8271:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727b603 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfabc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.228862:0:8271:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.228876:0:8271:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ab4d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+1441:2004:x1805522257669888:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 67us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.228886:0:8271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913957 00010000:00010000:2.0:1721880422.228913:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801357e7840/0x8a60d30f5716d2f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfabc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f8aa3 expref: 1440 pid: 15545 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.228920:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727b5f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.228925:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099eb0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011617536:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.228928:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727b5f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.228935:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727b5f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.228937:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727b603 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfabc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.228943:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727b5f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfaba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.228949:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727b603 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfabc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.228950:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727b5f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.228956:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325cb40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.228956:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727b603 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfabc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.228959:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727b5f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.228964:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727b603 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfabc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.228968:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727b5f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.228971:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727b603 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfabc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.228976:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e617100/2, rc 0, transno 1052581 00010000:00010000:0.0:1721880422.228977:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727b5f5 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfaba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.228977:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727b603 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfabc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.228983:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350b40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.228984:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727b5f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfaba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.228986:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727b603 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfabc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.228992:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e617100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011616896:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.228993:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727b603 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfabc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.229002:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727b603 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfabc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.229009:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727b603 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfabc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.229056:0:15514:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727b60a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfabd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.229068:0:15514:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727b60a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfabd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.229075:0:15514:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727b60a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfabd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.229082:0:15514:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727b60a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfabd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.229087:0:15514:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727b60a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfabd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.229092:0:15514:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106c480 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.229095:0:15514:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727b60a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfabd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.229101:0:15514:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727b60a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfabd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.229110:0:15514:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727b60a lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfabd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.229116:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727b60a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfabd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.229129:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+1818:3687:x1805522011616640:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4072us (4128us total) trans 4296019878 rc 0/0 00000100:00100000:0.0:1721880422.229136:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631762 00000100:00100000:2.0:1721880422.229152:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+1817:3689:x1805522011617280:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3740us (3780us total) trans 4296019879 rc 0/0 00000100:00100000:2.0:1721880422.229159:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631764 00000100:00100000:1.0:1721880422.229224:0:15514:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+1817:3689:x1805522011617408:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3712us (3753us total) trans 4296019880 rc 0/0 00000100:00100000:1.0:1721880422.229231:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631765 00000004:00080000:1.0:1721880422.229259:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800919c2a00/2, rc 0, transno 1052582 00000100:00100000:1.0:1721880422.229263:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800919c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011616640:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.229271:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099eb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011620992:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.229289:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.229316:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1721880422.229322:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009f52e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011620864:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.229330:0:16040:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011620992 00000100:00100000:2.0:1721880422.229334:0:16040:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011620992 00000100:00100000:1.0:1721880422.229335:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.229345:0:15514:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011621248 00000100:00100000:0.0:1721880422.229349:0:15514:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011621248 00000100:00100000:2.0:1721880422.229358:0:16040:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631778 00000100:00100000:2.0:1721880422.229363:0:16040:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e615180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:lustre-MDT0000-mdtlov_UUID+1819:3687:x1805522011620992:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.229375:0:16040:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64195 count 1 00000100:00100000:0.0:1721880422.229376:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631780 00000100:00100000:0.0:1721880422.229382:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e617800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+1819:3687:x1805522011620864:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.229386:0:16040:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727b665 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfac3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1721880422.229395:0:15514:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64194 count 1 00010000:00010000:2.0:1721880422.229397:0:16040:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801364c3180/0x8a60d30f5716fd36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfac3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fa656 expref: 1438 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.229403:0:16040:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.229405:0:16040:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.229406:0:15514:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727b673 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfac2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.229407:0:16040:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727b665 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfac3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.229418:0:15514:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b69c900/0x8a60d30f5716fb4c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfac2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fa5ca expref: 1438 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.229424:0:15514:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.229425:0:16040:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801364c3180/0x8a60d30f5716fd36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfac3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fa656 expref: 1438 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.229426:0:15514:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.229428:0:15514:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727b673 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfac2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.229435:0:16040:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801364c3180/0x8a60d30f5716fd36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfac3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fa656 expref: 1438 pid: 15514 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.229443:0:15514:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b69c900/0x8a60d30f5716fb4c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfac2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fa5ca expref: 1438 pid: 16039 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.229445:0:16040:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099eb2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_040:lustre-OST0001_UUID:16040:1805522011621504:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.229453:0:15514:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b69c900/0x8a60d30f5716fb4c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfac2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fa5ca expref: 1438 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.229462:0:15514:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800919c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:15514:1805522011621632:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.229468:0:16040:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03d80 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.229483:0:15514:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36180 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.229483:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.229495:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011621120 00000100:00100000:0.0:1721880422.229498:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011621120 00000100:00100000:0.0:1721880422.229513:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631781 00000100:00100000:0.0:1721880422.229517:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099eb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+1820:3689:x1805522011621120:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.229527:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64196 count 1 00010000:00010000:0.0:1721880422.229536:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727b67a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfac4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.229545:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011f975d40/0x8a60d30f5716fec5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfac4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fa6fe expref: 1438 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.229552:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.229553:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.229555:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727b67a lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfac4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.229570:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011f975d40/0x8a60d30f5716fec5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfac4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fa6fe expref: 1438 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.229580:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011f975d40/0x8a60d30f5716fec5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfac4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fa6fe expref: 1438 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.229589:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d123b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011621760:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.229619:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36f00 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.230865:0:16130:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b086a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0000_UUID:16130:1805522011618560:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.230881:0:16130:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325cfc0/0x8a60d30f5727b618 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe29e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.230902:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099eb0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011619072:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.230913:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727b62d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfabe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.230929:0:16113:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b08ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0000_UUID:16113:1805522011619200:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.230932:0:16120:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099eb2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0001_UUID:16120:1805522011619968:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.230943:0:16120:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727b642 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfac0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.230945:0:16113:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009106c900/0x8a60d30f5727b634 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe29f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.230967:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099eb3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:15466:1805522011619328:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.230969:0:16088:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007b8bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0000_UUID:16088:1805522011619456:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.230977:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.230977:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136351b00/0x8a60d30f5727b61f lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe29c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.230981:0:16088:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009106f600/0x8a60d30f5727b63b lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.230992:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257670272 00000100:00100000:0.0:1721880422.230995:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257670272 00010000:00010000:0.0:1721880422.231007:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800929f9200/0x8a60d30f571eacb4 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe29e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129356 expref: 423 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.231048:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913959 00000100:00100000:0.0:1721880422.231054:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094637800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+423:2005:x1805522257670272:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.231063:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.231067:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800929f9200/0x8a60d30f571eacb4 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe29e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129356 expref: 423 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.231076:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800929f9200/0x8a60d30f571eacb4 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe29e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129356 expref: 423 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.231089:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800929f9200/0x8a60d30f571eacb4 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe29e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129356 expref: 423 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.231100:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.231101:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.231104:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009325cfc0/0x8a60d30f5727b618 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe29e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.231110:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325cfc0/0x8a60d30f5727b618 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe29e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.231131:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.231157:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094637800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+422:2005:x1805522257670272:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 102us (181us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.231159:0:16130:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325cfc0/0x8a60d30f5727b618 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.231164:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913959 00010000:00010000:2.0:1721880422.231167:0:16130:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325cfc0/0x8a60d30f5727b618 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.231175:0:16130:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325cfc0/0x8a60d30f5727b618 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.231183:0:16130:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325cfc0/0x8a60d30f5727b618 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.231189:0:16130:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325cfc0/0x8a60d30f5727b618 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.231192:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800919c2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0000_UUID:16089:1805522011620096:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.231193:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.231195:0:16130:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325cfc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.231198:0:16130:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325cfc0/0x8a60d30f5727b618 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.231204:0:16130:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325cfc0/0x8a60d30f5727b618 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.231205:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325db00/0x8a60d30f5727b649 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.231211:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257670528 00010000:00010000:2.0:1721880422.231214:0:16130:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325cfc0/0x8a60d30f5727b618 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.231215:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257670528 00010000:00010000:2.0:1721880422.231220:0:16130:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325cfc0/0x8a60d30f5727b618 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.231228:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095d77840/0x8a60d30f5716d829 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfabe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f8bd7 expref: 1439 pid: 11675 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.231237:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.231271:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.231272:0:8271:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257670784 00000100:00100000:1.0:1721880422.231275:0:8271:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257670784 00010000:00010000:1.0:1721880422.231285:0:8271:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007bb15440/0x8a60d30f571eab2c lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe29c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1292ae expref: 422 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.231286:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.231307:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.231316:0:8271:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257671296 00000100:00100000:1.0:1721880422.231319:0:8271:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257671296 00000100:00100000:2.0:1721880422.231323:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257671552 00000100:00100000:2.0:1721880422.231327:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257671552 00010000:00010000:1.0:1721880422.231329:0:8271:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009203d680/0x8a60d30f5716e1c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfac1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f8e5b expref: 1441 pid: 15440 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.231340:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130a2e1c0/0x8a60d30f571eafaf lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1294d7 expref: 423 pid: 16091 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.231346:0:8271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913961 00000100:00100000:0.0:1721880422.231348:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.231352:0:8271:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094636a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+423:2005:x1805522257670784:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.231360:0:8271:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.231365:0:8271:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007bb15440/0x8a60d30f571eab2c lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe29c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1292ae expref: 423 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.231371:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257670400 00010000:00010000:1.0:1721880422.231374:0:8271:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007bb15440/0x8a60d30f571eab2c lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe29c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1292ae expref: 423 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.231374:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257670400 00000100:00100000:0.0:1721880422.231381:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.231386:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134f5dd40/0x8a60d30f5716db16 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfabf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f8cbe expref: 1441 pid: 15545 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.231387:0:8271:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007bb15440/0x8a60d30f571eab2c lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe29c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1292ae expref: 423 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.231398:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.231400:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.231401:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.231404:0:8271:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136351b00/0x8a60d30f5727b61f lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe29c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.231410:0:8271:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136351b00/0x8a60d30f5727b61f lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe29c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.231411:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257670656 00000100:00100000:2.0:1721880422.231414:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257670656 00000100:00100000:0.0:1721880422.231421:0:16188:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257670912 00000100:00100000:0.0:1721880422.231425:0:16188:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257670912 00010000:00010000:2.0:1721880422.231425:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132b13180/0x8a60d30f571ead47 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe29f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1293a3 expref: 423 pid: 9459 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.231426:0:8271:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.231436:0:16188:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ed8cfc0/0x8a60d30f571eae0b lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1293f7 expref: 424 pid: 9459 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.231443:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913963 00000100:00100000:1.0:1721880422.231444:0:8271:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094636a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+424:2005:x1805522257670784:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 91us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.231449:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094634000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+1440:2005:x1805522257671296:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.231451:0:8271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913961 00000100:00100000:0.0:1721880422.231457:0:16188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913964 00010000:00010000:2.0:1721880422.231458:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1721880422.231462:0:16188:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129d22c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+423:2005:x1805522257671552:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.231464:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009203d680/0x8a60d30f5716e1c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfac1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f8e5b expref: 1439 pid: 15440 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.231468:0:8271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913965 00010000:00010000:0.0:1721880422.231470:0:16188:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.231474:0:8271:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+1439:2005:x1805522257670400:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.231474:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009203d680/0x8a60d30f5716e1c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfac1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f8e5b expref: 1439 pid: 15440 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.231475:0:16188:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130a2e1c0/0x8a60d30f571eafaf lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1294d7 expref: 423 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.231484:0:16188:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130a2e1c0/0x8a60d30f571eafaf lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1294d7 expref: 423 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.231487:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009203d680/0x8a60d30f5716e1c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfac1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f8e5b expref: 1438 pid: 15440 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.231492:0:8271:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.231497:0:16188:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a2e1c0/0x8a60d30f571eafaf lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2a3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1294d7 expref: 423 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.231498:0:8271:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134f5dd40/0x8a60d30f5716db16 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfabf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f8cbe expref: 1437 pid: 15545 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.231498:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.231500:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.231503:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727b657 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfac1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.231507:0:8271:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134f5dd40/0x8a60d30f5716db16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfabf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f8cbe expref: 1437 pid: 15545 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.231509:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727b657 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfac1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.231513:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.231515:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.231518:0:16188:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6f40/0x8a60d30f5727b65e lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.231519:0:8271:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134f5dd40/0x8a60d30f5716db16 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfabf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0f8cbe expref: 1437 pid: 15545 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.231525:0:16188:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6f40/0x8a60d30f5727b65e lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2a3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.231529:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.231531:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.231531:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.231533:0:8271:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727b626 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfabf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.231540:0:8271:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727b626 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfabf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.231541:0:16188:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.231552:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094634000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+1436:2005:x1805522257671296:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 102us (264us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.231556:0:8271:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.231558:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913963 00000100:00100000:0.0:1721880422.231561:0:16188:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880129d22c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+421:2005:x1805522257671552:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 98us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.231568:0:16188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913964 00000100:00100000:1.0:1721880422.231574:0:8271:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+1435:2005:x1805522257670400:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 100us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.231575:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913967 00000100:00100000:1.0:1721880422.231581:0:8271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913965 00000100:00100000:2.0:1721880422.231581:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008777ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+419:2005:x1805522257670912:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.231588:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.231592:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ed8cfc0/0x8a60d30f571eae0b lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1293f7 expref: 419 pid: 9459 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.231601:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ed8cfc0/0x8a60d30f571eae0b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1293f7 expref: 419 pid: 9459 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.231612:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ed8cfc0/0x8a60d30f571eae0b lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2a0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1293f7 expref: 419 pid: 9459 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.231619:0:16110:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6f40/0x8a60d30f5727b65e lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.231620:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.231621:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.231623:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009106f600/0x8a60d30f5727b63b lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.231627:0:16110:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6f40/0x8a60d30f5727b65e lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.231630:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009106f600/0x8a60d30f5727b63b lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.231634:0:16110:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6f40/0x8a60d30f5727b65e lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.231641:0:16110:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6f40/0x8a60d30f5727b65e lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.231643:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.231649:0:16110:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6f40/0x8a60d30f5727b65e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.231660:0:16110:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b6f40 already unused, calling callback (ffffffffa084e330) 00000100:00100000:2.0:1721880422.231662:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008777ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+418:2005:x1805522257670912:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 81us (263us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.231663:0:16110:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6f40/0x8a60d30f5727b65e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.231668:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913967 00010000:00010000:0.0:1721880422.231670:0:16110:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6f40/0x8a60d30f5727b65e lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.231681:0:16110:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6f40/0x8a60d30f5727b65e lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.231684:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.231688:0:16110:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6f40/0x8a60d30f5727b65e lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.231697:0:15455:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257671168 00000100:00100000:2.0:1721880422.231701:0:15455:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257671168 00010000:00010000:1.0:1721880422.231706:0:16088:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009106f600/0x8a60d30f5727b63b lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.231713:0:15455:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008425fcc0/0x8a60d30f571eaeac lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129452 expref: 418 pid: 15497 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.231714:0:16088:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009106f600/0x8a60d30f5727b63b lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.231720:0:16088:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009106f600/0x8a60d30f5727b63b lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.231752:0:16088:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009106f600/0x8a60d30f5727b63b lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.231758:0:15455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913968 00010000:00010000:1.0:1721880422.231760:0:16088:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009106f600/0x8a60d30f5727b63b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.231762:0:15455:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b8bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+418:2005:x1805522257671168:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.231765:0:16088:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106f600 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.231768:0:16088:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009106f600/0x8a60d30f5727b63b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.231775:0:16088:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009106f600/0x8a60d30f5727b63b lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.231779:0:15455:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.231783:0:15455:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008425fcc0/0x8a60d30f571eaeac lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129452 expref: 418 pid: 15497 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.231784:0:16088:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009106f600/0x8a60d30f5727b63b lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.231790:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009106f600/0x8a60d30f5727b63b lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.231792:0:15455:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008425fcc0/0x8a60d30f571eaeac lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129452 expref: 418 pid: 15497 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.231800:0:15514:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800919c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:15514:1805522011621632:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.231803:0:15455:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008425fcc0/0x8a60d30f571eaeac lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129452 expref: 418 pid: 15497 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.231813:0:15514:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727b673 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfac2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.231813:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.231815:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.231817:0:15455:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009325db00/0x8a60d30f5727b649 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.231824:0:15455:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325db00/0x8a60d30f5727b649 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.231844:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.231844:0:15455:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.231861:0:15455:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b8bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+417:2005:x1805522257671168:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 98us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.231868:0:15455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913968 00000100:00100000:1.0:1721880422.231869:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257671424 00000100:00100000:1.0:1721880422.231873:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257671424 00000100:00100000:0.0:1721880422.231874:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.231884:0:15455:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257670144 00010000:00010000:1.0:1721880422.231886:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800982f06c0/0x8a60d30f571eaf3f lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129498 expref: 417 pid: 16091 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.231887:0:15455:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257670144 00000100:00100000:0.0:1721880422.231896:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.231897:0:15455:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094739680/0x8a60d30f571eac13 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe29d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1292fb expref: 418 pid: 16037 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.231901:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257671680 00000100:00100000:1.0:1721880422.231904:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257671680 00000100:00100000:0.0:1721880422.231912:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913969 00010000:00010000:1.0:1721880422.231914:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c8ccb40/0x8a60d30f571700a1 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfac5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fa791 expref: 1435 pid: 16115 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.231917:0:15455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913970 00000100:00100000:0.0:1721880422.231918:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008777ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+418:2005:x1805522257671424:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.231922:0:15455:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008777c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+418:2004:x1805522257670144:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.231928:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.231929:0:15455:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.231930:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913971 00010000:00010000:0.0:1721880422.231932:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800982f06c0/0x8a60d30f571eaf3f lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129498 expref: 418 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.231932:0:15455:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094739680/0x8a60d30f571eac13 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe29d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1292fb expref: 418 pid: 16037 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.231935:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a70ee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1435:2004:x1805522257671680:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.231941:0:15455:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094739680/0x8a60d30f571eac13 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe29d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1292fb expref: 418 pid: 16037 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.231942:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.231944:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800982f06c0/0x8a60d30f571eaf3f lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129498 expref: 418 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.231946:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c8ccb40/0x8a60d30f571700a1 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfac5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fa791 expref: 1435 pid: 16115 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.231953:0:15455:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094739680/0x8a60d30f571eac13 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe29d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1292fb expref: 418 pid: 16037 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.231955:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c8ccb40/0x8a60d30f571700a1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfac5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fa791 expref: 1435 pid: 16115 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.231956:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800982f06c0/0x8a60d30f571eaf3f lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129498 expref: 418 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.231963:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.231964:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.231965:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.231967:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.231967:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.231967:0:15455:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6d00/0x8a60d30f5727b611 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe29d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.231969:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.231970:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727b66c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfac5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.231972:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5200/0x8a60d30f5727b650 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.231976:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727b66c lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfac5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.231978:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5200/0x8a60d30f5727b650 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.231979:0:15455:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6d00/0x8a60d30f5727b611 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe29d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.231992:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.231993:0:15455:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.231995:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.232007:0:15455:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008777c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+416:2004:x1805522257670144:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 85us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.232012:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a70ee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1435:2004:x1805522257671680:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 76us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.232030:0:15455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913970 00000100:00100000:0.0:1721880422.232031:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008777ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+416:2005:x1805522257671424:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 97us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.232035:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913971 00000100:00100000:0.0:1721880422.232040:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913969 00010000:00010000:0.0:1721880422.232086:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5200/0x8a60d30f5727b650 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.232094:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5200/0x8a60d30f5727b650 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.232101:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5200/0x8a60d30f5727b650 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.232109:0:16130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0000-mdtlov_UUID+2637:3689:x1805522011618176:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4429us (4501us total) trans 4296061575 rc 0/0 00010000:00010000:0.0:1721880422.232112:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5200/0x8a60d30f5727b650 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.232115:0:16130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631767 00010000:00010000:0.0:1721880422.232119:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5200/0x8a60d30f5727b650 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.232125:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b5200 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.232128:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5200/0x8a60d30f5727b650 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.232135:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5200/0x8a60d30f5727b650 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.232143:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5200/0x8a60d30f5727b650 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.232147:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e616d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2635:3688:x1805522011618944:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4012us (4053us total) trans 4296061578 rc 0/0 00010000:00010000:0.0:1721880422.232150:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5200/0x8a60d30f5727b650 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.232153:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631772 00000100:00100000:2.0:1721880422.232171:0:16110:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f52f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_094:lustre-MDT0000-mdtlov_UUID+2634:3689:x1805522011620352:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3352us (3483us total) trans 4296061576 rc 0/0 00000100:00100000:2.0:1721880422.232176:0:16110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631777 00000004:00080000:1.0:1721880422.232181:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e614380/2, rc 0, transno 1094281 00000100:00100000:1.0:1721880422.232190:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e614380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011618816:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.232205:0:16040:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099eb2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_040:lustre-OST0001_UUID:16040:1805522011621504:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.232217:0:16040:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727b665 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfac3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.232222:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800919c2300/2, rc 0, transno 1052586 00000100:00100000:1.0:1721880422.232239:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800919c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011618304:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.232249:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007b8bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011621888:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1721880422.232269:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136351b00/0x8a60d30f5727b61f lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.232272:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cd22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2635:3687:x1805522011619840:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3753us (3778us total) trans 4296061579 rc 0/0 00000100:00100000:1.0:1721880422.232274:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.232277:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136351b00/0x8a60d30f5727b61f lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.232278:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631775 00010000:00010000:2.0:1721880422.232285:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136351b00/0x8a60d30f5727b61f lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.232290:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1721880422.232293:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011621888 00000100:00100000:0.0:1721880422.232296:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011621888 00000100:00100000:1.0:1721880422.232296:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099eb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011622016:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.232296:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136351b00/0x8a60d30f5727b61f lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.232302:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136351b00/0x8a60d30f5727b61f lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.232308:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136351b00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.232311:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136351b00/0x8a60d30f5727b61f lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.232312:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631782 00000100:00100000:1.0:1721880422.232315:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.232316:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b08ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2634:3686:x1805522011621888:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1721880422.232317:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136351b00/0x8a60d30f5727b61f lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.232327:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136351b00/0x8a60d30f5727b61f lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1721880422.232328:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58020 count 1 00000100:00100000:1.0:1721880422.232332:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011622016 00010000:00010000:2.0:1721880422.232333:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136351b00/0x8a60d30f5727b61f lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.232335:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011622016 00010000:00010000:0.0:1721880422.232338:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325d200/0x8a60d30f5727b681 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2a4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.232348:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095286880/0x8a60d30f571eb003 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12952b expref: 414 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.232353:0:16113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631783 00010000:00010000:0.0:1721880422.232355:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.232356:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.232358:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325d200/0x8a60d30f5727b681 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.232358:0:16113:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c84a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0000-mdtlov_UUID+1821:3686:x1805522011622016:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.232370:0:16113:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64198 count 1 00010000:00010000:0.0:1721880422.232371:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095286880/0x8a60d30f571eb003 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12952b expref: 414 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.232378:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095286880/0x8a60d30f571eb003 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12952b expref: 414 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.232380:0:16113:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727b688 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfac6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.232384:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008777ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16125:1805522011622144:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.232390:0:16113:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800911a21c0/0x8a60d30f5717126e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfac6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fb8a8 expref: 1434 pid: 16079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.232396:0:16113:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.232397:0:16113:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1721880422.232398:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36540 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.232400:0:16113:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727b688 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfac6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.232410:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325db00/0x8a60d30f5727b649 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.232415:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325db00/0x8a60d30f5727b649 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.232415:0:16113:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800911a21c0/0x8a60d30f5717126e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfac6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fb8a8 expref: 1434 pid: 16079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.232419:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325db00/0x8a60d30f5727b649 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.232425:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325db00/0x8a60d30f5727b649 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.232425:0:16113:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800911a21c0/0x8a60d30f5717126e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfac6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fb8a8 expref: 1434 pid: 16079 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.232429:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325db00/0x8a60d30f5727b649 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.232432:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325db00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.232433:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325db00/0x8a60d30f5727b649 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.232434:0:16113:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088db5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0001_UUID:16113:1805522011622272:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.232437:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325db00/0x8a60d30f5727b649 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.232443:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325db00/0x8a60d30f5727b649 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.232447:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325db00/0x8a60d30f5727b649 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.232451:0:16113:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb600 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.232457:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2635:3686:x1805522011617792:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4762us (4818us total) trans 4296061581 rc 0/0 00000100:00100000:2.0:1721880422.232464:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631768 00000004:00080000:1.0:1721880422.232474:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008cd22680/2, rc 0, transno 1094283 00000100:00100000:1.0:1721880422.232480:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008cd22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011619840:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1721880422.232500:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009f52ed80/2, rc 0, transno 1094280 00000004:00080000:1.0:1721880422.232502:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880094636d80/2, rc 0, transno 1052587 00000100:00100000:1.0:1721880422.232520:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011617920:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.232520:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009f52ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011620352:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.232532:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cd23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2635:3687:x1805522011619712:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4054us (4094us total) trans 4296061582 rc 0/0 00000100:00100000:0.0:1721880422.232536:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631774 00000004:00080000:1.0:1721880422.232552:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b8bf100/2, rc 0, transno 1094286 00000004:00080000:2.0:1721880422.232556:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800919c1f80/2, rc 0, transno 1094279 00000100:00100000:1.0:1721880422.232559:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007b8bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011619712:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.232562:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800919c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011618176:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.232563:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1721880422.232565:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000004:00080000:2.0:1721880422.232571:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800919c0e00/2, rc 0, transno 1094284 00000100:00100000:0.0:1721880422.232574:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257671808 00000100:00100000:2.0:1721880422.232575:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800919c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011618048:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.232576:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257671808 00010000:00010000:0.0:1721880422.232584:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801364c3180/0x8a60d30f5716fd36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfac3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fa656 expref: 1434 pid: 15514 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.232586:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011622528:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.232597:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099eb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011622656:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.232598:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913972 00000100:00100000:0.0:1721880422.232600:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008777ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+1434:2004:x1805522257671808:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.232608:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.232611:0:7118:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.232614:0:7118:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801364c3180/0x8a60d30f5716fd36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfac3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fa656 expref: 1434 pid: 15514 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.232620:0:7118:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801364c3180/0x8a60d30f5716fd36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfac3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fa656 expref: 1434 pid: 15514 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.232629:0:7118:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801364c3180/0x8a60d30f5716fd36 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfac3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fa656 expref: 1434 pid: 15514 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.232633:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a052c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011623040:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.232637:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.232638:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.232640:0:7118:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727b665 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfac3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.232645:0:7118:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727b665 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfac3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.232649:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.232649:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.232655:0:7118:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.232665:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1721880422.232666:0:7118:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008777ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+1433:2004:x1805522257671808:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 65us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.232670:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913972 00000100:00100000:2.0:1721880422.232671:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088db7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011622400:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.232679:0:7118:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257672064 00000100:00100000:0.0:1721880422.232681:0:7118:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257672064 00010000:00010000:0.0:1721880422.232687:0:7118:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011f975d40/0x8a60d30f5716fec5 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfac4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fa6fe expref: 1433 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.232687:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.232700:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.232701:0:16110:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011622528 00000100:00100000:0.0:1721880422.232704:0:7118:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257671936 00000100:00100000:2.0:1721880422.232704:0:16110:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011622528 00000100:00100000:0.0:1721880422.232706:0:7118:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257671936 00010000:00010000:0.0:1721880422.232712:0:7118:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b69c900/0x8a60d30f5716fb4c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfac2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fa5ca expref: 1434 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.232716:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913973 00000100:00100000:2.0:1721880422.232716:0:16110:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011623040 00000100:00100000:2.0:1721880422.232718:0:16110:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011623040 00000100:00100000:1.0:1721880422.232721:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a052dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1434:2005:x1805522257672064:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.232725:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913974 00010000:00010000:1.0:1721880422.232741:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1721880422.232742:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a052e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+1434:2007:x1805522257671936:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.232746:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011f975d40/0x8a60d30f5716fec5 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfac4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fa6fe expref: 1434 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.232747:0:7118:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.232748:0:16110:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011622400 00010000:00010000:0.0:1721880422.232750:0:7118:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b69c900/0x8a60d30f5716fb4c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfac2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fa5ca expref: 1434 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.232751:0:16110:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011622400 00010000:00010000:1.0:1721880422.232752:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011f975d40/0x8a60d30f5716fec5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfac4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fa6fe expref: 1434 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.232756:0:7118:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b69c900/0x8a60d30f5716fb4c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfac2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fa5ca expref: 1434 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.232761:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.232762:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.232764:0:7118:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b69c900/0x8a60d30f5716fb4c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfac2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fa5ca expref: 1434 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.232764:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727b67a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfac4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.232768:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727b67a lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfac4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.232774:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.232775:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.232776:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.232777:0:7118:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727b673 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfac2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.232781:0:7118:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727b673 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfac2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.232785:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a052dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1433:2005:x1805522257672064:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 64us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.232789:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913973 00010000:00010000:0.0:1721880422.232793:0:7118:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.232802:0:7118:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a052e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+1432:2007:x1805522257671936:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 59us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.232806:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913974 00000100:00100000:1.0:1721880422.232814:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631785 00000100:00100000:1.0:1721880422.232817:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099eb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2637:3689:x1805522011623040:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.232826:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.232838:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088db5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011622784:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.232850:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.232863:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011622656 00000100:00100000:1.0:1721880422.232865:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011622656 00000100:00100000:1.0:1721880422.232877:0:16130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011622784 00000100:00100000:1.0:1721880422.232879:0:16130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011622784 00000100:00100000:1.0:1721880422.232893:0:16130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631786 00000100:00100000:1.0:1721880422.232896:0:16130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008876c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0000-mdtlov_UUID+1822:3687:x1805522011622656:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.232903:0:16130:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64199 count 1 00010000:00010000:1.0:1721880422.232910:0:16130:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106dd40/0x8a60d30f5727b696 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfac7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.232917:0:16130:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c35e1c0/0x8a60d30f57171d73 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfac7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fc026 expref: 1431 pid: 16107 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.232921:0:16130:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.232922:0:16130:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.232922:0:16110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631788 00010000:00010000:1.0:1721880422.232923:0:16130:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106dd40/0x8a60d30f5727b696 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfac7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.232927:0:16110:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099eb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_094:lustre-MDT0000-mdtlov_UUID+2638:3689:x1805522011622400:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.232934:0:16130:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c35e1c0/0x8a60d30f57171d73 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfac7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fc026 expref: 1431 pid: 16107 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.232939:0:16130:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c35e1c0/0x8a60d30f57171d73 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfac7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fc026 expref: 1431 pid: 16107 timeout: 887 lvb_type: 0 00002000:00080000:2.0:1721880422.232939:0:16110:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58021 count 1 00000100:00100000:1.0:1721880422.232945:0:16130:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088dc2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0001_UUID:16130:1805522011623296:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.232949:0:16110:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136351440/0x8a60d30f5727b6a4 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2a5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.232955:0:16130:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb0c0 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.232959:0:15514:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727b673 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfac2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.232961:0:16110:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094601d40/0x8a60d30f571eb057 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129586 expref: 414 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.232964:0:15514:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727b673 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfac2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.232967:0:16088:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58025 count 1 00010000:00010000:2.0:1721880422.232968:0:16110:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.232969:0:15514:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727b673 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfac2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.232969:0:16110:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.232972:0:15514:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727b673 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfac2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.232972:0:16110:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136351440/0x8a60d30f5727b6a4 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.232973:0:16088:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009106f840/0x8a60d30f5727b6ab lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2a9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.232976:0:15514:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727b673 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfac2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.232979:0:15514:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325e640 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.232980:0:16088:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801349361c0/0x8a60d30f571eb1ca lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1296f9 expref: 414 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.232981:0:15514:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727b673 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfac2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.232984:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.232985:0:15514:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727b673 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfac2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.232985:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.232986:0:16088:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009106f840/0x8a60d30f5727b6ab lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.232990:0:16110:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094601d40/0x8a60d30f571eb057 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129586 expref: 414 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.232994:0:15514:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727b673 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfac2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.232995:0:16088:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801349361c0/0x8a60d30f571eb1ca lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1296f9 expref: 414 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.232998:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727b673 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfac2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.233002:0:16088:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801349361c0/0x8a60d30f571eb1ca lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1296f9 expref: 414 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.233002:0:16110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094601d40/0x8a60d30f571eb057 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129586 expref: 414 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.233008:0:16088:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088dc3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0000_UUID:16088:1805522011623680:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.233028:0:16110:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099eb0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_094:lustre-OST0000_UUID:16110:1805522011623552:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.233032:0:16088:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302ebc00 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.233046:0:16110:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03d80 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.233057:0:16040:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727b665 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfac3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.233065:0:16040:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727b665 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfac3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.233073:0:16040:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727b665 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfac3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.233080:0:16040:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727b665 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfac3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.233087:0:16040:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727b665 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfac3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.233092:0:16040:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136351f80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.233095:0:16040:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727b665 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfac3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.233102:0:16040:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727b665 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfac3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.233109:0:15514:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e617800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+1823:3687:x1805522011620864:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3726us (3772us total) trans 4296019886 rc 0/0 00010000:00010000:2.0:1721880422.233112:0:16040:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727b665 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfac3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.233113:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631780 00010000:00010000:2.0:1721880422.233117:0:16040:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727b665 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfac3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.233135:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011f975d40/0x8a60d30f5716fec5 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfac4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fa6fe expref: 1431 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.233143:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d123b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011621760:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.233154:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727b67a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfac4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.233159:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727b67a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfac4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.233162:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727b67a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfac4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.233166:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727b67a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfac4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.233172:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009f52ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011623936:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.233173:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727b67a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfac4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.233177:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727b67a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfac4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.233180:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325f3c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.233182:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727b67a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfac4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.233186:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727b67a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfac4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.233191:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727b67a lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfac4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.233194:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727b67a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfac4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.233199:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.233212:0:15514:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011623936 00000100:00100000:1.0:1721880422.233214:0:15514:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011623936 00000100:00100000:1.0:1721880422.233229:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631790 00000100:00100000:1.0:1721880422.233231:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+1825:3687:x1805522011623936:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.233239:0:15514:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64201 count 1 00000100:00100000:2.0:1721880422.233240:0:16040:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e615180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:lustre-MDT0000-mdtlov_UUID+1825:3687:x1805522011620992:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3874us (3948us total) trans 4296019887 rc 0/0 00010000:00010000:1.0:1721880422.233247:0:15514:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727b6b2 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfac9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.233247:0:16040:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631778 00010000:00010000:1.0:1721880422.233254:0:15514:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b46c000/0x8a60d30f57175709 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfac9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fe667 expref: 1430 pid: 16116 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.233262:0:15514:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.233262:0:15514:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.233264:0:15514:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727b6b2 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfac9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.233268:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088db6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011622912:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.233273:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099eb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+1824:3689:x1805522011621120:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3754us (3789us total) trans 4296019888 rc 0/0 00010000:00010000:1.0:1721880422.233273:0:15514:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b46c000/0x8a60d30f57175709 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfac9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fe667 expref: 1430 pid: 16116 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.233276:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631781 00010000:00010000:1.0:1721880422.233278:0:15514:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b46c000/0x8a60d30f57175709 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfac9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fe667 expref: 1430 pid: 16116 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.233284:0:15514:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088dc1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:15514:1805522011624192:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.233287:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.233299:0:15514:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb300 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.233304:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011622912 00000100:00100000:0.0:1721880422.233306:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011622912 00000004:00080000:2.0:1721880422.233310:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099eb0e00/2, rc 0, transno 1052592 00000004:00080000:1.0:1721880422.233313:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009f52e300/2, rc 0, transno 1052590 00000100:00100000:0.0:1721880422.233317:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631791 00000100:00100000:0.0:1721880422.233319:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2640:3689:x1805522011622912:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1721880422.233328:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58024 count 1 00000100:00100000:1.0:1721880422.233328:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009f52e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011620864:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.233328:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099eb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011621120:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1721880422.233334:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099eb0700/2, rc 0, transno 1052591 00010000:00010000:0.0:1721880422.233336:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325e1c0/0x8a60d30f5727b6c0 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2a8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.233337:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099eb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011620992:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.233342:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000004:00080000:2.0:1721880422.233342:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009f52e680/2, rc 0, transno 1052589 00010000:00010000:0.0:1721880422.233343:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136637a80/0x8a60d30f571eb153 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12967b expref: 414 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.233345:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009f52f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011623808:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.233346:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009f52e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011620480:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.233348:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.233349:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.233350:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325e1c0/0x8a60d30f5727b6c0 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.233357:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009ebdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011624448:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.233358:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.233361:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136637a80/0x8a60d30f571eb153 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12967b expref: 414 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.233366:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136637a80/0x8a60d30f571eb153 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12967b expref: 414 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.233368:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009ebd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011624832:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.233372:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008777c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0000_UUID:16028:1805522011624704:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.233378:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.233385:0:16040:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011623808 00000100:00100000:1.0:1721880422.233386:0:16040:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011623808 00000100:00100000:0.0:1721880422.233389:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36f00 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.233398:0:16040:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011624448 00000100:00100000:2.0:1721880422.233398:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1721880422.233400:0:16040:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011624448 00000100:00100000:0.0:1721880422.233401:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631792 00000100:00100000:0.0:1721880422.233404:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1825:3687:x1805522011623808:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.233404:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009ebd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011624960:0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.233412:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64200 count 1 00010000:00010000:0.0:1721880422.233419:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727b6c7 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfac8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.233419:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.233425:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0cb98c0/0x8a60d30f57171fa3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfac8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fc096 expref: 1430 pid: 16022 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.233428:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009ebdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011624576:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.233430:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.233431:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.233432:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727b6c7 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfac8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.233434:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011624832 00000100:00100000:1.0:1721880422.233436:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011624832 00010000:00010000:0.0:1721880422.233440:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0cb98c0/0x8a60d30f57171fa3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfac8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fc096 expref: 1430 pid: 16022 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.233443:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631794 00010000:00010000:0.0:1721880422.233445:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0cb98c0/0x8a60d30f57171fa3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfac8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fc096 expref: 1430 pid: 16022 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.233446:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+1826:3687:x1805522011624832:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.233449:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.233451:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008777ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011625088:192.168.201.24@tcp:104: 00002000:00080000:1.0:1721880422.233453:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64204 count 1 00010000:00010000:1.0:1721880422.233459:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727b6d5 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfacc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.233464:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36b40 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.233466:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800970da640/0x8a60d30f571771f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfacc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0ffd20 expref: 1430 pid: 16053 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.233470:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.233471:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.233472:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727b6d5 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfacc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.233474:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800919c1500/2, rc 0, transno 1094285 00010000:00010000:1.0:1721880422.233482:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800970da640/0x8a60d30f571771f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfacc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0ffd20 expref: 1430 pid: 16053 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.233482:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800919c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011617792:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.233487:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800970da640/0x8a60d30f571771f1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfacc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0ffd20 expref: 1430 pid: 16053 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.233493:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008c409180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011625344:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.233505:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eba80 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.233513:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011624576 00000100:00100000:2.0:1721880422.233514:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.233515:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011624576 00000100:00100000:1.0:1721880422.233526:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631795 00000100:00100000:1.0:1721880422.233529:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+1827:3686:x1805522011624576:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.233532:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e9c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011625472:0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1721880422.233535:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64203 count 1 00010000:00010000:1.0:1721880422.233541:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106c240/0x8a60d30f5727b6dc lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfacb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.233547:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095b5fa80/0x8a60d30f571770a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfacb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0ffc0f expref: 1430 pid: 15468 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.233550:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.233551:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.233551:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.233553:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106c240/0x8a60d30f5727b6dc lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfacb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.233557:0:9458:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011625472 00000100:00100000:0.0:1721880422.233559:0:9458:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011625472 00010000:00010000:1.0:1721880422.233561:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095b5fa80/0x8a60d30f571770a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfacb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0ffc0f expref: 1430 pid: 15468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.233566:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095b5fa80/0x8a60d30f571770a1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfacb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0ffc0f expref: 1430 pid: 15468 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.233571:0:9458:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631797 00000100:00100000:1.0:1721880422.233572:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008c40ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011625600:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.233574:0:9458:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2641:3689:x1805522011625472:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1721880422.233581:0:9458:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58027 count 1 00000100:00100000:1.0:1721880422.233583:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302ebd80 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.233588:0:9458:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325eac0/0x8a60d30f5727b6ea lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2ab:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.233596:0:9458:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800982f3180/0x8a60d30f571eb279 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1297a8 expref: 414 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.233600:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.233601:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.233603:0:9458:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325eac0/0x8a60d30f5727b6ea lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.233613:0:9458:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800982f3180/0x8a60d30f571eb279 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1297a8 expref: 414 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.233620:0:9458:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800982f3180/0x8a60d30f571eb279 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1297a8 expref: 414 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.233625:0:9458:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008777f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9458:1805522011625856:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.233637:0:9458:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36e40 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.235004:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.235031:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257672192 00000100:00100000:0.0:1721880422.235036:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257672192 00000100:00100000:2.0:1721880422.235042:0:16130:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088dc2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0001_UUID:16130:1805522011623296:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.235048:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800911a21c0/0x8a60d30f5717126e lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfac6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fb8a8 expref: 1431 pid: 16079 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.235053:0:16113:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088db5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0001_UUID:16113:1805522011622272:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.235059:0:16130:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106dd40/0x8a60d30f5727b696 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfac7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.235065:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913975 00000100:00100000:0.0:1721880422.235069:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008777df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1431:2007:x1805522257672192:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.235070:0:16113:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727b688 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfac6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.235075:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.235078:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800911a21c0/0x8a60d30f5717126e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfac6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fb8a8 expref: 1431 pid: 16079 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.235085:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800911a21c0/0x8a60d30f5717126e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfac6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fb8a8 expref: 1431 pid: 16079 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.235094:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800911a21c0/0x8a60d30f5717126e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfac6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fb8a8 expref: 1431 pid: 16079 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.235104:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.235105:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.235107:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727b688 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfac6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.235112:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727b688 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfac6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.235128:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.235138:0:16113:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727b688 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfac6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.235147:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008777df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1430:2007:x1805522257672192:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 78us (146us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.235150:0:16113:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727b688 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfac6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.235151:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913975 00010000:00010000:1.0:1721880422.235158:0:16113:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727b688 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfac6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.235165:0:16113:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727b688 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfac6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.235171:0:16113:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727b688 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfac6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.235177:0:16113:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106e1c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.235180:0:16113:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727b688 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfac6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.235187:0:16113:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727b688 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfac6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.235197:0:16113:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727b688 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfac6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.235204:0:16113:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727b688 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfac6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.235211:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.235219:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008777ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16125:1805522011622144:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.235221:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.235231:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325d200/0x8a60d30f5727b681 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.235241:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257672320 00000100:00100000:0.0:1721880422.235243:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257672320 00010000:00010000:0.0:1721880422.235251:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c35e1c0/0x8a60d30f57171d73 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfac7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fc026 expref: 1430 pid: 16107 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.235262:0:16110:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099eb0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_094:lustre-OST0000_UUID:16110:1805522011623552:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.235265:0:7118:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257672448 00000100:00100000:0.0:1721880422.235267:0:7118:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257672448 00010000:00010000:2.0:1721880422.235271:0:16110:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136351440/0x8a60d30f5727b6a4 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.235273:0:7118:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095286880/0x8a60d30f571eb003 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12952b expref: 415 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.235287:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913977 00000100:00100000:2.0:1721880422.235289:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.235290:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+415:2004:x1805522257672448:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.235295:0:7118:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.235298:0:7118:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095286880/0x8a60d30f571eb003 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12952b expref: 415 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.235304:0:7118:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095286880/0x8a60d30f571eb003 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12952b expref: 415 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.235307:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.235312:0:7118:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095286880/0x8a60d30f571eb003 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2a4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12952b expref: 415 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.235315:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.235318:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.235319:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.235321:0:7118:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009325d200/0x8a60d30f5727b681 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.235324:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257672576 00010000:00010000:0.0:1721880422.235325:0:7118:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325d200/0x8a60d30f5727b681 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.235326:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257672576 00000100:00100000:1.0:1721880422.235328:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257672832 00010000:00010000:0.0:1721880422.235333:0:7118:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.235333:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257672832 00010000:00010000:2.0:1721880422.235336:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131b30fc0/0x8a60d30f571eb0ff lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe2a7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12962e expref: 415 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.235345:0:7118:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+416:2004:x1805522257672448:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 54us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.235347:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257672704 00000100:00100000:0.0:1721880422.235348:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913977 00010000:00010000:1.0:1721880422.235348:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094601d40/0x8a60d30f571eb057 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129586 expref: 416 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.235348:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257672704 00010000:00010000:2.0:1721880422.235356:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801349361c0/0x8a60d30f571eb1ca lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe2a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1296f9 expref: 416 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.235358:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913978 00000100:00100000:0.0:1721880422.235361:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129d23450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+416:2005:x1805522257672576:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.235366:0:7118:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.235368:0:7118:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131b30fc0/0x8a60d30f571eb0ff lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe2a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12962e expref: 416 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.235373:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913979 00010000:00010000:0.0:1721880422.235375:0:7118:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131b30fc0/0x8a60d30f571eb0ff lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12962e expref: 416 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.235378:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913980 00000100:00100000:1.0:1721880422.235379:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+416:2005:x1805522257672832:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.235381:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.235381:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+416:2004:x1805522257672704:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.235382:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.235384:0:7118:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5d40/0x8a60d30f5727b69d lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.235387:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.235388:0:7118:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5d40/0x8a60d30f5727b69d lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2a7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.235388:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.235390:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801349361c0/0x8a60d30f571eb1ca lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe2a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1296f9 expref: 416 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.235393:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094601d40/0x8a60d30f571eb057 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2a5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129586 expref: 416 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.235394:0:7118:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.235397:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801349361c0/0x8a60d30f571eb1ca lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1296f9 expref: 416 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.235402:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094601d40/0x8a60d30f571eb057 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2a5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129586 expref: 416 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.235403:0:7118:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880129d23450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+416:2005:x1805522257672576:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 41us (113us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.235406:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1721880422.235407:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913978 00010000:00010000:2.0:1721880422.235407:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.235409:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009106f840/0x8a60d30f5727b6ab lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.235413:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009106f840/0x8a60d30f5727b6ab lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2a9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.235415:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094601d40/0x8a60d30f571eb057 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2a5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129586 expref: 415 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.235418:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325d200/0x8a60d30f5727b681 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.235420:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.235423:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325d200/0x8a60d30f5727b681 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.235427:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.235428:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325d200/0x8a60d30f5727b681 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.235428:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.235431:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136351440/0x8a60d30f5727b6a4 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.235431:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+414:2004:x1805522257672704:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 49us (115us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.235433:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325d200/0x8a60d30f5727b681 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.235436:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913980 00010000:00010000:0.0:1721880422.235437:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325d200/0x8a60d30f5727b681 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.235438:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136351440/0x8a60d30f5727b6a4 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2a5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.235440:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325d200 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.235442:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325d200/0x8a60d30f5727b681 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.235446:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325d200/0x8a60d30f5727b681 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.235451:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325d200/0x8a60d30f5727b681 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.235454:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325d200/0x8a60d30f5727b681 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.235457:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.235459:0:16110:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136351440/0x8a60d30f5727b6a4 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.235464:0:16110:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136351440/0x8a60d30f5727b6a4 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.235469:0:16110:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136351440/0x8a60d30f5727b6a4 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.235474:0:16110:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136351440/0x8a60d30f5727b6a4 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.235477:0:16110:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136351440/0x8a60d30f5727b6a4 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.235478:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+413:2005:x1805522257672832:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 98us (169us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.235480:0:16110:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136351440 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.235482:0:16110:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136351440/0x8a60d30f5727b6a4 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.235485:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913979 00010000:00010000:2.0:1721880422.235486:0:16110:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136351440/0x8a60d30f5727b6a4 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.235491:0:16110:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136351440/0x8a60d30f5727b6a4 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.235495:0:16110:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136351440/0x8a60d30f5727b6a4 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.235528:0:16113:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c84a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0000-mdtlov_UUID+1829:3686:x1805522011622016:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3169us (3212us total) trans 4296019889 rc 0/0 00000100:00100000:1.0:1721880422.235534:0:16113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631783 00000100:00100000:0.0:1721880422.235547:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b08ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2643:3686:x1805522011621888:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3230us (3273us total) trans 4296061583 rc 0/0 00000100:00100000:0.0:1721880422.235551:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631782 00010000:00010000:1.0:1721880422.235564:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801349361c0/0x8a60d30f571eb1ca lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1296f9 expref: 412 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.235575:0:16088:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088dc3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0000_UUID:16088:1805522011623680:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.235586:0:16110:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099eb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_094:lustre-MDT0000-mdtlov_UUID+2642:3689:x1805522011622400:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2659us (2899us total) trans 4296061584 rc 0/0 00010000:00010000:1.0:1721880422.235590:0:16088:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009106f840/0x8a60d30f5727b6ab lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.235590:0:16110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631788 00010000:00010000:1.0:1721880422.235597:0:16088:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009106f840/0x8a60d30f5727b6ab lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.235603:0:16088:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009106f840/0x8a60d30f5727b6ab lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.235609:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088db7480/2, rc 0, transno 1094288 00010000:00010000:1.0:1721880422.235610:0:16088:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009106f840/0x8a60d30f5727b6ab lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.235614:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088db7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011622400:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.235615:0:16088:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009106f840/0x8a60d30f5727b6ab lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.235622:0:16088:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009106f840/0x8a60d30f5727b6ab lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.235627:0:16088:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106f840 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.235630:0:16088:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009106f840/0x8a60d30f5727b6ab lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.235637:0:16088:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009106f840/0x8a60d30f5727b6ab lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.235637:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e9c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011625984:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.235646:0:16088:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009106f840/0x8a60d30f5727b6ab lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.235651:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.235653:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009106f840/0x8a60d30f5727b6ab lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.235667:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099eb2a00/2, rc 0, transno 1052593 00000100:00100000:0.0:1721880422.235677:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011625984 00000100:00100000:2.0:1721880422.235678:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099eb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011622016:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.235679:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011625984 00000004:00080000:2.0:1721880422.235684:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b8bdc00/2, rc 0, transno 1094287 00000100:00100000:2.0:1721880422.235688:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007b8bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011621888:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.235690:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631798 00000100:00100000:0.0:1721880422.235693:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2642:3686:x1805522011625984:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1721880422.235702:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58028 count 1 00000100:00100000:2.0:1721880422.235702:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1721880422.235705:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e9ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011626112:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.235710:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727b6f1 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2ac:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.235716:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.235717:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f5bdd40/0x8a60d30f571eb2cd lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1297fc expref: 410 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.235722:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.235723:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.235725:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727b6f1 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.235753:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f5bdd40/0x8a60d30f571eb2cd lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1297fc expref: 410 pid: 16099 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.235754:0:16113:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011626112 00000100:00100000:2.0:1721880422.235758:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1721880422.235759:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f5bdd40/0x8a60d30f571eb2cd lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1297fc expref: 410 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.235759:0:16113:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011626112 00000100:00100000:2.0:1721880422.235764:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009ebdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011626240:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.235766:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008777ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16125:1805522011626368:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.235776:0:16113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631799 00000100:00100000:2.0:1721880422.235776:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.235781:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36540 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.235781:0:16113:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0000-mdtlov_UUID+2644:3686:x1805522011626112:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.235790:0:16110:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011626240 00000100:00100000:0.0:1721880422.235792:0:16110:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011626240 00002000:00080000:1.0:1721880422.235794:0:16113:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58029 count 1 00000100:00100000:0.0:1721880422.235803:0:16110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631800 00010000:00010000:1.0:1721880422.235804:0:16113:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009106cd80/0x8a60d30f5727b6f8 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2ad:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.235805:0:16110:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099eb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_094:lustre-MDT0000-mdtlov_UUID+1829:3689:x1805522011626240:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.235813:0:16110:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64206 count 1 00010000:00010000:1.0:1721880422.235815:0:16113:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099b16880/0x8a60d30f571eb31a lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129849 expref: 410 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.235820:0:16110:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727b6ff lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xface:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.235821:0:16113:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.235823:0:16113:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.235825:0:16113:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009106cd80/0x8a60d30f5727b6f8 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.235831:0:16110:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009528cb40/0x8a60d30f5717734f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xface:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0ffe2a expref: 1428 pid: 16020 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.235832:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.235835:0:16110:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.235836:0:16110:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.235838:0:16110:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727b6ff lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xface:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.235841:0:16113:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099b16880/0x8a60d30f571eb31a lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129849 expref: 410 pid: 16119 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.235843:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257672960 00000100:00100000:2.0:1721880422.235845:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257672960 00010000:00010000:0.0:1721880422.235847:0:16110:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009528cb40/0x8a60d30f5717734f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xface:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0ffe2a expref: 1428 pid: 16020 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.235852:0:16110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009528cb40/0x8a60d30f5717734f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xface:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0ffe2a expref: 1428 pid: 16020 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.235854:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d33a880/0x8a60d30f571eb0ab lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe2a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1295da expref: 411 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.235856:0:16113:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099b16880/0x8a60d30f571eb31a lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129849 expref: 411 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.235858:0:16110:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008777e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_094:lustre-OST0001_UUID:16110:1805522011626624:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.235865:0:16113:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008c40aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0000_UUID:16113:1805522011626496:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.235870:0:16110:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36d80 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.235870:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913981 00000100:00100000:2.0:1721880422.235873:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099eb0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+411:2004:x1805522257672960:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.235879:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.235882:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d33a880/0x8a60d30f571eb0ab lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe2a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1295da expref: 411 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.235887:0:16113:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302ebc00 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.235891:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d33a880/0x8a60d30f571eb0ab lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2a6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1295da expref: 411 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.235900:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.235901:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.235902:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727b68f lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2a6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.235907:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727b68f lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2a6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.235909:0:15514:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088dc1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:15514:1805522011624192:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.235915:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.235922:0:15514:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727b6b2 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfac9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.235927:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099eb0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+410:2004:x1805522257672960:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 53us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.235931:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913981 00000100:00100000:2.0:1721880422.235952:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.235960:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257673088 00000100:00100000:2.0:1721880422.235962:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257673088 00010000:00010000:2.0:1721880422.235968:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b46c000/0x8a60d30f57175709 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfac9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fe667 expref: 1429 pid: 16116 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.235978:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913982 00000100:00100000:2.0:1721880422.235981:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1429:2007:x1805522257673088:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.235985:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.235987:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b46c000/0x8a60d30f57175709 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfac9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fe667 expref: 1429 pid: 16116 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.235996:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b46c000/0x8a60d30f57175709 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfac9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fe667 expref: 1429 pid: 16116 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.236005:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b46c000/0x8a60d30f57175709 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfac9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fe667 expref: 1429 pid: 16116 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.236025:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099eb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2645:3689:x1805522011623040:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3192us (3361us total) trans 4296061585 rc 0/0 00000100:00100000:1.0:1721880422.236032:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631785 00010000:00010000:2.0:1721880422.236033:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.236034:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.236035:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727b6b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfac9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.236040:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727b6b2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfac9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.236046:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a052c000/2, rc 0, transno 1094289 00000100:00100000:0.0:1721880422.236052:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a052c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011623040:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1721880422.236056:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.236062:0:15514:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727b6b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfac9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.236067:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1428:2007:x1805522257673088:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 85us (113us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.236070:0:15514:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727b6b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfac9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.236071:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913982 00000100:00100000:0.0:1721880422.236072:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008777e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011626752:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.236077:0:15514:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727b6b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfac9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.236083:0:15514:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727b6b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfac9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.236089:0:15514:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727b6b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfac9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.236090:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.236096:0:15514:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106ed00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.236099:0:15514:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727b6b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfac9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.236105:0:15514:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727b6b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfac9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.236112:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008777c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0000_UUID:16028:1805522011624704:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.236114:0:15514:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727b6b2 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfac9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.236120:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.236121:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325e1c0/0x8a60d30f5727b6c0 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.236121:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727b6b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfac9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.236126:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257673344 00000100:00100000:2.0:1721880422.236128:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257673344 00000100:00100000:0.0:1721880422.236133:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008777ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011625088:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.236135:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800970da640/0x8a60d30f571771f1 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfacc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0ffd20 expref: 1428 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.236141:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727b6c7 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfac8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.236145:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913983 00000100:00100000:2.0:1721880422.236147:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1428:2006:x1805522257673344:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.236153:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.236155:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800970da640/0x8a60d30f571771f1 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfacc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0ffd20 expref: 1428 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.236161:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800970da640/0x8a60d30f571771f1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfacc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0ffd20 expref: 1428 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.236168:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.236169:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.236170:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727b6d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfacc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.236175:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727b6d5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfacc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.236181:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.236188:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1428:2006:x1805522257673344:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 40us (67us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.236192:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913983 00000100:00100000:2.0:1721880422.236223:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.236231:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257673472 00000100:00100000:1.0:1721880422.236233:0:15514:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+1830:3687:x1805522011623936:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2999us (3032us total) trans 4296019891 rc 0/0 00000100:00100000:2.0:1721880422.236233:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257673472 00010000:00010000:2.0:1721880422.236239:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013130a880/0x8a60d30f57176dd7 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfaca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0ffa33 expref: 1428 pid: 16023 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.236240:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631790 00000100:00100000:2.0:1721880422.236249:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913984 00000100:00100000:2.0:1721880422.236252:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1428:2004:x1805522257673472:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.236258:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.236260:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013130a880/0x8a60d30f57176dd7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaca:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0ffa33 expref: 1428 pid: 16023 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.236265:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013130a880/0x8a60d30f57176dd7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0ffa33 expref: 1428 pid: 16023 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.236268:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800970da640/0x8a60d30f571771f1 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfacc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0ffd20 expref: 1428 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.236273:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013130a880/0x8a60d30f57176dd7 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfaca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0ffa33 expref: 1428 pid: 16023 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.236277:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008c409180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011625344:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.236280:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.236281:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.236283:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727b6ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.236287:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727b6ce lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfaca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.236291:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727b6d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfacc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.236297:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727b6d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfacc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.236302:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.236304:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727b6d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfacc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.236309:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727b6d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfacc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.236310:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1426:2004:x1805522257673472:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 57us (88us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.236312:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727b6d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfacc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.236314:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913984 00010000:00010000:1.0:1721880422.236316:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727b6d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfacc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.236319:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106eac0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.236320:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727b6d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfacc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.236324:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727b6d5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfacc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.236330:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727b6d5 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfacc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.236334:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727b6d5 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfacc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.236366:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.236373:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008c40ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011625600:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.236373:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257673216 00000100:00100000:2.0:1721880422.236375:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257673216 00010000:00010000:2.0:1721880422.236381:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136637a80/0x8a60d30f571eb153 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12967b expref: 410 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.236387:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106c240/0x8a60d30f5727b6dc lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfacb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.236394:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913985 00000100:00100000:2.0:1721880422.236397:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129d22850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+410:2004:x1805522257673216:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.236401:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.236403:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136637a80/0x8a60d30f571eb153 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12967b expref: 410 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.236408:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136637a80/0x8a60d30f571eb153 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12967b expref: 410 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.236411:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+1831:3687:x1805522011624832:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2964us (2990us total) trans 4296019892 rc 0/0 00000100:00100000:1.0:1721880422.236415:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631794 00010000:00010000:2.0:1721880422.236416:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136637a80/0x8a60d30f571eb153 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12967b expref: 410 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.236422:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.236423:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.236424:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009325e1c0/0x8a60d30f5727b6c0 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.236428:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325e1c0/0x8a60d30f5727b6c0 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.236436:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009ebd8000/2, rc 0, transno 1052596 00010000:00010000:2.0:1721880422.236436:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:0.0:1721880422.236437:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009ebdb800/2, rc 0, transno 1052597 00000100:00100000:0.0:1721880422.236442:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009ebdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011624448:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.236442:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009ebd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011624832:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.236443:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880129d22850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+409:2004:x1805522257673216:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 45us (77us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.236446:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913985 00010000:00010000:0.0:1721880422.236450:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325e1c0/0x8a60d30f5727b6c0 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.236455:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325e1c0/0x8a60d30f5727b6c0 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.236460:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325e1c0/0x8a60d30f5727b6c0 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.236463:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325e1c0/0x8a60d30f5727b6c0 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.236467:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325e1c0/0x8a60d30f5727b6c0 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.236470:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325e1c0 already unused, calling callback (ffffffffa084e330) 00000004:00080000:1.0:1721880422.236470:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009f52ce00/2, rc 0, transno 1052595 00010000:00010000:0.0:1721880422.236472:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325e1c0/0x8a60d30f5727b6c0 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.236474:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009f52ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011623936:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.236474:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.236478:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325e1c0/0x8a60d30f5727b6c0 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.236482:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257673600 00000100:00100000:2.0:1721880422.236484:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257673600 00010000:00010000:0.0:1721880422.236489:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325e1c0/0x8a60d30f5727b6c0 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.236489:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088db5180/2, rc 0, transno 1094290 00010000:00010000:2.0:1721880422.236489:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0cb98c0/0x8a60d30f57171fa3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfac8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fc096 expref: 1426 pid: 16022 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.236495:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325e1c0/0x8a60d30f5727b6c0 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.236499:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913986 00000100:00100000:1.0:1721880422.236500:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088db5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011622784:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.236502:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1426:2004:x1805522257673600:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000004:00080000:1.0:1721880422.236506:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099eb3480/2, rc 0, transno 1052594 00010000:00010000:2.0:1721880422.236506:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.236508:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0cb98c0/0x8a60d30f57171fa3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfac8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fc096 expref: 1426 pid: 16022 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.236509:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099eb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011622656:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.236514:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0cb98c0/0x8a60d30f57171fa3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfac8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fc096 expref: 1426 pid: 16022 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.236520:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0cb98c0/0x8a60d30f57171fa3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfac8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fc096 expref: 1426 pid: 16022 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.236526:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008c409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011627008:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.236526:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.236526:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.236528:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727b6c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfac8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.236533:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727b6c7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfac8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.236540:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.236541:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.236547:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1425:2004:x1805522257673600:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 44us (72us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.236552:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008777ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011627520:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.236553:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913986 00000100:00100000:1.0:1721880422.236564:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008c40b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011627136:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.236581:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.236583:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.236589:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257673728 00000100:00100000:2.0:1721880422.236591:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257673728 00000100:00100000:1.0:1721880422.236596:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011627136 00010000:00010000:2.0:1721880422.236596:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095b5fa80/0x8a60d30f571770a1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfacb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0ffc0f expref: 1425 pid: 15468 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.236598:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011627136 00000100:00100000:2.0:1721880422.236606:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913987 00000100:00100000:1.0:1721880422.236611:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631803 00000100:00100000:2.0:1721880422.236611:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1425:2004:x1805522257673728:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.236614:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ebdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+1832:3688:x1805522011627264:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.236614:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.236617:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095b5fa80/0x8a60d30f571770a1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfacb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0ffc0f expref: 1425 pid: 15468 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.236622:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095b5fa80/0x8a60d30f571770a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfacb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0ffc0f expref: 1425 pid: 15468 timeout: 887 lvb_type: 0 00002000:00080000:1.0:1721880422.236623:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64209 count 1 00010000:00010000:2.0:1721880422.236630:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095b5fa80/0x8a60d30f571770a1 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfacb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0ffc0f expref: 1425 pid: 15468 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.236631:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106e640/0x8a60d30f5727b70d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfad1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.236636:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2645:3689:x1805522011622912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3314us (3348us total) trans 4296061588 rc 0/0 00010000:00010000:2.0:1721880422.236636:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.236636:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.236638:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800983b6ac0/0x8a60d30f571775a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfad1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100030 expref: 1424 pid: 16020 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.236638:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106c240/0x8a60d30f5727b6dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfacb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.236641:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631791 00010000:00010000:2.0:1721880422.236642:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106c240/0x8a60d30f5727b6dc lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfacb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.236646:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.236647:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.236649:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106e640/0x8a60d30f5727b70d lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfad1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.236653:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631804 00010000:00010000:2.0:1721880422.236653:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.236656:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c40a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+1832:3687:x1805522011627136:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.236659:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800983b6ac0/0x8a60d30f571775a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfad1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100030 expref: 1424 pid: 16020 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.236660:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1424:2004:x1805522257673728:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 50us (77us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.236664:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800983b6ac0/0x8a60d30f571775a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfad1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100030 expref: 1424 pid: 16020 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.236664:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913987 00002000:00080000:0.0:1721880422.236666:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64208 count 1 00000100:00100000:1.0:1721880422.236670:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008c409500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011627648:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.236674:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727b71b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfad0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.236682:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eba80 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.236684:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132ecb180/0x8a60d30f571774d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfad0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fff7a expref: 1423 pid: 16059 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.236691:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.236692:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1721880422.236693:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.236695:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727b71b lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfad0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.236698:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.236703:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257673856 00000100:00100000:2.0:1721880422.236705:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257673856 00000100:00100000:1.0:1721880422.236706:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011627520 00000100:00100000:1.0:1721880422.236707:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011627520 00010000:00010000:2.0:1721880422.236711:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800982f3180/0x8a60d30f571eb279 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1297a8 expref: 409 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.236717:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132ecb180/0x8a60d30f571774d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfad0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fff7a expref: 1423 pid: 16059 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.236717:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631805 00000100:00100000:1.0:1721880422.236719:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c40b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2645:3686:x1805522011627520:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.236720:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913988 00000100:00100000:2.0:1721880422.236723:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+409:2004:x1805522257673856:12345-192.168.201.24@tcp:103:ldlm_bl.0 00002000:00080000:1.0:1721880422.236742:0:16088:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58031 count 1 00010000:00010000:2.0:1721880422.236745:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.236748:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800982f3180/0x8a60d30f571eb279 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe2ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1297a8 expref: 409 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.236749:0:16088:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009106cb40/0x8a60d30f5727b722 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2af:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.236750:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132ecb180/0x8a60d30f571774d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfad0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fff7a expref: 1423 pid: 16059 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.236754:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800982f3180/0x8a60d30f571eb279 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1297a8 expref: 409 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.236756:0:16088:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800928f6400/0x8a60d30f571eb3bb lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1298ea expref: 409 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.236760:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.236760:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1721880422.236761:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008777c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011627904:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.236762:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.236762:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.236763:0:16088:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009106cb40/0x8a60d30f5727b722 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.236763:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009325eac0/0x8a60d30f5727b6ea lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.236768:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325eac0/0x8a60d30f5727b6ea lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2ab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.236773:0:16088:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800928f6400/0x8a60d30f571eb3bb lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1298ea expref: 409 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.236777:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36b40 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.236778:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.236779:0:16088:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800928f6400/0x8a60d30f571eb3bb lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1298ea expref: 409 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.236785:0:16088:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008c40b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0000_UUID:16088:1805522011628032:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.236787:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106c240/0x8a60d30f5727b6dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfacb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.236788:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+409:2004:x1805522257673856:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 63us (89us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.236793:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106c240/0x8a60d30f5727b6dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfacb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.236793:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913988 00000100:00100000:1.0:1721880422.236795:0:16088:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb300 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.236800:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106c240/0x8a60d30f5727b6dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfacb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.236807:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106c240/0x8a60d30f5727b6dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfacb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.236814:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106c240/0x8a60d30f5727b6dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfacb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.236818:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106c240 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.236820:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106c240/0x8a60d30f5727b6dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfacb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.236825:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106c240/0x8a60d30f5727b6dc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfacb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.236832:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106c240/0x8a60d30f5727b6dc lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfacb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.236835:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106c240/0x8a60d30f5727b6dc lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfacb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.236939:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+1834:3686:x1805522011624576:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3408us (3490us total) trans 4296019894 rc 0/0 00000100:00100000:0.0:1721880422.236943:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631795 00000004:00080000:1.0:1721880422.236955:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009ebdaa00/2, rc 0, transno 1052598 00010000:00010000:0.0:1721880422.236959:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727b6c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfac8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.236960:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009ebdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011624576:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.236964:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727b6c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfac8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.236968:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727b6c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfac8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.236971:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727b6c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfac8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.236975:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727b6c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfac8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.236982:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325d680 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.236984:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727b6c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfac8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.236986:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008c408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011628288:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.236988:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727b6c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfac8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.236993:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727b6c7 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfac8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.236997:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727b6c7 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfac8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.237000:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.237031:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011628288 00000100:00100000:1.0:1721880422.237033:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011628288 00000100:00100000:2.0:1721880422.237041:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.237044:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631807 00000100:00100000:1.0:1721880422.237046:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+1835:3687:x1805522011628288:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.237050:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257673984 00000100:00100000:2.0:1721880422.237052:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257673984 00002000:00080000:1.0:1721880422.237055:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64211 count 1 00010000:00010000:2.0:1721880422.237061:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a2c0900/0x8a60d30f571772ca lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfacd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0ffdba expref: 1424 pid: 16076 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.237062:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727b730 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfad3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.237071:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135786f40/0x8a60d30f57177f96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfad3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1007fb expref: 1424 pid: 16018 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.237072:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913989 00000100:00100000:2.0:1721880422.237075:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1424:2006:x1805522257673984:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.237080:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.237082:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.237083:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a2c0900/0x8a60d30f571772ca lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfacd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0ffdba expref: 1424 pid: 16076 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.237084:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.237086:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727b730 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfad3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.237088:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1835:3687:x1805522011623808:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3683us (3728us total) trans 4296019895 rc 0/0 00010000:00010000:2.0:1721880422.237089:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a2c0900/0x8a60d30f571772ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfacd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0ffdba expref: 1424 pid: 16076 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.237092:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631792 00010000:00010000:2.0:1721880422.237096:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a2c0900/0x8a60d30f571772ca lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfacd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0ffdba expref: 1424 pid: 16076 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.237103:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135786f40/0x8a60d30f57177f96 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfad3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1007fb expref: 1423 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.237103:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.237104:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.237106:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727b6e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfacd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.237111:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135786f40/0x8a60d30f57177f96 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfad3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1007fb expref: 1423 pid: 16018 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.237113:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800982f3180/0x8a60d30f571eb279 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1297a8 expref: 408 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.237114:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727b6e3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfacd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.237119:0:9458:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008777f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9458:1805522011625856:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.237121:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008c409880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011628416:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.237123:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.237130:0:9458:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325eac0/0x8a60d30f5727b6ea lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.237131:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1423:2006:x1805522257673984:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 55us (92us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.237135:0:9458:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325eac0/0x8a60d30f5727b6ea lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.237135:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913989 00000100:00100000:1.0:1721880422.237136:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb600 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.237142:0:9458:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325eac0/0x8a60d30f5727b6ea lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.237147:0:9458:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325eac0/0x8a60d30f5727b6ea lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.237150:0:9458:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325eac0/0x8a60d30f5727b6ea lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.237154:0:9458:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325eac0/0x8a60d30f5727b6ea lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.237157:0:9458:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325eac0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.237158:0:9458:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325eac0/0x8a60d30f5727b6ea lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.237162:0:9458:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325eac0/0x8a60d30f5727b6ea lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.237163:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009f52f100/2, rc 0, transno 1052599 00010000:00010000:0.0:1721880422.237167:0:9458:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325eac0/0x8a60d30f5727b6ea lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.237169:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009f52f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011623808:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.237170:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.237171:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325eac0/0x8a60d30f5727b6ea lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.237178:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257674112 00000100:00100000:2.0:1721880422.237180:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257674112 00010000:00010000:2.0:1721880422.237187:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c3ef840/0x8a60d30f571eb225 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12975b expref: 408 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.237197:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913990 00000100:00100000:2.0:1721880422.237200:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+408:2004:x1805522257674112:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.237204:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.237206:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c3ef840/0x8a60d30f571eb225 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2aa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12975b expref: 408 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.237212:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c3ef840/0x8a60d30f571eb225 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2aa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12975b expref: 408 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.237219:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c3ef840/0x8a60d30f571eb225 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2aa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12975b expref: 408 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.237229:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.237230:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.237232:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727b6b9 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.237237:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727b6b9 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.237243:0:9458:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2646:3689:x1805522011625472:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3668us (3693us total) trans 4296061589 rc 0/0 00010000:00010000:2.0:1721880422.237244:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.237247:0:9458:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631797 00000100:00100000:2.0:1721880422.237251:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+407:2004:x1805522257674112:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 51us (82us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.237254:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913990 00000004:00080000:0.0:1721880422.237268:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e9c9180/2, rc 0, transno 1094293 00000100:00100000:0.0:1721880422.237282:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e9c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011625472:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1721880422.237288:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088db6a00/2, rc 0, transno 1094292 00000100:00100000:0.0:1721880422.237290:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088db6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011622912:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1721880422.237296:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088db4380/2, rc 0, transno 1094291 00000100:00100000:0.0:1721880422.237299:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011622528:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.237302:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1721880422.237308:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008c40ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011628544:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.237322:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.237335:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880098d25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011628800:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1721880422.237337:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009ebd8700/2, rc 0, transno 1052600 00000100:00100000:0.0:1721880422.237341:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009ebd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011624960:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.237353:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.237364:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1721880422.237365:0:9458:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011628544 00000100:00100000:0.0:1721880422.237367:0:9458:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011628544 00000100:00100000:1.0:1721880422.237367:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880098d24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011628928:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.237376:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.237382:0:9458:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011628800 00000100:00100000:0.0:1721880422.237384:0:9458:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011628800 00000100:00100000:0.0:1721880422.237391:0:9458:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011628928 00000100:00100000:0.0:1721880422.237393:0:9458:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011628928 00000100:00100000:1.0:1721880422.237400:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631808 00000100:00100000:1.0:1721880422.237405:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008777f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+1835:3689:x1805522011628544:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.237405:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631809 00000100:00100000:0.0:1721880422.237409:0:9458:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631810 00000100:00100000:2.0:1721880422.237409:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2647:3686:x1805522011628800:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.237412:0:9458:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2647:3686:x1805522011628928:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1721880422.237413:0:15514:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64212 count 1 00002000:00080000:2.0:1721880422.237419:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58033 count 1 00002000:00080000:0.0:1721880422.237420:0:9458:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58034 count 1 00010000:00010000:1.0:1721880422.237420:0:15514:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727b737 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfad4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.237427:0:9458:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b745 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2b2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.237427:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136353a80/0x8a60d30f5727b73e lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2b1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.237428:0:15514:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b5de880/0x8a60d30f571780d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfad4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10084f expref: 1422 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.237432:0:15514:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.237433:0:15514:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.237435:0:9458:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136392880/0x8a60d30f571eb4a9 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1299df expref: 406 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.237435:0:15514:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727b737 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfad4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.237435:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136390d80/0x8a60d30f571eb45c lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12998b expref: 406 pid: 16112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.237439:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.237440:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.237442:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136353a80/0x8a60d30f5727b73e lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.237443:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.237444:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.237444:0:15514:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b5de880/0x8a60d30f571780d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfad4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10084f expref: 1422 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.237446:0:9458:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b745 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.237449:0:15514:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b5de880/0x8a60d30f571780d8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfad4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10084f expref: 1422 pid: 16100 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.237452:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136390d80/0x8a60d30f571eb45c lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12998b expref: 406 pid: 16112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.237455:0:15514:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880098d25f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:15514:1805522011629184:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.237456:0:9458:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136392880/0x8a60d30f571eb4a9 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1299df expref: 406 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.237459:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136390d80/0x8a60d30f571eb45c lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12998b expref: 406 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.237461:0:9458:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136392880/0x8a60d30f571eb4a9 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1299df expref: 406 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.237465:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099eb0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0000_UUID:16060:1805522011629312:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.237467:0:9458:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008777fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9458:1805522011629440:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.237471:0:15514:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb780 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.237480:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03540 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.237484:0:9458:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36e40 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.237495:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088db5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011628672:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.237508:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.237519:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1721880422.237521:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008777ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011629056:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.237532:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.237549:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631811 00000100:00100000:2.0:1721880422.237552:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008777dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2648:3689:x1805522011628672:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1721880422.237561:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58032 count 1 00010000:00010000:2.0:1721880422.237568:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801363521c0/0x8a60d30f5727b74c lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2b0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.237575:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a06398c0/0x8a60d30f571eb408 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129937 expref: 406 pid: 16019 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.237579:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.237580:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.237581:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801363521c0/0x8a60d30f5727b74c lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.237590:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a06398c0/0x8a60d30f571eb408 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129937 expref: 406 pid: 16019 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.237596:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a06398c0/0x8a60d30f571eb408 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129937 expref: 406 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.237605:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fde2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:15453:1805522011629568:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.237621:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.237821:0:16130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011629824 00000100:00100000:1.0:1721880422.237824:0:16130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011629824 00000100:00100000:1.0:1721880422.237841:0:16130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631813 00000100:00100000:1.0:1721880422.237846:0:16130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096003480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0000-mdtlov_UUID+2649:3688:x1805522011629824:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1721880422.237857:0:16130:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58035 count 1 00010000:00010000:1.0:1721880422.237866:0:16130:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009106c6c0/0x8a60d30f5727b75a lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2b3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.237876:0:16130:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131e57cc0/0x8a60d30f571eb50b lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129a3a expref: 406 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.237886:0:16130:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.237887:0:16130:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.237889:0:16130:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009106c6c0/0x8a60d30f5727b75a lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.237905:0:16130:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131e57cc0/0x8a60d30f571eb50b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129a3a expref: 406 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.237912:0:16130:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131e57cc0/0x8a60d30f571eb50b lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129a3a expref: 406 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.237921:0:16130:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880098d27480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0000_UUID:16130:1805522011629952:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.237954:0:16130:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.238101:0:16110:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008777e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_094:lustre-OST0001_UUID:16110:1805522011626624:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.238112:0:16110:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727b6ff lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xface:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.238135:0:16113:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008c40aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0000_UUID:16113:1805522011626496:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.238152:0:16113:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009106cd80/0x8a60d30f5727b6f8 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.238174:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008777ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16125:1805522011626368:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.238190:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727b6f1 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.239178:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.239220:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.239221:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257674240 00000100:00100000:2.0:1721880422.239225:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257674240 00000100:00100000:2.0:1721880422.239233:0:15444:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257674496 00000100:00100000:2.0:1721880422.239234:0:15444:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257674496 00000100:00100000:0.0:1721880422.239235:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.239245:0:15444:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099b16880/0x8a60d30f571eb31a lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129849 expref: 407 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.239249:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.239252:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008c409500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011627648:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.239258:0:15444:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257674368 00000100:00100000:2.0:1721880422.239260:0:15444:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257674368 00000100:00100000:0.0:1721880422.239265:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.239265:0:15444:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f5bdd40/0x8a60d30f571eb2cd lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1297fc expref: 408 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.239267:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106e640/0x8a60d30f5727b70d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfad1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.239274:0:15444:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257674752 00000100:00100000:2.0:1721880422.239275:0:15444:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257674752 00000100:00100000:0.0:1721880422.239281:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.239281:0:15444:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800983b6ac0/0x8a60d30f571775a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfad1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100030 expref: 1424 pid: 16020 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.239288:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257674880 00000100:00100000:1.0:1721880422.239292:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257674880 00000100:00100000:0.0:1721880422.239294:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.239304:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009527b180/0x8a60d30f571773f7 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfacf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0ffeb6 expref: 1425 pid: 16076 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.239307:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913991 00000100:00100000:2.0:1721880422.239311:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ab4d4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+409:2005:x1805522257674496:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.239312:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913992 00000100:00100000:0.0:1721880422.239317:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008777c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+409:2005:x1805522257674368:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.239319:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.239322:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099b16880/0x8a60d30f571eb31a lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129849 expref: 409 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.239324:0:7118:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.239328:0:7118:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f5bdd40/0x8a60d30f571eb2cd lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1297fc expref: 409 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.239329:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099b16880/0x8a60d30f571eb31a lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129849 expref: 409 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.239333:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913993 00010000:00010000:0.0:1721880422.239336:0:7118:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f5bdd40/0x8a60d30f571eb2cd lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1297fc expref: 409 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.239338:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099b16880/0x8a60d30f571eb31a lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2ad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129849 expref: 409 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.239339:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008777d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+409:2005:x1805522257674624:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.239346:0:7118:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f5bdd40/0x8a60d30f571eb2cd lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1297fc expref: 408 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.239347:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.239348:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.239349:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.239351:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009106cd80/0x8a60d30f5727b6f8 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.239352:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131be18c0/0x8a60d30f571eb367 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12989d expref: 407 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.239356:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.239356:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009106cd80/0x8a60d30f5727b6f8 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.239357:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.239359:0:7118:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727b6f1 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.239361:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131be18c0/0x8a60d30f571eb367 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12989d expref: 407 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.239364:0:7118:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727b6f1 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.239367:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.239373:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131be18c0/0x8a60d30f571eb367 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2ae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12989d expref: 407 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.239374:0:7118:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.239383:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ab4d4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+406:2005:x1805522257674496:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 71us (163us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.239384:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.239385:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1721880422.239386:0:7118:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008777c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+406:2005:x1805522257674368:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 69us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.239387:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913991 00010000:00010000:1.0:1721880422.239388:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b58c0/0x8a60d30f5727b706 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.239390:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913992 00010000:00010000:1.0:1721880422.239394:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b58c0/0x8a60d30f5727b706 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.239398:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913995 00000100:00100000:0.0:1721880422.239402:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913996 00000100:00100000:2.0:1721880422.239402:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008777ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1425:2006:x1805522257674880:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.239405:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008777e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+1425:2006:x1805522257675008:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.239407:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.239410:0:7118:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.239410:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.239410:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009527b180/0x8a60d30f571773f7 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfacf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0ffeb6 expref: 1425 pid: 16076 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.239413:0:7118:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132ecb180/0x8a60d30f571774d0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfad0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fff7a expref: 1425 pid: 16059 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.239417:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009527b180/0x8a60d30f571773f7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfacf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0ffeb6 expref: 1425 pid: 16076 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.239420:0:7118:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132ecb180/0x8a60d30f571774d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfad0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fff7a expref: 1425 pid: 16059 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.239424:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.239425:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.239427:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727b714 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfacf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.239428:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.239428:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.239430:0:7118:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727b71b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfad0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.239431:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727b714 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfacf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.239434:0:7118:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727b71b lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfad0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.239435:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008777d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+404:2005:x1805522257674624:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 95us (184us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.239437:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.239440:0:7118:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.239441:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913993 00000100:00100000:2.0:1721880422.239453:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008777ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1424:2006:x1805522257674880:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 51us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.239454:0:7118:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008777e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+1424:2006:x1805522257675008:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 48us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.239457:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913995 00000100:00100000:0.0:1721880422.239460:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913996 00010000:00010000:1.0:1721880422.239468:0:16113:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009106cd80/0x8a60d30f5727b6f8 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.239475:0:16113:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009106cd80/0x8a60d30f5727b6f8 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.239477:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727b6f1 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.239479:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009528cb40/0x8a60d30f5717734f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xface:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0ffe2a expref: 1421 pid: 16020 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.239481:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727b6f1 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.239482:0:16113:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009106cd80/0x8a60d30f5727b6f8 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.239486:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727b6f1 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.239488:0:16113:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009106cd80/0x8a60d30f5727b6f8 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.239489:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913997 00010000:00010000:0.0:1721880422.239490:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727b6f1 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.239491:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008777d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1421:2005:x1805522257674240:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.239494:0:16113:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009106cd80/0x8a60d30f5727b6f8 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.239495:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727b6f1 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.239496:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.239498:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009528cb40/0x8a60d30f5717734f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xface:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0ffe2a expref: 1421 pid: 16020 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.239499:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325c480 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.239500:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727b6f1 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.239500:0:16113:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106cd80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.239503:0:16113:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009106cd80/0x8a60d30f5727b6f8 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.239504:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727b6f1 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.239504:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009528cb40/0x8a60d30f5717734f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xface:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0ffe2a expref: 1421 pid: 16020 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.239509:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727b6f1 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.239509:0:16113:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009106cd80/0x8a60d30f5727b6f8 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.239511:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009528cb40/0x8a60d30f5717734f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xface:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0ffe2a expref: 1421 pid: 16020 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.239513:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727b6f1 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.239517:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.239518:0:16113:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009106cd80/0x8a60d30f5727b6f8 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.239519:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.239520:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727b6ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xface:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.239524:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727b6ff lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xface:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.239529:0:16113:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009106cd80/0x8a60d30f5727b6f8 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.239531:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.239539:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008777d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1420:2005:x1805522257674240:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 47us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.239542:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913997 00010000:00010000:2.0:1721880422.239565:0:16110:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727b6ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xface:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.239569:0:16110:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727b6ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xface:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.239574:0:16110:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727b6ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xface:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.239577:0:16110:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727b6ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xface:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.239586:0:16110:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727b6ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xface:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.239589:0:16110:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325d440 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.239591:0:16110:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727b6ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xface:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.239595:0:16110:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727b6ff lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xface:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.239600:0:16110:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727b6ff lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xface:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.239604:0:16110:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727b6ff lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xface:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.239609:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2651:3686:x1805522011625984:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3914us (3956us total) trans 4296061591 rc 0/0 00000100:00100000:0.0:1721880422.239613:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631798 00010000:00010000:0.0:1721880422.239633:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132ecb180/0x8a60d30f571774d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfad0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b0fff7a expref: 1419 pid: 16059 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.239641:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008777c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011627904:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.239650:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727b71b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfad0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.239659:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727b71b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfad0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.239661:0:16113:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0000-mdtlov_UUID+2650:3686:x1805522011626112:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3878us (3941us total) trans 4296061592 rc 0/0 00010000:00010000:0.0:1721880422.239663:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727b71b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfad0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.239667:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727b71b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfad0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.239668:0:16113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631799 00010000:00010000:0.0:1721880422.239670:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727b71b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfad0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.239674:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727b71b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfad0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.239677:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325f600 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.239679:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727b71b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfad0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.239682:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727b71b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfad0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.239687:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106e640/0x8a60d30f5727b70d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfad1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.239688:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727b71b lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfad0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.239691:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727b71b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfad0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.239694:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106e640/0x8a60d30f5727b70d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfad1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.239701:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106e640/0x8a60d30f5727b70d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfad1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.239707:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106e640/0x8a60d30f5727b70d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfad1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.239708:0:16110:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099eb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_094:lustre-MDT0000-mdtlov_UUID+1837:3689:x1805522011626240:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3900us (3930us total) trans 4296019898 rc 0/0 00000100:00100000:2.0:1721880422.239712:0:16110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631800 00010000:00010000:1.0:1721880422.239713:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106e640/0x8a60d30f5727b70d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfad1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.239719:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106e640 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.239721:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106e640/0x8a60d30f5727b70d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfad1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.239749:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106e640/0x8a60d30f5727b70d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfad1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.239759:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106e640/0x8a60d30f5727b70d lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfad1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.239765:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106e640/0x8a60d30f5727b70d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfad1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.239801:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.239810:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257675136 00000100:00100000:2.0:1721880422.239812:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257675136 00000100:00100000:0.0:1721880422.239820:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c40a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+1838:3687:x1805522011627136:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3162us (3237us total) trans 4296019899 rc 0/0 00010000:00010000:2.0:1721880422.239822:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800928f6400/0x8a60d30f571eb3bb lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1298ea expref: 404 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.239825:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631804 00000100:00100000:2.0:1721880422.239832:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913998 00000100:00100000:2.0:1721880422.239835:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fde0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+404:2005:x1805522257675136:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.239840:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.239842:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800928f6400/0x8a60d30f571eb3bb lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe2af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1298ea expref: 404 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.239848:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800928f6400/0x8a60d30f571eb3bb lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1298ea expref: 404 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.239855:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000004:00080000:0.0:1721880422.239856:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009ebdb480/2, rc 0, transno 1052602 00010000:00010000:2.0:1721880422.239856:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.239858:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009106cb40/0x8a60d30f5727b722 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.239862:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009106cb40/0x8a60d30f5727b722 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2af:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.239863:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009ebdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011626240:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.239869:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.239875:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ebdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+1837:3688:x1805522011627264:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3259us (3311us total) trans 4296019900 rc 0/0 00000100:00100000:2.0:1721880422.239879:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fde0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+404:2005:x1805522257675136:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 43us (79us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.239882:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631803 00000100:00100000:2.0:1721880422.239884:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913998 00000004:00080000:0.0:1721880422.239898:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008777e680/2, rc 0, transno 1094297 00000100:00100000:0.0:1721880422.239906:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008777e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011626752:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.239911:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800928f6400/0x8a60d30f571eb3bb lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1298ea expref: 403 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.239911:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.239919:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257675264 00000100:00100000:1.0:1721880422.239921:0:16088:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008c40b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0000_UUID:16088:1805522011628032:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.239921:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257675264 00010000:00010000:2.0:1721880422.239927:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801203c2880/0x8a60d30f57177bc2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfad2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1004f2 expref: 1419 pid: 16057 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.239935:0:16088:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009106cb40/0x8a60d30f5727b722 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.239937:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 913999 00000100:00100000:2.0:1721880422.239940:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a70ee050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1419:2005:x1805522257675264:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.239942:0:16088:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009106cb40/0x8a60d30f5727b722 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.239944:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.239946:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801203c2880/0x8a60d30f57177bc2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfad2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1004f2 expref: 1419 pid: 16057 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.239948:0:16088:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009106cb40/0x8a60d30f5727b722 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.239951:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801203c2880/0x8a60d30f57177bc2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfad2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1004f2 expref: 1419 pid: 16057 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.239954:0:16088:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009106cb40/0x8a60d30f5727b722 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.239958:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801203c2880/0x8a60d30f57177bc2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfad2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1004f2 expref: 1419 pid: 16057 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.239965:0:16088:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009106cb40/0x8a60d30f5727b722 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.239965:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.239966:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.239968:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727b729 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfad2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.239971:0:16088:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009106cb40/0x8a60d30f5727b722 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.239972:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727b729 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfad2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.239975:0:16088:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106cb40 already unused, calling callback (ffffffffa084e330) 00000100:00100000:0.0:1721880422.239976:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.239978:0:16088:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009106cb40/0x8a60d30f5727b722 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.239980:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.239983:0:16088:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009106cb40/0x8a60d30f5727b722 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.239991:0:16088:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009106cb40/0x8a60d30f5727b722 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.239996:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009106cb40/0x8a60d30f5727b722 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.239996:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257675520 00000100:00100000:2.0:1721880422.239997:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257675520 00000100:00100000:0.0:1721880422.240000:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.240004:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b5de880/0x8a60d30f571780d8 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfad4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10084f expref: 1419 pid: 16100 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.240009:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257675392 00000100:00100000:0.0:1721880422.240026:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257675392 00000100:00100000:2.0:1721880422.240032:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914000 00000100:00100000:2.0:1721880422.240035:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008777df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+1420:2005:x1805522257675520:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.240036:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135786f40/0x8a60d30f57177f96 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfad3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1007fb expref: 1420 pid: 16018 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.240039:0:15473:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.240042:0:15473:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b5de880/0x8a60d30f571780d8 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfad4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10084f expref: 1420 pid: 16100 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.240048:0:15473:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b5de880/0x8a60d30f571780d8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfad4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10084f expref: 1420 pid: 16100 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.240050:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914001 00000100:00100000:0.0:1721880422.240053:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008777d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+1420:2004:x1805522257675392:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.240055:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.240056:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.240058:0:15473:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727b737 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfad4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.240059:0:7118:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.240062:0:7118:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135786f40/0x8a60d30f57177f96 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfad3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1007fb expref: 1420 pid: 16018 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.240062:0:15473:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727b737 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfad4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.240067:0:15473:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.240068:0:7118:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135786f40/0x8a60d30f57177f96 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfad3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1007fb expref: 1420 pid: 16018 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.240077:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.240077:0:15473:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008777df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+1420:2005:x1805522257675520:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 41us (102us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.240078:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.240080:0:7118:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727b730 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfad3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.240080:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914000 00010000:00010000:0.0:1721880422.240085:0:7118:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727b730 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfad3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.240092:0:7118:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.240095:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c40b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2650:3686:x1805522011627520:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3374us (3401us total) trans 4296061594 rc 0/0 00000100:00100000:1.0:1721880422.240100:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631805 00000100:00100000:2.0:1721880422.240111:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a70ee050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1419:2005:x1805522257675264:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 170us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.240113:0:7118:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008777d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+1419:2004:x1805522257675392:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 59us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.240115:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 913999 00000100:00100000:0.0:1721880422.240119:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914001 00010000:00010000:1.0:1721880422.240122:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b5de880/0x8a60d30f571780d8 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfad4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10084f expref: 1418 pid: 16100 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.240132:0:15514:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880098d25f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:15514:1805522011629184:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.240144:0:15514:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727b737 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfad4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.240148:0:15514:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727b737 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfad4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.240152:0:15514:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727b737 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfad4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.240156:0:15514:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727b737 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfad4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.240159:0:15514:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727b737 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfad4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.240163:0:15514:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727b737 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfad4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.240166:0:15514:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106fa80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.240167:0:15514:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727b737 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfad4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.240171:0:15514:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727b737 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfad4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.240176:0:15514:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727b737 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfad4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.240183:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727b737 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfad4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.240207:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099eb0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0000_UUID:16060:1805522011629312:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.240216:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136353a80/0x8a60d30f5727b73e lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.240228:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.240229:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fde2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:15453:1805522011629568:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.240235:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257675648 00010000:00010000:2.0:1721880422.240236:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801363521c0/0x8a60d30f5727b74c lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.240237:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257675648 00010000:00010000:0.0:1721880422.240245:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136390d80/0x8a60d30f571eb45c lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12998b expref: 403 pid: 16112 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.240261:0:15514:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008777f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+1838:3689:x1805522011628544:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2855us (2937us total) trans 4296019901 rc 0/0 00000100:00100000:0.0:1721880422.240262:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914002 00000100:00100000:0.0:1721880422.240265:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008777c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+403:2004:x1805522257675648:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.240265:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631808 00010000:00010000:0.0:1721880422.240270:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.240271:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.240273:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136390d80/0x8a60d30f571eb45c lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12998b expref: 403 pid: 16112 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.240278:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257675776 00010000:00010000:0.0:1721880422.240279:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136390d80/0x8a60d30f571eb45c lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12998b expref: 403 pid: 16112 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.240280:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257675776 00010000:00010000:0.0:1721880422.240287:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136390d80/0x8a60d30f571eb45c lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2b1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12998b expref: 404 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.240287:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135786f40/0x8a60d30f57177f96 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfad3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1007fb expref: 1416 pid: 16018 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.240287:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136392880/0x8a60d30f571eb4a9 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe2b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1299df expref: 404 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.240295:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008c409880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011628416:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.240299:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.240299:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.240299:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914003 00010000:00010000:0.0:1721880422.240301:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136353a80/0x8a60d30f5727b73e lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.240302:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727b730 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfad3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.240302:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fde2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+403:2006:x1805522257675776:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.240306:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136353a80/0x8a60d30f5727b73e lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.240307:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727b730 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfad3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.240310:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727b730 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfad3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.240312:0:7118:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.240314:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727b730 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfad3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.240315:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.240315:0:7118:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136392880/0x8a60d30f571eb4a9 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe2b2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1299df expref: 403 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.240318:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727b730 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfad3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.240320:0:7118:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136392880/0x8a60d30f571eb4a9 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2b2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1299df expref: 403 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.240324:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727b730 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfad3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.240326:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008777c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+403:2004:x1805522257675648:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 60us (99us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.240328:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106f180 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.240328:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1721880422.240329:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914002 00010000:00010000:2.0:1721880422.240329:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.240330:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727b730 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfad3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.240331:0:7118:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b745 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2b2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.240333:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727b730 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfad3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.240336:0:7118:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b745 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2b2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.240339:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727b730 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfad3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.240342:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727b730 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfad3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.240342:0:7118:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.240351:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136392880/0x8a60d30f571eb4a9 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1299df expref: 402 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.240352:0:7118:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fde2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+402:2006:x1805522257675776:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 50us (82us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.240359:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914003 00000100:00100000:0.0:1721880422.240361:0:9458:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008777fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9458:1805522011629440:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.240371:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136353a80/0x8a60d30f5727b73e lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.240373:0:9458:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b745 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.240376:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136353a80/0x8a60d30f5727b73e lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.240380:0:9458:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b745 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.240380:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136353a80/0x8a60d30f5727b73e lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.240384:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136353a80/0x8a60d30f5727b73e lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.240387:0:9458:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b745 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.240388:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136353a80/0x8a60d30f5727b73e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.240391:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353a80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.240393:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136353a80/0x8a60d30f5727b73e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.240395:0:9458:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b745 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.240396:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136353a80/0x8a60d30f5727b73e lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.240401:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136353a80/0x8a60d30f5727b73e lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.240402:0:9458:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b745 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.240405:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136353a80/0x8a60d30f5727b73e lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.240407:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+1838:3687:x1805522011628288:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3359us (3405us total) trans 4296019903 rc 0/0 00010000:00010000:0.0:1721880422.240409:0:9458:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b745 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.240411:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631807 00010000:00010000:0.0:1721880422.240415:0:9458:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325cd80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.240417:0:9458:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b745 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.240422:0:9458:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b745 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.240427:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008777ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011630208:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.240428:0:9458:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b745 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.240432:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b745 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.240438:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1721880422.240450:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008c408380/2, rc 0, transno 1052607 00000100:00100000:1.0:1721880422.240462:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008c408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011628288:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1721880422.240468:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008c40b800/2, rc 0, transno 1052603 00000100:00100000:1.0:1721880422.240470:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008c40b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011627136:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.240476:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1721880422.240479:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880084310000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011630848:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.240493:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011630208 00000100:00100000:1.0:1721880422.240495:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011630208 00000100:00100000:1.0:1721880422.240504:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011630592 00000100:00100000:1.0:1721880422.240505:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011630592 00000100:00100000:2.0:1721880422.240508:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2652:3686:x1805522011628800:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3097us (3153us total) trans 4296061595 rc 0/0 00000100:00100000:2.0:1721880422.240513:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631809 00000100:00100000:0.0:1721880422.240517:0:9458:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2652:3686:x1805522011628928:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3104us (3140us total) trans 4296061596 rc 0/0 00000100:00100000:1.0:1721880422.240517:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631815 00000100:00100000:1.0:1721880422.240521:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2651:3687:x1805522011630208:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.240526:0:9458:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631810 00002000:00080000:1.0:1721880422.240530:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58036 count 1 00010000:00010000:1.0:1721880422.240537:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009106e400/0x8a60d30f5727b768 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2b4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.240545:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c0e0d80/0x8a60d30f571eb551 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129a80 expref: 400 pid: 16099 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.240546:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000004:00080000:0.0:1721880422.240549:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008c40ad80/2, rc 0, transno 1052605 00010000:00010000:1.0:1721880422.240549:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.240550:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.240551:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009106e400/0x8a60d30f5727b768 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.240554:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257675904 00000100:00100000:2.0:1721880422.240556:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257675904 00010000:00010000:1.0:1721880422.240562:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c0e0d80/0x8a60d30f571eb551 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129a80 expref: 401 pid: 16099 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.240564:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008c40ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011628544:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.240564:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a06398c0/0x8a60d30f571eb408 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129937 expref: 401 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.240567:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c0e0d80/0x8a60d30f571eb551 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129a80 expref: 401 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.240574:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880098d27b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0000_UUID:16017:1805522011630976:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.240575:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914004 00000100:00100000:2.0:1721880422.240578:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fde0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+401:2004:x1805522257675904:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.240583:0:7118:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.240585:0:7118:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a06398c0/0x8a60d30f571eb408 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129937 expref: 401 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.240590:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb600 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.240591:0:7118:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a06398c0/0x8a60d30f571eb408 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129937 expref: 401 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.240598:0:7118:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a06398c0/0x8a60d30f571eb408 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2b0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129937 expref: 401 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.240605:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.240606:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.240608:0:7118:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801363521c0/0x8a60d30f5727b74c lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.240611:0:16130:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880098d27480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0000_UUID:16130:1805522011629952:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.240615:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.240616:0:7118:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801363521c0/0x8a60d30f5727b74c lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.240619:0:16130:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009106c6c0/0x8a60d30f5727b75a lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.240624:0:7118:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.240629:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257676032 00000100:00100000:0.0:1721880422.240632:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257676032 00000100:00100000:2.0:1721880422.240634:0:7118:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fde0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+400:2004:x1805522257675904:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 55us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.240637:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914004 00000004:00080000:1.0:1721880422.240639:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880098d24000/2, rc 0, transno 1094300 00010000:00010000:0.0:1721880422.240642:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800983b46c0/0x8a60d30f571783a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfad5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100905 expref: 1416 pid: 15447 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.240645:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880098d24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011628928:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1721880422.240647:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801363521c0/0x8a60d30f5727b74c lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.240652:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801363521c0/0x8a60d30f5727b74c lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.240654:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914005 00010000:00010000:2.0:1721880422.240656:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801363521c0/0x8a60d30f5727b74c lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.240657:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008777fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1416:2005:x1805522257676032:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.240660:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801363521c0/0x8a60d30f5727b74c lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.240662:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00080000:1.0:1721880422.240663:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880098d25180/2, rc 0, transno 1094299 00010000:00010000:2.0:1721880422.240663:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801363521c0/0x8a60d30f5727b74c lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.240664:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800983b46c0/0x8a60d30f571783a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfad5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100905 expref: 1416 pid: 15447 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.240667:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880098d25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011628800:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1721880422.240667:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801363521c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.240668:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801363521c0/0x8a60d30f5727b74c lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.240671:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800983b46c0/0x8a60d30f571783a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfad5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100905 expref: 1416 pid: 15447 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.240675:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801363521c0/0x8a60d30f5727b74c lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.240677:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008777ea00/2, rc 0, transno 1094298 00010000:00010000:0.0:1721880422.240678:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800983b46c0/0x8a60d30f571783a2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfad5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100905 expref: 1416 pid: 15447 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.240680:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008777ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011627520:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1721880422.240681:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801363521c0/0x8a60d30f5727b74c lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.240684:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801363521c0/0x8a60d30f5727b74c lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.240685:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.240686:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.240688:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727b753 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfad5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.240692:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008c409180/2, rc 0, transno 1052601 00010000:00010000:0.0:1721880422.240693:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727b753 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfad5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.240701:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008c409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011627008:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.240706:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:1.0:1721880422.240708:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e9ca300/2, rc 0, transno 1094296 00000100:00100000:1.0:1721880422.240711:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e9ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011626112:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.240718:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008777fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1415:2005:x1805522257676032:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 60us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.240722:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.240725:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914005 00000100:00100000:1.0:1721880422.240747:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008777c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011630080:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.240757:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880098d27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011631360:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.240758:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.240775:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880084313b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011630720:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.240780:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.240787:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008777dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2651:3689:x1805522011628672:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3233us (3278us total) trans 4296061597 rc 0/0 00000100:00100000:0.0:1721880422.240790:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880098d25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011631872:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.240791:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631811 00000100:00100000:1.0:1721880422.240795:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.240800:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011630848 00000100:00100000:2.0:1721880422.240802:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011630848 00000100:00100000:0.0:1721880422.240803:0:9458:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011630080 00000100:00100000:0.0:1721880422.240805:0:9458:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011630080 00000100:00100000:1.0:1721880422.240811:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880098d24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011631616:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.240812:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011630720 00000100:00100000:2.0:1721880422.240813:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011630720 00000100:00100000:0.0:1721880422.240816:0:9458:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631817 00000100:00100000:0.0:1721880422.240819:0:9458:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1841:3687:x1805522011630848:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.240820:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1721880422.240837:0:9458:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64218 count 1 00000100:00100000:2.0:1721880422.240839:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631818 00000100:00100000:2.0:1721880422.240842:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1841:3687:x1805522011630080:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.240846:0:9458:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727b776 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfada:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.240846:0:16113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631819 00000100:00100000:1.0:1721880422.240850:0:16113:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008777d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0000-mdtlov_UUID+2652:3689:x1805522011631360:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1721880422.240851:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64214 count 1 00010000:00010000:0.0:1721880422.240854:0:9458:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c5b9b00/0x8a60d30f57178ebc lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfada:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100b90 expref: 1414 pid: 16073 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.240858:0:16113:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58037 count 1 00010000:00010000:0.0:1721880422.240859:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.240859:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727b77d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfad6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.240860:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.240861:0:9458:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727b776 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfada:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.240866:0:16113:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098aa9200/0x8a60d30f5727b784 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.240867:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b76d200/0x8a60d30f5717858c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfad6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10096e expref: 1414 pid: 16109 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.240871:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.240873:0:16113:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800999d7cc0/0x8a60d30f571eb5b3 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129ae9 expref: 399 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.240873:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.240874:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727b77d lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfad6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.240877:0:9458:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c5b9b00/0x8a60d30f57178ebc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfada:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100b90 expref: 1414 pid: 16073 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.240877:0:16113:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.240878:0:16113:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.240880:0:16113:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098aa9200/0x8a60d30f5727b784 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.240885:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b76d200/0x8a60d30f5717858c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfad6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10096e expref: 1414 pid: 16109 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.240887:0:9458:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c5b9b00/0x8a60d30f57178ebc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfada:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100b90 expref: 1414 pid: 16073 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.240889:0:16113:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800999d7cc0/0x8a60d30f571eb5b3 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129ae9 expref: 399 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.240891:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b76d200/0x8a60d30f5717858c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfad6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10096e expref: 1414 pid: 16109 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.240894:0:16113:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800999d7cc0/0x8a60d30f571eb5b3 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129ae9 expref: 399 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.240898:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fde1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011632128:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.240900:0:16113:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008c409500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0000_UUID:16113:1805522011632256:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.240902:0:9458:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008777d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011632000:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.240915:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.240916:0:16113:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.240922:0:9458:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36e40 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.240927:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631821 00000100:00100000:1.0:1721880422.240931:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c40b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+2652:3687:x1805522011631616:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1721880422.240936:0:15514:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58039 count 1 00000100:00100000:3.0:1721880422.240936:0:16098:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec540 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.240941:0:15514:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098aa9d40/0x8a60d30f5727b792 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2b7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.240942:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.240947:0:15514:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092ba4b40/0x8a60d30f571eb662 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129b91 expref: 399 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.240951:0:15514:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1721880422.240951:0:16120:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011631872 00010000:00010000:1.0:1721880422.240952:0:15514:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.240953:0:15514:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098aa9d40/0x8a60d30f5727b792 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.240954:0:16120:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011631872 00000004:00080000:0.0:1721880422.240961:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088db5500/2, rc 0, transno 1094301 00010000:00010000:1.0:1721880422.240961:0:15514:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092ba4b40/0x8a60d30f571eb662 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129b91 expref: 399 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.240966:0:15514:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092ba4b40/0x8a60d30f571eb662 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129b91 expref: 399 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.240970:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088db5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011628672:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.240971:0:15514:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008c40aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:15514:1805522011632512:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.240973:0:16120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631822 00000100:00100000:3.0:1721880422.240977:0:16120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008777ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+2653:3689:x1805522011631872:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.240980:0:15514:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb780 going to sleep for 11 seconds 00002000:00080000:3.0:1721880422.240987:0:16120:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58040 count 1 00000100:00100000:0.0:1721880422.240993:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1721880422.240996:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880084df5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011631744:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1721880422.240996:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e9c8700/2, rc 0, transno 1094295 00010000:00010000:3.0:1721880422.240996:0:16120:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4b40/0x8a60d30f5727b799 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2b8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.241002:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.241006:0:16120:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099aecd80/0x8a60d30f571eb6af lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129bde expref: 399 pid: 16112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.241011:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e9c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011625984:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1721880422.241011:0:16120:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.241028:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257676160 00010000:00010000:3.0:1721880422.241028:0:16120:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.241030:0:16120:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4b40/0x8a60d30f5727b799 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.241031:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257676160 00000100:00100000:1.0:1721880422.241033:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880098d26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011631488:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1721880422.241040:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131e57cc0/0x8a60d30f571eb50b lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129a3a expref: 400 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.241045:0:16120:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099aecd80/0x8a60d30f571eb6af lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129bde expref: 400 pid: 16112 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.241049:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.241053:0:16120:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099aecd80/0x8a60d30f571eb6af lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129bde expref: 400 pid: 16112 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.241056:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914006 00000100:00100000:2.0:1721880422.241059:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8064c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+400:2005:x1805522257676160:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.241061:0:16120:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880084df6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16120:1805522011632896:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.241062:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007b8bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011632768:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1721880422.241064:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1721880422.241066:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011631744 00010000:00010000:2.0:1721880422.241066:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131e57cc0/0x8a60d30f571eb50b lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129a3a expref: 400 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.241068:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011631744 00010000:00010000:2.0:1721880422.241072:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131e57cc0/0x8a60d30f571eb50b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129a3a expref: 400 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.241076:0:16120:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdecb40 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.241079:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631823 00000100:00100000:0.0:1721880422.241081:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cd22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+1842:3689:x1805522011631744:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.241084:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131e57cc0/0x8a60d30f571eb50b lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2b3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129a3a expref: 400 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.241085:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1721880422.241090:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64220 count 1 00010000:00010000:2.0:1721880422.241092:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.241094:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.241096:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009106c6c0/0x8a60d30f5727b75a lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.241097:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727b7a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfadc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.241100:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009106c6c0/0x8a60d30f5727b75a lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.241103:0:16110:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011632768 00010000:00010000:0.0:1721880422.241105:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009594c480/0x8a60d30f57179369 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfadc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100ca1 expref: 1414 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.241106:0:16110:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011632768 00010000:00010000:0.0:1721880422.241109:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.241110:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.241112:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727b7a0 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfadc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.241113:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.241119:0:16130:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009106c6c0/0x8a60d30f5727b75a lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.241121:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009594c480/0x8a60d30f57179369 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfadc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100ca1 expref: 1414 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.241122:0:16110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631824 00000100:00100000:2.0:1721880422.241123:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8064c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+399:2005:x1805522257676160:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 63us (121us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.241124:0:16130:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009106c6c0/0x8a60d30f5727b75a lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.241126:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914006 00000100:00100000:3.0:1721880422.241126:0:16110:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b598e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_094:lustre-MDT0000-mdtlov_UUID+2654:3687:x1805522011632768:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.241128:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009594c480/0x8a60d30f57179369 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfadc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100ca1 expref: 1414 pid: 16100 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.241132:0:16130:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009106c6c0/0x8a60d30f5727b75a lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.241134:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008cd23800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011633024:192.168.201.24@tcp:104: 00002000:00080000:3.0:1721880422.241135:0:16110:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58042 count 1 00010000:00010000:1.0:1721880422.241136:0:16130:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009106c6c0/0x8a60d30f5727b75a lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.241140:0:16130:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009106c6c0/0x8a60d30f5727b75a lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.241142:0:16110:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7840/0x8a60d30f5727b7a7 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2ba:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.241143:0:16130:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106c6c0 already unused, calling callback (ffffffffa084e330) 00000100:00100000:0.0:1721880422.241144:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36b40 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.241144:0:16130:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009106c6c0/0x8a60d30f5727b75a lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.241148:0:16130:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009106c6c0/0x8a60d30f5727b75a lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.241149:0:16110:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800971c6640/0x8a60d30f571eb73b lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129c6a expref: 398 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.241153:0:16110:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.241154:0:16130:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009106c6c0/0x8a60d30f5727b75a lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.241154:0:16110:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.241155:0:16110:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7840/0x8a60d30f5727b7a7 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.241158:0:16130:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009106c6c0/0x8a60d30f5727b75a lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.241165:0:16110:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800971c6640/0x8a60d30f571eb73b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129c6a expref: 398 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.241170:0:16110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800971c6640/0x8a60d30f571eb73b lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129c6a expref: 398 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.241175:0:16110:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880084df5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_094:lustre-OST0000_UUID:16110:1805522011633152:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.241187:0:16110:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec780 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.241248:0:16130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880096003480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0000-mdtlov_UUID+2655:3688:x1805522011629824:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3401us (3444us total) trans 4296061598 rc 0/0 00000100:00100000:1.0:1721880422.241252:0:16130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631813 00000100:00100000:3.0:1721880422.241260:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a65c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+1843:3689:x1805522011629056:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3692us (3726us total) trans 4296019904 rc 0/0 00000100:00100000:3.0:1721880422.241265:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631812 00000100:00100000:1.0:1721880422.241268:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1721880422.241278:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008777ed80/2, rc 0, transno 1052608 00000100:00100000:1.0:1721880422.241282:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008777e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011632640:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.241287:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008777ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011629056:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.241293:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.241302:0:16130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011631488 00000100:00100000:1.0:1721880422.241304:0:16130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011631488 00000100:00100000:0.0:1721880422.241309:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1721880422.241312:0:16130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011632640 00000100:00100000:1.0:1721880422.241313:0:16130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011632640 00000100:00100000:0.0:1721880422.241315:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009f52df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011633280:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.241320:0:16130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631825 00000100:00100000:1.0:1721880422.241323:0:16130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0000-mdtlov_UUID+2656:3686:x1805522011631488:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1721880422.241330:0:16130:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58038 count 1 00000100:00100000:2.0:1721880422.241330:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631826 00000100:00100000:0.0:1721880422.241334:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.241334:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b59aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2656:3686:x1805522011632640:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.241336:0:16130:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098aa86c0/0x8a60d30f5727b7ae lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2b6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.241343:0:16130:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800842c1f80/0x8a60d30f571eb60e lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129b3d expref: 398 pid: 16101 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.241344:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58041 count 1 00010000:00010000:1.0:1721880422.241347:0:16130:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.241348:0:16130:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.241349:0:16130:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098aa86c0/0x8a60d30f5727b7ae lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.241352:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136352400/0x8a60d30f5727b7b5 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2b9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.241352:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011633280 00000100:00100000:3.0:1721880422.241355:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011633280 00010000:00010000:1.0:1721880422.241359:0:16130:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800842c1f80/0x8a60d30f571eb60e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129b3d expref: 398 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.241359:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800971c5b00/0x8a60d30f571eb6f5 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129c24 expref: 398 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.241364:0:16130:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800842c1f80/0x8a60d30f571eb60e lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129b3d expref: 398 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.241364:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.241365:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.241366:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136352400/0x8a60d30f5727b7b5 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.241370:0:16130:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b59b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0000_UUID:16130:1805522011633408:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.241372:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631827 00000100:00100000:3.0:1721880422.241376:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f52ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+1843:3689:x1805522011633280:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.241378:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800971c5b00/0x8a60d30f571eb6f5 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129c24 expref: 398 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.241384:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800971c5b00/0x8a60d30f571eb6f5 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129c24 expref: 398 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.241387:0:16130:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb300 going to sleep for 11 seconds 00002000:00080000:3.0:1721880422.241389:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64221 count 1 00000100:00100000:2.0:1721880422.241390:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fde2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0000_UUID:16060:1805522011633536:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.241399:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727b7bc lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfadd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.241404:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03900 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.241408:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012078c000/0x8a60d30f571795fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfadd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100d3b expref: 1414 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.241414:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.241415:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.241417:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727b7bc lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfadd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.241433:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012078c000/0x8a60d30f571795fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfadd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100d3b expref: 1414 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.241441:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012078c000/0x8a60d30f571795fb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfadd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100d3b expref: 1414 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.241450:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880084df7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011633664:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.241473:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec180 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.241489:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1721880422.241520:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880098d24700/2, rc 0, transno 1094302 00000100:00100000:1.0:1721880422.241523:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011631104 00000100:00100000:1.0:1721880422.241525:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011631104 00000100:00100000:3.0:1721880422.241527:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880098d24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011629824:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.241538:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631828 00000100:00100000:1.0:1721880422.241541:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084df7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+1844:3688:x1805522011631104:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.241548:0:16088:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64219 count 1 00010000:00010000:1.0:1721880422.241554:0:16088:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727b7c3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfadb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.241561:0:16088:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b70fcc0/0x8a60d30f57179132 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfadb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100c2a expref: 1414 pid: 16122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.241565:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.241566:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.241567:0:16088:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727b7c3 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfadb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.241579:0:16088:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b70fcc0/0x8a60d30f57179132 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfadb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100c2a expref: 1414 pid: 16122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.241586:0:16088:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b70fcc0/0x8a60d30f57179132 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfadb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100c2a expref: 1414 pid: 16122 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.241594:0:16088:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b59b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011633792:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.241627:0:16088:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eba80 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.241651:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009f52d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011633920:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.241676:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.241695:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011633920 00000100:00100000:0.0:1721880422.241700:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011633920 00000100:00100000:0.0:1721880422.241719:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631829 00000100:00100000:0.0:1721880422.241723:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fde0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2657:3689:x1805522011633920:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1721880422.241754:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58043 count 1 00010000:00010000:0.0:1721880422.241763:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325df80/0x8a60d30f5727b7ca lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2bb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.241772:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880134b8df80/0x8a60d30f571eb814 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129d43 expref: 398 pid: 16112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.241779:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.241780:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.241782:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325df80/0x8a60d30f5727b7ca lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.241804:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880134b8df80/0x8a60d30f571eb814 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129d43 expref: 398 pid: 16112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.241814:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880134b8df80/0x8a60d30f571eb814 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129d43 expref: 398 pid: 16112 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.241823:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009f52f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16125:1805522011634048:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.241847:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36f00 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.242040:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.242058:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009ebd8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011630464:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.242072:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727b761 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfad7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.242113:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257676288 00000100:00100000:2.0:1721880422.242117:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257676288 00010000:00010000:2.0:1721880422.242130:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880120392640/0x8a60d30f57178784 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfad7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1009e5 expref: 1415 pid: 15447 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.242149:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914007 00000100:00100000:2.0:1721880422.242153:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f52d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1415:2004:x1805522257676288:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.242162:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880098d27b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0000_UUID:16017:1805522011630976:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.242162:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.242163:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880084df4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011631232:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.242166:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880120392640/0x8a60d30f57178784 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfad7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1009e5 expref: 1415 pid: 15447 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.242175:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880120392640/0x8a60d30f57178784 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfad7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1009e5 expref: 1415 pid: 15447 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.242175:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727b76f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfad8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.242176:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009106e400/0x8a60d30f5727b768 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.242194:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880120392640/0x8a60d30f57178784 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfad7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1009e5 expref: 1415 pid: 15447 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.242203:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.242205:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.242208:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727b761 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfad7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.242215:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727b761 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfad7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.242230:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.242237:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727b761 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfad7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.242244:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727b761 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfad7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.242250:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f52d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1414:2004:x1805522257676288:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 95us (209us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.242251:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727b761 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfad7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.242256:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914007 00010000:00010000:3.0:1721880422.242259:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727b761 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfad7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.242265:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727b761 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfad7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.242270:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4d80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.242273:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727b761 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfad7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.242280:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727b761 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfad7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.242294:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.242294:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727b761 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfad7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.242300:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727b761 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfad7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.242307:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257676416 00000100:00100000:2.0:1721880422.242311:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257676416 00010000:00010000:2.0:1721880422.242323:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c0e0d80/0x8a60d30f571eb551 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129a80 expref: 399 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.242340:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914008 00000100:00100000:2.0:1721880422.242344:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f52ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+399:2005:x1805522257676416:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.242351:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.242355:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c0e0d80/0x8a60d30f571eb551 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2b4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129a80 expref: 399 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.242369:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c0e0d80/0x8a60d30f571eb551 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2b4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129a80 expref: 399 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.242381:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c0e0d80/0x8a60d30f571eb551 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2b4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129a80 expref: 399 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.242392:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.242393:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.242396:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009106e400/0x8a60d30f5727b768 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.242402:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009106e400/0x8a60d30f5727b768 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.242406:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a052d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+1845:3688:x1805522011630336:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2336us (2398us total) trans 4296019905 rc 0/0 00000100:00100000:3.0:1721880422.242412:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631814 00000004:00080000:0.0:1721880422.242417:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a052e300/2, rc 0, transno 1052609 00000100:00100000:0.0:1721880422.242422:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a052e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011630336:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.242425:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.242443:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f52ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+398:2005:x1805522257676416:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 97us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.242449:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914008 00010000:00010000:1.0:1721880422.242450:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009106e400/0x8a60d30f5727b768 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.242457:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009106e400/0x8a60d30f5727b768 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.242464:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009106e400/0x8a60d30f5727b768 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.242470:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009106e400/0x8a60d30f5727b768 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.242476:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009106e400/0x8a60d30f5727b768 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.242482:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106e400 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.242484:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009106e400/0x8a60d30f5727b768 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.242490:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009106e400/0x8a60d30f5727b768 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.242499:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009106e400/0x8a60d30f5727b768 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.242505:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009106e400/0x8a60d30f5727b768 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.242571:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.242585:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fde1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011632128:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.242600:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727b77d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfad6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.242606:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2658:3687:x1805522011630208:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2083us (2165us total) trans 4296061599 rc 0/0 00000100:00100000:3.0:1721880422.242611:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257676544 00000100:00100000:1.0:1721880422.242612:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631815 00000100:00100000:3.0:1721880422.242615:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257676544 00010000:00010000:3.0:1721880422.242629:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099ae2640/0x8a60d30f57178998 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfad8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100a40 expref: 1414 pid: 16044 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.242639:0:16113:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008c409500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0000_UUID:16113:1805522011632256:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.242646:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914009 00010000:00010000:1.0:1721880422.242649:0:16113:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880098aa9200/0x8a60d30f5727b784 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.242651:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e616300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1414:2004:x1805522257676544:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.242658:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.242662:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099ae2640/0x8a60d30f57178998 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfad8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100a40 expref: 1414 pid: 16044 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.242664:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009f52fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011634176:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.242671:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099ae2640/0x8a60d30f57178998 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfad8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100a40 expref: 1414 pid: 16044 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.242681:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.242683:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099ae2640/0x8a60d30f57178998 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfad8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100a40 expref: 1414 pid: 16044 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.242694:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011634176 00000100:00100000:0.0:1721880422.242697:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011634176 00010000:00010000:3.0:1721880422.242698:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.242699:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.242702:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727b76f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfad8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.242707:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008777ca80/2, rc 0, transno 1094303 00010000:00010000:3.0:1721880422.242708:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727b76f lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfad8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.242711:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631830 00000100:00100000:0.0:1721880422.242714:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+1845:3686:x1805522011634176:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.242721:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.242726:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008777ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011630208:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1721880422.242762:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e616300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1413:2004:x1805522257676544:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 109us (190us total) trans 0 rc 0/0 00002000:00080000:0.0:1721880422.242767:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64222 count 1 00000100:00100000:1.0:1721880422.242767:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1721880422.242768:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914009 00010000:00010000:2.0:1721880422.242769:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727b76f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfad8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.242774:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e617b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011634304:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.242778:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727b7d1 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfade:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.242778:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727b76f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfad8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.242786:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727b76f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfad8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.242789:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800946a4fc0/0x8a60d30f57179871 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfade:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100dce expref: 1412 pid: 16048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.242793:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727b76f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfad8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.242794:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.242796:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.242798:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.242800:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727b76f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfad8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.242801:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727b7d1 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfade:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.242805:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4000 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.242808:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727b76f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfad8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.242814:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727b76f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfad8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.242817:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800946a4fc0/0x8a60d30f57179871 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfade:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100dce expref: 1412 pid: 16048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.242823:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727b76f lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfad8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.242827:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800946a4fc0/0x8a60d30f57179871 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfade:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100dce expref: 1412 pid: 16048 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.242828:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727b76f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfad8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.242836:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e616d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011634432:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.242860:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36240 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.242941:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880084df6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+1846:3688:x1805522011630592:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2414us (2449us total) trans 4296019906 rc 0/0 00000100:00100000:2.0:1721880422.242946:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631816 00000004:00080000:0.0:1721880422.242958:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009ebd9500/2, rc 0, transno 1052610 00000100:00100000:2.0:1721880422.242960:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011634304 00000100:00100000:2.0:1721880422.242963:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011634304 00000100:00100000:0.0:1721880422.242964:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009ebd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011630592:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.242979:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631831 00000100:00100000:2.0:1721880422.242983:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b599180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2658:3686:x1805522011634304:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1721880422.242995:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58044 count 1 00000100:00100000:0.0:1721880422.243003:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011634560:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.243006:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136350fc0/0x8a60d30f5727b7d8 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2bc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.243031:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.243032:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012382a640/0x8a60d30f571eb85a lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129d89 expref: 397 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.243038:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.243039:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.243042:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136350fc0/0x8a60d30f5727b7d8 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.243048:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011634560 00000100:00100000:1.0:1721880422.243053:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011634560 00010000:00010000:2.0:1721880422.243059:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012382a640/0x8a60d30f571eb85a lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129d89 expref: 397 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.243068:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012382a640/0x8a60d30f571eb85a lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129d89 expref: 397 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.243072:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631832 00000100:00100000:1.0:1721880422.243077:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e616a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1846:3688:x1805522011634560:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.243078:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fde1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0000_UUID:16111:1805522011634688:192.168.201.24@tcp:104: 00002000:00080000:1.0:1721880422.243088:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64223 count 1 00010000:00010000:1.0:1721880422.243099:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727b7df lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfadf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.243100:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.243109:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d1fe400/0x8a60d30f57179b5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfadf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100e6f expref: 1412 pid: 16122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.243120:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.243122:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.243124:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727b7df lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfadf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.243140:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d1fe400/0x8a60d30f57179b5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfadf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100e6f expref: 1412 pid: 16122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.243149:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d1fe400/0x8a60d30f57179b5e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfadf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100e6f expref: 1412 pid: 16122 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.243159:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b59a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011634816:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.243184:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.243187:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.243188:0:9458:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008777d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011632000:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.243202:0:9458:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727b776 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfada:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.243204:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257676800 00000100:00100000:2.0:1721880422.243208:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257676800 00010000:00010000:2.0:1721880422.243221:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800999d7cc0/0x8a60d30f571eb5b3 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129ae9 expref: 398 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.243236:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.243243:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257676672 00000100:00100000:2.0:1721880422.243246:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257676672 00000100:00100000:3.0:1721880422.243254:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914010 00000100:00100000:1.0:1721880422.243255:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.243257:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b76d200/0x8a60d30f5717858c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfad6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10096e expref: 1413 pid: 16109 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.243258:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084df4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+398:2007:x1805522257676800:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.243264:0:7118:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.243268:0:7118:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800999d7cc0/0x8a60d30f571eb5b3 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129ae9 expref: 398 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.243273:0:7118:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800999d7cc0/0x8a60d30f571eb5b3 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129ae9 expref: 398 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.243276:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257676928 00000100:00100000:2.0:1721880422.243278:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257676928 00010000:00010000:3.0:1721880422.243282:0:7118:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800999d7cc0/0x8a60d30f571eb5b3 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2b5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129ae9 expref: 398 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.243286:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c5b9b00/0x8a60d30f57178ebc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfada:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100b90 expref: 1414 pid: 16073 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.243294:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.243295:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.243296:0:7118:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098aa9200/0x8a60d30f5727b784 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.243299:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914011 00010000:00010000:3.0:1721880422.243301:0:7118:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098aa9200/0x8a60d30f5727b784 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.243304:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914012 00000100:00100000:2.0:1721880422.243304:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b59ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+1414:2005:x1805522257676672:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.243308:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097138700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1414:2005:x1805522257676928:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.243309:0:7118:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.243310:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.243311:0:15514:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008c40aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:15514:1805522011632512:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.243314:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b76d200/0x8a60d30f5717858c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfad6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10096e expref: 1414 pid: 16109 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.243322:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b76d200/0x8a60d30f5717858c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfad6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10096e expref: 1414 pid: 16109 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.243323:0:15514:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880098aa9d40/0x8a60d30f5727b792 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.243323:0:7118:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880084df4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+397:2007:x1805522257676800:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 65us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.243327:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914010 00010000:00010000:2.0:1721880422.243335:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b76d200/0x8a60d30f5717858c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfad6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10096e expref: 1414 pid: 16109 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.243337:0:16113:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098aa9200/0x8a60d30f5727b784 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.243343:0:16113:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098aa9200/0x8a60d30f5727b784 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.243346:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.243347:0:16098:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880084df6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0001_UUID:16098:1805522011632384:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.243348:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.243350:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.243351:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727b77d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfad6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.243354:0:16113:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098aa9200/0x8a60d30f5727b784 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.243354:0:16098:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727b78b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfad9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.243355:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c5b9b00/0x8a60d30f57178ebc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfada:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100b90 expref: 1413 pid: 16073 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.243361:0:16113:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098aa9200/0x8a60d30f5727b784 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.243362:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727b77d lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfad6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.243365:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c5b9b00/0x8a60d30f57178ebc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfada:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100b90 expref: 1413 pid: 16073 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.243367:0:16113:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098aa9200/0x8a60d30f5727b784 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.243372:0:16113:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa9200 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.243373:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c5b9b00/0x8a60d30f57178ebc lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfada:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100b90 expref: 1413 pid: 16073 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.243375:0:16113:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098aa9200/0x8a60d30f5727b784 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.243377:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.243380:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.243381:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.243381:0:16113:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098aa9200/0x8a60d30f5727b784 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.243383:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727b776 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfada:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.243383:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727b77d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfad6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.243387:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727b776 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfada:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.243387:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727b77d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfad6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.243391:0:16113:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098aa9200/0x8a60d30f5727b784 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.243392:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727b77d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfad6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.243395:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b59ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+1412:2005:x1805522257676672:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 90us (159us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.243395:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727b77d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfad6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.243397:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.243397:0:16113:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098aa9200/0x8a60d30f5727b784 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.243400:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727b77d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfad6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.243401:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914011 00010000:00010000:3.0:1721880422.243403:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353840 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.243405:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727b77d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfad6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.243409:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880097138700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1412:2005:x1805522257676928:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 101us (154us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.243409:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727b77d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfad6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.243413:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914012 00010000:00010000:3.0:1721880422.243414:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727b77d lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfad6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.243418:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727b77d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfad6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.243431:0:9458:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727b776 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfada:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.243438:0:9458:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727b776 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfada:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.243445:0:9458:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727b776 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfada:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.243458:0:9458:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727b776 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfada:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.243505:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1847:3687:x1805522011630080:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2661us (2745us total) trans 4296019907 rc 0/0 00000100:00100000:3.0:1721880422.243509:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631818 00000100:00100000:1.0:1721880422.243510:0:16113:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008777d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0000-mdtlov_UUID+2659:3689:x1805522011631360:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2658us (2728us total) trans 4296061600 rc 0/0 00000100:00100000:1.0:1721880422.243516:0:16113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631819 00010000:00010000:0.0:1721880422.243524:0:9458:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727b776 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfada:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.243526:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008777c700/2, rc 0, transno 1052611 00010000:00010000:0.0:1721880422.243528:0:9458:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325c6c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.243530:0:9458:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727b776 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfada:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.243535:0:9458:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727b776 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfada:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.243536:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008777c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011630080:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.243541:0:9458:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727b776 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfada:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.243543:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880098d27480/2, rc 0, transno 1094304 00010000:00010000:0.0:1721880422.243545:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727b776 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfada:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.243562:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880098d27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011631360:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.243567:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1721880422.243576:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880084df6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011634944:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.243589:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1721880422.243596:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.243600:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e617800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011635072:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.243618:0:16113:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011634944 00000100:00100000:1.0:1721880422.243621:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.243621:0:16113:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011634944 00000100:00100000:3.0:1721880422.243621:0:16120:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880084df6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16120:1805522011632896:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.243633:0:16120:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4b40/0x8a60d30f5727b799 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.243636:0:16113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631833 00000100:00100000:0.0:1721880422.243638:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257677056 00000100:00100000:2.0:1721880422.243639:0:16113:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008777d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0000-mdtlov_UUID+1848:3688:x1805522011634944:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.243643:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257677056 00002000:00080000:2.0:1721880422.243649:0:16113:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64224 count 1 00000100:00100000:1.0:1721880422.243655:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.243658:0:16113:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727b7e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfae0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.243669:0:16113:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d744900/0x8a60d30f57179e05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfae0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100f10 expref: 1411 pid: 16059 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.243671:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.243675:0:16113:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.243676:0:16113:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.243678:0:16113:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727b7e6 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfae0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.243690:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.243695:0:16113:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d744900/0x8a60d30f57179e05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfae0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100f10 expref: 1411 pid: 16059 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.243698:0:16110:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880084df5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_094:lustre-OST0000_UUID:16110:1805522011633152:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.243702:0:16113:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d744900/0x8a60d30f57179e05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfae0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100f10 expref: 1411 pid: 16059 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.243704:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257677312 00000100:00100000:1.0:1721880422.243707:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257677312 00000100:00100000:2.0:1721880422.243709:0:16113:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008777f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0001_UUID:16113:1805522011635200:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.243710:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009402fa80/0x8a60d30f57178c3f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfad9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100acc expref: 1411 pid: 15466 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.243711:0:16110:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7840/0x8a60d30f5727b7a7 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.243719:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099aecd80/0x8a60d30f571eb6af lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129bde expref: 397 pid: 16112 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.243725:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011635072 00000100:00100000:0.0:1721880422.243747:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257677440 00000100:00100000:0.0:1721880422.243750:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257677440 00000100:00100000:2.0:1721880422.243751:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914013 00000100:00100000:3.0:1721880422.243753:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011635072 00000100:00100000:2.0:1721880422.243755:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ab4d5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+1412:2005:x1805522257677056:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.243759:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009594c480/0x8a60d30f57179369 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfadc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100ca1 expref: 1412 pid: 16100 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.243759:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914014 00010000:00010000:2.0:1721880422.243759:0:15473:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.243763:0:15473:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009402fa80/0x8a60d30f57178c3f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfad9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100acc expref: 1412 pid: 15466 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.243765:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009713a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+397:2005:x1805522257677312:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.243769:0:15473:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009402fa80/0x8a60d30f57178c3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfad9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100acc expref: 1412 pid: 15466 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.243772:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914015 00010000:00010000:1.0:1721880422.243772:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1721880422.243775:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009713ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1412:2005:x1805522257677440:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.243777:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099aecd80/0x8a60d30f571eb6af lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129bde expref: 397 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.243777:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009402fa80/0x8a60d30f57178c3f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfad9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100acc expref: 1412 pid: 15466 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.243781:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.243783:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009594c480/0x8a60d30f57179369 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfadc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100ca1 expref: 1411 pid: 16100 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.243784:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.243785:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.243786:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099aecd80/0x8a60d30f571eb6af lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129bde expref: 397 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.243787:0:15473:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727b78b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfad9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.243790:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009594c480/0x8a60d30f57179369 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfadc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100ca1 expref: 1411 pid: 16100 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.243791:0:15473:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727b78b lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfad9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.243797:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.243797:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099aecd80/0x8a60d30f571eb6af lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2b8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129bde expref: 397 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.243798:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.243800:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727b7a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfadc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.243802:0:15473:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.243804:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727b7a0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfadc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.243807:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.243808:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.243811:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4b40/0x8a60d30f5727b799 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.243812:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.243812:0:15473:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ab4d5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+1411:2005:x1805522257677056:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 57us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.243816:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914013 00010000:00010000:1.0:1721880422.243818:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4b40/0x8a60d30f5727b799 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.243824:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009713ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1410:2005:x1805522257677440:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 48us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.243828:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914015 00010000:00010000:1.0:1721880422.243832:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.243848:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009594c480/0x8a60d30f57179369 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfadc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100ca1 expref: 1409 pid: 16100 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.243848:0:16120:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4b40/0x8a60d30f5727b799 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.243850:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009713a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+396:2005:x1805522257677312:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 85us (195us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.243853:0:16120:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4b40/0x8a60d30f5727b799 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.243854:0:16113:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03a80 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.243857:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914014 00010000:00010000:3.0:1721880422.243857:0:16120:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4b40/0x8a60d30f5727b799 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.243858:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008cd23800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011633024:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.243861:0:16120:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4b40/0x8a60d30f5727b799 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.243865:0:16120:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4b40/0x8a60d30f5727b799 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.243868:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727b7a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfadc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.243868:0:16120:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4b40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.243870:0:16120:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4b40/0x8a60d30f5727b799 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.243876:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727b7a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfadc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.243877:0:16120:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4b40/0x8a60d30f5727b799 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.243882:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727b7a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfadc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.243884:0:16120:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4b40/0x8a60d30f5727b799 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.243887:0:16120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4b40/0x8a60d30f5727b799 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.243890:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727b7a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfadc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.243897:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727b7a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfadc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.243904:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727b7a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfadc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.243909:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325c240 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.243912:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727b7a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfadc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.243919:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727b7a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfadc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.243928:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727b7a0 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfadc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.243940:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727b7a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfadc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.243997:0:16120:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008777ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+2660:3689:x1805522011631872:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3018us (3053us total) trans 4296061601 rc 0/0 00000100:00100000:3.0:1721880422.244004:0:16120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631822 00000004:00080000:2.0:1721880422.244033:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880098d25500/2, rc 0, transno 1094305 00010000:00010000:3.0:1721880422.244034:0:16098:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727b78b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfad9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.244040:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880098d25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011631872:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1721880422.244041:0:16098:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727b78b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfad9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.244047:0:16098:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727b78b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfad9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.244053:0:16098:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727b78b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfad9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.244058:0:16098:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727b78b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfad9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.244068:0:16098:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b46c0 already unused, calling callback (ffffffffa084e330) 00000004:00080000:2.0:1721880422.244071:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880084df5f80/2, rc 0, transno 1052613 00010000:00010000:3.0:1721880422.244071:0:16098:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727b78b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfad9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.244074:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cd22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+1849:3689:x1805522011631744:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2990us (3022us total) trans 4296019909 rc 0/0 00000100:00100000:2.0:1721880422.244076:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880084df5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011631744:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.244076:0:16098:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727b78b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfad9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.244080:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631823 00000100:00100000:1.0:1721880422.244082:0:16130:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b59b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0000_UUID:16130:1805522011633408:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.244083:0:16098:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727b78b lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfad9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.244087:0:16098:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727b78b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfad9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.244089:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1721880422.244094:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008777dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011635456:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.244096:0:16130:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880098aa86c0/0x8a60d30f5727b7ae lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.244110:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1721880422.244110:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.244118:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008777f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011635328:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.244136:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.244144:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fde2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0000_UUID:16060:1805522011633536:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.244154:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136352400/0x8a60d30f5727b7b5 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.244168:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.244169:0:16098:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c409880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0000-mdtlov_UUID+1849:3687:x1805522011630720:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3315us (3373us total) trans 4296019910 rc 0/0 00000100:00100000:3.0:1721880422.244174:0:16098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631820 00000100:00100000:3.0:1721880422.244184:0:16098:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011635456 00000100:00100000:3.0:1721880422.244186:0:16098:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011635456 00000100:00100000:1.0:1721880422.244187:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257677568 00000100:00100000:1.0:1721880422.244190:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257677568 00000100:00100000:3.0:1721880422.244196:0:16098:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011635328 00000100:00100000:3.0:1721880422.244198:0:16098:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011635328 00010000:00010000:1.0:1721880422.244199:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800971c6640/0x8a60d30f571eb73b lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129c6a expref: 396 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.244204:0:16098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631834 00000100:00100000:3.0:1721880422.244207:0:16098:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008777df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0000-mdtlov_UUID+1849:3689:x1805522011635456:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.244211:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914016 00000100:00100000:1.0:1721880422.244214:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e615180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+396:2005:x1805522257677568:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.244215:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631835 00002000:00080000:3.0:1721880422.244215:0:16098:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64225 count 1 00000100:00100000:0.0:1721880422.244219:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.244219:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.244219:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097138e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2660:3686:x1805522011635328:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.244221:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800971c6640/0x8a60d30f571eb73b lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129c6a expref: 396 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.244222:0:16098:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727b7ed lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfae1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.244227:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800971c6640/0x8a60d30f571eb73b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129c6a expref: 396 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.244229:0:16098:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800981d4d80/0x8a60d30f5717a250 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfae1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100fb8 expref: 1408 pid: 16024 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.244230:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58046 count 1 00010000:00010000:3.0:1721880422.244233:0:16098:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.244234:0:16098:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.244236:0:16098:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727b7ed lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfae1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.244238:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800971c6640/0x8a60d30f571eb73b lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2ba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129c6a expref: 396 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.244238:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136353600/0x8a60d30f5727b7f4 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.244240:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.244246:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.244246:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa03600/0x8a60d30f571eb8ed lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129e15 expref: 395 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.244246:0:16098:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800981d4d80/0x8a60d30f5717a250 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfae1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100fb8 expref: 1408 pid: 16024 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.244247:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.244249:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7840/0x8a60d30f5727b7a7 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.244252:0:16098:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800981d4d80/0x8a60d30f5717a250 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfae1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100fb8 expref: 1408 pid: 16024 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.244253:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7840/0x8a60d30f5727b7a7 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.244256:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.244256:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.244258:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136353600/0x8a60d30f5727b7f4 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.244258:0:16098:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880084df5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0001_UUID:16098:1805522011635584:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.244261:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.244265:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257677824 00000100:00100000:2.0:1721880422.244267:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257677824 00000100:00100000:3.0:1721880422.244273:0:16098:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec780 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.244275:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800971c5b00/0x8a60d30f571eb6f5 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129c24 expref: 396 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.244277:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e615180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+396:2005:x1805522257677568:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 62us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.244281:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914016 00000100:00100000:2.0:1721880422.244284:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257677696 00000100:00100000:2.0:1721880422.244286:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257677696 00000100:00100000:1.0:1721880422.244291:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914017 00010000:00010000:2.0:1721880422.244292:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800842c1f80/0x8a60d30f571eb60e lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129b3d expref: 396 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.244293:0:16120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631836 00000100:00100000:1.0:1721880422.244294:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e616300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+396:2005:x1805522257677824:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.244296:0:16120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084df6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+2660:3687:x1805522011635072:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.244297:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.244299:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.244302:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800971c5b00/0x8a60d30f571eb6f5 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129c24 expref: 396 pid: 16130 timeout: 887 lvb_type: 0 00002000:00080000:3.0:1721880422.244303:0:16120:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58045 count 1 00010000:00010000:1.0:1721880422.244308:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800971c5b00/0x8a60d30f571eb6f5 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129c24 expref: 396 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.244309:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257677952 00010000:00010000:3.0:1721880422.244310:0:16120:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6f40/0x8a60d30f5727b7fb lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.244311:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257677952 00010000:00010000:1.0:1721880422.244314:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800971c5b00/0x8a60d30f571eb6f5 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2b9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129c24 expref: 396 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.244317:0:16120:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099fdc6c0/0x8a60d30f571eb8a0 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129dd6 expref: 396 pid: 16112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.244318:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012078c000/0x8a60d30f571795fb lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfadd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100d3b expref: 1409 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.244319:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914018 00010000:00010000:3.0:1721880422.244321:0:16120:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.244321:0:16120:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.244322:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.244322:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.244323:0:16120:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6f40/0x8a60d30f5727b7fb lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.244324:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cd23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+395:2005:x1805522257677696:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.244324:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136352400/0x8a60d30f5727b7b5 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.244329:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136352400/0x8a60d30f5727b7b5 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.244329:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914019 00010000:00010000:0.0:1721880422.244332:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.244332:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b08ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+1409:2005:x1805522257677952:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.244336:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800842c1f80/0x8a60d30f571eb60e lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129b3d expref: 395 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.244336:0:16120:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099fdc6c0/0x8a60d30f571eb8a0 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129dd6 expref: 395 pid: 16112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.244337:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.244337:0:15473:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.244339:0:15473:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012078c000/0x8a60d30f571795fb lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfadd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100d3b expref: 1409 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.244342:0:16120:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099fdc6c0/0x8a60d30f571eb8a0 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129dd6 expref: 395 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.244346:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800842c1f80/0x8a60d30f571eb60e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129b3d expref: 395 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.244347:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e616300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+395:2005:x1805522257677824:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 52us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.244348:0:16120:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880084df4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16120:1805522011635712:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.244349:0:15473:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012078c000/0x8a60d30f571795fb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfadd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100d3b expref: 1409 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.244351:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914017 00010000:00010000:2.0:1721880422.244357:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.244357:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.244359:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800842c1f80/0x8a60d30f571eb60e lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2b6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129b3d expref: 394 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.244359:0:15473:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727b7bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfadd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.244359:0:16120:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdecb40 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.244364:0:15473:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727b7bc lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfadd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.244367:0:16110:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7840/0x8a60d30f5727b7a7 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.244370:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.244371:0:16110:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7840/0x8a60d30f5727b7a7 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.244371:0:15473:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.244372:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.244375:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098aa86c0/0x8a60d30f5727b7ae lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.244376:0:16110:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7840/0x8a60d30f5727b7a7 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.244376:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012078c000/0x8a60d30f571795fb lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfadd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100d3b expref: 1409 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.244379:0:16110:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7840/0x8a60d30f5727b7a7 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.244382:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098aa86c0/0x8a60d30f5727b7ae lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.244383:0:16110:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7840/0x8a60d30f5727b7a7 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.244383:0:15473:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b08ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+1408:2005:x1805522257677952:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 50us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.244383:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880084df7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011633664:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.244388:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914019 00010000:00010000:1.0:1721880422.244390:0:16110:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b7840 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.244392:0:16110:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7840/0x8a60d30f5727b7a7 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.244393:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727b7bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfadd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.244396:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.244396:0:16110:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7840/0x8a60d30f5727b7a7 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.244397:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727b7bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfadd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.244401:0:16110:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7840/0x8a60d30f5727b7a7 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.244401:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727b7bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfadd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.244405:0:16110:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7840/0x8a60d30f5727b7a7 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.244405:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727b7bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfadd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.244406:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136352400/0x8a60d30f5727b7b5 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.244408:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727b7bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfadd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.244409:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cd23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+393:2005:x1805522257677696:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 85us (168us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.244411:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136352400/0x8a60d30f5727b7b5 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.244413:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727b7bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfadd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.244415:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914018 00010000:00010000:2.0:1721880422.244415:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136352400/0x8a60d30f5727b7b5 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.244416:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b5440 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.244418:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727b7bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfadd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.244419:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136352400/0x8a60d30f5727b7b5 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.244421:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727b7bc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfadd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.244427:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136352400/0x8a60d30f5727b7b5 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.244428:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727b7bc lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfadd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.244431:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352400 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.244433:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136352400/0x8a60d30f5727b7b5 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.244433:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727b7bc lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfadd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.244436:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136352400/0x8a60d30f5727b7b5 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.244441:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136352400/0x8a60d30f5727b7b5 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.244445:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136352400/0x8a60d30f5727b7b5 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.244486:0:9458:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1850:3687:x1805522011630848:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3664us (3762us total) trans 4296019908 rc 0/0 00000100:00100000:1.0:1721880422.244486:0:16110:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b598e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_094:lustre-MDT0000-mdtlov_UUID+2662:3687:x1805522011632768:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3359us (3401us total) trans 4296061602 rc 0/0 00000100:00100000:1.0:1721880422.244491:0:16110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631824 00000100:00100000:0.0:1721880422.244494:0:9458:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631817 00010000:00010000:1.0:1721880422.244505:0:16130:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098aa86c0/0x8a60d30f5727b7ae lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.244509:0:16130:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098aa86c0/0x8a60d30f5727b7ae lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.244514:0:16130:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098aa86c0/0x8a60d30f5727b7ae lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.244518:0:16130:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098aa86c0/0x8a60d30f5727b7ae lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.244522:0:16130:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098aa86c0/0x8a60d30f5727b7ae lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.244526:0:16130:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa86c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.244528:0:16130:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098aa86c0/0x8a60d30f5727b7ae lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.244531:0:16130:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098aa86c0/0x8a60d30f5727b7ae lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.244536:0:16130:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098aa86c0/0x8a60d30f5727b7ae lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.244540:0:16130:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098aa86c0/0x8a60d30f5727b7ae lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.244543:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f52ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+1849:3689:x1805522011633280:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3164us (3207us total) trans 4296019911 rc 0/0 00000100:00100000:3.0:1721880422.244549:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631827 00000100:00100000:0.0:1721880422.244554:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.244559:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b59aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2661:3686:x1805522011632640:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3223us (3263us total) trans 4296061603 rc 0/0 00000100:00100000:0.0:1721880422.244563:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257678080 00000100:00100000:0.0:1721880422.244565:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257678080 00000100:00100000:2.0:1721880422.244566:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631826 00000004:00080000:3.0:1721880422.244572:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b8bfb80/2, rc 0, transno 1094306 00010000:00010000:0.0:1721880422.244575:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b70fcc0/0x8a60d30f57179132 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfadb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100c2a expref: 1408 pid: 16122 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.244579:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007b8bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011632768:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.244589:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914020 00000100:00100000:0.0:1721880422.244594:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129d21450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1408:2005:x1805522257678080:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.244595:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa03600/0x8a60d30f571eb8ed lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129e15 expref: 392 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.244600:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.244603:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b70fcc0/0x8a60d30f57179132 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfadb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100c2a expref: 1408 pid: 16122 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.244605:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa03600/0x8a60d30f571eb8ed lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129e15 expref: 392 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.244609:0:16130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0000-mdtlov_UUID+2661:3686:x1805522011631488:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3285us (3340us total) trans 4296061604 rc 0/0 00000004:00080000:3.0:1721880422.244609:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880084310000/2, rc 0, transno 1052612 00010000:00010000:0.0:1721880422.244612:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b70fcc0/0x8a60d30f57179132 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfadb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100c2a expref: 1408 pid: 16122 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.244614:0:16130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631825 00000100:00100000:2.0:1721880422.244615:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008777d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0000_UUID:16075:1805522011635840:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.244615:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880084310000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011630848:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.244629:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.244631:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.244634:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727b7c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfadb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.244636:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b70fcc0/0x8a60d30f57179132 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfadb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100c2a expref: 1408 pid: 16122 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.244637:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03900 going to sleep for 11 seconds 00000004:00080000:3.0:1721880422.244639:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880084313b80/2, rc 0, transno 1052614 00010000:00010000:0.0:1721880422.244641:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727b7c3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfadb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.244644:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880084313b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011630720:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.244645:0:16088:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b59b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011633792:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.244648:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1721880422.244650:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.244655:0:16088:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727b7c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfadb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.244655:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880084df7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011635968:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.244663:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880129d21450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1407:2005:x1805522257678080:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 68us (108us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.244664:0:16088:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727b7c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfadb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.244664:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008876c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011636096:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.244668:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914020 00010000:00010000:1.0:1721880422.244668:0:16088:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727b7c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfadb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.244672:0:16088:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727b7c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfadb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.244676:0:16088:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727b7c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfadb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.244676:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.244679:0:16088:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727b7c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfadb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.244682:0:16088:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8240 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.244684:0:16088:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727b7c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfadb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.244690:0:16088:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727b7c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfadb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.244695:0:16088:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727b7c3 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfadb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.244699:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727b7c3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfadb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.244709:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009f52df80/2, rc 0, transno 1052615 00000100:00100000:0.0:1721880422.244710:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009f52f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16125:1805522011634048:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.244711:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.244713:0:16130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011635968 00000100:00100000:1.0:1721880422.244715:0:16130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011635968 00000100:00100000:2.0:1721880422.244721:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009f52df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011633280:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.244722:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325df80/0x8a60d30f5727b7ca lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.244724:0:16130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011636096 00000100:00100000:1.0:1721880422.244725:0:16130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011636096 00000100:00100000:1.0:1721880422.244751:0:16130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631837 00000100:00100000:1.0:1721880422.244754:0:16130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008777c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0000-mdtlov_UUID+2661:3689:x1805522011635968:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.244756:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631838 00000100:00100000:2.0:1721880422.244760:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ebd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+1849:3687:x1805522011636096:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.244762:0:16130:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58047 count 1 00010000:00010000:1.0:1721880422.244769:0:16130:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098aa9440/0x8a60d30f5727b802 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.244770:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009ebdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011636352:0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.244771:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64226 count 1 00010000:00010000:1.0:1721880422.244776:0:16130:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009204aac0/0x8a60d30f571eb933 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129e5b expref: 392 pid: 16019 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.244779:0:16130:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.244779:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727b809 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfae2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.244780:0:16130:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.244782:0:16130:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098aa9440/0x8a60d30f5727b802 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.244786:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cb3aac0/0x8a60d30f5717aabc lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfae2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b101060 expref: 1406 pid: 16084 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.244787:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.244790:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.244791:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.244792:0:16130:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009204aac0/0x8a60d30f571eb933 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129e5b expref: 392 pid: 16019 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.244793:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727b809 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfae2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.244797:0:16130:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009204aac0/0x8a60d30f571eb933 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129e5b expref: 392 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.244803:0:16130:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880097139880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0000_UUID:16130:1805522011636480:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.244803:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011636352 00010000:00010000:2.0:1721880422.244804:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cb3aac0/0x8a60d30f5717aabc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfae2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b101060 expref: 1406 pid: 16084 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.244806:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011636352 00010000:00010000:2.0:1721880422.244809:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cb3aac0/0x8a60d30f5717aabc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfae2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b101060 expref: 1406 pid: 16084 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.244815:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008777fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011636608:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.244817:0:16130:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eba80 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.244821:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631839 00000100:00100000:3.0:1721880422.244827:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a052dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+1850:3688:x1805522011636352:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.244832:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03f00 going to sleep for 11 seconds 00002000:00080000:3.0:1721880422.244838:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64228 count 1 00010000:00010000:3.0:1721880422.244847:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727b810 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfae4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.244855:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.244858:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011f8b3a80/0x8a60d30f5717b3ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfae4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1011a9 expref: 1406 pid: 16025 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.244864:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1721880422.244866:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257678208 00010000:00010000:3.0:1721880422.244866:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1721880422.244868:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257678208 00010000:00010000:3.0:1721880422.244868:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727b810 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfae4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.244879:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134b8df80/0x8a60d30f571eb814 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129d43 expref: 393 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.244883:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011f8b3a80/0x8a60d30f5717b3ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfae4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1011a9 expref: 1406 pid: 16025 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.244892:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011f8b3a80/0x8a60d30f5717b3ad lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfae4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1011a9 expref: 1406 pid: 16025 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.244896:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880084df7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+1851:3688:x1805522011631104:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3353us (3406us total) trans 4296019912 rc 0/0 00000100:00100000:1.0:1721880422.244900:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631828 00000004:00080000:2.0:1721880422.244907:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880084df4e00/2, rc 0, transno 1052616 00000100:00100000:3.0:1721880422.244907:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008c40aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011636736:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.244913:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880084df4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011631104:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1721880422.244919:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880098d26680/2, rc 0, transno 1094308 00000100:00100000:1.0:1721880422.244924:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880098d26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011631488:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1721880422.244927:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec180 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.244933:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fde2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011636864:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1721880422.244943:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008777e300/2, rc 0, transno 1094307 00000100:00100000:3.0:1721880422.244944:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b086a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011636224:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.244947:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914021 00000100:00100000:1.0:1721880422.244947:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008777e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011632640:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.244952:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b08ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+393:2005:x1805522257678208:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.244959:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.244959:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009713b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011636992:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.244964:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134b8df80/0x8a60d30f571eb814 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2bb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129d43 expref: 393 pid: 16112 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.244964:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.244973:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134b8df80/0x8a60d30f571eb814 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2bb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129d43 expref: 393 pid: 16112 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.244977:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.244981:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880097139180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011637120:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.244984:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134b8df80/0x8a60d30f571eb814 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2bb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129d43 expref: 393 pid: 16112 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.244986:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.244992:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1721880422.244993:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011636224 00010000:00010000:0.0:1721880422.244994:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1721880422.244995:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011636224 00010000:00010000:0.0:1721880422.244996:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009325df80/0x8a60d30f5727b7ca lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.244999:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.245004:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325df80/0x8a60d30f5727b7ca lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.245036:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.245039:0:16110:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011636992 00000100:00100000:3.0:1721880422.245040:0:9458:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011636864 00000100:00100000:1.0:1721880422.245041:0:16110:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011636992 00000100:00100000:3.0:1721880422.245043:0:9458:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011636864 00000100:00100000:0.0:1721880422.245048:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b08ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+392:2005:x1805522257678208:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 96us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.245050:0:16110:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011637120 00000100:00100000:1.0:1721880422.245051:0:16110:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011637120 00000100:00100000:0.0:1721880422.245054:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914021 00000100:00100000:1.0:1721880422.245060:0:16110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631840 00000100:00100000:1.0:1721880422.245064:0:16110:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_094:lustre-MDT0000-mdtlov_UUID+1852:3687:x1805522011636224:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.245065:0:9458:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631841 00000100:00100000:3.0:1721880422.245070:0:9458:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097139500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2663:3686:x1805522011636992:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.245071:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631842 00002000:00080000:1.0:1721880422.245072:0:16110:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64227 count 1 00000100:00100000:0.0:1721880422.245076:0:16100:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631843 00000100:00100000:2.0:1721880422.245078:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a65f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1852:3689:x1805522011636864:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.245079:0:16110:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727b817 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfae3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.245081:0:16100:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:lustre-MDT0000-mdtlov_UUID+2663:3687:x1805522011637120:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.245087:0:16110:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009711e640/0x8a60d30f5717afb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfae3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b101101 expref: 1406 pid: 16046 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.245088:0:9458:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58048 count 1 00010000:00010000:1.0:1721880422.245091:0:16110:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00002000:00080000:2.0:1721880422.245091:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64229 count 1 00010000:00010000:1.0:1721880422.245092:0:16110:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00002000:00080000:0.0:1721880422.245094:0:16100:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58049 count 1 00010000:00010000:1.0:1721880422.245094:0:16110:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727b817 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfae3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.245098:0:9458:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5b00/0x8a60d30f5727b81e lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2c0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.245102:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727b825 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfae5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.245104:0:16100:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325d8c0/0x8a60d30f5727b82c lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2c1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.245107:0:16110:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009711e640/0x8a60d30f5717afb6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfae3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b101101 expref: 1406 pid: 16046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.245108:0:9458:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095036f40/0x8a60d30f571eb972 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129ea1 expref: 391 pid: 16019 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.245112:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094006400/0x8a60d30f5717b711 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfae5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b101258 expref: 1406 pid: 9460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.245113:0:16110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009711e640/0x8a60d30f5717afb6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfae3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b101101 expref: 1406 pid: 16046 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.245115:0:16100:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092049440/0x8a60d30f571eb9b8 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129ee7 expref: 391 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.245115:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.245116:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1721880422.245118:0:16110:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009713bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_094:lustre-OST0001_UUID:16110:1805522011637248:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.245118:0:9458:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5b00/0x8a60d30f5727b81e lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.245120:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.245121:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.245122:0:16100:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.245123:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727b825 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfae5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.245124:0:16100:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.245126:0:16100:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325d8c0/0x8a60d30f5727b82c lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.245130:0:16110:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb300 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.245132:0:9458:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095036f40/0x8a60d30f571eb972 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129ea1 expref: 391 pid: 16019 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.245139:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094006400/0x8a60d30f5717b711 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfae5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b101258 expref: 1406 pid: 9460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.245140:0:16100:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092049440/0x8a60d30f571eb9b8 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129ee7 expref: 391 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.245146:0:9458:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095036f40/0x8a60d30f571eb972 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129ea1 expref: 391 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.245149:0:16100:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092049440/0x8a60d30f571eb9b8 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129ee7 expref: 391 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.245149:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094006400/0x8a60d30f5717b711 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfae5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b101258 expref: 1406 pid: 9460 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.245153:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.245155:0:9458:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008c408700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9458:1805522011637376:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.245159:0:16100:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e615180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_087:lustre-OST0000_UUID:16100:1805522011637632:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.245159:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009f52f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011637504:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.245163:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257677184 00000100:00100000:1.0:1721880422.245165:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257677184 00000100:00100000:3.0:1721880422.245169:0:9458:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec540 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.245173:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092ba4b40/0x8a60d30f571eb662 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129b91 expref: 392 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.245176:0:16100:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36f00 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.245179:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfded80 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.245184:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914022 00000100:00100000:1.0:1721880422.245187:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009713b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+392:2004:x1805522257677184:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.245191:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.245193:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092ba4b40/0x8a60d30f571eb662 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129b91 expref: 392 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.245199:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092ba4b40/0x8a60d30f571eb662 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129b91 expref: 392 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.245206:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092ba4b40/0x8a60d30f571eb662 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2b7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129b91 expref: 392 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.245217:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.245217:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.245219:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098aa9d40/0x8a60d30f5727b792 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.245224:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098aa9d40/0x8a60d30f5727b792 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.245232:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.245240:0:15514:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098aa9d40/0x8a60d30f5727b792 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.245241:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009713b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+391:2004:x1805522257677184:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 53us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.245245:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914022 00010000:00010000:2.0:1721880422.245245:0:15514:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098aa9d40/0x8a60d30f5727b792 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.245250:0:15514:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098aa9d40/0x8a60d30f5727b792 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.245254:0:15514:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098aa9d40/0x8a60d30f5727b792 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.245258:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325df80/0x8a60d30f5727b7ca lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.245258:0:15514:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098aa9d40/0x8a60d30f5727b792 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.245261:0:15514:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa9d40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.245262:0:15514:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098aa9d40/0x8a60d30f5727b792 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.245266:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325df80/0x8a60d30f5727b7ca lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.245266:0:15514:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098aa9d40/0x8a60d30f5727b792 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.245273:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325df80/0x8a60d30f5727b7ca lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.245273:0:15514:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098aa9d40/0x8a60d30f5727b792 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.245277:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098aa9d40/0x8a60d30f5727b792 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.245280:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325df80/0x8a60d30f5727b7ca lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.245281:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.245286:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257678336 00010000:00010000:0.0:1721880422.245287:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325df80/0x8a60d30f5727b7ca lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.245288:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257678336 00010000:00010000:0.0:1721880422.245294:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325df80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.245294:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800946a4fc0/0x8a60d30f57179871 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfade:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100dce expref: 1407 pid: 16048 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.245297:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325df80/0x8a60d30f5727b7ca lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.245297:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fde1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0000_UUID:16111:1805522011634688:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.245303:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325df80/0x8a60d30f5727b7ca lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.245304:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914023 00000100:00100000:1.0:1721880422.245307:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097138a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1407:2005:x1805522257678336:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.245312:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325df80/0x8a60d30f5727b7ca lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.245313:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136350fc0/0x8a60d30f5727b7d8 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.245317:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.245319:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325df80/0x8a60d30f5727b7ca lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.245320:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800946a4fc0/0x8a60d30f57179871 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfade:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100dce expref: 1407 pid: 16048 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.245326:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800946a4fc0/0x8a60d30f57179871 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfade:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100dce expref: 1407 pid: 16048 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.245336:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.245337:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.245339:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727b7d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfade:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.245343:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727b7d1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfade:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.245349:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.245356:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880097138a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1407:2005:x1805522257678336:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 49us (75us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.245359:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914023 00000100:00100000:2.0:1721880422.245372:0:15514:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c40b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+2664:3687:x1805522011631616:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4440us (4551us total) trans 4296061605 rc 0/0 00000100:00100000:2.0:1721880422.245377:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631821 00000004:00080000:3.0:1721880422.245386:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880098d24a80/2, rc 0, transno 1094309 00000100:00100000:3.0:1721880422.245394:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880098d24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011631616:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.245400:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.245414:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257678464 00000100:00100000:2.0:1721880422.245416:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257678464 00000100:00100000:1.0:1721880422.245417:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.245424:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012382a640/0x8a60d30f571eb85a lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129d89 expref: 391 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.245426:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257678592 00000100:00100000:1.0:1721880422.245429:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257678592 00000100:00100000:2.0:1721880422.245436:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914024 00000100:00100000:2.0:1721880422.245439:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097138000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+391:2005:x1805522257678464:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.245440:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d1fe400/0x8a60d30f57179b5e lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfadf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100e6f expref: 1407 pid: 16122 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.245444:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.245446:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012382a640/0x8a60d30f571eb85a lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2bc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129d89 expref: 391 pid: 16098 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.245452:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012382a640/0x8a60d30f571eb85a lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2bc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129d89 expref: 391 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.245455:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914025 00000100:00100000:1.0:1721880422.245460:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009713a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1407:2006:x1805522257678592:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.245460:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012382a640/0x8a60d30f571eb85a lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2bc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129d89 expref: 391 pid: 16098 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.245466:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.245467:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.245467:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.245469:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136350fc0/0x8a60d30f5727b7d8 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.245471:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d1fe400/0x8a60d30f57179b5e lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfadf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100e6f expref: 1407 pid: 16122 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.245473:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136350fc0/0x8a60d30f5727b7d8 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.245474:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fde0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2664:3689:x1805522011633920:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3749us (3797us total) trans 4296061606 rc 0/0 00010000:00010000:1.0:1721880422.245479:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d1fe400/0x8a60d30f57179b5e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfadf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100e6f expref: 1407 pid: 16122 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.245481:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631829 00010000:00010000:2.0:1721880422.245483:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.245490:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.245491:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.245491:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880097138000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+390:2005:x1805522257678464:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 52us (93us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.245492:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136350fc0/0x8a60d30f5727b7d8 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.245494:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727b7df lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfadf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.245495:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914024 00010000:00010000:3.0:1721880422.245498:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136350fc0/0x8a60d30f5727b7d8 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.245500:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727b7df lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfadf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.245505:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136350fc0/0x8a60d30f5727b7d8 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.245508:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800946a4fc0/0x8a60d30f57179871 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfade:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100dce expref: 1407 pid: 16048 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.245511:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.245511:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136350fc0/0x8a60d30f5727b7d8 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.245515:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009f52d880/2, rc 0, transno 1094310 00010000:00010000:3.0:1721880422.245516:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136350fc0/0x8a60d30f5727b7d8 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.245518:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e616d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011634432:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.245522:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350fc0 already unused, calling callback (ffffffffa084e330) 00000100:00100000:1.0:1721880422.245525:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009713a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1406:2006:x1805522257678592:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 64us (107us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.245527:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136350fc0/0x8a60d30f5727b7d8 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.245528:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009f52d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011633920:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.245530:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727b7d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfade:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.245531:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1721880422.245532:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914025 00010000:00010000:3.0:1721880422.245532:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136350fc0/0x8a60d30f5727b7d8 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.245536:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008c40a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011637760:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.245538:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727b7d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfade:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.245541:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136350fc0/0x8a60d30f5727b7d8 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.245547:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136350fc0/0x8a60d30f5727b7d8 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.245550:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727b7d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfade:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.245552:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.245554:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d1fe400/0x8a60d30f57179b5e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfadf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100e6f expref: 1405 pid: 16122 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.245557:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727b7d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfade:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.245563:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727b7d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfade:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.245564:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b59a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011634816:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.245567:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011637760 00010000:00010000:0.0:1721880422.245569:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727b7d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfade:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.245569:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011637760 00010000:00010000:1.0:1721880422.245574:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727b7df lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfadf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.245575:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325fa80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.245578:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727b7d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfade:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.245579:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727b7df lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfadf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.245581:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631844 00010000:00010000:1.0:1721880422.245583:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727b7df lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfadf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.245584:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727b7d1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfade:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.245584:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f52d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2664:3689:x1805522011637760:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.245587:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727b7df lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfadf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.245592:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727b7df lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfadf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.245593:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727b7d1 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfade:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.245596:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727b7df lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfadf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.245599:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727b7d1 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfade:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.245599:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8fc0 already unused, calling callback (ffffffffa084e330) 00002000:00080000:2.0:1721880422.245599:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58050 count 1 00010000:00010000:1.0:1721880422.245601:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727b7df lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfadf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.245605:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727b7df lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfadf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.245608:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136350240/0x8a60d30f5727b833 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2c2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.245611:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727b7df lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfadf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.245614:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727b7df lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfadf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.245615:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099fd8000/0x8a60d30f571eba05 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129f34 expref: 389 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.245620:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.245621:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.245623:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136350240/0x8a60d30f5727b833 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.245632:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099fd8000/0x8a60d30f571eba05 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129f34 expref: 389 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.245639:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099fd8000/0x8a60d30f571eba05 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129f34 expref: 389 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.245644:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009f52ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16125:1805522011638016:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.245659:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdeb40 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.245669:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1721880422.245674:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008c40b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011637888:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1721880422.245674:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b599180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2665:3686:x1805522011634304:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2689us (2878us total) trans 4296061607 rc 0/0 00000100:00100000:3.0:1721880422.245678:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631831 00000100:00100000:2.0:1721880422.245700:0:16113:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008777f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0001_UUID:16113:1805522011635200:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.245701:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.245707:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+1854:3686:x1805522011634176:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2991us (3024us total) trans 4296019913 rc 0/0 00010000:00010000:2.0:1721880422.245710:0:16113:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727b7e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfae0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.245714:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631830 00000100:00100000:2.0:1721880422.245743:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.245748:0:16098:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880084df5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0001_UUID:16098:1805522011635584:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.245752:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011637888 00000100:00100000:0.0:1721880422.245755:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011637888 00010000:00010000:3.0:1721880422.245761:0:16098:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727b7ed lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfae1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.245769:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631845 00000100:00100000:0.0:1721880422.245773:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008777f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2665:3688:x1805522011637888:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.245773:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00002000:00080000:0.0:1721880422.245783:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58051 count 1 00000100:00100000:1.0:1721880422.245786:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257678720 00000100:00100000:2.0:1721880422.245787:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257678848 00000100:00100000:1.0:1721880422.245788:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257678720 00000100:00100000:2.0:1721880422.245790:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257678848 00010000:00010000:0.0:1721880422.245794:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325ed00/0x8a60d30f5727b83a lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2c3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.245798:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d744900/0x8a60d30f57179e05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfae0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100f10 expref: 1406 pid: 16059 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.245800:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800981d4d80/0x8a60d30f5717a250 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfae1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100fb8 expref: 1406 pid: 16024 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.245804:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094256640/0x8a60d30f571eba4b lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129f7a expref: 389 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.245810:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.245812:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.245814:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325ed00/0x8a60d30f5727b83a lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.245814:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914026 00000100:00100000:2.0:1721880422.245819:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8067850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1406:2004:x1805522257678848:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.245823:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914027 00000100:00100000:1.0:1721880422.245826:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009713aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1406:2005:x1805522257678720:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.245828:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094256640/0x8a60d30f571eba4b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129f7a expref: 389 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.245828:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.245831:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.245831:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800981d4d80/0x8a60d30f5717a250 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfae1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100fb8 expref: 1406 pid: 16024 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.245834:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d744900/0x8a60d30f57179e05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfae0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100f10 expref: 1406 pid: 16059 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.245836:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094256640/0x8a60d30f571eba4b lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129f7a expref: 389 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.245837:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800981d4d80/0x8a60d30f5717a250 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfae1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100fb8 expref: 1406 pid: 16024 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.245841:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d744900/0x8a60d30f57179e05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfae0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100f10 expref: 1406 pid: 16059 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.245845:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e616d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0000_UUID:16028:1805522011638144:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.245846:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800981d4d80/0x8a60d30f5717a250 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfae1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100fb8 expref: 1406 pid: 16024 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.245850:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d744900/0x8a60d30f57179e05 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfae0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b100f10 expref: 1406 pid: 16059 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.245853:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.245854:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.245856:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727b7ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfae1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.245859:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1721880422.245860:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36240 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.245860:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.245860:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727b7ed lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfae1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.245862:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727b7e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfae0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.245867:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727b7e6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfae0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.245869:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.245873:0:16098:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727b7ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfae1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.245876:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.245878:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8067850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1404:2004:x1805522257678848:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 58us (105us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.245880:0:16098:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727b7ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfae1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.245881:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914026 00000100:00100000:1.0:1721880422.245888:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009713aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1403:2005:x1805522257678720:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 61us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.245891:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914027 00010000:00010000:3.0:1721880422.245892:0:16098:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727b7ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfae1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.245893:0:16113:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727b7e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfae0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.245897:0:16098:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727b7ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfae1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.245898:0:16113:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727b7e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfae0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.245903:0:16113:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727b7e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfae0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.245903:0:16098:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727b7ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfae1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.245906:0:16113:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727b7e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfae0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.245908:0:16098:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b5200 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.245910:0:16098:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727b7ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfae1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.245914:0:16113:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727b7e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfae0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.245916:0:16098:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727b7ed lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfae1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.245918:0:16113:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353cc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.245919:0:16113:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727b7e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfae0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.245923:0:16113:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727b7e6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfae0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.245924:0:16098:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727b7ed lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfae1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.245928:0:16113:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727b7e6 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfae0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.245930:0:16098:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727b7ed lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfae1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.245932:0:16113:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727b7e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfae0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.245958:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e616a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1853:3688:x1805522011634560:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2881us (2926us total) trans 4296019914 rc 0/0 00000100:00100000:1.0:1721880422.245962:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631832 00000004:00080000:1.0:1721880422.245981:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e617b80/2, rc 0, transno 1094311 00000100:00100000:1.0:1721880422.245991:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e617b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011634304:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1721880422.245999:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009f52fb80/2, rc 0, transno 1052617 00000100:00100000:1.0:1721880422.246003:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009f52fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011634176:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.246035:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008c408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011638272:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.246040:0:16113:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008777d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0000-mdtlov_UUID+1854:3688:x1805522011634944:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2399us (2442us total) trans 4296019916 rc 0/0 00000100:00100000:2.0:1721880422.246044:0:16113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631833 00000100:00100000:1.0:1721880422.246048:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.246054:0:16113:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011638272 00000100:00100000:2.0:1721880422.246056:0:16113:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011638272 00000100:00100000:1.0:1721880422.246059:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1721880422.246062:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009713b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011638400:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.246066:0:16113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631846 00000100:00100000:2.0:1721880422.246068:0:16113:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097138a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0000-mdtlov_UUID+2666:3686:x1805522011638272:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.246072:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:2.0:1721880422.246076:0:16113:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58052 count 1 00010000:00010000:2.0:1721880422.246084:0:16113:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136351200/0x8a60d30f5727b841 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2c4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.246084:0:16098:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008777df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0000-mdtlov_UUID+1853:3689:x1805522011635456:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1873us (1970us total) trans 4296019915 rc 0/0 00000100:00100000:0.0:1721880422.246085:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011638400 00000100:00100000:0.0:1721880422.246088:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011638400 00000100:00100000:3.0:1721880422.246090:0:16098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631834 00010000:00010000:2.0:1721880422.246095:0:16113:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095b8d440/0x8a60d30f571eba98 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129fc7 expref: 389 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.246100:0:16113:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.246101:0:16113:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.246102:0:16113:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136351200/0x8a60d30f5727b841 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.246106:0:16098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631847 00000100:00100000:3.0:1721880422.246111:0:16098:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097138000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0000-mdtlov_UUID+1853:3686:x1805522011638400:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.246112:0:16113:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095b8d440/0x8a60d30f571eba98 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129fc7 expref: 389 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.246117:0:16113:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095b8d440/0x8a60d30f571eba98 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129fc7 expref: 389 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.246123:0:16113:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b59a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0000_UUID:16113:1805522011638528:192.168.201.24@tcp:104: 00002000:00080000:3.0:1721880422.246124:0:16098:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64230 count 1 00010000:00010000:3.0:1721880422.246134:0:16098:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727b848 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfae6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.246141:0:16113:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdee40 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.246144:0:16098:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c6fc000/0x8a60d30f5717bb6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfae6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1012eb expref: 1402 pid: 16084 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.246150:0:16098:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.246151:0:16098:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.246153:0:16098:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727b848 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfae6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.246156:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880084df6300/2, rc 0, transno 1052620 00000100:00100000:2.0:1721880422.246161:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880084df6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011634944:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1721880422.246168:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009b598a80/2, rc 0, transno 1052618 00010000:00010000:3.0:1721880422.246169:0:16098:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c6fc000/0x8a60d30f5717bb6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfae6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1012eb expref: 1402 pid: 16084 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.246170:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011634560:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.246179:0:16098:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c6fc000/0x8a60d30f5717bb6a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfae6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1012eb expref: 1402 pid: 16084 timeout: 887 lvb_type: 0 00000004:00080000:2.0:1721880422.246181:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008777dc00/2, rc 0, transno 1052619 00000100:00100000:2.0:1721880422.246184:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008777dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011635456:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.246188:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1721880422.246188:0:16098:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880084df5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0001_UUID:16098:1805522011638656:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.246194:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009713a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011638784:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.246207:0:16098:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec780 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.246210:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.246218:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880097139f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011639040:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.246221:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009713aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011638912:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.246231:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.246239:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.246250:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011638784 00000100:00100000:3.0:1721880422.246250:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011638912 00000100:00100000:3.0:1721880422.246252:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011638912 00000100:00100000:1.0:1721880422.246253:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011638784 00000100:00100000:3.0:1721880422.246266:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011639040 00000100:00100000:3.0:1721880422.246267:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011639040 00000100:00100000:1.0:1721880422.246270:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631848 00000100:00100000:1.0:1721880422.246274:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b59b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1856:3689:x1805522011638912:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.246276:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631849 00000100:00100000:0.0:1721880422.246281:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b59b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+1856:3689:x1805522011638784:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.246283:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64232 count 1 00000100:00100000:2.0:1721880422.246283:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631850 00000100:00100000:2.0:1721880422.246288:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e616300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+1856:3686:x1805522011639040:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.246290:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727b84f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfae8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1721880422.246293:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64231 count 1 00010000:00010000:1.0:1721880422.246297:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013563e880/0x8a60d30f5717c622 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfae8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10147a expref: 1402 pid: 16018 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.246299:0:15514:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64233 count 1 00010000:00010000:1.0:1721880422.246301:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.246302:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727b856 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfae7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.246302:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.246304:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727b84f lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfae8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.246310:0:15514:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727b85d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfae9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.246313:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009502b600/0x8a60d30f5717c224 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfae7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1013bd expref: 1402 pid: 16105 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.246318:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013563e880/0x8a60d30f5717c622 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfae8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10147a expref: 1402 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.246319:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.246320:0:15514:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800913c9b00/0x8a60d30f5717c84b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfae9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10150d expref: 1402 pid: 16128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.246321:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.246323:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727b856 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfae7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.246324:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013563e880/0x8a60d30f5717c622 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfae8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10147a expref: 1402 pid: 16018 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.246326:0:15514:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.246328:0:15514:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1721880422.246330:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009713ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011639168:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.246330:0:15514:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727b85d lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfae9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.246338:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009502b600/0x8a60d30f5717c224 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfae7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1013bd expref: 1402 pid: 16105 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.246346:0:15514:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800913c9b00/0x8a60d30f5717c84b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfae9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10150d expref: 1402 pid: 16128 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.246347:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb780 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.246348:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009502b600/0x8a60d30f5717c224 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfae7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1013bd expref: 1402 pid: 16105 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.246355:0:15514:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800913c9b00/0x8a60d30f5717c84b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfae9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10150d expref: 1402 pid: 16128 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.246357:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008cd23800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011639296:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.246365:0:15514:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b59ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:15514:1805522011639424:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.246375:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36e40 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.246384:0:15514:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.246650:0:16120:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880084df4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16120:1805522011635712:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.246664:0:16120:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6f40/0x8a60d30f5727b7fb lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.247263:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.247305:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257678976 00000100:00100000:1.0:1721880422.247309:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257678976 00010000:00010000:1.0:1721880422.247322:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099fdc6c0/0x8a60d30f571eb8a0 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129dd6 expref: 390 pid: 16112 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.247324:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.247340:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257679104 00000100:00100000:1.0:1721880422.247342:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257679104 00000100:00100000:0.0:1721880422.247345:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914028 00000100:00100000:2.0:1721880422.247351:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008777d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0000_UUID:16075:1805522011635840:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.247352:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d120000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+391:2005:x1805522257678976:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.247352:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa03600/0x8a60d30f571eb8ed lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129e15 expref: 391 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.247361:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.247368:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136353600/0x8a60d30f5727b7f4 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.247370:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914029 00000100:00100000:1.0:1721880422.247374:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d123b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+391:2004:x1805522257679104:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.247375:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008777fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011636608:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.247379:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.247382:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa03600/0x8a60d30f571eb8ed lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129e15 expref: 391 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.247387:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa03600/0x8a60d30f571eb8ed lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129e15 expref: 391 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.247391:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727b809 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfae2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.247397:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa03600/0x8a60d30f571eb8ed lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129e15 expref: 391 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.247405:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.247406:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.247408:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136353600/0x8a60d30f5727b7f4 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.247412:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099fdc6c0/0x8a60d30f571eb8a0 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129dd6 expref: 390 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.247412:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136353600/0x8a60d30f5727b7f4 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.247422:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099fdc6c0/0x8a60d30f571eb8a0 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129dd6 expref: 390 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.247422:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.247434:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136353600/0x8a60d30f5727b7f4 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.247436:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099fdc6c0/0x8a60d30f571eb8a0 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129dd6 expref: 390 pid: 16112 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.247439:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d123b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+390:2004:x1805522257679104:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 64us (115us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.247441:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136353600/0x8a60d30f5727b7f4 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.247442:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914029 00010000:00010000:0.0:1721880422.247447:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.247449:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.247449:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136353600/0x8a60d30f5727b7f4 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.247452:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6f40/0x8a60d30f5727b7fb lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.247456:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136353600/0x8a60d30f5727b7f4 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.247459:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6f40/0x8a60d30f5727b7fb lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.247462:0:16130:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880097139880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0000_UUID:16130:1805522011636480:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.247463:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136353600/0x8a60d30f5727b7f4 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.247469:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353600 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.247472:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136353600/0x8a60d30f5727b7f4 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.247473:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.247473:0:16130:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880098aa9440/0x8a60d30f5727b802 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.247479:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136353600/0x8a60d30f5727b7f4 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.247482:0:16120:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6f40/0x8a60d30f5727b7fb lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.247489:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d120000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+388:2005:x1805522257678976:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 137us (228us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.247490:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136353600/0x8a60d30f5727b7f4 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.247490:0:16120:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6f40/0x8a60d30f5727b7fb lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.247495:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914028 00010000:00010000:3.0:1721880422.247497:0:16120:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6f40/0x8a60d30f5727b7fb lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.247502:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136353600/0x8a60d30f5727b7f4 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.247504:0:16120:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6f40/0x8a60d30f5727b7fb lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.247510:0:16120:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6f40/0x8a60d30f5727b7fb lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.247516:0:16120:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b6f40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.247519:0:16120:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6f40/0x8a60d30f5727b7fb lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.247526:0:16120:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6f40/0x8a60d30f5727b7fb lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.247541:0:16120:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6f40/0x8a60d30f5727b7fb lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.247548:0:16120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6f40/0x8a60d30f5727b7fb lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.247550:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.247582:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257679232 00000100:00100000:1.0:1721880422.247585:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257679232 00010000:00010000:1.0:1721880422.247593:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009204aac0/0x8a60d30f571eb933 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129e5b expref: 388 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.247598:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.247610:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257679360 00000100:00100000:1.0:1721880422.247611:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257679360 00010000:00010000:1.0:1721880422.247618:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb3aac0/0x8a60d30f5717aabc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfae2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b101060 expref: 1403 pid: 16084 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.247620:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914030 00000100:00100000:3.0:1721880422.247625:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+388:2004:x1805522257679232:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.247627:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880097138e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2668:3686:x1805522011635328:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3406us (3488us total) trans 4296061608 rc 0/0 00000100:00100000:0.0:1721880422.247630:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.247632:0:7118:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.247635:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257679488 00000100:00100000:1.0:1721880422.247636:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257679488 00000100:00100000:2.0:1721880422.247636:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631835 00010000:00010000:3.0:1721880422.247637:0:7118:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009204aac0/0x8a60d30f571eb933 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129e5b expref: 388 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.247642:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011f8b3a80/0x8a60d30f5717b3ad lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfae4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1011a9 expref: 1404 pid: 16025 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.247643:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.247645:0:7118:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009204aac0/0x8a60d30f571eb933 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129e5b expref: 388 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.247655:0:7118:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009204aac0/0x8a60d30f571eb933 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129e5b expref: 388 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.247659:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257679616 00000100:00100000:0.0:1721880422.247662:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257679616 00000100:00100000:1.0:1721880422.247663:0:16188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914031 00010000:00010000:3.0:1721880422.247663:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.247664:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.247667:0:7118:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098aa9440/0x8a60d30f5727b802 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.247668:0:16188:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+1405:2005:x1805522257679360:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.247673:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009711e640/0x8a60d30f5717afb6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfae3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b101101 expref: 1405 pid: 16046 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.247674:0:7118:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098aa9440/0x8a60d30f5727b802 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.247675:0:16188:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.247675:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914032 00010000:00010000:1.0:1721880422.247680:0:16188:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cb3aac0/0x8a60d30f5717aabc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfae2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b101060 expref: 1405 pid: 16084 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.247680:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1405:2007:x1805522257679488:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.247687:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.247689:0:16188:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cb3aac0/0x8a60d30f5717aabc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfae2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b101060 expref: 1405 pid: 16084 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.247690:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914033 00010000:00010000:2.0:1721880422.247692:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011f8b3a80/0x8a60d30f5717b3ad lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfae4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1011a9 expref: 1405 pid: 16025 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.247693:0:7118:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.247694:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1405:2007:x1805522257679616:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.247699:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011f8b3a80/0x8a60d30f5717b3ad lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfae4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1011a9 expref: 1405 pid: 16025 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.247701:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.247701:0:16188:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cb3aac0/0x8a60d30f5717aabc lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfae2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b101060 expref: 1405 pid: 16084 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.247705:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009711e640/0x8a60d30f5717afb6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfae3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b101101 expref: 1405 pid: 16046 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.247708:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.247709:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.247711:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.247711:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727b810 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfae4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.247713:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.247715:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009711e640/0x8a60d30f5717afb6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfae3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b101101 expref: 1404 pid: 16046 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.247715:0:16188:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727b809 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfae2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.247716:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727b810 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfae4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.247716:0:7118:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+387:2004:x1805522257679232:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 89us (165us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.247722:0:16188:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727b809 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfae2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.247723:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914030 00010000:00010000:2.0:1721880422.247724:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.247726:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.247745:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.247748:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727b817 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfae3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.247756:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727b817 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfae3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.247759:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1404:2007:x1805522257679488:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 78us (129us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.247761:0:16130:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098aa9440/0x8a60d30f5727b802 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.247764:0:16188:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.247766:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.247768:0:16130:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098aa9440/0x8a60d30f5727b802 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.247770:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914032 00010000:00010000:3.0:1721880422.247774:0:16130:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098aa9440/0x8a60d30f5727b802 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.247781:0:16130:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098aa9440/0x8a60d30f5727b802 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.247783:0:16188:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+1403:2005:x1805522257679360:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 113us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.247784:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1403:2007:x1805522257679616:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 89us (140us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.247787:0:16130:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098aa9440/0x8a60d30f5727b802 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.247788:0:16188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914031 00000100:00100000:0.0:1721880422.247791:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914033 00010000:00010000:3.0:1721880422.247793:0:16130:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa9440 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.247795:0:16130:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098aa9440/0x8a60d30f5727b802 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.247801:0:16130:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098aa9440/0x8a60d30f5727b802 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.247806:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008777f480/2, rc 0, transno 1094312 00010000:00010000:3.0:1721880422.247814:0:16130:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098aa9440/0x8a60d30f5727b802 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.247815:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008777f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011635328:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.247820:0:16110:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009711e640/0x8a60d30f5717afb6 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfae3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b101101 expref: 1402 pid: 16046 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.247821:0:16130:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098aa9440/0x8a60d30f5727b802 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.247830:0:16110:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009713bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_094:lustre-OST0001_UUID:16110:1805522011637248:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.247842:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1721880422.247844:0:16110:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727b817 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfae3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.247848:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008777fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011639552:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.247851:0:16110:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727b817 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfae3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.247857:0:16110:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727b817 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfae3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.247865:0:16110:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727b817 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfae3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.247865:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.247871:0:16110:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727b817 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfae3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.247875:0:16110:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727b817 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfae3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.247881:0:16110:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aaa880 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.247884:0:16110:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727b817 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfae3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.247884:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011639552 00010000:00010000:1.0:1721880422.247887:0:16110:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727b817 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfae3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.247887:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011639552 00010000:00010000:1.0:1721880422.247893:0:16110:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727b817 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfae3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.247897:0:16110:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727b817 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfae3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.247901:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631851 00000100:00100000:2.0:1721880422.247904:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008777d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2669:3686:x1805522011639552:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1721880422.247915:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58053 count 1 00010000:00010000:2.0:1721880422.247925:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727b864 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2c5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.247929:0:16130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008777c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0000-mdtlov_UUID+2669:3689:x1805522011635968:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3173us (3252us total) trans 4296061610 rc 0/0 00010000:00010000:2.0:1721880422.247935:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800940933c0/0x8a60d30f571ebade lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a00d expref: 386 pid: 16119 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.247937:0:16130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631837 00010000:00010000:2.0:1721880422.247942:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.247943:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.247945:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727b864 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.247958:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800940933c0/0x8a60d30f571ebade lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a00d expref: 386 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.247963:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800940933c0/0x8a60d30f571ebade lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a00d expref: 386 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.247974:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099eb1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0000_UUID:16075:1805522011639680:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.247978:0:16110:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c409500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_094:lustre-MDT0000-mdtlov_UUID+1857:3687:x1805522011636224:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2913us (3015us total) trans 4296019917 rc 0/0 00000100:00100000:1.0:1721880422.247982:0:16110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631840 00000100:00100000:2.0:1721880422.247989:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde780 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.248003:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.248005:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009f52f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011637504:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.248009:0:16120:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880084df6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+2668:3687:x1805522011635072:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3710us (4337us total) trans 4296061609 rc 0/0 00000100:00100000:3.0:1721880422.248030:0:16120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631836 00010000:00010000:2.0:1721880422.248033:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727b825 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfae5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.248037:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257679744 00000100:00100000:1.0:1721880422.248041:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257679744 00000100:00100000:0.0:1721880422.248043:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.248049:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727b809 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfae2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.248054:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092049440/0x8a60d30f571eb9b8 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe2c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129ee7 expref: 387 pid: 16039 timeout: 887 lvb_type: 0 00000004:00080000:2.0:1721880422.248056:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009b086a00/2, rc 0, transno 1052621 00010000:00010000:3.0:1721880422.248056:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727b809 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfae2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.248063:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727b809 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfae2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.248068:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b086a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011636224:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.248068:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727b809 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfae2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.248075:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e617800/2, rc 0, transno 1094313 00010000:00010000:3.0:1721880422.248075:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727b809 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfae2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.248078:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e617800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011635072:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1721880422.248084:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350000 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.248087:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727b809 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfae2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.248088:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.248093:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727b809 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfae2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.248099:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257679872 00000100:00100000:0.0:1721880422.248102:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257679872 00000100:00100000:1.0:1721880422.248102:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257680000 00000100:00100000:2.0:1721880422.248102:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009713bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011639808:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.248102:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727b809 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfae2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.248104:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257680000 00010000:00010000:3.0:1721880422.248108:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727b809 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfae2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.248113:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094006400/0x8a60d30f5717b711 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfae5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b101258 expref: 1401 pid: 9460 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.248114:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095036f40/0x8a60d30f571eb972 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe2c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129ea1 expref: 388 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.248117:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.248123:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914034 00000100:00100000:1.0:1721880422.248127:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8067450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+388:2005:x1805522257679744:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.248130:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1721880422.248133:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.248137:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092049440/0x8a60d30f571eb9b8 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe2c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129ee7 expref: 388 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.248140:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914035 00000100:00100000:0.0:1721880422.248145:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1401:2005:x1805522257680000:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.248145:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914036 00010000:00010000:1.0:1721880422.248146:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092049440/0x8a60d30f571eb9b8 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129ee7 expref: 388 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.248151:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+388:2004:x1805522257679872:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.248152:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.248157:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094006400/0x8a60d30f5717b711 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfae5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b101258 expref: 1401 pid: 9460 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.248158:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.248159:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.248159:0:15473:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.248162:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009325d8c0/0x8a60d30f5727b82c lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.248164:0:15473:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095036f40/0x8a60d30f571eb972 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe2c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129ea1 expref: 388 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.248166:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094006400/0x8a60d30f5717b711 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfae5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b101258 expref: 1401 pid: 9460 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.248169:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325d8c0/0x8a60d30f5727b82c lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2c1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.248173:0:15473:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095036f40/0x8a60d30f571eb972 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129ea1 expref: 388 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.248179:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094006400/0x8a60d30f5717b711 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfae5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b101258 expref: 1401 pid: 9460 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.248180:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.248185:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.248187:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.248188:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.248190:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.248190:0:15473:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5b00/0x8a60d30f5727b81e lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.248192:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727b825 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfae5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.248197:0:15473:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5b00/0x8a60d30f5727b81e lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2c0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.248198:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8067450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+388:2005:x1805522257679744:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 69us (196us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.248200:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727b825 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfae5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.248203:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914034 00010000:00010000:2.0:1721880422.248208:0:15473:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.248211:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.248212:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ebd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+1857:3687:x1805522011636096:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3450us (3500us total) trans 4296019918 rc 0/0 00000100:00100000:3.0:1721880422.248218:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631838 00000100:00100000:2.0:1721880422.248224:0:15473:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+387:2004:x1805522257679872:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 73us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.248225:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1400:2005:x1805522257680000:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 80us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.248230:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914036 00000100:00100000:0.0:1721880422.248233:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914035 00000100:00100000:3.0:1721880422.248233:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011639808 00000100:00100000:3.0:1721880422.248237:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011639808 00010000:00010000:2.0:1721880422.248251:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727b825 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfae5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.248252:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631852 00000100:00100000:3.0:1721880422.248256:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099eb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+1857:3688:x1805522011639808:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.248258:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727b825 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfae5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.248261:0:16100:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092049440/0x8a60d30f571eb9b8 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129ee7 expref: 386 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.248263:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727b825 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfae5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.248266:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727b825 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfae5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.248266:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64234 count 1 00000100:00100000:0.0:1721880422.248271:0:16100:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e615180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_087:lustre-OST0000_UUID:16100:1805522011637632:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.248271:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727b825 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfae5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.248276:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727b86b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfaea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.248283:0:16100:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325d8c0/0x8a60d30f5727b82c lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.248283:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801363533c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.248286:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727b825 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfae5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.248286:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c80ad00/0x8a60d30f5717cb5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfaea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1015bc expref: 1399 pid: 16109 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.248290:0:16100:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325d8c0/0x8a60d30f5727b82c lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.248293:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727b825 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfae5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.248296:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.248297:0:16100:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325d8c0/0x8a60d30f5727b82c lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.248297:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.248299:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727b86b lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfaea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.248303:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727b825 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfae5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.248304:0:16100:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325d8c0/0x8a60d30f5727b82c lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.248310:0:16100:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325d8c0/0x8a60d30f5727b82c lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.248310:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727b825 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfae5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.248314:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c80ad00/0x8a60d30f5717cb5b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1015bc expref: 1399 pid: 16109 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.248317:0:16100:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325d8c0/0x8a60d30f5727b82c lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.248322:0:16100:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325d8c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.248322:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c80ad00/0x8a60d30f5717cb5b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1015bc expref: 1399 pid: 16109 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.248325:0:16100:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325d8c0/0x8a60d30f5727b82c lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.248331:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880084df4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011640064:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.248338:0:16100:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325d8c0/0x8a60d30f5727b82c lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.248347:0:16100:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325d8c0/0x8a60d30f5727b82c lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.248351:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdecb40 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.248353:0:16100:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325d8c0/0x8a60d30f5727b82c lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.248375:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095036f40/0x8a60d30f571eb972 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129ea1 expref: 385 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.248387:0:9458:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008c408700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9458:1805522011637376:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.248402:0:9458:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5b00/0x8a60d30f5727b81e lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.248409:0:9458:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5b00/0x8a60d30f5727b81e lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.248415:0:9458:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5b00/0x8a60d30f5727b81e lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.248426:0:9458:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5b00/0x8a60d30f5727b81e lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.248432:0:9458:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5b00/0x8a60d30f5727b81e lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.248437:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a65f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1858:3689:x1805522011636864:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3358us (3450us total) trans 4296019919 rc 0/0 00010000:00010000:3.0:1721880422.248438:0:9458:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5b00/0x8a60d30f5727b81e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.248442:0:9458:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b5b00 already unused, calling callback (ffffffffa084e330) 00000100:00100000:2.0:1721880422.248445:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631842 00010000:00010000:3.0:1721880422.248445:0:9458:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5b00/0x8a60d30f5727b81e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.248451:0:9458:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5b00/0x8a60d30f5727b81e lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.248460:0:9458:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5b00/0x8a60d30f5727b81e lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.248463:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099eb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011639936:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1721880422.248466:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5b00/0x8a60d30f5727b81e lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.248480:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.248497:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011639936 00000100:00100000:2.0:1721880422.248500:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011639936 00000100:00100000:2.0:1721880422.248515:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631853 00000100:00100000:2.0:1721880422.248518:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2670:3688:x1805522011639936:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1721880422.248527:0:16088:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58054 count 1 00010000:00010000:2.0:1721880422.248536:0:16088:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801363518c0/0x8a60d30f5727b872 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2c6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.248545:0:16088:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880072b31d40/0x8a60d30f571ebb2b lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a05a expref: 384 pid: 16019 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.248549:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.248551:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.248552:0:16088:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801363518c0/0x8a60d30f5727b872 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.248563:0:16100:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:lustre-MDT0000-mdtlov_UUID+2670:3687:x1805522011637120:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3481us (3563us total) trans 4296061611 rc 0/0 00010000:00010000:2.0:1721880422.248563:0:16088:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880072b31d40/0x8a60d30f571ebb2b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a05a expref: 384 pid: 16019 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.248570:0:16100:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631843 00010000:00010000:2.0:1721880422.248570:0:16088:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880072b31d40/0x8a60d30f571ebb2b lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a05a expref: 384 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.248576:0:16088:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099eb1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0000_UUID:16088:1805522011640192:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.248578:0:9458:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880097139500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2670:3686:x1805522011636992:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3506us (3598us total) trans 4296061612 rc 0/0 00000100:00100000:3.0:1721880422.248584:0:9458:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631841 00000100:00100000:2.0:1721880422.248590:0:16088:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfded80 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.248610:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009f52ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16125:1805522011638016:192.168.201.24@tcp:104: 00000004:00080000:3.0:1721880422.248614:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009713b800/2, rc 0, transno 1094316 00010000:00010000:2.0:1721880422.248620:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136350240/0x8a60d30f5727b833 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.248620:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009713b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011636992:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1721880422.248634:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880097139180/2, rc 0, transno 1094315 00000100:00100000:2.0:1721880422.248637:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880097139180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011637120:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1721880422.248644:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008876c000/2, rc 0, transno 1052622 00000100:00100000:3.0:1721880422.248653:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008c408700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011640320:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.248660:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008876c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011636096:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.248667:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fde1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011640448:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1721880422.248672:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.248688:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.248692:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.248704:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011640320 00000100:00100000:0.0:1721880422.248706:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257680128 00000100:00100000:2.0:1721880422.248706:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011640320 00010000:00010000:3.0:1721880422.248708:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011f8b3a80/0x8a60d30f5717b3ad lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfae4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1011a9 expref: 1399 pid: 16025 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.248709:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257680128 00000100:00100000:2.0:1721880422.248717:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011640448 00000100:00100000:2.0:1721880422.248718:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011640448 00010000:00010000:0.0:1721880422.248719:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099fd8000/0x8a60d30f571eba05 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129f34 expref: 385 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.248719:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008c40aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011636736:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.248722:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880097139880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011640576:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.248747:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631854 00000100:00100000:2.0:1721880422.248751:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2670:3686:x1805522011640320:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1721880422.248752:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727b810 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfae4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.248756:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914037 00000100:00100000:0.0:1721880422.248760:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+385:2004:x1805522257680128:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.248764:0:16100:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631855 00000100:00100000:1.0:1721880422.248765:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.248767:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.248767:0:16100:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099eb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:lustre-MDT0000-mdtlov_UUID+2670:3687:x1805522011640448:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.248771:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099fd8000/0x8a60d30f571eba05 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129f34 expref: 385 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.248771:0:16120:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011640576 00000100:00100000:3.0:1721880422.248773:0:16120:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011640576 00002000:00080000:2.0:1721880422.248774:0:16100:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58056 count 1 00010000:00010000:0.0:1721880422.248781:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099fd8000/0x8a60d30f571eba05 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129f34 expref: 385 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.248782:0:16100:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136352f40/0x8a60d30f5727b879 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2c8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.248789:0:16100:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880072b30900/0x8a60d30f571ebba9 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a0e6 expref: 385 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.248793:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099fd8000/0x8a60d30f571eba05 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129f34 expref: 385 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.248793:0:16100:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1721880422.248793:0:16120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631856 00010000:00010000:2.0:1721880422.248794:0:16100:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.248796:0:16100:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136352f40/0x8a60d30f5727b879 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.248796:0:16120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009713a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+1858:3688:x1805522011640576:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.248805:0:16120:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64235 count 1 00010000:00010000:0.0:1721880422.248806:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.248806:0:16100:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880072b30900/0x8a60d30f571ebba9 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a0e6 expref: 384 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.248807:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.248810:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136350240/0x8a60d30f5727b833 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.248811:0:16100:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880072b30900/0x8a60d30f571ebba9 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a0e6 expref: 384 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.248812:0:16120:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727b880 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfaeb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.248817:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136350240/0x8a60d30f5727b833 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.248817:0:16100:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009f52ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_087:lustre-OST0000_UUID:16100:1805522011640704:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.248819:0:16120:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009402ef40/0x8a60d30f5717cd4c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfaeb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10165d expref: 1398 pid: 16076 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.248823:0:16120:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.248824:0:16120:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.248825:0:16120:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727b880 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfaeb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.248829:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.248831:0:16100:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdeb40 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.248836:0:16120:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009402ef40/0x8a60d30f5717cd4c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaeb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10165d expref: 1398 pid: 16076 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.248843:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+384:2004:x1805522257680128:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 82us (152us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.248845:0:16120:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009402ef40/0x8a60d30f5717cd4c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaeb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10165d expref: 1398 pid: 16076 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.248848:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914037 00002000:00080000:2.0:1721880422.248848:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58055 count 1 00000100:00100000:3.0:1721880422.248855:0:16120:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880098d24e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0001_UUID:16120:1805522011640832:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.248856:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801363506c0/0x8a60d30f5727b887 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2c7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.248866:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009431a880/0x8a60d30f571ebb78 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a0a7 expref: 383 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.248870:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e616d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0000_UUID:16028:1805522011638144:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.248870:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.248871:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.248872:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801363506c0/0x8a60d30f5727b887 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.248878:0:16120:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec180 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.248882:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325ed00/0x8a60d30f5727b83a lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.248882:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009431a880/0x8a60d30f571ebb78 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a0a7 expref: 383 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.248888:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009431a880/0x8a60d30f571ebb78 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a0a7 expref: 383 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.248888:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727b810 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfae4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.248893:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009f52f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:15453:1805522011640960:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.248895:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727b810 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfae4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.248903:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727b810 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfae4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.248907:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde240 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.248909:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.248909:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727b810 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfae4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.248914:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136350240/0x8a60d30f5727b833 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.248916:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727b810 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfae4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.248918:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136350240/0x8a60d30f5727b833 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.248921:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b7a80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.248924:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136350240/0x8a60d30f5727b833 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.248924:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727b810 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfae4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.248927:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136350240/0x8a60d30f5727b833 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.248931:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727b810 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfae4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.248932:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136350240/0x8a60d30f5727b833 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.248936:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350240 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.248938:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136350240/0x8a60d30f5727b833 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.248941:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727b810 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfae4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.248942:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136350240/0x8a60d30f5727b833 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.248948:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136350240/0x8a60d30f5727b833 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.248949:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727b810 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfae4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.248950:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257680256 00010000:00010000:2.0:1721880422.248951:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136350240/0x8a60d30f5727b833 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.248955:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257680256 00000100:00100000:0.0:1721880422.248956:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.248972:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094256640/0x8a60d30f571eba4b lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129f7a expref: 384 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.248972:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257680384 00000100:00100000:0.0:1721880422.248973:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.248973:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257680384 00010000:00010000:2.0:1721880422.248981:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095b8d440/0x8a60d30f571eba98 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe2c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129fc7 expref: 385 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.248982:0:16098:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880084df5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0001_UUID:16098:1805522011638656:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.248991:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257680512 00000100:00100000:1.0:1721880422.248994:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257680512 00010000:00010000:3.0:1721880422.248994:0:16098:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727b848 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfae6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.248995:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914038 00000100:00100000:2.0:1721880422.248998:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+385:2005:x1805522257680256:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.249002:0:15473:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.249004:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c6fc000/0x8a60d30f5717bb6a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfae6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1012eb expref: 1399 pid: 16084 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.249005:0:15473:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094256640/0x8a60d30f571eba4b lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129f7a expref: 385 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.249008:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.249026:0:15473:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094256640/0x8a60d30f571eba4b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129f7a expref: 385 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.249037:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094256640/0x8a60d30f571eba4b lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129f7a expref: 385 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.249043:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.249043:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.249044:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.249046:0:15473:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009325ed00/0x8a60d30f5727b83a lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.249051:0:15473:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325ed00/0x8a60d30f5727b83a lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.249055:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257680640 00000100:00100000:1.0:1721880422.249058:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257680640 00010000:00010000:2.0:1721880422.249060:0:15473:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.249061:0:7118:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257680768 00000100:00100000:3.0:1721880422.249064:0:7118:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257680768 00010000:00010000:1.0:1721880422.249069:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013563e880/0x8a60d30f5717c622 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfae8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10147a expref: 1401 pid: 16018 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.249071:0:15473:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+384:2005:x1805522257680256:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 73us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.249074:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.249074:0:7118:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009502b600/0x8a60d30f5717c224 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfae7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1013bd expref: 1401 pid: 16105 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.249075:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914038 00000100:00100000:2.0:1721880422.249084:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257680896 00000100:00100000:2.0:1721880422.249086:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257680896 00000100:00100000:1.0:1721880422.249092:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914039 00010000:00010000:2.0:1721880422.249093:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800913c9b00/0x8a60d30f5717c84b lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfae9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10150d expref: 1402 pid: 16128 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.249096:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914040 00000100:00100000:1.0:1721880422.249098:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+383:2004:x1805522257680384:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.249100:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+1402:2007:x1805522257680512:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.249105:0:7118:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.249106:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.249106:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914041 00010000:00010000:3.0:1721880422.249108:0:7118:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c6fc000/0x8a60d30f5717bb6a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfae6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1012eb expref: 1402 pid: 16084 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.249109:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e194c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+1402:2005:x1805522257680640:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.249111:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095b8d440/0x8a60d30f571eba98 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe2c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129fc7 expref: 383 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.249114:0:15473:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.249114:0:7118:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c6fc000/0x8a60d30f5717bb6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfae6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1012eb expref: 1402 pid: 16084 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.249117:0:15473:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013563e880/0x8a60d30f5717c622 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfae8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10147a expref: 1402 pid: 16018 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.249121:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095b8d440/0x8a60d30f571eba98 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129fc7 expref: 383 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.249123:0:15473:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013563e880/0x8a60d30f5717c622 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfae8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10147a expref: 1402 pid: 16018 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.249123:0:7118:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c6fc000/0x8a60d30f5717bb6a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfae6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1012eb expref: 1402 pid: 16084 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.249131:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.249132:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.249133:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.249133:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.249134:0:15473:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727b84f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfae8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.249135:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.249135:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.249137:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136351200/0x8a60d30f5727b841 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.249137:0:7118:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727b848 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfae6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.249138:0:15473:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727b84f lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfae8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.249143:0:15473:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.249143:0:7118:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727b848 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfae6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.249144:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136351200/0x8a60d30f5727b841 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.249146:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.249149:0:15473:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e194c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+1401:2005:x1805522257680640:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 40us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.249152:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914041 00010000:00010000:1.0:1721880422.249156:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.249158:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257681024 00010000:00010000:3.0:1721880422.249158:0:7118:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.249160:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257681024 00010000:00010000:2.0:1721880422.249166:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800940933c0/0x8a60d30f571ebade lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a00d expref: 384 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.249170:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008cd23800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011639296:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.249176:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+384:2004:x1805522257680384:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 76us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.249177:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914042 00000100:00100000:3.0:1721880422.249178:0:7118:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+1400:2007:x1805522257680512:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 76us (203us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.249180:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727b856 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfae7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.249181:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+1400:2005:x1805522257680768:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.249183:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914039 00010000:00010000:2.0:1721880422.249185:0:15473:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.249187:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914040 00010000:00010000:2.0:1721880422.249188:0:15473:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009502b600/0x8a60d30f5717c224 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfae7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1013bd expref: 1400 pid: 16105 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.249192:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325ed00/0x8a60d30f5727b83a lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.249198:0:15473:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009502b600/0x8a60d30f5717c224 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfae7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1013bd expref: 1399 pid: 16105 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.249199:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325ed00/0x8a60d30f5727b83a lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.249201:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914043 00010000:00010000:2.0:1721880422.249205:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009502b600/0x8a60d30f5717c224 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfae7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1013bd expref: 1399 pid: 16105 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.249206:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325ed00/0x8a60d30f5727b83a lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.249206:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+1399:2004:x1805522257680896:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.249213:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325ed00/0x8a60d30f5727b83a lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.249213:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.249214:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.249214:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.249216:0:15473:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727b856 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfae7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.249216:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914044 00010000:00010000:0.0:1721880422.249219:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325ed00/0x8a60d30f5727b83a lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.249219:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800913c9b00/0x8a60d30f5717c84b lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfae9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10150d expref: 1398 pid: 16128 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.249220:0:15473:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727b856 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfae7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.249220:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+383:2005:x1805522257681024:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.249224:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325ed00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.249226:0:7118:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.249227:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325ed00/0x8a60d30f5727b83a lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.249227:0:15473:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.249228:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800913c9b00/0x8a60d30f5717c84b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfae9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10150d expref: 1398 pid: 16128 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.249230:0:7118:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800940933c0/0x8a60d30f571ebade lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe2c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a00d expref: 383 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.249233:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325ed00/0x8a60d30f5727b83a lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.249235:0:15473:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+1398:2005:x1805522257680768:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 53us (192us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.249238:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.249239:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914042 00010000:00010000:3.0:1721880422.249239:0:7118:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800940933c0/0x8a60d30f571ebade lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a00d expref: 383 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.249240:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.249242:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325ed00/0x8a60d30f5727b83a lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.249243:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727b85d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfae9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.249249:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325ed00/0x8a60d30f5727b83a lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.249249:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727b85d lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfae9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.249249:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.249250:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.249253:0:7118:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727b864 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.249258:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.249261:0:16113:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095b8d440/0x8a60d30f571eba98 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129fc7 expref: 383 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.249264:0:7118:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727b864 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.249270:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+1397:2004:x1805522257680896:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 64us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.249271:0:16113:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b59a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0000_UUID:16113:1805522011638528:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.249274:0:7118:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.249276:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914043 00010000:00010000:2.0:1721880422.249280:0:16113:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136351200/0x8a60d30f5727b841 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.249287:0:7118:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+382:2005:x1805522257681024:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 66us (141us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.249290:0:16113:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136351200/0x8a60d30f5727b841 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.249293:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914044 00010000:00010000:2.0:1721880422.249296:0:16113:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136351200/0x8a60d30f5727b841 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.249303:0:16113:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136351200/0x8a60d30f5727b841 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.249309:0:16113:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136351200/0x8a60d30f5727b841 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.249316:0:16113:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136351200/0x8a60d30f5727b841 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.249318:0:16098:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727b848 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfae6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.249321:0:16113:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136351200 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.249323:0:16113:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136351200/0x8a60d30f5727b841 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.249323:0:16098:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727b848 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfae6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.249327:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013563e880/0x8a60d30f5717c622 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfae8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10147a expref: 1396 pid: 16018 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.249327:0:16098:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727b848 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfae6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.249330:0:16113:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136351200/0x8a60d30f5727b841 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.249331:0:16098:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727b848 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfae6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.249334:0:16098:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727b848 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfae6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.249338:0:16098:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b7cc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.249339:0:16113:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136351200/0x8a60d30f5727b841 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.249339:0:16098:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727b848 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfae6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.249340:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009713ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011639168:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.249346:0:16113:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136351200/0x8a60d30f5727b841 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.249346:0:16098:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727b848 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfae6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.249353:0:16098:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727b848 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfae6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.249356:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008777f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2671:3688:x1805522011637888:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3580us (3626us total) trans 4296061613 rc 0/0 00010000:00010000:3.0:1721880422.249356:0:16098:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727b848 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfae6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.249357:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727b84f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfae8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.249362:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631845 00010000:00010000:1.0:1721880422.249362:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727b84f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfae8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.249366:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727b84f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfae8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.249370:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727b84f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfae8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.249374:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727b84f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfae8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.249377:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727b84f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfae8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.249378:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727b856 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfae7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.249381:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8480 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.249383:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727b84f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfae8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.249386:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727b856 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfae7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.249387:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727b84f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfae8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.249393:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727b856 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfae7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.249393:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727b84f lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfae8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.249399:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727b856 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfae7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.249400:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727b84f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfae8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.249405:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727b856 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfae7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.249411:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325c000 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.249414:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727b856 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfae7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.249420:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727b856 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfae7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.249430:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727b856 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfae7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.249437:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727b856 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfae7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.249450:0:16113:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880097138a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0000-mdtlov_UUID+2671:3686:x1805522011638272:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3380us (3400us total) trans 4296061614 rc 0/0 00000100:00100000:2.0:1721880422.249456:0:16113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631846 00000100:00100000:3.0:1721880422.249456:0:16098:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880097138000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0000-mdtlov_UUID+1861:3686:x1805522011638400:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3344us (3382us total) trans 4296019921 rc 0/0 00000100:00100000:3.0:1721880422.249460:0:16098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631847 00010000:00010000:2.0:1721880422.249478:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800913c9b00/0x8a60d30f5717c84b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfae9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10150d expref: 1395 pid: 16128 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.249488:0:15514:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b59ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:15514:1805522011639424:192.168.201.24@tcp:104: 00000004:00080000:3.0:1721880422.249490:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009713b100/2, rc 0, transno 1052625 00000100:00100000:1.0:1721880422.249496:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b59b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1861:3689:x1805522011638912:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3220us (3262us total) trans 4296019922 rc 0/0 00010000:00010000:2.0:1721880422.249502:0:15514:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727b85d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfae9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.249504:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631848 00000100:00100000:3.0:1721880422.249504:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009713b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011638400:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.249507:0:15514:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727b85d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfae9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.249511:0:15514:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727b85d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfae9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.249515:0:15514:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727b85d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfae9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.249515:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008c408a80/2, rc 0, transno 1094318 00010000:00010000:2.0:1721880422.249519:0:15514:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727b85d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfae9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.249520:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008c408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011638272:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1721880422.249522:0:15514:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727b85d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfae9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.249529:0:15514:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353180 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.249531:0:15514:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727b85d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfae9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.249535:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b59b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+1860:3689:x1805522011638784:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3253us (3323us total) trans 4296019923 rc 0/0 00010000:00010000:2.0:1721880422.249535:0:15514:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727b85d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfae9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.249541:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631849 00010000:00010000:2.0:1721880422.249541:0:15514:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727b85d lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfae9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.249544:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727b85d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfae9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.249549:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880098d24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011641216:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1721880422.249551:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008c40b100/2, rc 0, transno 1094317 00000100:00100000:1.0:1721880422.249559:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008c40b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011637888:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1721880422.249567:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.249578:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1721880422.249582:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1721880422.249584:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009713ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011641088:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.249587:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880097138700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011641344:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.249605:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.249625:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011641216 00000100:00100000:1.0:1721880422.249628:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011641216 00000100:00100000:2.0:1721880422.249630:0:15514:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e616300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+1860:3686:x1805522011639040:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3341us (3391us total) trans 4296019924 rc 0/0 00000100:00100000:2.0:1721880422.249634:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631850 00000100:00100000:1.0:1721880422.249643:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011641088 00000100:00100000:1.0:1721880422.249645:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011641088 00000100:00100000:2.0:1721880422.249646:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631857 00000100:00100000:2.0:1721880422.249649:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084df5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+2671:3686:x1805522011641216:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.249656:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631858 00002000:00080000:2.0:1721880422.249658:0:15514:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58057 count 1 00000100:00100000:1.0:1721880422.249660:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1860:3688:x1805522011641088:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.249660:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a052dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+1860:3688:x1805522011636352:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4832us (4871us total) trans 4296019920 rc 0/0 00010000:00010000:2.0:1721880422.249666:0:15514:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136351440/0x8a60d30f5727b88e lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2c9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.249666:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631839 00002000:00080000:1.0:1721880422.249668:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64236 count 1 00010000:00010000:2.0:1721880422.249673:0:15514:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880072b30d80/0x8a60d30f571ebbef lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a11e expref: 381 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.249676:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727b895 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfaec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.249678:0:15514:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.249679:0:15514:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.249681:0:15514:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136351440/0x8a60d30f5727b88e lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.249684:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ce1fa80/0x8a60d30f5717d14a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfaec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1016fe expref: 1394 pid: 16059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.249688:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.249689:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.249691:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727b895 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfaec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.249691:0:15514:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880072b30d80/0x8a60d30f571ebbef lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a11e expref: 381 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.249697:0:15514:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880072b30d80/0x8a60d30f571ebbef lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a11e expref: 381 pid: 16098 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.249701:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ce1fa80/0x8a60d30f5717d14a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1016fe expref: 1394 pid: 16059 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.249702:0:15514:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b59ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:15514:1805522011641472:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.249707:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ce1fa80/0x8a60d30f5717d14a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1016fe expref: 1394 pid: 16059 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.249714:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d120000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011641600:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.249719:0:15514:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.249748:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb780 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.249750:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800940933c0/0x8a60d30f571ebade lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a00d expref: 381 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.249758:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099eb1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0000_UUID:16075:1805522011639680:192.168.201.24@tcp:104: 00000004:00080000:1.0:1721880422.249767:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009ebdb100/2, rc 0, transno 1052624 00010000:00010000:2.0:1721880422.249767:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727b864 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.249772:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009ebdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011636352:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.249772:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727b864 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.249776:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727b864 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.249780:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727b864 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.249787:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727b864 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.249791:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727b864 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.249794:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352880 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.249796:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727b864 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.249800:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727b864 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.249805:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727b864 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.249809:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727b864 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.249844:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.249860:0:16113:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011641344 00000004:00080000:3.0:1721880422.249862:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880097139f80/2, rc 0, transno 1052628 00000100:00100000:0.0:1721880422.249864:0:16113:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011641344 00000100:00100000:3.0:1721880422.249867:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880097139f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011639040:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.249880:0:16113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631859 00000100:00100000:0.0:1721880422.249884:0:16113:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084df6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0000-mdtlov_UUID+2673:3686:x1805522011641344:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.249888:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b08ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011641728:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.249892:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008777d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2673:3686:x1805522011639552:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1986us (2025us total) trans 4296061615 rc 0/0 00002000:00080000:0.0:1721880422.249895:0:16113:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58058 count 1 00000100:00100000:2.0:1721880422.249895:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631851 00000004:00080000:3.0:1721880422.249900:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008777fb80/2, rc 0, transno 1094319 00010000:00010000:0.0:1721880422.249904:0:16113:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b89c lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2ca:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.249910:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008777fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011639552:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.249911:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.249915:0:16113:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800932cc240/0x8a60d30f571ebc35 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a164 expref: 380 pid: 16019 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.249922:0:16113:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.249923:0:16113:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.249926:0:16113:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b89c lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.249940:0:16113:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800932cc240/0x8a60d30f571ebc35 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a164 expref: 380 pid: 16019 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.249944:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1721880422.249948:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800959a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011641856:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.249954:0:16113:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800932cc240/0x8a60d30f571ebc35 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a164 expref: 380 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.249954:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800959a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011641984:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.249964:0:16113:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800919c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0000_UUID:16113:1805522011642112:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.249966:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.249980:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f52d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2673:3689:x1805522011637760:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4394us (4426us total) trans 4296061616 rc 0/0 00000100:00100000:2.0:1721880422.249983:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631844 00000100:00100000:3.0:1721880422.249986:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.249987:0:16113:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36e40 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.249996:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011641728 00000100:00100000:2.0:1721880422.249997:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011641856 00000100:00100000:0.0:1721880422.249999:0:16098:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011641984 00000100:00100000:1.0:1721880422.249999:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011641728 00000100:00100000:2.0:1721880422.250000:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011641856 00000100:00100000:0.0:1721880422.250001:0:16098:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011641984 00000100:00100000:2.0:1721880422.250034:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631860 00000100:00100000:2.0:1721880422.250039:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+1861:3688:x1805522011641856:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.250040:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631861 00000100:00100000:0.0:1721880422.250046:0:16098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631862 00000100:00100000:1.0:1721880422.250046:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+1861:3688:x1805522011641728:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.250050:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64238 count 1 00000100:00100000:0.0:1721880422.250051:0:16098:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084df7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0000-mdtlov_UUID+2673:3686:x1805522011641984:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1721880422.250058:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64237 count 1 00010000:00010000:2.0:1721880422.250061:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727b8a3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfaee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1721880422.250062:0:16098:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58059 count 1 00010000:00010000:1.0:1721880422.250067:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727b8aa lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfaed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.250071:0:16098:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325f600/0x8a60d30f5727b8b1 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2cb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.250072:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099ae1d40/0x8a60d30f5717dfc1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfaee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1018b0 expref: 1394 pid: 16025 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.250077:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f1d8480/0x8a60d30f5717d659 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfaed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1017f3 expref: 1394 pid: 16118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.250078:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.250080:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.250081:0:16098:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800932cfcc0/0x8a60d30f571ebc7b lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a1aa expref: 380 pid: 16019 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.250082:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727b8a3 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfaee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.250083:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.250085:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.250087:0:16098:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.250087:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727b8aa lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfaed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.250088:0:16098:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.250091:0:16098:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325f600/0x8a60d30f5727b8b1 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.250099:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099ae1d40/0x8a60d30f5717dfc1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1018b0 expref: 1394 pid: 16025 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.250102:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f1d8480/0x8a60d30f5717d659 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1017f3 expref: 1394 pid: 16118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.250105:0:16098:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800932cfcc0/0x8a60d30f571ebc7b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a1aa expref: 380 pid: 16019 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.250107:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099ae1d40/0x8a60d30f5717dfc1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1018b0 expref: 1394 pid: 16025 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.250111:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f1d8480/0x8a60d30f5717d659 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1017f3 expref: 1394 pid: 16118 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.250114:0:16098:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800932cfcc0/0x8a60d30f571ebc7b lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a1aa expref: 380 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.250117:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b59a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011642240:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.250121:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800959a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011642368:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.250129:0:16098:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800919c3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0000_UUID:16098:1805522011642496:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.250136:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde780 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.250142:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eba80 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.250146:0:16098:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36240 going to sleep for 11 seconds 00000004:00080000:2.0:1721880422.250163:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009713aa00/2, rc 0, transno 1052626 00000100:00100000:2.0:1721880422.250171:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009713aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011638912:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1721880422.250180:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009713a300/2, rc 0, transno 1052627 00000100:00100000:2.0:1721880422.250183:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009713a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011638784:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1721880422.250193:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008c40a680/2, rc 0, transno 1094320 00000100:00100000:2.0:1721880422.250202:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008c40a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011637760:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1721880422.250212:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008fde2a00/2, rc 0, transno 1052623 00000100:00100000:1.0:1721880422.250217:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800959a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011642752:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.250219:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fde2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011636864:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.250220:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1721880422.250228:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800959a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011642624:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1721880422.250230:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880084df7800/2, rc 0, transno 1094314 00000100:00100000:1.0:1721880422.250233:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.250246:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880084df7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011635968:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1721880422.250249:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.250257:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011642752 00000100:00100000:2.0:1721880422.250258:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800959a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011642880:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.250259:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011642752 00000100:00100000:1.0:1721880422.250260:0:9458:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011642624 00000100:00100000:1.0:1721880422.250262:0:9458:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011642624 00000100:00100000:3.0:1721880422.250266:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800919c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011643008:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.250277:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631863 00000100:00100000:0.0:1721880422.250282:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+1863:3688:x1805522011642752:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.250282:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.250283:0:9458:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631864 00000100:00100000:1.0:1721880422.250289:0:9458:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084df6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1863:3686:x1805522011642624:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.250292:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64240 count 1 00000100:00100000:3.0:1721880422.250298:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011642880 00000100:00100000:3.0:1721880422.250301:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011642880 00010000:00010000:0.0:1721880422.250302:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727b8b8 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfaf0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.250307:0:9458:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64239 count 1 00010000:00010000:0.0:1721880422.250311:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095ec9200/0x8a60d30f5718217d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfaf0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10419f expref: 1394 pid: 16021 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.250318:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.250319:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.250322:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727b8b8 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfaf0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.250324:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631865 00000100:00100000:3.0:1721880422.250328:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b598e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2674:3689:x1805522011642880:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.250335:0:9458:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727b8bf lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfaef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.250340:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58060 count 1 00010000:00010000:1.0:1721880422.250344:0:9458:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007bb12400/0x8a60d30f57181b8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfaef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b103d77 expref: 1394 pid: 16029 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.250350:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4000/0x8a60d30f5727b8c6 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2cc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.250354:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.250355:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.250357:0:9458:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727b8bf lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfaef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.250361:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d5afcc0/0x8a60d30f571ebcc1 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a1f0 expref: 380 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.250367:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.250368:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.250370:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4000/0x8a60d30f5727b8c6 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.250372:0:9458:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007bb12400/0x8a60d30f57181b8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b103d77 expref: 1394 pid: 16029 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.250380:0:9458:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007bb12400/0x8a60d30f57181b8e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b103d77 expref: 1394 pid: 16029 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.250386:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d5afcc0/0x8a60d30f571ebcc1 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a1f0 expref: 380 pid: 16119 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.250389:0:9458:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800959a7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011643264:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.250395:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d5afcc0/0x8a60d30f571ebcc1 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a1f0 expref: 380 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.250402:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095ec9200/0x8a60d30f5718217d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaf0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10419f expref: 1394 pid: 16021 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.250404:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880096003480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0000_UUID:16017:1805522011643392:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.250411:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095ec9200/0x8a60d30f5718217d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaf0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10419f expref: 1394 pid: 16021 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.250416:0:9458:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb600 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.250421:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800919c1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011643520:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.250423:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec540 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.250436:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.250441:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36f00 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.250449:0:16110:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011643008 00000100:00100000:3.0:1721880422.250449:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1721880422.250452:0:16110:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011643008 00000100:00100000:3.0:1721880422.250454:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800959a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011643136:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1721880422.250470:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.250475:0:16110:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011643136 00000100:00100000:1.0:1721880422.250477:0:16110:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011643136 00000100:00100000:3.0:1721880422.250486:0:16130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631866 00000100:00100000:1.0:1721880422.250490:0:16110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631867 00000100:00100000:3.0:1721880422.250490:0:16130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0000-mdtlov_UUID+1864:3686:x1805522011643008:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.250493:0:16110:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_094:lustre-MDT0000-mdtlov_UUID+2675:3686:x1805522011643136:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1721880422.250500:0:16130:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64241 count 1 00002000:00080000:1.0:1721880422.250503:0:16110:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58061 count 1 00010000:00010000:3.0:1721880422.250509:0:16130:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727b8cd lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfaf1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.250512:0:16110:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098aa8900/0x8a60d30f5727b8d4 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2cd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.250516:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880084df4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011640064:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.250518:0:16130:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0d7c6c0/0x8a60d30f57182305 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfaf1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b104239 expref: 1394 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.250521:0:16110:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084269200/0x8a60d30f571ebd15 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a244 expref: 380 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.250524:0:16130:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.250525:0:16130:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.250527:0:16130:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727b8cd lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfaf1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.250531:0:16110:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.250532:0:16110:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.250532:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727b86b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfaea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.250534:0:16110:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098aa8900/0x8a60d30f5727b8d4 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.250542:0:16130:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0d7c6c0/0x8a60d30f57182305 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaf1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b104239 expref: 1394 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.250549:0:16110:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084269200/0x8a60d30f571ebd15 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a244 expref: 380 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.250555:0:16130:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0d7c6c0/0x8a60d30f57182305 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaf1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b104239 expref: 1394 pid: 15506 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.250556:0:16088:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099eb1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0000_UUID:16088:1805522011640192:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.250558:0:16110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084269200/0x8a60d30f571ebd15 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a244 expref: 380 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.250564:0:16130:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880098d25880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0001_UUID:16130:1805522011643648:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.250566:0:16088:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801363518c0/0x8a60d30f5727b872 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.250567:0:16110:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800959a5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_094:lustre-OST0000_UUID:16110:1805522011643776:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.250585:0:16130:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec300 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.250586:0:16110:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302ebc00 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.250901:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.250928:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.250930:0:16100:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009f52ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_087:lustre-OST0000_UUID:16100:1805522011640704:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.250935:0:15455:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257681152 00000100:00100000:3.0:1721880422.250939:0:15455:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257681152 00010000:00010000:2.0:1721880422.250946:0:16100:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136352f40/0x8a60d30f5727b879 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.250950:0:15455:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c80ad00/0x8a60d30f5717cb5b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1015bc expref: 1395 pid: 16109 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.250962:0:15455:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257681280 00000100:00100000:3.0:1721880422.250964:0:15455:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257681280 00010000:00010000:3.0:1721880422.250970:0:15455:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880072b30900/0x8a60d30f571ebba9 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a0e6 expref: 381 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.250976:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914045 00000100:00100000:0.0:1721880422.250982:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1395:2004:x1805522257681152:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.250989:0:15455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914046 00010000:00010000:0.0:1721880422.250990:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.250993:0:15455:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+381:2007:x1805522257681280:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.250995:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c80ad00/0x8a60d30f5717cb5b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1015bc expref: 1395 pid: 16109 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.250999:0:15455:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.251003:0:15455:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880072b30900/0x8a60d30f571ebba9 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a0e6 expref: 381 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.251005:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c80ad00/0x8a60d30f5717cb5b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1015bc expref: 1395 pid: 16109 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.251025:0:15455:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880072b30900/0x8a60d30f571ebba9 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a0e6 expref: 381 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.251031:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c80ad00/0x8a60d30f5717cb5b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfaea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1015bc expref: 1395 pid: 16109 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.251038:0:15455:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880072b30900/0x8a60d30f571ebba9 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a0e6 expref: 381 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.251043:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.251044:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.251047:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727b86b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.251049:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.251051:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.251054:0:15455:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136352f40/0x8a60d30f5727b879 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.251055:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727b86b lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfaea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.251061:0:15455:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136352f40/0x8a60d30f5727b879 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.251073:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.251076:0:15455:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.251096:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1394:2004:x1805522257681152:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 113us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.251097:0:15455:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+380:2007:x1805522257681280:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 102us (167us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.251100:0:16100:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136352f40/0x8a60d30f5727b879 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.251102:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914045 00000100:00100000:3.0:1721880422.251107:0:15455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914046 00010000:00010000:2.0:1721880422.251109:0:16100:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136352f40/0x8a60d30f5727b879 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.251117:0:16100:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136352f40/0x8a60d30f5727b879 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.251124:0:16100:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136352f40/0x8a60d30f5727b879 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.251131:0:16100:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136352f40/0x8a60d30f5727b879 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.251137:0:16100:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352f40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.251140:0:16100:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136352f40/0x8a60d30f5727b879 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.251146:0:16100:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136352f40/0x8a60d30f5727b879 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.251156:0:16100:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136352f40/0x8a60d30f5727b879 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.251163:0:16100:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136352f40/0x8a60d30f5727b879 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.251290:0:16100:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099eb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:lustre-MDT0000-mdtlov_UUID+2676:3687:x1805522011640448:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2519us (2599us total) trans 4296061617 rc 0/0 00000100:00100000:0.0:1721880422.251293:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.251297:0:16100:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631855 00010000:00010000:2.0:1721880422.251316:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727b86b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.251316:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257681408 00000100:00100000:3.0:1721880422.251320:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257681408 00010000:00010000:2.0:1721880422.251323:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727b86b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.251330:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727b86b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.251333:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880072b31d40/0x8a60d30f571ebb2b lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a05a expref: 380 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.251336:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727b86b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfaea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.251342:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727b86b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.251348:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b5f80 already unused, calling callback (ffffffffa084e330) 00000100:00100000:3.0:1721880422.251350:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914047 00010000:00010000:2.0:1721880422.251351:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727b86b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.251354:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+380:2005:x1805522257681408:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.251358:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727b86b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.251360:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.251364:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880072b31d40/0x8a60d30f571ebb2b lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a05a expref: 380 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.251368:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727b86b lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfaea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.251372:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727b86b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfaea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.251372:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880072b31d40/0x8a60d30f571ebb2b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a05a expref: 380 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.251387:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880072b31d40/0x8a60d30f571ebb2b lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a05a expref: 380 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.251396:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.251398:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.251400:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801363518c0/0x8a60d30f5727b872 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.251407:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801363518c0/0x8a60d30f5727b872 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.251408:0:16113:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800919c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0000_UUID:16113:1805522011642112:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.251411:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.251420:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.251422:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257681536 00000100:00100000:0.0:1721880422.251425:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257681536 00010000:00010000:1.0:1721880422.251427:0:16113:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b89c lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.251437:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009402ef40/0x8a60d30f5717cd4c lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfaeb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10165d expref: 1394 pid: 16076 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.251443:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+379:2005:x1805522257681408:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 87us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.251449:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914047 00000100:00100000:0.0:1721880422.251461:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914048 00000100:00100000:0.0:1721880422.251465:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ab4d6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1394:2005:x1805522257681536:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.251472:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.251476:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009402ef40/0x8a60d30f5717cd4c lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfaeb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10165d expref: 1394 pid: 16076 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.251485:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009402ef40/0x8a60d30f5717cd4c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaeb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10165d expref: 1394 pid: 16076 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.251488:0:16120:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880098d24e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0001_UUID:16120:1805522011640832:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.251497:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009402ef40/0x8a60d30f5717cd4c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfaeb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10165d expref: 1394 pid: 16076 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.251498:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099eb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+1865:3688:x1805522011639808:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3240us (3378us total) trans 4296019925 rc 0/0 00010000:00010000:3.0:1721880422.251503:0:16120:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727b880 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfaeb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.251505:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631852 00010000:00010000:0.0:1721880422.251507:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000004:00080000:1.0:1721880422.251508:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009713bb80/2, rc 0, transno 1052629 00010000:00010000:0.0:1721880422.251509:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.251512:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727b880 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaeb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.251516:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009713bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011639808:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.251520:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727b880 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfaeb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.251531:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009f52f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:15453:1805522011640960:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.251532:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.251534:0:16120:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727b880 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.251540:0:16120:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727b880 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.251545:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801363506c0/0x8a60d30f5727b887 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.251547:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ab4d6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1393:2005:x1805522257681536:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 81us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.251547:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800959a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011643904:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.251547:0:16120:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727b880 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.251553:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914048 00010000:00010000:3.0:1721880422.251555:0:16120:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727b880 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfaeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.251560:0:16088:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801363518c0/0x8a60d30f5727b872 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.251561:0:16120:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727b880 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.251565:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.251566:0:16088:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801363518c0/0x8a60d30f5727b872 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.251566:0:16120:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b6ac0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.251570:0:16120:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727b880 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.251571:0:16088:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801363518c0/0x8a60d30f5727b872 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.251575:0:16088:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801363518c0/0x8a60d30f5727b872 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.251576:0:16120:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727b880 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.251579:0:16088:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801363518c0/0x8a60d30f5727b872 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.251582:0:16088:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801363518c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.251584:0:16088:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801363518c0/0x8a60d30f5727b872 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.251586:0:16120:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727b880 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfaeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.251587:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011643904 00010000:00010000:2.0:1721880422.251587:0:16088:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801363518c0/0x8a60d30f5727b872 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.251590:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011643904 00010000:00010000:3.0:1721880422.251592:0:16120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727b880 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfaeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.251598:0:16088:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801363518c0/0x8a60d30f5727b872 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.251603:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801363518c0/0x8a60d30f5727b872 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.251608:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631868 00000100:00100000:1.0:1721880422.251613:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+1865:3688:x1805522011643904:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.251624:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64242 count 1 00010000:00010000:1.0:1721880422.251634:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727b8db lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfaf2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.251644:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f814000/0x8a60d30f5718292c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfaf2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1042b7 expref: 1392 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.251650:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.251651:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.251654:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727b8db lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfaf2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.251667:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f814000/0x8a60d30f5718292c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaf2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1042b7 expref: 1392 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.251675:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f814000/0x8a60d30f5718292c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaf2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1042b7 expref: 1392 pid: 15452 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.251682:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2676:3688:x1805522011639936:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3162us (3201us total) trans 4296061618 rc 0/0 00000100:00100000:1.0:1721880422.251683:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801312d1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011644032:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.251687:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631853 00000100:00100000:1.0:1721880422.251701:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302ebe40 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.251705:0:15514:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b59ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:15514:1805522011641472:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.251714:0:15514:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136351440/0x8a60d30f5727b88e lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.251715:0:16120:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009713a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+1866:3688:x1805522011640576:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2916us (2950us total) trans 4296019926 rc 0/0 00000100:00100000:0.0:1721880422.251719:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.251722:0:16120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631856 00000100:00100000:1.0:1721880422.251723:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d120000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011641600:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.251745:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257681792 00000100:00100000:0.0:1721880422.251748:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257681792 00010000:00010000:1.0:1721880422.251757:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727b895 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfaec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.251758:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880072b30d80/0x8a60d30f571ebbef lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a11e expref: 379 pid: 16098 timeout: 887 lvb_type: 0 00000004:00080000:2.0:1721880422.251759:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008fde1500/2, rc 0, transno 1094321 00000100:00100000:2.0:1721880422.251765:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fde1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011640448:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.251774:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914049 00000004:00080000:1.0:1721880422.251774:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880097139880/2, rc 0, transno 1052630 00000100:00100000:0.0:1721880422.251779:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+379:2004:x1805522257681792:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.251780:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880097139880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011640576:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.251785:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.251788:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880072b30d80/0x8a60d30f571ebbef lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a11e expref: 379 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.251795:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880098d24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011644160:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.251797:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880072b30d80/0x8a60d30f571ebbef lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a11e expref: 379 pid: 16098 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.251808:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880072b30d80/0x8a60d30f571ebbef lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a11e expref: 379 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.251810:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.251812:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801312d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011644288:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1721880422.251816:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099eb0380/2, rc 0, transno 1094322 00010000:00010000:0.0:1721880422.251818:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.251819:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1721880422.251821:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099eb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011639936:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.251822:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136351440/0x8a60d30f5727b88e lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.251827:0:16120:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011644160 00010000:00010000:0.0:1721880422.251829:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136351440/0x8a60d30f5727b88e lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.251830:0:16120:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011644160 00010000:00010000:0.0:1721880422.251843:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.251844:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801312d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011644416:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1721880422.251846:0:16120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631869 00000100:00100000:3.0:1721880422.251850:0:16120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b59ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+2676:3689:x1805522011644160:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.251857:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+378:2004:x1805522257681792:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 78us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.251861:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1721880422.251861:0:16120:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58062 count 1 00000100:00100000:0.0:1721880422.251864:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914049 00010000:00010000:3.0:1721880422.251870:0:16120:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5680/0x8a60d30f5727b8e2 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2ce:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.251872:0:16100:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011644416 00000100:00100000:1.0:1721880422.251874:0:16100:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011644416 00010000:00010000:2.0:1721880422.251874:0:15514:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136351440/0x8a60d30f5727b88e lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.251880:0:15514:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136351440/0x8a60d30f5727b88e lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.251880:0:16120:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b1fef40/0x8a60d30f571ebd62 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a28a expref: 377 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.251886:0:16120:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1721880422.251887:0:16100:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631870 00000100:00100000:0.0:1721880422.251888:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.251888:0:15514:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136351440/0x8a60d30f5727b88e lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.251888:0:16120:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1721880422.251890:0:16100:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096c9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:lustre-MDT0000-mdtlov_UUID+2677:3687:x1805522011644416:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1721880422.251890:0:16120:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5680/0x8a60d30f5727b8e2 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.251893:0:15514:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136351440/0x8a60d30f5727b88e lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.251896:0:15514:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136351440/0x8a60d30f5727b88e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.251897:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257681920 00002000:00080000:1.0:1721880422.251898:0:16100:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58063 count 1 00000100:00100000:0.0:1721880422.251899:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257681920 00010000:00010000:2.0:1721880422.251899:0:15514:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136351440 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.251901:0:15514:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136351440/0x8a60d30f5727b88e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.251905:0:16100:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098aaaac0/0x8a60d30f5727b8e9 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2cf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.251905:0:15514:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136351440/0x8a60d30f5727b88e lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.251907:0:16120:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b1fef40/0x8a60d30f571ebd62 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a28a expref: 377 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.251908:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ce1fa80/0x8a60d30f5717d14a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1016fe expref: 1393 pid: 16059 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.251910:0:15514:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136351440/0x8a60d30f5727b88e lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.251913:0:16100:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dae6400/0x8a60d30f571ebda8 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a2d7 expref: 377 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.251914:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136351440/0x8a60d30f5727b88e lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.251915:0:16120:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b1fef40/0x8a60d30f571ebd62 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a28a expref: 377 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.251917:0:16100:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.251918:0:16100:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.251919:0:16100:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098aaaac0/0x8a60d30f5727b8e9 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.251926:0:16120:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009f52f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16120:1805522011644544:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.251928:0:16100:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009dae6400/0x8a60d30f571ebda8 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a2d7 expref: 377 pid: 16099 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.251930:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914050 00010000:00010000:1.0:1721880422.251933:0:16100:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009dae6400/0x8a60d30f571ebda8 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a2d7 expref: 377 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.251934:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1393:2006:x1805522257681920:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.251939:0:16100:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801312d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_087:lustre-OST0000_UUID:16100:1805522011644672:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.251941:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.251945:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ce1fa80/0x8a60d30f5717d14a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1016fe expref: 1393 pid: 16059 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.251953:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ce1fa80/0x8a60d30f5717d14a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1016fe expref: 1393 pid: 16059 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.251954:0:16120:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec180 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.251955:0:16100:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb780 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.251964:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ce1fa80/0x8a60d30f5717d14a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfaec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1016fe expref: 1393 pid: 16059 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.251972:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.251973:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.251976:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727b895 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.251978:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.251984:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727b895 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfaec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.251986:0:15514:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880084df5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+2678:3686:x1805522011641216:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2336us (2418us total) trans 4296061619 rc 0/0 00000100:00100000:1.0:1721880422.251989:0:16040:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011644288 00000100:00100000:1.0:1721880422.251991:0:16040:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011644288 00000100:00100000:2.0:1721880422.251991:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631857 00010000:00010000:0.0:1721880422.251997:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:3.0:1721880422.252000:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880098d24380/2, rc 0, transno 1094323 00000100:00100000:1.0:1721880422.252004:0:16040:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631871 00000100:00100000:1.0:1721880422.252008:0:16040:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f52ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:lustre-MDT0000-mdtlov_UUID+1866:3686:x1805522011644288:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.252009:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880098d24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011641216:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.252010:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1392:2006:x1805522257681920:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 75us (122us total) trans 0 rc 0/0 00002000:00080000:1.0:1721880422.252028:0:16040:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64243 count 1 00000100:00100000:0.0:1721880422.252030:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914050 00010000:00010000:1.0:1721880422.252035:0:16040:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727b8f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfaf3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.252042:0:16040:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880084f20b40/0x8a60d30f571834b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfaf3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10435f expref: 1391 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.252046:0:16040:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.252047:0:16040:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.252049:0:16040:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727b8f0 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfaf3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.252055:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.252059:0:16040:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880084f20b40/0x8a60d30f571834b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaf3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10435f expref: 1391 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.252059:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1721880422.252064:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257681664 00010000:00010000:1.0:1721880422.252064:0:16040:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880084f20b40/0x8a60d30f571834b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaf3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10435f expref: 1391 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.252065:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009f52ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011644800:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.252067:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257681664 00000100:00100000:1.0:1721880422.252070:0:16040:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801312d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_040:lustre-OST0001_UUID:16040:1805522011644928:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.252075:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009431a880/0x8a60d30f571ebb78 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a0a7 expref: 378 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.252081:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.252085:0:16040:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.252090:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914051 00000100:00100000:0.0:1721880422.252094:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+378:2006:x1805522257681664:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.252095:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727b895 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.252099:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727b895 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.252099:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011644800 00010000:00010000:0.0:1721880422.252100:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.252103:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009431a880/0x8a60d30f571ebb78 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a0a7 expref: 378 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.252103:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011644800 00010000:00010000:1.0:1721880422.252108:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727b895 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.252112:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009431a880/0x8a60d30f571ebb78 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a0a7 expref: 378 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.252112:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727b895 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfaec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.252116:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727b895 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.252119:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8d80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.252121:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727b895 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.252121:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631872 00010000:00010000:0.0:1721880422.252123:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009431a880/0x8a60d30f571ebb78 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a0a7 expref: 378 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.252125:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727b895 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.252127:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b59aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2678:3689:x1805522011644800:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.252130:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727b895 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfaec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.252134:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727b895 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfaec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.252139:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.252141:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.252143:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801363506c0/0x8a60d30f5727b887 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.252145:0:16088:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58064 count 1 00010000:00010000:0.0:1721880422.252151:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801363506c0/0x8a60d30f5727b887 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.252156:0:16088:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6400/0x8a60d30f5727b8f7 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2d0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.252161:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.252165:0:16088:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095fb1f80/0x8a60d30f571ebdee lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a31d expref: 377 pid: 16019 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.252166:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801363506c0/0x8a60d30f5727b887 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.252171:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.252172:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801363506c0/0x8a60d30f5727b887 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.252173:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1721880422.252174:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+377:2006:x1805522257681664:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 80us (119us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.252175:0:16088:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6400/0x8a60d30f5727b8f7 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.252176:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801363506c0/0x8a60d30f5727b887 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.252179:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914051 00010000:00010000:2.0:1721880422.252180:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801363506c0/0x8a60d30f5727b887 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.252184:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801363506c0/0x8a60d30f5727b887 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.252188:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801363506c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.252189:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801363506c0/0x8a60d30f5727b887 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.252191:0:16088:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095fb1f80/0x8a60d30f571ebdee lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a31d expref: 376 pid: 16019 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.252193:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801363506c0/0x8a60d30f5727b887 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.252199:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801363506c0/0x8a60d30f5727b887 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.252199:0:16088:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095fb1f80/0x8a60d30f571ebdee lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a31d expref: 376 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.252202:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801363506c0/0x8a60d30f5727b887 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.252207:0:16088:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fde0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0000_UUID:16088:1805522011645056:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.252213:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.252221:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257682048 00000100:00100000:0.0:1721880422.252224:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257682048 00000100:00100000:3.0:1721880422.252229:0:16088:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec3c0 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.252233:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800932cc240/0x8a60d30f571ebc35 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a164 expref: 377 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.252245:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1867:3688:x1805522011641088:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2583us (2638us total) trans 4296019927 rc 0/0 00000100:00100000:0.0:1721880422.252247:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914052 00000100:00100000:1.0:1721880422.252252:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631858 00000100:00100000:0.0:1721880422.252253:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+377:2006:x1805522257682048:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.252260:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.252263:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800932cc240/0x8a60d30f571ebc35 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a164 expref: 377 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.252272:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800932cc240/0x8a60d30f571ebc35 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a164 expref: 377 pid: 16019 timeout: 887 lvb_type: 0 00000004:00080000:1.0:1721880422.252278:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009713ad80/2, rc 0, transno 1052631 00000100:00100000:1.0:1721880422.252285:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009713ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011641088:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.252289:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800932cc240/0x8a60d30f571ebc35 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a164 expref: 377 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.252299:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.252300:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.252300:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2679:3686:x1805522011640320:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3547us (3626us total) trans 4296061620 rc 0/0 00010000:00010000:0.0:1721880422.252303:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b89c lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.252307:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631854 00000100:00100000:1.0:1721880422.252308:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000004:00080000:3.0:1721880422.252308:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008c408700/2, rc 0, transno 1094324 00010000:00010000:0.0:1721880422.252310:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b89c lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.252315:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801312d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011645184:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.252316:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008c408700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011640320:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.252329:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.252335:0:16113:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b89c lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.252342:0:16113:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b89c lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.252343:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+376:2006:x1805522257682048:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 90us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.252344:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880097138e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011645312:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.252348:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914052 00010000:00010000:1.0:1721880422.252350:0:16113:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b89c lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.252355:0:16113:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b89c lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.252361:0:16113:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b89c lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.252365:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.252366:0:16113:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325cd80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.252368:0:16113:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b89c lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.252373:0:16113:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b89c lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.252377:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011645312 00000100:00100000:2.0:1721880422.252380:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011645312 00010000:00010000:1.0:1721880422.252381:0:16113:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b89c lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.252391:0:16113:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325cd80/0x8a60d30f5727b89c lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.252393:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631873 00000100:00100000:2.0:1721880422.252396:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008777d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2679:3686:x1805522011645312:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.252406:0:16098:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800919c3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0000_UUID:16098:1805522011642496:192.168.201.24@tcp:104: 00002000:00080000:2.0:1721880422.252406:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58065 count 1 00010000:00010000:2.0:1721880422.252414:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136351b00/0x8a60d30f5727b8fe lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2d1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.252416:0:16098:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325f600/0x8a60d30f5727b8b1 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.252422:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097303180/0x8a60d30f571ebe2d lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a35c expref: 375 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.252427:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.252428:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.252429:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136351b00/0x8a60d30f5727b8fe lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.252440:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097303180/0x8a60d30f571ebe2d lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a35c expref: 375 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.252445:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097303180/0x8a60d30f571ebe2d lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a35c expref: 375 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.252451:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b599880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:15453:1805522011645440:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.252468:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.252476:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880096003480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0000_UUID:16017:1805522011643392:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.252484:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b59a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011642240:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.252486:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4000/0x8a60d30f5727b8c6 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.252490:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.252492:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727b8a3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfaee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.252499:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257682560 00000100:00100000:0.0:1721880422.252501:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257682560 00000004:00080000:3.0:1721880422.252507:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880097138700/2, rc 0, transno 1094325 00000100:00100000:1.0:1721880422.252510:0:16113:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880084df6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0000-mdtlov_UUID+2680:3686:x1805522011641344:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2623us (2663us total) trans 4296061621 rc 0/0 00010000:00010000:0.0:1721880422.252511:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007bb12400/0x8a60d30f57181b8e lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfaef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b103d77 expref: 1392 pid: 16029 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.252513:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880097138700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011641344:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.252516:0:16113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631859 00000100:00100000:0.0:1721880422.252526:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914053 00000100:00100000:0.0:1721880422.252531:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1392:2006:x1805522257682560:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.252538:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.252539:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b59a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011645568:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.252541:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007bb12400/0x8a60d30f57181b8e lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfaef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b103d77 expref: 1392 pid: 16029 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.252547:0:9458:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800959a7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011643264:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.252550:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007bb12400/0x8a60d30f57181b8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b103d77 expref: 1392 pid: 16029 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.252554:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.252561:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007bb12400/0x8a60d30f57181b8e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfaef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b103d77 expref: 1392 pid: 16029 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.252561:0:9458:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727b8bf lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfaef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.252563:0:16113:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011645568 00000100:00100000:3.0:1721880422.252565:0:16113:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011645568 00010000:00010000:0.0:1721880422.252572:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.252573:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.252575:0:16113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631874 00010000:00010000:0.0:1721880422.252576:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727b8bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.252578:0:16113:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b599180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0000-mdtlov_UUID+2680:3687:x1805522011645568:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.252582:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800959a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011642368:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.252583:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727b8bf lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfaef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.252586:0:16113:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58066 count 1 00010000:00010000:1.0:1721880422.252593:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727b8aa lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfaed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.252593:0:16113:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6d00/0x8a60d30f5727b905 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2d2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.252595:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.252599:0:16113:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097303a80/0x8a60d30f571ebe7a lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a3a9 expref: 375 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.252603:0:16113:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.252604:0:16113:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.252605:0:16113:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6d00/0x8a60d30f5727b905 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.252606:0:9458:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727b8bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.252607:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1391:2006:x1805522257682560:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 75us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.252612:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914053 00010000:00010000:1.0:1721880422.252612:0:9458:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727b8bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.252615:0:16113:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097303a80/0x8a60d30f571ebe7a lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a3a9 expref: 375 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.252619:0:9458:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727b8bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.252620:0:16113:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097303a80/0x8a60d30f571ebe7a lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a3a9 expref: 375 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.252624:0:9458:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727b8bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfaef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.252629:0:16113:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008777ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0000_UUID:16113:1805522011645696:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.252632:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800919c1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011643520:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.252636:0:9458:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727b8bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.252641:0:9458:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aaaf40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.252642:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727b8b8 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfaf0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.252644:0:9458:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727b8bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.252644:0:16113:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec540 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.252650:0:9458:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727b8bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.252659:0:9458:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727b8bf lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfaef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.252664:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727b8bf lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfaef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.252680:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.252681:0:16130:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880098d25880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0001_UUID:16130:1805522011643648:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.252688:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257682304 00000100:00100000:0.0:1721880422.252690:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257682304 00010000:00010000:3.0:1721880422.252691:0:16130:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727b8cd lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfaf1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.252698:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800932cfcc0/0x8a60d30f571ebc7b lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a1aa expref: 376 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.252712:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914054 00000100:00100000:0.0:1721880422.252717:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+376:2004:x1805522257682304:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.252723:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.252742:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800932cfcc0/0x8a60d30f571ebc7b lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a1aa expref: 376 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.252751:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800932cfcc0/0x8a60d30f571ebc7b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a1aa expref: 376 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.252762:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800932cfcc0/0x8a60d30f571ebc7b lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a1aa expref: 376 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.252772:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.252773:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.252776:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009325f600/0x8a60d30f5727b8b1 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.252783:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325f600/0x8a60d30f5727b8b1 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.252796:0:9458:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880084df6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1867:3686:x1805522011642624:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2506us (2545us total) trans 4296019928 rc 0/0 00010000:00010000:0.0:1721880422.252800:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.252802:0:9458:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631864 00000100:00100000:0.0:1721880422.252813:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+375:2004:x1805522257682304:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 95us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.252819:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914054 00000100:00100000:1.0:1721880422.252826:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.252833:0:16098:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325f600/0x8a60d30f5727b8b1 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.252840:0:16098:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325f600/0x8a60d30f5727b8b1 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.252841:0:9458:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011645184 00000004:00080000:3.0:1721880422.252841:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800959a4e00/2, rc 0, transno 1052632 00000100:00100000:1.0:1721880422.252844:0:9458:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011645184 00010000:00010000:0.0:1721880422.252847:0:16098:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325f600/0x8a60d30f5727b8b1 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.252850:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800959a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011642624:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.252853:0:16098:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325f600/0x8a60d30f5727b8b1 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.252860:0:16098:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325f600/0x8a60d30f5727b8b1 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.252865:0:16098:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325f600 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.252868:0:16098:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325f600/0x8a60d30f5727b8b1 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.252874:0:16098:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325f600/0x8a60d30f5727b8b1 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.252883:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801312d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011645824:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.252887:0:16098:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325f600/0x8a60d30f5727b8b1 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.252888:0:9458:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631875 00000100:00100000:1.0:1721880422.252892:0:9458:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1867:3688:x1805522011645184:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.252894:0:16098:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325f600/0x8a60d30f5727b8b1 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.252900:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:1.0:1721880422.252903:0:9458:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64244 count 1 00010000:00010000:1.0:1721880422.252912:0:9458:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727b90c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfaf4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.252913:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011645824 00000100:00100000:3.0:1721880422.252915:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011645824 00010000:00010000:1.0:1721880422.252923:0:9458:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0884d80/0x8a60d30f57183ef0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfaf4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1046a7 expref: 1390 pid: 11675 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.252926:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631876 00000100:00100000:3.0:1721880422.252929:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+1868:3688:x1805522011645824:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.252930:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.252931:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.252933:0:9458:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727b90c lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfaf4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.252936:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64245 count 1 00010000:00010000:3.0:1721880422.252943:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727b913 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfaf5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.252948:0:9458:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0884d80/0x8a60d30f57183ef0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaf4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1046a7 expref: 1390 pid: 11675 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.252950:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e5f8480/0x8a60d30f57184946 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfaf5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b104eb1 expref: 1390 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.252954:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.252955:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.252956:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727b913 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfaf5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.252957:0:9458:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0884d80/0x8a60d30f57183ef0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaf4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1046a7 expref: 1390 pid: 11675 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.252965:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e5f8480/0x8a60d30f57184946 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaf5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b104eb1 expref: 1390 pid: 16090 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.252966:0:9458:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801312d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011645952:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.252971:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e5f8480/0x8a60d30f57184946 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaf5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b104eb1 expref: 1390 pid: 16090 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.252976:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008777d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011646080:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.252986:0:9458:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eba80 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.252991:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec300 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.253004:0:16098:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880084df7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0000-mdtlov_UUID+2681:3686:x1805522011641984:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2952us (3017us total) trans 4296061622 rc 0/0 00000100:00100000:0.0:1721880422.253010:0:16098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631862 00000004:00080000:2.0:1721880422.253011:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800959a7480/2, rc 0, transno 1094326 00000100:00100000:2.0:1721880422.253030:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800959a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011641984:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.253056:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.253063:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1721880422.253067:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008777df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011646208:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.253078:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.253080:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.253084:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257682688 00000100:00100000:1.0:1721880422.253088:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257682688 00000100:00100000:0.0:1721880422.253094:0:16098:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011646208 00000100:00100000:3.0:1721880422.253095:0:15455:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257682176 00000100:00100000:0.0:1721880422.253097:0:16098:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011646208 00000100:00100000:3.0:1721880422.253099:0:15455:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257682176 00010000:00010000:1.0:1721880422.253101:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d5afcc0/0x8a60d30f571ebcc1 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a1f0 expref: 375 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.253109:0:16098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631877 00010000:00010000:3.0:1721880422.253111:0:15455:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099ae1d40/0x8a60d30f5717dfc1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1018b0 expref: 1391 pid: 16025 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.253113:0:16098:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084df4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0000-mdtlov_UUID+2681:3688:x1805522011646208:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.253120:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914055 00002000:00080000:0.0:1721880422.253124:0:16098:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58067 count 1 00000100:00100000:1.0:1721880422.253126:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a70eec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+375:2004:x1805522257682688:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.253133:0:16098:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325eac0/0x8a60d30f5727b91a lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2d3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.253133:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.253133:0:15455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914056 00000100:00100000:3.0:1721880422.253136:0:15455:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+1391:2004:x1805522257682176:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.253138:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d5afcc0/0x8a60d30f571ebcc1 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a1f0 expref: 375 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.253141:0:15455:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.253144:0:16098:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0cbcc0/0x8a60d30f571ebece lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a3fd expref: 375 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.253144:0:15455:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099ae1d40/0x8a60d30f5717dfc1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1018b0 expref: 1391 pid: 16025 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.253148:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d5afcc0/0x8a60d30f571ebcc1 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a1f0 expref: 375 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.253150:0:16098:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.253150:0:15455:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099ae1d40/0x8a60d30f5717dfc1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1018b0 expref: 1391 pid: 16025 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.253152:0:16098:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.253154:0:16098:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325eac0/0x8a60d30f5727b91a lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.253158:0:15455:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099ae1d40/0x8a60d30f5717dfc1 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfaee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1018b0 expref: 1391 pid: 16025 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.253161:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d5afcc0/0x8a60d30f571ebcc1 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a1f0 expref: 375 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.253166:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.253167:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.253169:0:15455:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727b8a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.253171:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.253173:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.253174:0:16098:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0cbcc0/0x8a60d30f571ebece lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a3fd expref: 374 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.253174:0:15455:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727b8a3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfaee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.253175:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4000/0x8a60d30f5727b8c6 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.253182:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4000/0x8a60d30f5727b8c6 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.253182:0:15455:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.253183:0:16098:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b0cbcc0/0x8a60d30f571ebece lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a3fd expref: 374 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.253188:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727b8a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.253192:0:16098:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800919c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0000_UUID:16098:1805522011646336:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.253194:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727b8a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.253194:0:15455:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+1390:2004:x1805522257682176:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 57us (116us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.253198:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.253198:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727b8a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.253199:0:15455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914056 00010000:00010000:2.0:1721880422.253202:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727b8a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfaee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.253207:0:16098:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36f00 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.253209:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727b8a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.253213:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136351f80 already unused, calling callback (ffffffffa084e330) 00000100:00100000:1.0:1721880422.253214:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a70eec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+374:2004:x1805522257682688:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 87us (157us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.253215:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727b8a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.253218:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727b8a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.253220:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914055 00010000:00010000:2.0:1721880422.253224:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727b8a3 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfaee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.253228:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727b8a3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfaee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.253241:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.253254:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257682432 00000100:00100000:1.0:1721880422.253257:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257682432 00010000:00010000:1.0:1721880422.253266:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f1d8480/0x8a60d30f5717d659 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1017f3 expref: 1390 pid: 16118 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.253270:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.253280:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257682816 00000100:00100000:1.0:1721880422.253283:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257682816 00000100:00100000:3.0:1721880422.253287:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914057 00010000:00010000:1.0:1721880422.253291:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095ec9200/0x8a60d30f5718217d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaf0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10419f expref: 1391 pid: 16021 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.253292:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1391:2004:x1805522257682432:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.253293:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.253299:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.253303:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f1d8480/0x8a60d30f5717d659 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1017f3 expref: 1391 pid: 16118 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.253311:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257682944 00010000:00010000:3.0:1721880422.253312:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f1d8480/0x8a60d30f5717d659 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1017f3 expref: 1391 pid: 16118 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.253313:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257682944 00000100:00100000:2.0:1721880422.253316:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914058 00000100:00100000:2.0:1721880422.253321:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+1392:2004:x1805522257682816:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.253322:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0d7c6c0/0x8a60d30f57182305 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaf1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b104239 expref: 1392 pid: 15506 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.253323:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f1d8480/0x8a60d30f5717d659 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfaed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1017f3 expref: 1392 pid: 16118 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.253327:0:7118:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.253331:0:7118:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095ec9200/0x8a60d30f5718217d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaf0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10419f expref: 1391 pid: 16021 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.253334:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.253335:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.253337:0:7118:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095ec9200/0x8a60d30f5718217d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaf0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10419f expref: 1391 pid: 16021 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.253337:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727b8aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.253338:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914059 00000100:00100000:1.0:1721880422.253342:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1391:2006:x1805522257682944:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.253344:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727b8aa lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfaed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.253350:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.253350:0:7118:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095ec9200/0x8a60d30f5718217d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfaf0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10419f expref: 1391 pid: 16021 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.253355:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0d7c6c0/0x8a60d30f57182305 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaf1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b104239 expref: 1391 pid: 15506 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.253358:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.253358:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.253359:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.253361:0:7118:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727b8b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaf0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.253363:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0d7c6c0/0x8a60d30f57182305 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaf1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b104239 expref: 1390 pid: 15506 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.253366:0:7118:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727b8b8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfaf0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.253367:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.253373:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1390:2004:x1805522257682432:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 81us (132us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.253375:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0d7c6c0/0x8a60d30f57182305 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfaf1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b104239 expref: 1390 pid: 15506 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.253376:0:7118:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.253378:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914057 00000100:00100000:0.0:1721880422.253383:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257683072 00000100:00100000:0.0:1721880422.253385:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257683072 00010000:00010000:1.0:1721880422.253385:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.253386:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.253386:0:7118:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+1389:2004:x1805522257682816:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 64us (116us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.253389:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727b8cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaf1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.253389:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914058 00010000:00010000:1.0:1721880422.253396:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727b8cd lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfaf1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.253397:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084269200/0x8a60d30f571ebd15 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe2cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a244 expref: 374 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.253398:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727b8aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.253405:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727b8aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.253412:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727b8aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.253419:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914060 00010000:00010000:1.0:1721880422.253420:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.253420:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727b8aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfaed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.253422:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+1869:3688:x1805522011641856:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3384us (3457us total) trans 4296019929 rc 0/0 00000100:00100000:0.0:1721880422.253423:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+374:2005:x1805522257683072:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.253426:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631860 00010000:00010000:3.0:1721880422.253426:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727b8aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.253430:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.253432:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aaad00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.253434:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084269200/0x8a60d30f571ebd15 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe2cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a244 expref: 374 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.253435:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727b8aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.253437:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1387:2006:x1805522257682944:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 93us (142us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.253438:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727b8b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.253441:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727b8aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.253443:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084269200/0x8a60d30f571ebd15 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a244 expref: 374 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.253443:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727b8b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.253445:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914059 00010000:00010000:2.0:1721880422.253448:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727b8b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.253455:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.253455:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727b8b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfaf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.253455:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727b8aa lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfaed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.253457:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.253459:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727b8b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.253460:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098aa8900/0x8a60d30f5727b8d4 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.253460:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727b8aa lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfaed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.253462:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325c480 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.253464:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727b8b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.253467:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098aa8900/0x8a60d30f5727b8d4 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.253468:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727b8b8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.253473:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727b8b8 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfaf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.253477:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.253477:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727b8b8 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfaf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.253478:0:16110:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084269200/0x8a60d30f571ebd15 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a244 expref: 374 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.253480:0:16130:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727b8cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.253487:0:16130:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727b8cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.253488:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+373:2005:x1805522257683072:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 64us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.253489:0:16110:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800959a5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_094:lustre-OST0000_UUID:16110:1805522011643776:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.253493:0:16130:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727b8cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.253494:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914060 00010000:00010000:3.0:1721880422.253499:0:16130:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727b8cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfaf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.253505:0:16110:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880098aa8900/0x8a60d30f5727b8d4 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.253506:0:16130:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727b8cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.253511:0:16130:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b5d40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.253513:0:16110:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098aa8900/0x8a60d30f5727b8d4 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.253514:0:16130:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727b8cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.253519:0:16110:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098aa8900/0x8a60d30f5727b8d4 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.253520:0:16130:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727b8cd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.253529:0:16130:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727b8cd lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfaf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.253536:0:16130:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727b8cd lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfaf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.253538:0:16110:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098aa8900/0x8a60d30f5727b8d4 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.253544:0:16110:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098aa8900/0x8a60d30f5727b8d4 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.253549:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+1869:3688:x1805522011642752:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3266us (3315us total) trans 4296019930 rc 0/0 00000100:00100000:2.0:1721880422.253552:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631863 00010000:00010000:1.0:1721880422.253555:0:16110:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098aa8900/0x8a60d30f5727b8d4 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.253561:0:16110:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8900 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.253563:0:16110:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098aa8900/0x8a60d30f5727b8d4 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.253571:0:16110:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098aa8900/0x8a60d30f5727b8d4 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.253571:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800959a6a00/2, rc 0, transno 1052634 00000100:00100000:2.0:1721880422.253576:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800959a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011642752:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.253580:0:16110:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098aa8900/0x8a60d30f5727b8d4 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.253586:0:16110:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098aa8900/0x8a60d30f5727b8d4 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.253595:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1721880422.253599:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099eb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011646464:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.253611:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.253622:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011646464 00000100:00100000:2.0:1721880422.253623:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011646464 00000100:00100000:2.0:1721880422.253633:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631878 00000100:00100000:2.0:1721880422.253636:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099eb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+1870:3687:x1805522011646464:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.253643:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64246 count 1 00010000:00010000:2.0:1721880422.253651:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727b921 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfaf6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.253651:0:16130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0000-mdtlov_UUID+1870:3686:x1805522011643008:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3159us (3213us total) trans 4296019931 rc 0/0 00000100:00100000:3.0:1721880422.253657:0:16130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631866 00010000:00010000:2.0:1721880422.253659:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800998be400/0x8a60d30f57184c33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfaf6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10501d expref: 1386 pid: 16052 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.253663:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.253664:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.253665:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727b921 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfaf6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.253676:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800998be400/0x8a60d30f57184c33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaf6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10501d expref: 1386 pid: 16052 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.253681:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800998be400/0x8a60d30f57184c33 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaf6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10501d expref: 1386 pid: 16052 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.253688:0:16110:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_094:lustre-MDT0000-mdtlov_UUID+2682:3686:x1805522011643136:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3193us (3216us total) trans 4296061623 rc 0/0 00000100:00100000:2.0:1721880422.253688:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088dc3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011646592:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.253694:0:16110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631867 00000100:00100000:2.0:1721880422.253704:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde780 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.253715:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4000/0x8a60d30f5727b8c6 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.253718:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800959a5180/2, rc 0, transno 1052633 00010000:00010000:1.0:1721880422.253722:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4000/0x8a60d30f5727b8c6 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.253722:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800959a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011641856:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.253749:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4000/0x8a60d30f5727b8c6 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.253755:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4000/0x8a60d30f5727b8c6 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.253762:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4000/0x8a60d30f5727b8c6 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.253765:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088dc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011646720:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.253769:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+1870:3688:x1805522011641728:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3722us (3858us total) trans 4296019932 rc 0/0 00010000:00010000:1.0:1721880422.253772:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4000 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.253775:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4000/0x8a60d30f5727b8c6 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.253775:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631861 00010000:00010000:1.0:1721880422.253781:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4000/0x8a60d30f5727b8c6 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.253781:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.253787:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011646720 00010000:00010000:1.0:1721880422.253790:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4000/0x8a60d30f5727b8c6 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.253790:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011646720 00010000:00010000:1.0:1721880422.253796:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4000/0x8a60d30f5727b8c6 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.253802:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800959a7100/2, rc 0, transno 1094327 00000100:00100000:3.0:1721880422.253807:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631879 00000100:00100000:3.0:1721880422.253813:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+1870:3687:x1805522011646720:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.253815:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800959a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011643136:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1721880422.253821:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800919c0700/2, rc 0, transno 1052635 00000100:00100000:2.0:1721880422.253825:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800919c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011643008:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1721880422.253849:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009b08ce00/2, rc 0, transno 1052636 00002000:00080000:3.0:1721880422.253851:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64247 count 1 00000100:00100000:2.0:1721880422.253852:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b08ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011641728:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.253861:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727b928 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfaf7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.253867:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088dc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011646976:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.253870:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fbc8480/0x8a60d30f571854bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfaf7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10562f expref: 1386 pid: 15447 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.253876:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.253877:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.253879:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727b928 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfaf7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.253886:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.253890:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b598e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2682:3689:x1805522011642880:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3560us (3607us total) trans 4296061624 rc 0/0 00010000:00010000:3.0:1721880422.253895:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fbc8480/0x8a60d30f571854bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaf7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10562f expref: 1386 pid: 15447 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.253896:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631865 00010000:00010000:3.0:1721880422.253904:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fbc8480/0x8a60d30f571854bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaf7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10562f expref: 1386 pid: 15447 timeout: 887 lvb_type: 0 00000004:00080000:2.0:1721880422.253906:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800959a5880/2, rc 0, transno 1094328 00000100:00100000:1.0:1721880422.253907:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011646976 00000100:00100000:1.0:1721880422.253910:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011646976 00000100:00100000:3.0:1721880422.253914:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880098d25880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011647232:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.253920:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800959a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011642880:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.253924:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631880 00000100:00100000:1.0:1721880422.253928:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+1871:3689:x1805522011646976:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.253934:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00002000:00080000:1.0:1721880422.253938:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64248 count 1 00000100:00100000:2.0:1721880422.253941:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880096003480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011647360:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.253947:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727b92f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfaf8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.253956:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801206e9f80/0x8a60d30f57185c55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfaf8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b105b92 expref: 1386 pid: 16082 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.253965:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdeccc0 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.253966:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.253966:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.253967:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.253969:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727b92f lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfaf8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.253981:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011647104:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.253982:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011647360 00010000:00010000:1.0:1721880422.253983:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801206e9f80/0x8a60d30f57185c55 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaf8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b105b92 expref: 1386 pid: 16082 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.253985:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011647360 00010000:00010000:1.0:1721880422.253990:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801206e9f80/0x8a60d30f57185c55 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaf8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b105b92 expref: 1386 pid: 16082 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.253996:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.253999:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801312d0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011647488:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.254035:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302ebc00 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.254035:0:16130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011647104 00000100:00100000:3.0:1721880422.254038:0:16130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011647104 00000100:00100000:0.0:1721880422.254046:0:16110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631881 00000100:00100000:2.0:1721880422.254048:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008777c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011646848:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.254051:0:16110:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_094:lustre-MDT0000-mdtlov_UUID+2682:3687:x1805522011647360:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1721880422.254059:0:16130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631882 00002000:00080000:0.0:1721880422.254063:0:16110:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58069 count 1 00000100:00100000:3.0:1721880422.254063:0:16130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0000-mdtlov_UUID+1872:3687:x1805522011647104:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.254066:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.254072:0:16110:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325d680/0x8a60d30f5727b936 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2d5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.254074:0:16130:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64249 count 1 00010000:00010000:3.0:1721880422.254082:0:16130:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727b93d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfaf9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.254083:0:16110:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880123982ac0/0x8a60d30f571ebf53 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a482 expref: 372 pid: 16039 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.254085:0:15514:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011646848 00000100:00100000:2.0:1721880422.254088:0:15514:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011646848 00010000:00010000:0.0:1721880422.254090:0:16110:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.254091:0:16110:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.254091:0:16130:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f606ac0/0x8a60d30f571866ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfaf9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1063f0 expref: 1386 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.254093:0:16110:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325d680/0x8a60d30f5727b936 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.254097:0:16130:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.254099:0:16130:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.254102:0:16130:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727b93d lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfaf9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.254107:0:16110:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880123982ac0/0x8a60d30f571ebf53 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a482 expref: 372 pid: 16039 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.254107:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631883 00000100:00100000:2.0:1721880422.254111:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+2683:3688:x1805522011646848:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.254115:0:16110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880123982ac0/0x8a60d30f571ebf53 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a482 expref: 372 pid: 16039 timeout: 887 lvb_type: 0 00002000:00080000:2.0:1721880422.254122:0:15514:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58068 count 1 00010000:00010000:3.0:1721880422.254122:0:16130:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f606ac0/0x8a60d30f571866ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaf9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1063f0 expref: 1386 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.254124:0:16110:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800919c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_094:lustre-OST0000_UUID:16110:1805522011647616:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.254131:0:16130:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f606ac0/0x8a60d30f571866ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaf9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1063f0 expref: 1386 pid: 16075 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.254133:0:15514:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727b944 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2d4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.254140:0:16110:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36240 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.254140:0:16130:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009ebd8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0001_UUID:16130:1805522011647744:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.254144:0:15514:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801239833c0/0x8a60d30f571ebf0d lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a43c expref: 372 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.254151:0:15514:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.254152:0:15514:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.254155:0:15514:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727b944 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.254160:0:16130:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec840 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.254171:0:15514:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801239833c0/0x8a60d30f571ebf0d lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a43c expref: 372 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.254180:0:15514:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801239833c0/0x8a60d30f571ebf0d lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a43c expref: 372 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.254188:0:15514:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e9c8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:15514:1805522011647872:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.254210:0:15514:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde240 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.255434:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.255445:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257683200 00000100:00100000:0.0:1721880422.255447:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257683200 00000100:00100000:1.0:1721880422.255458:0:16100:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801312d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_087:lustre-OST0000_UUID:16100:1805522011644672:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.255470:0:16120:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009f52f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16120:1805522011644544:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.255475:0:16100:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880098aaaac0/0x8a60d30f5727b8e9 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.255489:0:16120:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5680/0x8a60d30f5727b8e2 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.255496:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b1fef40/0x8a60d30f571ebd62 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a28a expref: 373 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.255500:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801312d1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011644032:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.255513:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727b8db lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfaf2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.255516:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914061 00000100:00100000:0.0:1721880422.255519:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+373:2005:x1805522257683200:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.255525:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.255528:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b1fef40/0x8a60d30f571ebd62 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a28a expref: 373 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.255533:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b1fef40/0x8a60d30f571ebd62 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a28a expref: 373 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.255542:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b1fef40/0x8a60d30f571ebd62 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a28a expref: 373 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.255551:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.255553:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.255555:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5680/0x8a60d30f5727b8e2 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.255559:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5680/0x8a60d30f5727b8e2 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.255573:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.255591:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+372:2005:x1805522257683200:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 71us (159us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.255593:0:16120:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5680/0x8a60d30f5727b8e2 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.255595:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914061 00010000:00010000:3.0:1721880422.255602:0:16120:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5680/0x8a60d30f5727b8e2 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.255610:0:16120:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5680/0x8a60d30f5727b8e2 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.255616:0:16120:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5680/0x8a60d30f5727b8e2 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.255619:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.255621:0:16120:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5680/0x8a60d30f5727b8e2 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.255627:0:16120:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b5680 already unused, calling callback (ffffffffa084e330) 00000100:00100000:0.0:1721880422.255628:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257683328 00010000:00010000:3.0:1721880422.255629:0:16120:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5680/0x8a60d30f5727b8e2 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.255630:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257683328 00010000:00010000:3.0:1721880422.255635:0:16120:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5680/0x8a60d30f5727b8e2 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.255638:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f814000/0x8a60d30f5718292c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaf2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1042b7 expref: 1387 pid: 15452 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.255644:0:16120:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5680/0x8a60d30f5727b8e2 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.255651:0:16120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5680/0x8a60d30f5727b8e2 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.255653:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914062 00000100:00100000:0.0:1721880422.255656:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8064450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1387:2005:x1805522257683328:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.255661:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.255663:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f814000/0x8a60d30f5718292c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaf2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1042b7 expref: 1387 pid: 15452 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.255669:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f814000/0x8a60d30f5718292c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaf2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1042b7 expref: 1387 pid: 15452 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.255676:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f814000/0x8a60d30f5718292c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfaf2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1042b7 expref: 1387 pid: 15452 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.255688:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.255689:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.255690:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727b8db lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaf2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.255695:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727b8db lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfaf2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.255703:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.255715:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727b8db lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.255716:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8064450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1386:2005:x1805522257683328:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 59us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.255719:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914062 00010000:00010000:1.0:1721880422.255724:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727b8db lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.255752:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727b8db lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.255759:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727b8db lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfaf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.255770:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727b8db lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.255777:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aab3c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.255780:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727b8db lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.255787:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727b8db lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.255796:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727b8db lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfaf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.255803:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727b8db lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfaf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.255809:0:16120:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b59ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+2684:3689:x1805522011644160:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3956us (3995us total) trans 4296061625 rc 0/0 00000004:00080000:2.0:1721880422.255816:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880098d24e00/2, rc 0, transno 1094329 00000100:00100000:3.0:1721880422.255817:0:16120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631869 00000100:00100000:0.0:1721880422.255822:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.255823:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880098d24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011644160:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.255830:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.255846:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.255849:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257683456 00000100:00100000:3.0:1721880422.255849:0:16088:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fde0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0000_UUID:16088:1805522011645056:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.255851:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257683456 00000100:00100000:0.0:1721880422.255853:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257683584 00000100:00100000:0.0:1721880422.255855:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257683584 00010000:00010000:2.0:1721880422.255861:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009dae6400/0x8a60d30f571ebda8 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a2d7 expref: 372 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.255863:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880084f20b40/0x8a60d30f571834b6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfaf3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10435f expref: 1386 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.255863:0:16088:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6400/0x8a60d30f5727b8f7 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.255879:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257683712 00000100:00100000:2.0:1721880422.255880:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257683712 00000100:00100000:0.0:1721880422.255886:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914063 00010000:00010000:2.0:1721880422.255886:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095fb1f80/0x8a60d30f571ebdee lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a31d expref: 373 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.255890:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+373:2005:x1805522257683456:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.255893:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914064 00010000:00010000:0.0:1721880422.255894:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.255897:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009dae6400/0x8a60d30f571ebda8 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a2d7 expref: 373 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.255901:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1386:2005:x1805522257683584:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.255906:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009dae6400/0x8a60d30f571ebda8 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a2d7 expref: 373 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.255907:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914065 00010000:00010000:1.0:1721880422.255910:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.255913:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+373:2005:x1805522257683712:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.255915:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dae6400/0x8a60d30f571ebda8 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a2d7 expref: 373 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.255916:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880084f20b40/0x8a60d30f571834b6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfaf3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10435f expref: 1386 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.255921:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b599880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:15453:1805522011645440:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.255923:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.255923:0:7118:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.255925:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.255926:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098aaaac0/0x8a60d30f5727b8e9 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.255926:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880084f20b40/0x8a60d30f571834b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaf3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10435f expref: 1386 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.255928:0:7118:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095fb1f80/0x8a60d30f571ebdee lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a31d expref: 372 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.255930:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098aaaac0/0x8a60d30f5727b8e9 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.255932:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136351b00/0x8a60d30f5727b8fe lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.255937:0:7118:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095fb1f80/0x8a60d30f571ebdee lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a31d expref: 372 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.255938:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.255940:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.255940:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.255943:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727b8f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaf3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.255943:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e9c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011648000:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1721880422.255949:0:7118:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095fb1f80/0x8a60d30f571ebdee lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a31d expref: 372 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.255951:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727b8f0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfaf3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.255952:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+372:2005:x1805522257683456:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 61us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.255955:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914063 00000100:00100000:2.0:1721880422.255958:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.255959:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.255961:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.255962:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.255964:0:7118:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6400/0x8a60d30f5727b8f7 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.255970:0:7118:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6400/0x8a60d30f5727b8f7 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.255977:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.255981:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1386:2005:x1805522257683584:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 81us (149us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.255985:0:7118:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.255986:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914064 00010000:00010000:2.0:1721880422.255991:0:16088:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6400/0x8a60d30f5727b8f7 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.255996:0:16088:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6400/0x8a60d30f5727b8f7 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.256001:0:16088:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6400/0x8a60d30f5727b8f7 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.256002:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257683840 00010000:00010000:2.0:1721880422.256005:0:16088:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6400/0x8a60d30f5727b8f7 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.256005:0:7118:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+370:2005:x1805522257683712:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 90us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.256006:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257683840 00010000:00010000:2.0:1721880422.256008:0:16088:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6400/0x8a60d30f5727b8f7 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.256011:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914065 00010000:00010000:2.0:1721880422.256023:0:16088:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b6400 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.256026:0:16088:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6400/0x8a60d30f5727b8f7 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.256032:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097303180/0x8a60d30f571ebe2d lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a35c expref: 371 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.256037:0:16088:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6400/0x8a60d30f5727b8f7 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.256045:0:16088:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6400/0x8a60d30f5727b8f7 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.256049:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6400/0x8a60d30f5727b8f7 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.256055:0:15455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914066 00000100:00100000:3.0:1721880422.256060:0:15455:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+370:2007:x1805522257683840:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.256067:0:15455:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.256072:0:15455:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097303180/0x8a60d30f571ebe2d lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a35c expref: 370 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.256080:0:15455:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097303180/0x8a60d30f571ebe2d lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a35c expref: 370 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.256084:0:16040:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880084f20b40/0x8a60d30f571834b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfaf3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10435f expref: 1385 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.256092:0:15455:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097303180/0x8a60d30f571ebe2d lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a35c expref: 370 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.256093:0:16040:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801312d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_040:lustre-OST0001_UUID:16040:1805522011644928:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.256102:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.256103:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.256106:0:15455:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136351b00/0x8a60d30f5727b8fe lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.256107:0:16040:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727b8f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.256112:0:15455:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136351b00/0x8a60d30f5727b8fe lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.256115:0:16040:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727b8f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.256121:0:16040:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727b8f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.256127:0:15455:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.256129:0:16040:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727b8f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.256135:0:16040:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727b8f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfaf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.256138:0:16098:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800919c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0000_UUID:16098:1805522011646336:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.256141:0:16040:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727b8f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.256147:0:16098:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325eac0/0x8a60d30f5727b91a lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.256147:0:16040:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aab840 already unused, calling callback (ffffffffa084e330) 00000100:00100000:3.0:1721880422.256147:0:15455:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+369:2007:x1805522257683840:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 87us (168us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.256150:0:16040:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727b8f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.256154:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b59aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2684:3689:x1805522011644800:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4027us (4071us total) trans 4296061626 rc 0/0 00000100:00100000:3.0:1721880422.256154:0:15455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914066 00010000:00010000:1.0:1721880422.256156:0:16040:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727b8f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.256159:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631872 00000100:00100000:0.0:1721880422.256165:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.256165:0:16040:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727b8f0 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfaf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.256168:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011648000 00000100:00100000:2.0:1721880422.256170:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011648000 00010000:00010000:1.0:1721880422.256171:0:16040:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727b8f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfaf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.256176:0:7118:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257683968 00000100:00100000:2.0:1721880422.256179:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631884 00000100:00100000:3.0:1721880422.256180:0:7118:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257683968 00000100:00100000:2.0:1721880422.256182:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2684:3688:x1805522011648000:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1721880422.256190:0:16088:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58070 count 1 00010000:00010000:3.0:1721880422.256191:0:7118:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097303a80/0x8a60d30f571ebe7a lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe2d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a3a9 expref: 369 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.256197:0:16088:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136350480/0x8a60d30f5727b94b lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.256205:0:16088:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e4046c0/0x8a60d30f571ebf92 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a4c1 expref: 369 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.256210:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.256211:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.256213:0:16088:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136350480/0x8a60d30f5727b94b lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.256216:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914067 00000100:00100000:3.0:1721880422.256222:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+369:2004:x1805522257683968:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.256225:0:16088:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e4046c0/0x8a60d30f571ebf92 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a4c1 expref: 369 pid: 16099 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.256227:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.256229:0:7118:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.256231:0:16088:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e4046c0/0x8a60d30f571ebf92 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a4c1 expref: 369 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.256233:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257684224 00010000:00010000:3.0:1721880422.256233:0:7118:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097303a80/0x8a60d30f571ebe7a lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe2d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a3a9 expref: 369 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.256236:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257684224 00000100:00100000:2.0:1721880422.256237:0:16088:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e9cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0000_UUID:16088:1805522011648128:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.256245:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e5f8480/0x8a60d30f57184946 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfaf5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b104eb1 expref: 1385 pid: 16090 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.256248:0:7118:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097303a80/0x8a60d30f571ebe7a lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a3a9 expref: 369 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.256251:0:16088:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdecc0 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.256258:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1721880422.256259:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914068 00010000:00010000:3.0:1721880422.256260:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1721880422.256262:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1385:2004:x1805522257684224:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.256262:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136351b00/0x8a60d30f5727b8fe lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.256263:0:7118:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6d00/0x8a60d30f5727b905 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.256266:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136351b00/0x8a60d30f5727b8fe lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.256267:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.256269:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e5f8480/0x8a60d30f57184946 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfaf5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b104eb1 expref: 1385 pid: 16090 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.256269:0:7118:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6d00/0x8a60d30f5727b905 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.256272:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136351b00/0x8a60d30f5727b8fe lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.256275:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e5f8480/0x8a60d30f57184946 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaf5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b104eb1 expref: 1385 pid: 16090 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.256275:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136351b00/0x8a60d30f5727b8fe lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.256279:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136351b00/0x8a60d30f5727b8fe lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.256279:0:7118:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.256282:0:16040:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f52ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:lustre-MDT0000-mdtlov_UUID+1874:3686:x1805522011644288:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4272us (4303us total) trans 4296019934 rc 0/0 00010000:00010000:2.0:1721880422.256282:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136351b00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.256283:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.256284:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.256284:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136351b00/0x8a60d30f5727b8fe lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.256286:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727b913 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaf5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.256289:0:16040:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631871 00010000:00010000:2.0:1721880422.256289:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136351b00/0x8a60d30f5727b8fe lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.256290:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727b913 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfaf5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.256295:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136351b00/0x8a60d30f5727b8fe lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.256296:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.256296:0:7118:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+369:2004:x1805522257683968:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 74us (130us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.256298:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136351b00/0x8a60d30f5727b8fe lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.256302:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914067 00000100:00100000:0.0:1721880422.256308:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1385:2004:x1805522257684224:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 45us (81us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.256308:0:16100:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098aaaac0/0x8a60d30f5727b8e9 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.256312:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914068 00010000:00010000:1.0:1721880422.256315:0:16100:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098aaaac0/0x8a60d30f5727b8e9 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.256322:0:16100:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098aaaac0/0x8a60d30f5727b8e9 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.256328:0:16100:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098aaaac0/0x8a60d30f5727b8e9 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.256335:0:16100:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098aaaac0/0x8a60d30f5727b8e9 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.256338:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.256341:0:16100:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aaaac0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.256342:0:16113:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097303a80/0x8a60d30f571ebe7a lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a3a9 expref: 368 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.256343:0:16100:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098aaaac0/0x8a60d30f5727b8e9 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.256345:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257684096 00000100:00100000:0.0:1721880422.256347:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257684096 00010000:00010000:1.0:1721880422.256350:0:16100:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098aaaac0/0x8a60d30f5727b8e9 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.256351:0:16113:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008777ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0000_UUID:16113:1805522011645696:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.256354:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0884d80/0x8a60d30f57183ef0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfaf4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1046a7 expref: 1385 pid: 11675 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.256359:0:16100:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098aaaac0/0x8a60d30f5727b8e9 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.256364:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914069 00010000:00010000:1.0:1721880422.256365:0:16100:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098aaaac0/0x8a60d30f5727b8e9 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.256366:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e196050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1385:2005:x1805522257684096:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.256368:0:16113:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6d00/0x8a60d30f5727b905 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.256370:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.256372:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0884d80/0x8a60d30f57183ef0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfaf4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1046a7 expref: 1385 pid: 11675 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.256375:0:16113:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6d00/0x8a60d30f5727b905 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.256377:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008777d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2685:3686:x1805522011645312:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3979us (4012us total) trans 4296061627 rc 0/0 00010000:00010000:0.0:1721880422.256378:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0884d80/0x8a60d30f57183ef0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaf4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1046a7 expref: 1385 pid: 11675 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.256381:0:16113:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6d00/0x8a60d30f5727b905 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.256382:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631873 00010000:00010000:0.0:1721880422.256384:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.256385:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.256387:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727b90c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaf4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.256389:0:16113:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6d00/0x8a60d30f5727b905 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.256390:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727b90c lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfaf4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.256395:0:16113:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6d00/0x8a60d30f5727b905 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.256396:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.256402:0:16113:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6d00/0x8a60d30f5727b905 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.256407:0:16113:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b6d00 already unused, calling callback (ffffffffa084e330) 00000100:00100000:0.0:1721880422.256408:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e196050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1385:2005:x1805522257684096:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 40us (69us total) trans 0 rc 0/0 00000004:00080000:2.0:1721880422.256409:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880097138e00/2, rc 0, transno 1094331 00010000:00010000:3.0:1721880422.256410:0:16113:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6d00/0x8a60d30f5727b905 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.256411:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914069 00010000:00010000:3.0:1721880422.256415:0:16113:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6d00/0x8a60d30f5727b905 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.256417:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880097138e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011645312:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1721880422.256423:0:16113:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6d00/0x8a60d30f5727b905 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.256429:0:16113:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6d00/0x8a60d30f5727b905 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.256440:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.256447:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257684352 00000004:00080000:2.0:1721880422.256448:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801312d1880/2, rc 0, transno 1052638 00000100:00100000:0.0:1721880422.256449:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257684352 00000100:00100000:2.0:1721880422.256454:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801312d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011644288:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.256463:0:16100:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880096c9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:lustre-MDT0000-mdtlov_UUID+2685:3687:x1805522011644416:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4570us (4600us total) trans 4296061628 rc 0/0 00000100:00100000:1.0:1721880422.256469:0:16100:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631870 00000100:00100000:2.0:1721880422.256480:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009bd88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011648384:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.256500:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0cbcc0/0x8a60d30f571ebece lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a3fd expref: 368 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.256501:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.256516:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914070 00000100:00100000:0.0:1721880422.256519:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+368:2005:x1805522257684352:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.256521:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+1873:3688:x1805522011643904:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4907us (4954us total) trans 4296019933 rc 0/0 00010000:00010000:0.0:1721880422.256524:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.256526:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b0cbcc0/0x8a60d30f571ebece lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a3fd expref: 368 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.256526:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631868 00000004:00080000:2.0:1721880422.256527:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800959a5500/2, rc 0, transno 1052637 00000100:00100000:2.0:1721880422.256531:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800959a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011643904:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.256532:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b0cbcc0/0x8a60d30f571ebece lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a3fd expref: 368 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.256534:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1721880422.256541:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b0cbcc0/0x8a60d30f571ebece lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a3fd expref: 368 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.256542:0:16113:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b599180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0000-mdtlov_UUID+2685:3687:x1805522011645568:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3961us (3985us total) trans 4296061629 rc 0/0 00010000:00010000:0.0:1721880422.256548:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.256549:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.256549:0:16113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631874 00010000:00010000:0.0:1721880422.256550:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009325eac0/0x8a60d30f5727b91a lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.256550:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011648256:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.256555:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325eac0/0x8a60d30f5727b91a lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.256562:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.256563:0:16113:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011648384 00000100:00100000:3.0:1721880422.256567:0:16113:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011648384 00000100:00100000:0.0:1721880422.256573:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+367:2005:x1805522257684352:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 53us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.256573:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.256576:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914070 00000100:00100000:3.0:1721880422.256584:0:16113:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011648256 00010000:00010000:0.0:1721880422.256586:0:16098:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325eac0/0x8a60d30f5727b91a lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.256586:0:16113:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011648256 00000100:00100000:2.0:1721880422.256590:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631885 00010000:00010000:0.0:1721880422.256591:0:16098:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325eac0/0x8a60d30f5727b91a lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.256595:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bd8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1873:3686:x1805522011648384:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.256596:0:16098:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325eac0/0x8a60d30f5727b91a lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.256599:0:16098:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325eac0/0x8a60d30f5727b91a lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.256602:0:16113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631886 00010000:00010000:0.0:1721880422.256603:0:16098:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325eac0/0x8a60d30f5727b91a lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.256605:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64250 count 1 00010000:00010000:0.0:1721880422.256606:0:16098:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325eac0 already unused, calling callback (ffffffffa084e330) 00000100:00100000:3.0:1721880422.256606:0:16113:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b174e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0000-mdtlov_UUID+2685:3688:x1805522011648256:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.256608:0:16098:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325eac0/0x8a60d30f5727b91a lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.256612:0:16098:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325eac0/0x8a60d30f5727b91a lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.256613:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727b952 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfafa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.256617:0:16098:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325eac0/0x8a60d30f5727b91a lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.256618:0:16113:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58071 count 1 00010000:00010000:0.0:1721880422.256620:0:16098:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325eac0/0x8a60d30f5727b91a lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.256620:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d20ef40/0x8a60d30f57186bd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfafa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1067bd expref: 1384 pid: 16123 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.256625:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.256626:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.256628:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727b952 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfafa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.256628:0:16113:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4d80/0x8a60d30f5727b959 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2d7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.256638:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d20ef40/0x8a60d30f57186bd6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfafa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1067bd expref: 1384 pid: 16123 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.256638:0:16113:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880123982400/0x8a60d30f571ebfd8 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a507 expref: 366 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.256643:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d20ef40/0x8a60d30f57186bd6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfafa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1067bd expref: 1384 pid: 16123 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.256643:0:16113:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.256645:0:16113:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.256647:0:16113:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4d80/0x8a60d30f5727b959 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.256649:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b176a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011648640:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.256664:0:16113:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880123982400/0x8a60d30f571ebfd8 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a507 expref: 366 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.256666:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdeb40 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.256673:0:16113:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880123982400/0x8a60d30f571ebfd8 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a507 expref: 366 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.256681:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088dc3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011646592:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.256682:0:16113:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008777f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0000_UUID:16113:1805522011648768:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.256692:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727b921 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfaf6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.256704:0:16113:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec540 going to sleep for 11 seconds 00000004:00080000:2.0:1721880422.256705:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009f52ca80/2, rc 0, transno 1094330 00000100:00100000:2.0:1721880422.256710:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009f52ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011644800:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.256715:0:16098:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880084df4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0000-mdtlov_UUID+2686:3688:x1805522011646208:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3601us (3633us total) trans 4296061630 rc 0/0 00000100:00100000:1.0:1721880422.256715:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.256720:0:16098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631877 00000100:00100000:2.0:1721880422.256725:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1721880422.256743:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257684480 00000100:00100000:1.0:1721880422.256746:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257684480 00010000:00010000:3.0:1721880422.256753:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e5f8480/0x8a60d30f57184946 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfaf5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b104eb1 expref: 1385 pid: 16090 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.256758:0:16110:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800919c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_094:lustre-OST0000_UUID:16110:1805522011647616:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.256758:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800998be400/0x8a60d30f57184c33 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaf6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10501d expref: 1385 pid: 16052 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.256762:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1721880422.256767:0:16110:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325d680/0x8a60d30f5727b936 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.256767:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b174a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011648896:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1721880422.256772:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008777d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011646080:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.256774:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914071 00000100:00100000:1.0:1721880422.256779:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1384:2005:x1805522257684480:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.256782:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.256786:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.256787:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727b913 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.256790:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800998be400/0x8a60d30f57184c33 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaf6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10501d expref: 1384 pid: 16052 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.256792:0:16098:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011648896 00000100:00100000:0.0:1721880422.256794:0:16098:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011648896 00010000:00010000:1.0:1721880422.256799:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800998be400/0x8a60d30f57184c33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaf6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10501d expref: 1384 pid: 16052 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.256804:0:16098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631887 00000004:00080000:2.0:1721880422.256806:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009b59a680/2, rc 0, transno 1094333 00000100:00100000:0.0:1721880422.256807:0:16098:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b177b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0000-mdtlov_UUID+2686:3689:x1805522011648896:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.256810:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800998be400/0x8a60d30f57184c33 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfaf6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10501d expref: 1384 pid: 16052 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.256810:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b59a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011645568:0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1721880422.256818:0:16098:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58072 count 1 00010000:00010000:1.0:1721880422.256821:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.256823:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.256823:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b176300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011648512:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.256826:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727b921 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaf6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.256829:0:16098:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325e1c0/0x8a60d30f5727b960 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.256833:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727b921 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfaf6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.256833:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.256839:0:16098:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ad1cb40/0x8a60d30f571ec017 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a546 expref: 366 pid: 16019 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.256846:0:16098:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.256847:0:16098:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.256847:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:2.0:1721880422.256848:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008777df80/2, rc 0, transno 1094334 00010000:00010000:0.0:1721880422.256849:0:16098:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325e1c0/0x8a60d30f5727b960 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.256852:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008777df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011646208:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.256863:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1383:2005:x1805522257684480:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 83us (150us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.256864:0:16098:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ad1cb40/0x8a60d30f571ec017 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a546 expref: 366 pid: 16019 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.256866:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727b921 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.256868:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914071 00010000:00010000:2.0:1721880422.256871:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727b921 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.256874:0:16098:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ad1cb40/0x8a60d30f571ec017 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a546 expref: 366 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.256875:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727b921 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.256879:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727b921 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfaf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.256882:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727b921 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.256885:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350b40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.256888:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727b921 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.256889:0:16098:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800919c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0000_UUID:16098:1805522011649280:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.256892:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727b921 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.256898:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727b921 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfaf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.256902:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727b921 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfaf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.256906:0:16098:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36240 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.256919:0:16040:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011648512 00000100:00100000:0.0:1721880422.256922:0:16040:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011648512 00000100:00100000:0.0:1721880422.256939:0:16040:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631888 00000100:00100000:0.0:1721880422.256943:0:16040:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b176680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:lustre-MDT0000-mdtlov_UUID+1874:3686:x1805522011648512:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.256948:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727b913 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1721880422.256954:0:16040:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64251 count 1 00010000:00010000:3.0:1721880422.256956:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727b913 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.256963:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727b913 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.256964:0:16040:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727b967 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfafb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.256969:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727b913 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfaf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.256975:0:16040:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b3c21c0/0x8a60d30f57186f41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfafb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10698b expref: 1382 pid: 16129 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.256976:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727b913 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.256982:0:16040:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.256982:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b7840 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.256983:0:16040:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.256985:0:16040:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727b967 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfafb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.256985:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727b913 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.256992:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727b913 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.256994:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099eb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+1875:3687:x1805522011646464:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3356us (3381us total) trans 4296019935 rc 0/0 00000100:00100000:2.0:1721880422.256999:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631878 00010000:00010000:0.0:1721880422.257001:0:16040:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b3c21c0/0x8a60d30f57186f41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfafb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10698b expref: 1382 pid: 16129 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.257007:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727b913 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfaf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.257010:0:16040:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b3c21c0/0x8a60d30f57186f41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfafb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10698b expref: 1382 pid: 16129 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.257029:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727b913 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfaf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.257032:0:16040:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800919c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_040:lustre-OST0001_UUID:16040:1805522011649408:192.168.201.24@tcp:104: 00000004:00080000:2.0:1721880422.257034:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801312d1f80/2, rc 0, transno 1094332 00000100:00100000:2.0:1721880422.257039:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801312d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011644416:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.257042:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1721880422.257049:0:16040:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec360c0 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.257059:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1721880422.257062:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b174380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011649024:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.257063:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801312d0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011647488:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.257075:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727b92f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfaf8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.257079:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.257095:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1721880422.257098:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0884d80/0x8a60d30f57183ef0 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfaf4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1046a7 expref: 1382 pid: 11675 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.257099:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800966b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011649536:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.257108:0:9458:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801312d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011645952:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.257108:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.257117:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011649024 00010000:00010000:1.0:1721880422.257119:0:9458:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727b90c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.257120:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011649024 00010000:00010000:1.0:1721880422.257125:0:9458:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727b90c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.257130:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011649536 00000100:00100000:2.0:1721880422.257131:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011649536 00010000:00010000:1.0:1721880422.257137:0:9458:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727b90c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.257140:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631889 00000100:00100000:2.0:1721880422.257142:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2688:3688:x1805522011649024:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.257143:0:16100:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631890 00010000:00010000:1.0:1721880422.257144:0:9458:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727b90c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.257147:0:16100:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:lustre-MDT0000-mdtlov_UUID+2688:3686:x1805522011649536:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.257150:0:9458:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727b90c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfaf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.257150:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58073 count 1 00000100:00100000:3.0:1721880422.257154:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+1875:3688:x1805522011645824:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4222us (4251us total) trans 4296019936 rc 0/0 00002000:00080000:0.0:1721880422.257155:0:16100:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58075 count 1 00010000:00010000:1.0:1721880422.257157:0:9458:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727b90c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.257159:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136352ac0/0x8a60d30f5727b96e lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.257161:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631876 00010000:00010000:1.0:1721880422.257162:0:9458:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8000 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.257163:0:16100:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325f3c0/0x8a60d30f5727b975 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.257165:0:9458:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727b90c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.257167:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880123981b00/0x8a60d30f571ec087 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a5b6 expref: 366 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.257171:0:16100:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009eb8ba80/0x8a60d30f571ec0e9 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a618 expref: 366 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.257171:0:9458:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727b90c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.257171:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.257172:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.257174:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136352ac0/0x8a60d30f5727b96e lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.257175:0:16100:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.257176:0:16100:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.257178:0:16100:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325f3c0/0x8a60d30f5727b975 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.257179:0:9458:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727b90c lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfaf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.257184:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880123981b00/0x8a60d30f571ec087 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a5b6 expref: 366 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.257185:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727b90c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfaf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.257187:0:16100:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009eb8ba80/0x8a60d30f571ec0e9 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a618 expref: 366 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.257189:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880123981b00/0x8a60d30f571ec087 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a5b6 expref: 366 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.257191:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880098d25880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011647232:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.257192:0:16100:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009eb8ba80/0x8a60d30f571ec0e9 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a618 expref: 366 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.257195:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800966b1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0000_UUID:16028:1805522011649664:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.257198:0:16100:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800919c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_087:lustre-OST0000_UUID:16100:1805522011649792:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.257207:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727b928 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfaf7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.257210:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde780 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.257211:0:16100:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36e40 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.257218:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011649152:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.257231:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.257243:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.257243:0:16130:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009ebd8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0001_UUID:16130:1805522011647744:192.168.201.24@tcp:104: 00000004:00080000:2.0:1721880422.257248:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099eb1500/2, rc 0, transno 1052639 00000100:00100000:2.0:1721880422.257252:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099eb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011646464:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.257257:0:16130:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727b93d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfaf9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.257267:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1721880422.257270:0:15455:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257684608 00000100:00100000:2.0:1721880422.257272:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800966b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011649920:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.257273:0:15455:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257684608 00000100:00100000:1.0:1721880422.257282:0:9458:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1875:3688:x1805522011645184:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4388us (4454us total) trans 4296019937 rc 0/0 00000100:00100000:2.0:1721880422.257283:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.257283:0:15455:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fbc8480/0x8a60d30f571854bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaf7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10562f expref: 1382 pid: 15447 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.257285:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.257289:0:9458:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631875 00000100:00100000:3.0:1721880422.257299:0:15455:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257684864 00000004:00080000:2.0:1721880422.257301:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801312d0000/2, rc 0, transno 1052640 00000100:00100000:3.0:1721880422.257301:0:15455:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257684864 00000100:00100000:0.0:1721880422.257302:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914072 00000100:00100000:0.0:1721880422.257305:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1382:2007:x1805522257684608:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.257305:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801312d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011645824:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.257307:0:9458:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011649152 00000100:00100000:1.0:1721880422.257309:0:9458:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011649152 00010000:00010000:3.0:1721880422.257310:0:15455:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880123982ac0/0x8a60d30f571ebf53 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a482 expref: 367 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.257312:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.257316:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fbc8480/0x8a60d30f571854bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaf7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10562f expref: 1382 pid: 15447 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.257317:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800966b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011650048:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.257322:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fbc8480/0x8a60d30f571854bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaf7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10562f expref: 1382 pid: 15447 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.257322:0:9458:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011649920 00000100:00100000:1.0:1721880422.257324:0:9458:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011649920 00000100:00100000:3.0:1721880422.257325:0:15455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914073 00000100:00100000:2.0:1721880422.257328:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.257330:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fbc8480/0x8a60d30f571854bb lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfaf7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10562f expref: 1382 pid: 15447 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.257330:0:15455:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+367:2007:x1805522257684864:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.257336:0:9458:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011650048 00010000:00010000:3.0:1721880422.257337:0:15455:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.257338:0:9458:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011650048 00010000:00010000:0.0:1721880422.257339:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.257340:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.257341:0:15455:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880123982ac0/0x8a60d30f571ebf53 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a482 expref: 367 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.257342:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727b928 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaf7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.257346:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727b928 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfaf7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.257351:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631891 00010000:00010000:3.0:1721880422.257351:0:15455:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880123982ac0/0x8a60d30f571ebf53 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a482 expref: 367 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.257355:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.257355:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2689:3687:x1805522011649152:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.257356:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631892 00000100:00100000:1.0:1721880422.257360:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1876:3689:x1805522011649920:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.257364:0:15455:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880123982ac0/0x8a60d30f571ebf53 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a482 expref: 367 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.257366:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1381:2007:x1805522257684608:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 60us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.257369:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914072 00002000:00080000:2.0:1721880422.257369:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58074 count 1 00002000:00080000:1.0:1721880422.257372:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64252 count 1 00010000:00010000:3.0:1721880422.257375:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.257377:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136352d00/0x8a60d30f5727b97c lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.257377:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.257380:0:15455:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009325d680/0x8a60d30f5727b936 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.257381:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727b983 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfafc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.257385:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800842a5680/0x8a60d30f571ec0b8 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a5e7 expref: 366 pid: 16019 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.257386:0:15455:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325d680/0x8a60d30f5727b936 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.257390:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1721880422.257391:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.257392:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.257393:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d26a400/0x8a60d30f571872f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfafc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b106b75 expref: 1380 pid: 16073 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.257394:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136352d00/0x8a60d30f5727b97c lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.257398:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257684736 00010000:00010000:1.0:1721880422.257399:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.257400:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1721880422.257401:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257684736 00010000:00010000:3.0:1721880422.257402:0:15455:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.257403:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727b983 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfafc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.257409:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801206e9f80/0x8a60d30f57185c55 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaf8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b105b92 expref: 1381 pid: 16082 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.257411:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800842a5680/0x8a60d30f571ec0b8 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a5e7 expref: 366 pid: 16019 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.257417:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d26a400/0x8a60d30f571872f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfafc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b106b75 expref: 1381 pid: 16073 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.257420:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800842a5680/0x8a60d30f571ec0b8 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a5e7 expref: 366 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.257421:0:15455:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+366:2007:x1805522257684864:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 90us (134us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.257426:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d26a400/0x8a60d30f571872f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfafc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b106b75 expref: 1381 pid: 16073 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.257428:0:15455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914073 00000100:00100000:2.0:1721880422.257430:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800966b3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:15466:1805522011650176:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.257432:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914074 00000100:00100000:0.0:1721880422.257435:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1381:2005:x1805522257684736:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.257435:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801312d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011650304:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.257440:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.257442:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801206e9f80/0x8a60d30f57185c55 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaf8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b105b92 expref: 1381 pid: 16082 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.257447:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801206e9f80/0x8a60d30f57185c55 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaf8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b105b92 expref: 1381 pid: 16082 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.257454:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfded80 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.257455:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801206e9f80/0x8a60d30f57185c55 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfaf8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b105b92 expref: 1381 pid: 16082 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.257456:0:16120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631893 00000100:00100000:1.0:1721880422.257457:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eba80 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.257461:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.257462:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.257462:0:16120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+1876:3689:x1805522011650048:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.257464:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727b92f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaf8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.257468:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727b92f lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfaf8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.257473:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801312d2d80/2, rc 0, transno 1052641 00002000:00080000:3.0:1721880422.257474:0:16120:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64253 count 1 00010000:00010000:0.0:1721880422.257478:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.257480:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801312d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011645184:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.257484:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727b92f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.257484:0:16120:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727b98a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfafd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.257488:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1380:2005:x1805522257684736:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 53us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.257491:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914074 00010000:00010000:1.0:1721880422.257491:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727b92f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.257494:0:16120:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c660fc0/0x8a60d30f571877b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfafd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b106e15 expref: 1380 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.257498:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727b92f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.257500:0:16120:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.257501:0:16120:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.257503:0:16110:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325d680/0x8a60d30f5727b936 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.257503:0:16120:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727b98a lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfafd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.257504:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727b92f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfaf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.257505:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800966b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011650432:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.257508:0:16110:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325d680/0x8a60d30f5727b936 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.257510:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727b92f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.257513:0:16110:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325d680/0x8a60d30f5727b936 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.257515:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aaa400 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.257517:0:16110:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325d680/0x8a60d30f5727b936 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.257518:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727b92f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.257519:0:16120:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008c660fc0/0x8a60d30f571877b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfafd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b106e15 expref: 1379 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.257520:0:16110:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325d680/0x8a60d30f5727b936 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.257523:0:16110:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325d680 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.257524:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727b92f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.257525:0:16110:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325d680/0x8a60d30f5727b936 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.257526:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.257528:0:16120:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008c660fc0/0x8a60d30f571877b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfafd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b106e15 expref: 1379 pid: 15466 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.257529:0:16110:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325d680/0x8a60d30f5727b936 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.257533:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727b92f lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfaf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.257534:0:16110:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325d680/0x8a60d30f5727b936 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.257538:0:16110:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325d680/0x8a60d30f5727b936 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.257538:0:16120:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008777d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0001_UUID:16120:1805522011650560:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.257539:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727b92f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfaf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.257550:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011650432 00000100:00100000:2.0:1721880422.257553:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011650432 00000100:00100000:3.0:1721880422.257558:0:16120:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec840 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.257578:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631894 00000100:00100000:3.0:1721880422.257584:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+1878:3686:x1805522011650432:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.257596:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64254 count 1 00010000:00010000:3.0:1721880422.257606:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727b991 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfafe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.257621:0:16110:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_094:lustre-MDT0000-mdtlov_UUID+2690:3687:x1805522011647360:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3570us (3654us total) trans 4296061631 rc 0/0 00010000:00010000:3.0:1721880422.257621:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007b4ec000/0x8a60d30f57187d3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfafe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1071f7 expref: 1379 pid: 16056 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.257626:0:16110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631881 00010000:00010000:3.0:1721880422.257627:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.257629:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.257631:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727b991 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfafe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.257635:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880096003480/2, rc 0, transno 1094335 00010000:00010000:0.0:1721880422.257641:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727b928 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.257641:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+1878:3689:x1805522011646976:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3711us (3753us total) trans 4296019938 rc 0/0 00000100:00100000:2.0:1721880422.257642:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880096003480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011647360:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.257646:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727b928 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.257646:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007b4ec000/0x8a60d30f57187d3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfafe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1071f7 expref: 1379 pid: 16056 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.257647:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631880 00010000:00010000:0.0:1721880422.257651:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727b928 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.257654:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727b928 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfaf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.257654:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007b4ec000/0x8a60d30f57187d3a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfafe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1071f7 expref: 1379 pid: 16056 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.257658:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727b928 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.257661:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4900 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.257662:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727b928 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.257663:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008777d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011650688:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.257666:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727b928 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.257671:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727b928 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfaf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.257675:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727b928 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfaf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.257682:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.257682:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdeccc0 going to sleep for 11 seconds 00000004:00080000:2.0:1721880422.257705:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088dc1880/2, rc 0, transno 1052642 00000100:00100000:2.0:1721880422.257711:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088dc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011646976:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.257724:0:15514:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e9c8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:15514:1805522011647872:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.257746:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.257756:0:15514:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727b944 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.257758:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d7a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011650944:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.257766:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257684992 00000100:00100000:0.0:1721880422.257769:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257685120 00000100:00100000:1.0:1721880422.257769:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257684992 00000100:00100000:0.0:1721880422.257772:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257685120 00000100:00100000:2.0:1721880422.257780:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.257783:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801239833c0/0x8a60d30f571ebf0d lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a43c expref: 366 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.257784:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f606ac0/0x8a60d30f571866ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaf9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1063f0 expref: 1380 pid: 16075 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.257800:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011650944 00000100:00100000:2.0:1721880422.257803:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1721880422.257804:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914075 00000100:00100000:3.0:1721880422.257804:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011650944 00000100:00100000:0.0:1721880422.257808:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e195c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+366:2004:x1805522257685120:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.257808:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800966b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011650816:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.257809:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914076 00010000:00010000:0.0:1721880422.257812:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.257813:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1380:2004:x1805522257684992:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.257815:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801239833c0/0x8a60d30f571ebf0d lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a43c expref: 366 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.257820:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.257821:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801239833c0/0x8a60d30f571ebf0d lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a43c expref: 366 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.257824:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f606ac0/0x8a60d30f571866ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaf9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1063f0 expref: 1380 pid: 16075 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.257825:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.257828:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801239833c0/0x8a60d30f571ebf0d lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a43c expref: 366 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.257830:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631895 00010000:00010000:1.0:1721880422.257833:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f606ac0/0x8a60d30f571866ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaf9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1063f0 expref: 1380 pid: 16075 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.257834:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.257834:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d7a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+1879:3688:x1805522011650944:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.257835:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.257837:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727b944 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.257841:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727b944 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.257845:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f606ac0/0x8a60d30f571866ea lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfaf9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1063f0 expref: 1380 pid: 16075 timeout: 887 lvb_type: 0 00002000:00080000:3.0:1721880422.257845:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64255 count 1 00010000:00010000:0.0:1721880422.257850:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.257855:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.257855:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727b998 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfaff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.257857:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.257860:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727b93d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaf9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.257862:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e195c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+365:2004:x1805522257685120:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 54us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.257866:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914075 00010000:00010000:3.0:1721880422.257866:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fe6a880/0x8a60d30f57187f01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfaff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107267 expref: 1379 pid: 16084 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.257867:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727b93d lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfaf9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.257872:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.257873:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.257875:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727b998 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfaff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.257881:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.257891:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fe6a880/0x8a60d30f57187f01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107267 expref: 1379 pid: 16084 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.257894:0:16130:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727b93d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.257898:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1379:2004:x1805522257684992:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 84us (215us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.257899:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fe6a880/0x8a60d30f57187f01 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107267 expref: 1379 pid: 16084 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.257903:0:16130:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727b93d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.257904:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914076 00000100:00100000:3.0:1721880422.257908:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008777ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011651072:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.257911:0:16130:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727b93d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.257918:0:16130:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727b93d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfaf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.257925:0:16130:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727b93d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.257930:0:16130:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4b40 already unused, calling callback (ffffffffa084e330) 00000100:00100000:3.0:1721880422.257930:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec300 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.257933:0:16130:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727b93d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.257939:0:16130:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727b93d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.257941:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011650816 00000100:00100000:1.0:1721880422.257943:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011650816 00010000:00010000:3.0:1721880422.257943:0:15514:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727b944 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.257949:0:16130:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727b93d lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfaf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.257949:0:15514:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727b944 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.257955:0:16130:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727b93d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfaf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.257956:0:15514:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727b944 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.257964:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631896 00010000:00010000:3.0:1721880422.257968:0:15514:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727b944 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.257969:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d7a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2690:3686:x1805522011650816:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1721880422.257974:0:15514:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727b944 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.257979:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58076 count 1 00010000:00010000:3.0:1721880422.257979:0:15514:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352640 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.257982:0:15514:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727b944 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.257988:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098aa9680/0x8a60d30f5727b99f lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.257989:0:15514:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727b944 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.257998:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800971e86c0/0x8a60d30f571ec121 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a649 expref: 364 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.257999:0:15514:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727b944 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.258004:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.258005:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.258005:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727b944 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.258007:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098aa9680/0x8a60d30f5727b99f lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.258038:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800971e86c0/0x8a60d30f571ec121 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a649 expref: 364 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.258047:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800971e86c0/0x8a60d30f571ec121 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a649 expref: 364 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.258049:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+1880:3687:x1805522011646720:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4237us (4266us total) trans 4296019939 rc 0/0 00000100:00100000:0.0:1721880422.258054:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631879 00000100:00100000:1.0:1721880422.258056:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801312d0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0000_UUID:16017:1805522011651200:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.258069:0:16130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0000-mdtlov_UUID+1879:3687:x1805522011647104:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4005us (4072us total) trans 4296019940 rc 0/0 00000100:00100000:2.0:1721880422.258074:0:16130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631882 00000100:00100000:1.0:1721880422.258078:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb3c0 going to sleep for 11 seconds 00000004:00080000:2.0:1721880422.258094:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088dc3480/2, rc 0, transno 1052644 00000100:00100000:2.0:1721880422.258099:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011647104:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.258116:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d7a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011651328:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.258130:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.258138:0:15514:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+2691:3688:x1805522011646848:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4024us (4070us total) trans 4296061632 rc 0/0 00000100:00100000:1.0:1721880422.258143:0:9458:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011651328 00000100:00100000:3.0:1721880422.258145:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631883 00000100:00100000:1.0:1721880422.258146:0:9458:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011651328 00000004:00080000:2.0:1721880422.258146:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088dc0000/2, rc 0, transno 1052643 00000100:00100000:2.0:1721880422.258149:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088dc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011646720:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.258161:0:9458:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631897 00000100:00100000:2.0:1721880422.258161:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1721880422.258164:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d7a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011651456:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.258165:0:9458:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d7a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1879:3689:x1805522011651328:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.258174:0:9458:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64256 count 1 00000100:00100000:2.0:1721880422.258175:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.258182:0:9458:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727b9a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb00:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.258192:0:9458:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fe69f80/0x8a60d30f571880cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1072de expref: 1378 pid: 16024 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.258193:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011651456 00000100:00100000:3.0:1721880422.258197:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011651456 00010000:00010000:1.0:1721880422.258198:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.258199:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.258202:0:9458:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727b9a6 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.258202:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008777c380/2, rc 0, transno 1094336 00000100:00100000:2.0:1721880422.258206:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008777c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011646848:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.258214:0:9458:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fe69f80/0x8a60d30f571880cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1072de expref: 1378 pid: 16024 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.258215:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631898 00000100:00100000:2.0:1721880422.258219:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1721880422.258221:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d7a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+1880:3687:x1805522011651456:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.258222:0:9458:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fe69f80/0x8a60d30f571880cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1072de expref: 1378 pid: 16024 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.258223:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d7a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011651712:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.258231:0:9458:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801312d0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011651584:192.168.201.24@tcp:104: 00002000:00080000:3.0:1721880422.258233:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64257 count 1 00000100:00100000:2.0:1721880422.258237:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.258243:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727b9ad lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb01:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.258254:0:9458:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302ebe40 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.258254:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007298f180/0x8a60d30f57188361 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107394 expref: 1378 pid: 16049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.258260:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.258261:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.258264:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727b9ad lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.258280:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007298f180/0x8a60d30f57188361 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107394 expref: 1378 pid: 16049 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.258288:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007298f180/0x8a60d30f57188361 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107394 expref: 1378 pid: 16049 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.258297:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e9c8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011651840:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.258316:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.258328:0:15514:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011651712 00000100:00100000:3.0:1721880422.258331:0:15514:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011651712 00000100:00100000:3.0:1721880422.258348:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631899 00000100:00100000:3.0:1721880422.258352:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096c9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+2691:3686:x1805522011651712:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.258361:0:16088:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e9cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0000_UUID:16088:1805522011648128:192.168.201.24@tcp:104: 00002000:00080000:3.0:1721880422.258362:0:15514:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58077 count 1 00010000:00010000:3.0:1721880422.258371:0:15514:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727b9b4 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2dd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.258375:0:16088:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136350480/0x8a60d30f5727b94b lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.258379:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.258385:0:15514:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a05efcc0/0x8a60d30f571ec14b lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a673 expref: 364 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.258388:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257685248 00000100:00100000:1.0:1721880422.258390:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257685248 00010000:00010000:3.0:1721880422.258391:0:15514:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.258393:0:15514:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.258395:0:15514:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727b9b4 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.258399:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b176a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011648640:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.258400:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e4046c0/0x8a60d30f571ebf92 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a4c1 expref: 365 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.258411:0:15514:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a05efcc0/0x8a60d30f571ec14b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a673 expref: 365 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.258413:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727b952 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfafa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.258415:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914077 00000100:00100000:1.0:1721880422.258419:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+365:2004:x1805522257685248:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.258420:0:15514:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a05efcc0/0x8a60d30f571ec14b lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a673 expref: 365 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.258424:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.258428:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e4046c0/0x8a60d30f571ebf92 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a4c1 expref: 365 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.258430:0:15514:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e9cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:15514:1805522011651968:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.258437:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e4046c0/0x8a60d30f571ebf92 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a4c1 expref: 365 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.258448:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e4046c0/0x8a60d30f571ebf92 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a4c1 expref: 365 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.258452:0:15514:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec180 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.258459:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.258460:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.258463:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136350480/0x8a60d30f5727b94b lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.258470:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136350480/0x8a60d30f5727b94b lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.258477:0:16113:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008777f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0000_UUID:16113:1805522011648768:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.258486:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.258490:0:16113:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4d80/0x8a60d30f5727b959 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.258499:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+364:2004:x1805522257685248:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 79us (120us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.258499:0:16088:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136350480/0x8a60d30f5727b94b lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.258504:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914077 00010000:00010000:2.0:1721880422.258507:0:16088:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136350480/0x8a60d30f5727b94b lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.258515:0:16088:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136350480/0x8a60d30f5727b94b lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.258522:0:16088:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136350480/0x8a60d30f5727b94b lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.258530:0:16088:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136350480/0x8a60d30f5727b94b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.258537:0:16088:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350480 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.258540:0:16088:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136350480/0x8a60d30f5727b94b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.258547:0:16088:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136350480/0x8a60d30f5727b94b lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.258557:0:16088:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136350480/0x8a60d30f5727b94b lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.258563:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136350480/0x8a60d30f5727b94b lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.258582:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.258598:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257685376 00000100:00100000:1.0:1721880422.258599:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.258602:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257685376 00000100:00100000:0.0:1721880422.258617:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257685504 00000100:00100000:0.0:1721880422.258620:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257685504 00010000:00010000:0.0:1721880422.258635:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880123982400/0x8a60d30f571ebfd8 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a507 expref: 364 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.258656:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914078 00000100:00100000:0.0:1721880422.258661:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+364:2004:x1805522257685504:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.258661:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.258669:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.258673:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880123982400/0x8a60d30f571ebfd8 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a507 expref: 364 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.258678:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.258678:0:7118:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257685760 00010000:00010000:0.0:1721880422.258680:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880123982400/0x8a60d30f571ebfd8 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a507 expref: 364 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.258682:0:7118:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257685760 00000100:00100000:2.0:1721880422.258687:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2692:3688:x1805522011648000:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2502us (2726us total) trans 4296061633 rc 0/0 00010000:00010000:0.0:1721880422.258689:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880123982400/0x8a60d30f571ebfd8 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a507 expref: 364 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.258690:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257685888 00000100:00100000:1.0:1721880422.258692:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257685888 00000100:00100000:2.0:1721880422.258694:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631884 00010000:00010000:3.0:1721880422.258695:0:7118:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b3c21c0/0x8a60d30f57186f41 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfafb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10698b expref: 1380 pid: 16129 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.258698:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.258699:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.258702:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4d80/0x8a60d30f5727b959 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.258702:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880123981b00/0x8a60d30f571ec087 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe2d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a5b6 expref: 364 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.258707:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4d80/0x8a60d30f5727b959 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.258719:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:2.0:1721880422.258720:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e9c9500/2, rc 0, transno 1094337 00000100:00100000:3.0:1721880422.258724:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914079 00000100:00100000:2.0:1721880422.258744:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e9c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011648000:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1721880422.258754:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+1380:2005:x1805522257685760:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.258755:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+364:2004:x1805522257685504:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 93us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.258755:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914080 00000100:00100000:0.0:1721880422.258760:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914078 00000100:00100000:1.0:1721880422.258760:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+364:2004:x1805522257685888:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.258763:0:7118:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.258767:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.258767:0:7118:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b3c21c0/0x8a60d30f57186f41 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfafb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10698b expref: 1380 pid: 16129 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.258771:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880123981b00/0x8a60d30f571ec087 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe2d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a5b6 expref: 363 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.258775:0:7118:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b3c21c0/0x8a60d30f57186f41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfafb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10698b expref: 1380 pid: 16129 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.258780:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880123981b00/0x8a60d30f571ec087 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a5b6 expref: 363 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.258785:0:16098:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800919c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0000_UUID:16098:1805522011649280:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.258786:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.258788:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.258790:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.258791:0:7118:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727b967 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfafb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.258792:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.258795:0:16098:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325e1c0/0x8a60d30f5727b960 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.258795:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136352ac0/0x8a60d30f5727b96e lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.258797:0:7118:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727b967 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfafb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.258807:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136352ac0/0x8a60d30f5727b96e lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.258808:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d20ef40/0x8a60d30f57186bd6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfafa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1067bd expref: 1380 pid: 16123 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.258808:0:7118:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.258816:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.258820:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914081 00000100:00100000:0.0:1721880422.258824:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1380:2006:x1805522257685376:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.258826:0:7118:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+1380:2005:x1805522257685760:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 72us (164us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.258829:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.258829:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+363:2004:x1805522257685888:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 69us (152us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.258832:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d20ef40/0x8a60d30f57186bd6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfafa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1067bd expref: 1380 pid: 16123 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.258833:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914079 00000100:00100000:1.0:1721880422.258837:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914080 00010000:00010000:0.0:1721880422.258839:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d20ef40/0x8a60d30f57186bd6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfafa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1067bd expref: 1380 pid: 16123 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.258856:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1721880422.258862:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d7a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011652096:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.258865:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.258886:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257686016 00000100:00100000:2.0:1721880422.258890:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257686016 00010000:00010000:2.0:1721880422.258903:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009eb8ba80/0x8a60d30f571ec0e9 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a618 expref: 363 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.258928:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d20ef40/0x8a60d30f57186bd6 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfafa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1067bd expref: 1379 pid: 16123 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.258933:0:15455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914082 00010000:00010000:0.0:1721880422.258938:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.258939:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.258939:0:15455:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+363:2004:x1805522257686016:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.258941:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727b952 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfafa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.258946:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727b952 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfafa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.258946:0:15455:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.258951:0:15455:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009eb8ba80/0x8a60d30f571ec0e9 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe2db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a618 expref: 363 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.258956:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.258959:0:15455:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009eb8ba80/0x8a60d30f571ec0e9 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a618 expref: 363 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.258963:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.258970:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.258971:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.258974:0:15455:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009325f3c0/0x8a60d30f5727b975 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.258975:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1378:2006:x1805522257685376:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 149us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.258975:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.258980:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914081 00010000:00010000:3.0:1721880422.258980:0:15455:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325f3c0/0x8a60d30f5727b975 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.258985:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727b952 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfafa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.258987:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257685632 00000100:00100000:1.0:1721880422.258990:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257685632 00010000:00010000:3.0:1721880422.258990:0:15455:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.258993:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727b952 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfafa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.259000:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ad1cb40/0x8a60d30f571ec017 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a546 expref: 364 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.259001:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727b952 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfafa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.259008:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727b952 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfafa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.259008:0:15455:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+364:2004:x1805522257686016:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 69us (142us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.259031:0:16040:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b3c21c0/0x8a60d30f57186f41 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfafb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10698b expref: 1377 pid: 16129 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.259033:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727b952 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfafa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.259034:0:15455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914082 00000100:00100000:1.0:1721880422.259038:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914083 00010000:00010000:2.0:1721880422.259039:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136351680 already unused, calling callback (ffffffffa084e330) 00000100:00100000:1.0:1721880422.259042:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ab4d5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+364:2005:x1805522257685632:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.259042:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727b952 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfafa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.259048:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.259050:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727b952 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfafa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.259052:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ad1cb40/0x8a60d30f571ec017 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a546 expref: 363 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.259057:0:16113:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4d80/0x8a60d30f5727b959 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.259060:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727b952 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfafa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.259061:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ad1cb40/0x8a60d30f571ec017 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a546 expref: 363 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.259064:0:16113:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4d80/0x8a60d30f5727b959 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.259070:0:16113:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4d80/0x8a60d30f5727b959 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.259072:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ad1cb40/0x8a60d30f571ec017 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a546 expref: 363 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.259072:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727b952 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfafa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.259076:0:16113:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4d80/0x8a60d30f5727b959 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.259083:0:16113:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4d80/0x8a60d30f5727b959 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.259088:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.259089:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.259092:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009325e1c0/0x8a60d30f5727b960 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.259093:0:16113:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4d80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.259096:0:16113:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4d80/0x8a60d30f5727b959 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.259099:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325e1c0/0x8a60d30f5727b960 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.259103:0:16113:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4d80/0x8a60d30f5727b959 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.259104:0:16040:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800919c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_040:lustre-OST0001_UUID:16040:1805522011649408:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.259111:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.259112:0:16113:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4d80/0x8a60d30f5727b959 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.259117:0:16040:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727b967 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfafb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.259118:0:16113:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4d80/0x8a60d30f5727b959 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.259124:0:16040:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727b967 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfafb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.259124:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ab4d5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+362:2005:x1805522257685632:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 81us (151us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.259127:0:16040:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727b967 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfafb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.259129:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914083 00010000:00010000:0.0:1721880422.259132:0:16040:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727b967 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfafb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.259137:0:16040:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727b967 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfafb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.259141:0:16040:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727b967 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfafb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.259145:0:16040:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325d200 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.259146:0:16040:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727b967 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfafb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.259150:0:16040:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727b967 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfafb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.259156:0:16040:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727b967 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfafb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.259160:0:16040:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727b967 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfafb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.259190:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bd8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1881:3686:x1805522011648384:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2593us (2688us total) trans 4296019941 rc 0/0 00000100:00100000:2.0:1721880422.259196:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631885 00000100:00100000:2.0:1721880422.259208:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011652096 00000100:00100000:2.0:1721880422.259212:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011652096 00000100:00100000:3.0:1721880422.259226:0:16113:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b174e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0000-mdtlov_UUID+2693:3688:x1805522011648256:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2618us (2650us total) trans 4296061634 rc 0/0 00000100:00100000:2.0:1721880422.259227:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631900 00000100:00100000:2.0:1721880422.259231:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d7a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2693:3689:x1805522011652096:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1721880422.259232:0:16113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631886 00002000:00080000:2.0:1721880422.259240:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58078 count 1 00010000:00010000:2.0:1721880422.259249:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136350d80/0x8a60d30f5727b9bb lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2de:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.259257:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d8cb40/0x8a60d30f571ec175 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a69d expref: 361 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.259262:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.259263:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.259263:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880123981b00/0x8a60d30f571ec087 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a5b6 expref: 361 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.259264:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136350d80/0x8a60d30f5727b9bb lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.259274:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800966b1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0000_UUID:16028:1805522011649664:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.259276:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096d8cb40/0x8a60d30f571ec175 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a69d expref: 360 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.259282:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096d8cb40/0x8a60d30f571ec175 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a69d expref: 360 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.259289:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d7a0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:15453:1805522011652224:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.259289:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136352ac0/0x8a60d30f5727b96e lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.259297:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136352ac0/0x8a60d30f5727b96e lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.259308:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdeb40 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.259308:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136352ac0/0x8a60d30f5727b96e lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.259315:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136352ac0/0x8a60d30f5727b96e lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.259320:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136352ac0/0x8a60d30f5727b96e lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.259325:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136352ac0/0x8a60d30f5727b96e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.259326:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009bd88380/2, rc 0, transno 1052645 00010000:00010000:3.0:1721880422.259328:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352ac0 already unused, calling callback (ffffffffa084e330) 00000100:00100000:2.0:1721880422.259330:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009bd88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011648384:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.259330:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136352ac0/0x8a60d30f5727b96e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.259334:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136352ac0/0x8a60d30f5727b96e lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.259340:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136352ac0/0x8a60d30f5727b96e lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.259344:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136352ac0/0x8a60d30f5727b96e lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.259354:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800966b3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:15466:1805522011650176:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.259363:0:16040:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b176680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:lustre-MDT0000-mdtlov_UUID+1881:3686:x1805522011648512:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2417us (2526us total) trans 4296019942 rc 0/0 00010000:00010000:2.0:1721880422.259365:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136352d00/0x8a60d30f5727b97c lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.259369:0:16040:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631888 00000004:00080000:2.0:1721880422.259376:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009b176300/2, rc 0, transno 1052646 00000100:00100000:2.0:1721880422.259380:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b176300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011648512:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.259390:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801312d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011650304:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.259391:0:16098:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325e1c0/0x8a60d30f5727b960 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.259391:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1721880422.259396:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d7a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011652480:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.259399:0:16098:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325e1c0/0x8a60d30f5727b960 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.259402:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727b983 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfafc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.259406:0:16098:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325e1c0/0x8a60d30f5727b960 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.259410:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.259414:0:16098:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325e1c0/0x8a60d30f5727b960 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.259421:0:16098:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325e1c0/0x8a60d30f5727b960 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.259426:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d7a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011652352:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.259427:0:16098:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325e1c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.259430:0:16098:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325e1c0/0x8a60d30f5727b960 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.259435:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2693:3688:x1805522011649024:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2291us (2355us total) trans 4296061635 rc 0/0 00010000:00010000:0.0:1721880422.259437:0:16098:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325e1c0/0x8a60d30f5727b960 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.259440:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631889 00000100:00100000:2.0:1721880422.259445:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.259446:0:16098:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325e1c0/0x8a60d30f5727b960 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.259448:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.259452:0:16098:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325e1c0/0x8a60d30f5727b960 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.259458:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257686144 00000100:00100000:1.0:1721880422.259461:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257686144 00000100:00100000:3.0:1721880422.259461:0:16120:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008777d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0001_UUID:16120:1805522011650560:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.259467:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011652480 00010000:00010000:1.0:1721880422.259470:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800842a5680/0x8a60d30f571ec0b8 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a5e7 expref: 361 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.259470:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011652480 00010000:00010000:3.0:1721880422.259470:0:16120:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727b98a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfafd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.259480:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011652352 00000100:00100000:3.0:1721880422.259484:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011652352 00000100:00100000:2.0:1721880422.259487:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631901 00000100:00100000:1.0:1721880422.259488:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914084 00000100:00100000:2.0:1721880422.259492:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d7a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+1882:3687:x1805522011652480:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.259493:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+361:2004:x1805522257686144:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.259499:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.259500:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631902 00010000:00010000:1.0:1721880422.259503:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800842a5680/0x8a60d30f571ec0b8 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a5e7 expref: 361 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.259503:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b176a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+1882:3689:x1805522011652352:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.259505:0:16088:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64259 count 1 00010000:00010000:1.0:1721880422.259511:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800842a5680/0x8a60d30f571ec0b8 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a5e7 expref: 361 pid: 16019 timeout: 887 lvb_type: 0 00002000:00080000:3.0:1721880422.259512:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64258 count 1 00010000:00010000:2.0:1721880422.259516:0:16088:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727b9c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb03:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.259520:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727b9c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb02:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.259522:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800842a5680/0x8a60d30f571ec0b8 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a5e7 expref: 361 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.259527:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082e4d200/0x8a60d30f571886a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107458 expref: 1376 pid: 16107 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.259528:0:16088:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800911446c0/0x8a60d30f57188996 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107523 expref: 1376 pid: 16059 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.259531:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.259532:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.259532:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.259533:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.259533:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727b9c9 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.259535:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.259536:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136352d00/0x8a60d30f5727b97c lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.259536:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.259539:0:16088:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727b9c2 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.259543:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136352d00/0x8a60d30f5727b97c lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.259543:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082e4d200/0x8a60d30f571886a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107458 expref: 1376 pid: 16107 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.259549:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082e4d200/0x8a60d30f571886a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107458 expref: 1376 pid: 16107 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.259555:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.259558:0:16088:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800911446c0/0x8a60d30f57188996 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107523 expref: 1376 pid: 16059 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.259558:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800966b3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011652608:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.259567:0:16088:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800911446c0/0x8a60d30f57188996 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107523 expref: 1376 pid: 16059 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.259568:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+360:2004:x1805522257686144:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 75us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.259572:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec840 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.259573:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914084 00000100:00100000:2.0:1721880422.259577:0:16088:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008854c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011652736:192.168.201.24@tcp:104: 00000004:00080000:3.0:1721880422.259594:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009b174380/2, rc 0, transno 1094339 00000100:00100000:2.0:1721880422.259601:0:16088:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfded80 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.259601:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b174380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011649024:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1721880422.259614:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136352d00/0x8a60d30f5727b97c lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.259622:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136352d00/0x8a60d30f5727b97c lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.259626:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.259628:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136352d00/0x8a60d30f5727b97c lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.259632:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008777d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011650688:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.259634:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136352d00/0x8a60d30f5727b97c lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.259636:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257686272 00000100:00100000:1.0:1721880422.259638:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257686272 00010000:00010000:2.0:1721880422.259641:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136352d00/0x8a60d30f5727b97c lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.259641:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727b991 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfafe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.259647:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d26a400/0x8a60d30f571872f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfafc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b106b75 expref: 1377 pid: 16073 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.259647:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352d00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.259649:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136352d00/0x8a60d30f5727b97c lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.259651:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009b599880/2, rc 0, transno 1094338 00010000:00010000:2.0:1721880422.259654:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136352d00/0x8a60d30f5727b97c lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.259655:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011648256:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.259659:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914085 00010000:00010000:2.0:1721880422.259660:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136352d00/0x8a60d30f5727b97c lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.259663:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1377:2006:x1805522257686272:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.259664:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136352d00/0x8a60d30f5727b97c lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.259669:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.259672:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008777d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011652992:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.259673:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d26a400/0x8a60d30f571872f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfafc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b106b75 expref: 1377 pid: 16073 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.259681:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d26a400/0x8a60d30f571872f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfafc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b106b75 expref: 1377 pid: 16073 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.259691:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d26a400/0x8a60d30f571872f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfafc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b106b75 expref: 1377 pid: 16073 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.259700:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.259702:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.259704:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727b983 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfafc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.259711:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727b983 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfafc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.259720:0:16098:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b177b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0000-mdtlov_UUID+2694:3689:x1805522011648896:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2910us (2936us total) trans 4296061636 rc 0/0 00010000:00010000:1.0:1721880422.259721:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.259725:0:16098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631887 00000100:00100000:3.0:1721880422.259747:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.259753:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1376:2006:x1805522257686272:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 88us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.259756:0:16098:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011652992 00000100:00100000:1.0:1721880422.259758:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914085 00000100:00100000:0.0:1721880422.259760:0:16098:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011652992 00010000:00010000:1.0:1721880422.259771:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727b983 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfafc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.259774:0:16098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631903 00000100:00100000:2.0:1721880422.259777:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2694:3687:x1805522011649152:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2419us (2542us total) trans 4296061637 rc 0/0 00000100:00100000:0.0:1721880422.259779:0:16098:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008777d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0000-mdtlov_UUID+2694:3688:x1805522011652992:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.259779:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727b983 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfafc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.259784:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631891 00010000:00010000:1.0:1721880422.259791:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727b983 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfafc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1721880422.259795:0:16098:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58080 count 1 00010000:00010000:1.0:1721880422.259798:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727b983 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfafc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.259804:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727b983 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfafc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.259807:0:16098:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325e640/0x8a60d30f5727b9d0 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.259807:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1721880422.259809:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa9440 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.259812:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727b983 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfafc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.259815:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800966b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011652864:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.259818:0:16098:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880082c0ed00/0x8a60d30f571ec1bb lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a6e3 expref: 359 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.259819:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727b983 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfafc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.259824:0:16098:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.259826:0:16098:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.259827:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727b983 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfafc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.259828:0:16098:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325e640/0x8a60d30f5727b9d0 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.259832:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.259833:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727b983 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfafc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.259844:0:16098:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880082c0ed00/0x8a60d30f571ec1bb lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a6e3 expref: 359 pid: 16099 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.259846:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011652864 00000100:00100000:3.0:1721880422.259849:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011652864 00000004:00080000:2.0:1721880422.259851:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088dc3800/2, rc 0, transno 1094341 00010000:00010000:0.0:1721880422.259853:0:16098:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880082c0ed00/0x8a60d30f571ec1bb lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a6e3 expref: 359 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.259863:0:16098:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800919c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0000_UUID:16098:1805522011653120:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.259864:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011649152:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.259875:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631904 00000100:00100000:2.0:1721880422.259878:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008854dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2694:3686:x1805522011652864:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1721880422.259881:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1721880422.259885:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008777f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011653248:0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1721880422.259887:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58079 count 1 00010000:00010000:2.0:1721880422.259895:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727b9d7 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2df:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.259901:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.259903:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099da8000/0x8a60d30f571ec198 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a6c0 expref: 359 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.259907:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.259908:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.259909:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727b9d7 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.259910:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011653248 00000100:00100000:3.0:1721880422.259912:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011653248 00010000:00010000:2.0:1721880422.259920:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099da8000/0x8a60d30f571ec198 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a6c0 expref: 359 pid: 16126 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.259920:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631905 00000100:00100000:3.0:1721880422.259923:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ebd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2695:3688:x1805522011653248:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1721880422.259925:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099da8000/0x8a60d30f571ec198 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a6c0 expref: 359 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.259931:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008854d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:15466:1805522011653376:192.168.201.24@tcp:104: 00002000:00080000:3.0:1721880422.259932:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58081 count 1 00000100:00100000:1.0:1721880422.259937:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1883:3689:x1805522011649920:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2575us (2652us total) trans 4296019943 rc 0/0 00010000:00010000:3.0:1721880422.259940:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727b9de lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.259944:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631892 00000100:00100000:2.0:1721880422.259945:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdecc0 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.259948:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011f92e400/0x8a60d30f571ec1e5 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a70d expref: 359 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.259953:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.259954:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.259956:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727b9de lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.259959:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800966b1c00/2, rc 0, transno 1052647 00000100:00100000:0.0:1721880422.259960:0:16098:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec360c0 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.259964:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800966b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011649920:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.259966:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011f92e400/0x8a60d30f571ec1e5 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a70d expref: 359 pid: 16099 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.259972:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.259972:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011f92e400/0x8a60d30f571ec1e5 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a70d expref: 359 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.259978:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fde0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0000_UUID:16089:1805522011653504:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.259980:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1721880422.259984:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008854ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011653632:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.259989:0:16100:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009eb8ba80/0x8a60d30f571ec0e9 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a618 expref: 359 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.259992:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdeccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.259998:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.259999:0:16100:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800919c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_087:lustre-OST0000_UUID:16100:1805522011649792:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.260002:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.260010:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008777ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011651072:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.260024:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257686400 00000100:00100000:1.0:1721880422.260027:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257686400 00010000:00010000:0.0:1721880422.260028:0:16100:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325f3c0/0x8a60d30f5727b975 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.260032:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009b174a80/2, rc 0, transno 1094340 00010000:00010000:0.0:1721880422.260036:0:16100:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325f3c0/0x8a60d30f5727b975 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.260037:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008c660fc0/0x8a60d30f571877b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfafd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b106e15 expref: 1376 pid: 15466 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.260037:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b174a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011648896:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1721880422.260040:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727b998 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfaff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.260042:0:16100:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325f3c0/0x8a60d30f5727b975 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.260050:0:16100:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325f3c0/0x8a60d30f5727b975 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.260055:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1721880422.260056:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257686528 00010000:00010000:0.0:1721880422.260057:0:16100:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325f3c0/0x8a60d30f5727b975 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.260058:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257686528 00000100:00100000:2.0:1721880422.260058:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008854f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011653760:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.260063:0:16100:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325f3c0/0x8a60d30f5727b975 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.260063:0:15455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914086 00010000:00010000:1.0:1721880422.260064:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007b4ec000/0x8a60d30f57187d3a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfafe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1071f7 expref: 1377 pid: 16056 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.260068:0:16100:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325f3c0 already unused, calling callback (ffffffffa084e330) 00000100:00100000:3.0:1721880422.260068:0:15455:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+1377:2006:x1805522257686400:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.260070:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.260071:0:16100:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325f3c0/0x8a60d30f5727b975 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.260076:0:15455:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.260080:0:16100:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325f3c0/0x8a60d30f5727b975 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.260080:0:15455:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008c660fc0/0x8a60d30f571877b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfafd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b106e15 expref: 1377 pid: 15466 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.260083:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914087 00000100:00100000:1.0:1721880422.260088:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1377:2005:x1805522257686528:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.260090:0:16100:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325f3c0/0x8a60d30f5727b975 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.260090:0:15455:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008c660fc0/0x8a60d30f571877b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfafd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b106e15 expref: 1377 pid: 15466 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.260094:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.260098:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007b4ec000/0x8a60d30f57187d3a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfafe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1071f7 expref: 1377 pid: 16056 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.260102:0:16100:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325f3c0/0x8a60d30f5727b975 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.260103:0:15455:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c660fc0/0x8a60d30f571877b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfafd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b106e15 expref: 1377 pid: 15466 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.260106:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007b4ec000/0x8a60d30f57187d3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfafe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1071f7 expref: 1377 pid: 16056 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.260113:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.260114:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.260117:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007b4ec000/0x8a60d30f57187d3a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfafe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1071f7 expref: 1376 pid: 16056 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.260117:0:15455:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727b98a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfafd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.260124:0:15455:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727b98a lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfafd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.260127:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.260128:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1721880422.260129:0:16130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011653632 00010000:00010000:1.0:1721880422.260130:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727b991 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfafe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.260132:0:16130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011653632 00010000:00010000:3.0:1721880422.260138:0:15455:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.260142:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727b991 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfafe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.260146:0:16120:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727b98a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfafd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.260148:0:16130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011653760 00000100:00100000:0.0:1721880422.260150:0:16130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011653760 00010000:00010000:2.0:1721880422.260151:0:16120:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727b98a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfafd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.260154:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.260156:0:16120:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727b98a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfafd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.260156:0:15455:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+1375:2006:x1805522257686400:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 87us (184us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.260160:0:16120:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727b98a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfafd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.260162:0:16130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631906 00000100:00100000:3.0:1721880422.260162:0:15455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914086 00010000:00010000:2.0:1721880422.260163:0:16120:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727b98a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfafd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.260166:0:16120:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b61c0 already unused, calling callback (ffffffffa084e330) 00000100:00100000:0.0:1721880422.260167:0:16130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008854df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0000-mdtlov_UUID+1883:3687:x1805522011653632:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.260168:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1375:2005:x1805522257686528:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 79us (165us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.260168:0:16120:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727b98a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfafd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.260172:0:16120:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727b98a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfafd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.260173:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914087 00002000:00080000:0.0:1721880422.260178:0:16130:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64260 count 1 00010000:00010000:2.0:1721880422.260178:0:16120:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727b98a lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfafd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.260182:0:16120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727b98a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfafd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.260186:0:16110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631907 00010000:00010000:0.0:1721880422.260188:0:16130:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727b9e5 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb04:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.260191:0:16110:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008854f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_094:lustre-MDT0000-mdtlov_UUID+2696:3686:x1805522011653760:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.260199:0:16130:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0c661c0/0x8a60d30f57188d01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb04:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1075ee expref: 1373 pid: 16049 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.260204:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.260205:0:16130:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00002000:00080000:3.0:1721880422.260205:0:16110:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58082 count 1 00010000:00010000:0.0:1721880422.260206:0:16130:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.260208:0:16130:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727b9e5 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb04:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.260212:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257686656 00000100:00100000:1.0:1721880422.260214:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257686656 00010000:00010000:3.0:1721880422.260214:0:16110:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7a80/0x8a60d30f5727b9ec lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.260223:0:16130:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0c661c0/0x8a60d30f57188d01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb04:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1075ee expref: 1374 pid: 16049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.260223:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fe6a880/0x8a60d30f57187f01 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107267 expref: 1374 pid: 16084 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.260225:0:16110:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011f92d8c0/0x8a60d30f571ec20f lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a737 expref: 358 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.260232:0:16130:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0c661c0/0x8a60d30f57188d01 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb04:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1075ee expref: 1374 pid: 16049 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.260238:0:16110:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.260240:0:16110:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.260242:0:16110:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7a80/0x8a60d30f5727b9ec lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.260243:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914088 00000100:00100000:0.0:1721880422.260247:0:16130:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800919c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0001_UUID:16130:1805522011653888:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.260247:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1374:2004:x1805522257686656:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.260252:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.260256:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fe6a880/0x8a60d30f57187f01 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107267 expref: 1374 pid: 16084 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.260263:0:16130:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36e40 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.260265:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fe6a880/0x8a60d30f57187f01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107267 expref: 1374 pid: 16084 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.260266:0:16110:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011f92d8c0/0x8a60d30f571ec20f lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a737 expref: 358 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.260275:0:16110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011f92d8c0/0x8a60d30f571ec20f lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a737 expref: 358 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.260276:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fe6a880/0x8a60d30f57187f01 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfaff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107267 expref: 1374 pid: 16084 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.260278:0:16120:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+1884:3689:x1805522011650048:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2815us (2948us total) trans 4296019944 rc 0/0 00000100:00100000:2.0:1721880422.260283:0:16120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631893 00000100:00100000:3.0:1721880422.260285:0:16110:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008777ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_094:lustre-OST0000_UUID:16110:1805522011654016:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.260290:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.260291:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.260294:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727b998 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.260301:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727b998 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfaff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.260302:0:16110:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec300 going to sleep for 11 seconds 00000004:00080000:2.0:1721880422.260303:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800966b3100/2, rc 0, transno 1052648 00000100:00100000:2.0:1721880422.260306:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800966b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011650048:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.260314:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.260317:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727b991 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfafe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.260322:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1721880422.260325:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1373:2004:x1805522257686656:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 77us (121us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.260325:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727b991 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfafe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.260326:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008854c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011654144:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.260330:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914088 00010000:00010000:3.0:1721880422.260333:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727b991 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfafe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.260338:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727b991 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfafe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.260339:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.260342:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727b991 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfafe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.260346:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4240 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.260349:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727b991 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfafe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.260352:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727b991 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfafe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.260354:0:16113:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011654144 00000100:00100000:2.0:1721880422.260356:0:16113:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011654144 00010000:00010000:3.0:1721880422.260359:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727b991 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfafe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.260362:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727b991 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfafe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.260366:0:16113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631908 00000100:00100000:0.0:1721880422.260368:0:16100:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:lustre-MDT0000-mdtlov_UUID+2697:3686:x1805522011649536:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3218us (3256us total) trans 4296061638 rc 0/0 00000100:00100000:2.0:1721880422.260369:0:16113:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008854ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0000-mdtlov_UUID+1884:3689:x1805522011654144:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.260374:0:16100:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631890 00002000:00080000:2.0:1721880422.260376:0:16113:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64261 count 1 00010000:00010000:2.0:1721880422.260384:0:16113:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727b9f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb05:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.260391:0:16113:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a1de1c0/0x8a60d30f57188fc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1076c7 expref: 1372 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.260395:0:16113:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.260396:0:16113:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.260397:0:16113:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727b9f3 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.260404:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.260408:0:16113:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a1de1c0/0x8a60d30f57188fc4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1076c7 expref: 1372 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.260417:0:16113:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a1de1c0/0x8a60d30f57188fc4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1076c7 expref: 1372 pid: 16018 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.260422:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257686784 00000100:00100000:2.0:1721880422.260423:0:16113:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008854c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0001_UUID:16113:1805522011654272:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.260426:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257686784 00000100:00100000:1.0:1721880422.260429:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.260437:0:16113:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdee40 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.260439:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800971e86c0/0x8a60d30f571ec121 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe2dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a649 expref: 359 pid: 16099 timeout: 887 lvb_type: 0 00000004:00080000:2.0:1721880422.260453:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800966b0380/2, rc 0, transno 1052649 00000100:00100000:3.0:1721880422.260454:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+1885:3686:x1805522011650432:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2869us (2928us total) trans 4296019945 rc 0/0 00000100:00100000:0.0:1721880422.260456:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257686912 00000100:00100000:0.0:1721880422.260458:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257686912 00000100:00100000:2.0:1721880422.260458:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800966b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011650432:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.260459:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631894 00010000:00010000:0.0:1721880422.260467:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fe69f80/0x8a60d30f571880cf lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1072de expref: 1373 pid: 16024 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.260480:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914089 00000100:00100000:3.0:1721880422.260482:0:15514:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e9cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:15514:1805522011651968:192.168.201.24@tcp:104: 00000004:00080000:2.0:1721880422.260484:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800966b0e00/2, rc 0, transno 1094342 00000100:00100000:1.0:1721880422.260486:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.260487:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+359:2004:x1805522257686784:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.260487:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800966b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011649536:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1721880422.260492:0:15514:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727b9b4 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.260495:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.260499:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800971e86c0/0x8a60d30f571ec121 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe2dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a649 expref: 359 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.260505:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e9c8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011651840:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.260506:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.260507:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257687040 00010000:00010000:0.0:1721880422.260508:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800971e86c0/0x8a60d30f571ec121 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a649 expref: 359 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.260509:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257687040 00010000:00010000:3.0:1721880422.260511:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727b9ad lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.260515:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257687168 00000100:00100000:1.0:1721880422.260518:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257687168 00010000:00010000:2.0:1721880422.260518:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007298f180/0x8a60d30f57188361 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107394 expref: 1374 pid: 16049 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.260518:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727b998 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.260520:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.260522:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.260523:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727b998 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.260525:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098aa9680/0x8a60d30f5727b99f lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.260527:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a05efcc0/0x8a60d30f571ec14b lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a673 expref: 360 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.260528:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727b998 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfaff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.260532:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098aa9680/0x8a60d30f5727b99f lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.260533:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727b998 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfaff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.260537:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727b998 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.260539:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914090 00010000:00010000:3.0:1721880422.260540:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b58c0 already unused, calling callback (ffffffffa084e330) 00000100:00100000:2.0:1721880422.260542:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ab4d7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1374:2005:x1805522257686912:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.260542:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727b998 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfaff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.260543:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914091 00010000:00010000:0.0:1721880422.260544:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.260546:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727b998 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfaff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.260547:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.260548:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1374:2005:x1805522257687040:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.260551:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fe69f80/0x8a60d30f571880cf lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb00:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1072de expref: 1374 pid: 16024 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.260552:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727b998 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfaff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.260554:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.260556:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727b998 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfaff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.260557:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fe69f80/0x8a60d30f571880cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb00:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1072de expref: 1374 pid: 16024 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.260558:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007298f180/0x8a60d30f57188361 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb01:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107394 expref: 1374 pid: 16049 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.260563:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+360:2004:x1805522257686784:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 77us (158us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.260565:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.260566:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.260568:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727b9a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb00:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.260570:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914089 00010000:00010000:1.0:1721880422.260573:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007298f180/0x8a60d30f57188361 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb01:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107394 expref: 1374 pid: 16049 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.260573:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727b9a6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb00:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.260580:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.260583:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914092 00010000:00010000:1.0:1721880422.260584:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007298f180/0x8a60d30f57188361 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb01:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107394 expref: 1374 pid: 16049 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.260587:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+359:2005:x1805522257687168:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.260592:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.260592:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ab4d7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1373:2005:x1805522257686912:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 49us (163us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.260594:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.260594:0:7118:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.260596:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914090 00010000:00010000:1.0:1721880422.260597:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727b9ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.260597:0:7118:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a05efcc0/0x8a60d30f571ec14b lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a673 expref: 359 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.260603:0:7118:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a05efcc0/0x8a60d30f571ec14b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a673 expref: 359 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.260604:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727b9ad lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.260611:0:7118:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a05efcc0/0x8a60d30f571ec14b lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a673 expref: 359 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.260615:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.260618:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.260619:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.260621:0:7118:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727b9b4 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.260623:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1721880422.260625:0:7118:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727b9b4 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.260627:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011654528:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.260629:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1372:2005:x1805522257687040:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 80us (144us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.260634:0:7118:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.260635:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914091 00000100:00100000:2.0:1721880422.260641:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.260647:0:7118:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+358:2005:x1805522257687168:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 59us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.260651:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914092 00000100:00100000:2.0:1721880422.260657:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011654400:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.260660:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800971e86c0/0x8a60d30f571ec121 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a649 expref: 357 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.260663:0:15514:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727b9b4 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.260666:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.260667:0:15514:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727b9b4 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.260671:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801312d0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0000_UUID:16017:1805522011651200:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.260672:0:15514:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727b9b4 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.260674:0:16120:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011654528 00000100:00100000:2.0:1721880422.260676:0:16120:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011654528 00010000:00010000:3.0:1721880422.260677:0:15514:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727b9b4 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.260680:0:15514:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727b9b4 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.260683:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880098aa9680/0x8a60d30f5727b99f lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.260683:0:15514:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4fc0 already unused, calling callback (ffffffffa084e330) 00000100:00100000:2.0:1721880422.260685:0:16120:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011654400 00010000:00010000:3.0:1721880422.260685:0:15514:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727b9b4 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.260686:0:16120:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011654400 00010000:00010000:3.0:1721880422.260688:0:15514:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727b9b4 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.260693:0:15514:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727b9b4 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.260694:0:16120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631909 00010000:00010000:1.0:1721880422.260695:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098aa9680/0x8a60d30f5727b99f lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.260696:0:16120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088effb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+2697:3687:x1805522011654528:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1721880422.260696:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727b9b4 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.260698:0:16040:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631910 00010000:00010000:1.0:1721880422.260701:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098aa9680/0x8a60d30f5727b99f lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.260703:0:16040:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088efc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:lustre-MDT0000-mdtlov_UUID+1885:3689:x1805522011654400:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.260704:0:16120:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58083 count 1 00010000:00010000:1.0:1721880422.260708:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098aa9680/0x8a60d30f5727b99f lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.260711:0:16120:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136353180/0x8a60d30f5727b9fa lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.260714:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098aa9680/0x8a60d30f5727b99f lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1721880422.260715:0:16040:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64262 count 1 00010000:00010000:2.0:1721880422.260718:0:16120:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880123983a80/0x8a60d30f571ec232 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a753 expref: 356 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.260721:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098aa9680/0x8a60d30f5727b99f lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.260725:0:16040:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727ba01 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb06:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.260741:0:16120:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.260742:0:16120:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.260743:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa9680 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.260743:0:16120:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136353180/0x8a60d30f5727b9fa lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.260746:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098aa9680/0x8a60d30f5727b99f lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.260752:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098aa9680/0x8a60d30f5727b99f lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.260755:0:16120:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880123983a80/0x8a60d30f571ec232 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a753 expref: 356 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.260759:0:16040:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095b30480/0x8a60d30f5718923a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb06:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107737 expref: 1371 pid: 16058 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.260761:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098aa9680/0x8a60d30f5727b99f lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.260761:0:16120:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880123983a80/0x8a60d30f571ec232 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a753 expref: 356 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.260764:0:16040:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.260766:0:16040:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.260767:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098aa9680/0x8a60d30f5727b99f lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.260767:0:16120:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088efe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16120:1805522011654656:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.260768:0:16040:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727ba01 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb06:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.260778:0:16120:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde840 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.260801:0:15514:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880096c9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+2698:3686:x1805522011651712:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2447us (2562us total) trans 4296061639 rc 0/0 00000100:00100000:3.0:1721880422.260804:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631899 00000004:00080000:2.0:1721880422.260815:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009d7a3480/2, rc 0, transno 1094343 00010000:00010000:3.0:1721880422.260819:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727b9ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.260820:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d7a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011651712:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1721880422.260823:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727b9ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.260828:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727b9ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.260831:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727b9ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.260835:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011654784:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1721880422.260835:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727b9ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.260838:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b6640 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.260839:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727b9ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.260843:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727b9ad lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.260848:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.260848:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727b9ad lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.260853:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727b9ad lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.260916:0:16100:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011654784 00000100:00100000:0.0:1721880422.260920:0:16100:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011654784 00000100:00100000:3.0:1721880422.260927:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d7a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+1886:3687:x1805522011651456:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2705us (2751us total) trans 4296019946 rc 0/0 00000100:00100000:3.0:1721880422.260932:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631898 00000100:00100000:0.0:1721880422.260940:0:16100:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631911 00000100:00100000:0.0:1721880422.260946:0:16100:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088efd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:lustre-MDT0000-mdtlov_UUID+2699:3687:x1805522011654784:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.260950:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d7a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2699:3686:x1805522011650816:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2980us (3123us total) trans 4296061640 rc 0/0 00000100:00100000:1.0:1721880422.260957:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631896 00002000:00080000:0.0:1721880422.260959:0:16100:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58084 count 1 00000004:00080000:2.0:1721880422.260961:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800966b0a80/2, rc 0, transno 1094344 00000100:00100000:2.0:1721880422.260965:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800966b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011650816:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.260970:0:16100:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727ba08 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.260980:0:16100:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ef1cd80/0x8a60d30f571ec25c lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a77d expref: 356 pid: 16099 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.260983:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1721880422.260987:0:16100:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.260987:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fe69f80/0x8a60d30f571880cf lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1072de expref: 1371 pid: 16024 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.260987:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011654912:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.260989:0:16100:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.260991:0:16100:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727ba08 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.260998:0:9458:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801312d0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011651584:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.261002:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d7a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+1886:3688:x1805522011650944:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3167us (3221us total) trans 4296019947 rc 0/0 00000100:00100000:2.0:1721880422.261003:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.261006:0:16100:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ef1cd80/0x8a60d30f571ec25c lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a77d expref: 356 pid: 16099 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.261006:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631895 00010000:00010000:1.0:1721880422.261007:0:9458:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727b9a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.261030:0:9458:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727b9a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.261032:0:16100:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ef1cd80/0x8a60d30f571ec25c lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a77d expref: 356 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.261032:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011654912 00000100:00100000:3.0:1721880422.261036:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011654912 00010000:00010000:1.0:1721880422.261037:0:9458:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727b9a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.261042:0:16100:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800919c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_087:lustre-OST0000_UUID:16100:1805522011655040:192.168.201.24@tcp:104: 00000004:00080000:2.0:1721880422.261043:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009d7a3100/2, rc 0, transno 1052650 00010000:00010000:1.0:1721880422.261044:0:9458:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727b9a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.261049:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d7a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011651456:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.261050:0:9458:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727b9a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.261050:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631912 00000100:00100000:3.0:1721880422.261052:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088efd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2699:3689:x1805522011654912:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.261056:0:9458:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727b9a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.261059:0:16100:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36240 going to sleep for 11 seconds 00002000:00080000:3.0:1721880422.261061:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58085 count 1 00010000:00010000:1.0:1721880422.261067:0:9458:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8b40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.261068:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5b00/0x8a60d30f5727ba0f lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2e5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.261070:0:9458:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727b9a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.261072:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088efce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011655168:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.261075:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007b9edf80/0x8a60d30f571ec286 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a7a7 expref: 356 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.261077:0:9458:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727b9a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.261079:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.261080:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.261082:0:16040:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095b30480/0x8a60d30f5718923a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb06:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107737 expref: 1370 pid: 16058 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.261082:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5b00/0x8a60d30f5727ba0f lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.261083:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.261086:0:9458:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727b9a6 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.261091:0:16040:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095b30480/0x8a60d30f5718923a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb06:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107737 expref: 1370 pid: 16058 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.261092:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007b9edf80/0x8a60d30f571ec286 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a7a7 expref: 356 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.261093:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727b9a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.261097:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007b9edf80/0x8a60d30f571ec286 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a7a7 expref: 356 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.261101:0:16040:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800919c3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_040:lustre-OST0001_UUID:16040:1805522011655296:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.261104:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e9c8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0000_UUID:16075:1805522011655424:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.261117:0:16040:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36540 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.261120:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.261130:0:15514:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011655168 00000100:00100000:0.0:1721880422.261133:0:15514:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011655168 00000004:00080000:3.0:1721880422.261138:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009d7a0000/2, rc 0, transno 1052651 00000100:00100000:3.0:1721880422.261143:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d7a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011650944:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.261149:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631913 00000100:00100000:0.0:1721880422.261152:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088efe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+1887:3689:x1805522011655168:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.261160:0:15514:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64263 count 1 00000100:00100000:2.0:1721880422.261162:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1721880422.261166:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011655552:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.261168:0:15514:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727ba16 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb07:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.261176:0:15514:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bc60fc0/0x8a60d30f57189512 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1077ed expref: 1370 pid: 16114 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.261180:0:15514:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.261181:0:15514:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.261181:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.261183:0:15514:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727ba16 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.261184:0:9458:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d7a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1887:3689:x1805522011651328:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3017us (3052us total) trans 4296019948 rc 0/0 00000004:00080000:3.0:1721880422.261186:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009d7a1c00/2, rc 0, transno 1052652 00000100:00100000:1.0:1721880422.261190:0:9458:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631897 00000100:00100000:3.0:1721880422.261192:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d7a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011651328:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.261193:0:15514:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bc60fc0/0x8a60d30f57189512 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1077ed expref: 1370 pid: 16114 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.261193:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011655552 00000100:00100000:2.0:1721880422.261195:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011655552 00010000:00010000:0.0:1721880422.261198:0:15514:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bc60fc0/0x8a60d30f57189512 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1077ed expref: 1370 pid: 16114 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.261204:0:15514:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800919c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:15514:1805522011655680:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.261207:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631914 00000100:00100000:2.0:1721880422.261210:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088eff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+1887:3687:x1805522011655552:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.261214:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1721880422.261216:0:15514:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36d80 going to sleep for 11 seconds 00002000:00080000:2.0:1721880422.261218:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64264 count 1 00000100:00100000:3.0:1721880422.261220:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e9cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011655808:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.261225:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727ba1d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb08:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.261233:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8f1d40/0x8a60d30f571897b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb08:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1078a3 expref: 1370 pid: 16019 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.261234:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.261237:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.261238:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.261239:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727ba1d lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb08:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.261245:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011655808 00000100:00100000:3.0:1721880422.261247:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011655808 00010000:00010000:2.0:1721880422.261252:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d8f1d40/0x8a60d30f571897b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb08:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1078a3 expref: 1370 pid: 16019 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.261259:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631915 00010000:00010000:2.0:1721880422.261260:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d8f1d40/0x8a60d30f571897b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb08:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1078a3 expref: 1370 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.261262:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f52d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1888:3686:x1805522011655808:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.261269:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64265 count 1 00000100:00100000:2.0:1721880422.261275:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088efea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011655936:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.261276:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727ba24 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb09:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.261283:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801356b61c0/0x8a60d30f57189e81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107960 expref: 1370 pid: 16076 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.261287:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.261288:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.261289:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727ba24 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.261291:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdea80 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.261298:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801356b61c0/0x8a60d30f57189e81 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107960 expref: 1370 pid: 16076 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.261306:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801356b61c0/0x8a60d30f57189e81 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107960 expref: 1370 pid: 16076 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.261312:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009f52f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011656064:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.261322:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec180 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.261342:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d7a0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:15453:1805522011652224:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.261350:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.261355:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136350d80/0x8a60d30f5727b9bb lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.261359:0:7118:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257687296 00000100:00100000:3.0:1721880422.261361:0:7118:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257687296 00010000:00010000:3.0:1721880422.261369:0:7118:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d8cb40/0x8a60d30f571ec175 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a69d expref: 357 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.261387:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914093 00000100:00100000:3.0:1721880422.261389:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+357:2004:x1805522257687296:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.261394:0:7118:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.261396:0:7118:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096d8cb40/0x8a60d30f571ec175 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a69d expref: 357 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.261401:0:7118:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096d8cb40/0x8a60d30f571ec175 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a69d expref: 357 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.261409:0:7118:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d8cb40/0x8a60d30f571ec175 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a69d expref: 357 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.261415:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.261415:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.261418:0:7118:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136350d80/0x8a60d30f5727b9bb lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.261422:0:7118:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136350d80/0x8a60d30f5727b9bb lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.261431:0:7118:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.261436:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136350d80/0x8a60d30f5727b9bb lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.261441:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136350d80/0x8a60d30f5727b9bb lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.261441:0:7118:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+356:2004:x1805522257687296:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 52us (93us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.261445:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914093 00010000:00010000:2.0:1721880422.261446:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136350d80/0x8a60d30f5727b9bb lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.261450:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136350d80/0x8a60d30f5727b9bb lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.261453:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136350d80/0x8a60d30f5727b9bb lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.261456:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350d80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.261458:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136350d80/0x8a60d30f5727b9bb lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.261465:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136350d80/0x8a60d30f5727b9bb lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.261472:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136350d80/0x8a60d30f5727b9bb lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.261476:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136350d80/0x8a60d30f5727b9bb lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.261569:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d7a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2700:3689:x1805522011652096:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2337us (2606us total) trans 4296061641 rc 0/0 00000100:00100000:2.0:1721880422.261574:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631900 00000004:00080000:3.0:1721880422.261580:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009d7a1500/2, rc 0, transno 1094345 00000100:00100000:3.0:1721880422.261596:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d7a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011652096:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1721880422.261634:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800919c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011656192:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1721880422.261656:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.261668:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011656192 00000100:00100000:2.0:1721880422.261671:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011656192 00000100:00100000:2.0:1721880422.261681:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631916 00000100:00100000:2.0:1721880422.261684:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f52ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2700:3688:x1805522011656192:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1721880422.261692:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58086 count 1 00010000:00010000:2.0:1721880422.261699:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136350240/0x8a60d30f5727ba2b lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.261706:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007b9eef40/0x8a60d30f571ec2a9 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a7ca expref: 355 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.261710:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.261711:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.261713:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136350240/0x8a60d30f5727ba2b lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.261725:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007b9eef40/0x8a60d30f571ec2a9 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a7ca expref: 355 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.261749:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007b9eef40/0x8a60d30f571ec2a9 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a7ca expref: 355 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.261755:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135170000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:15453:1805522011656320:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.261784:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.262318:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800966b3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011652608:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.262329:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727b9c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.262340:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008854d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:15466:1805522011653376:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.262345:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fde0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0000_UUID:16089:1805522011653504:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.262353:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727b9de lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.262355:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727b9d7 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.262361:0:16098:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800919c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0000_UUID:16098:1805522011653120:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.262374:0:16130:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800919c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0001_UUID:16130:1805522011653888:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.262376:0:16088:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008854c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011652736:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.262379:0:16098:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325e640/0x8a60d30f5727b9d0 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.262385:0:16130:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727b9e5 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb04:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.262386:0:16088:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727b9c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.262761:0:16110:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008777ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_094:lustre-OST0000_UUID:16110:1805522011654016:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.262776:0:16110:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7a80/0x8a60d30f5727b9ec lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.263032:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.263061:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.263080:0:7118:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257687552 00000100:00100000:3.0:1721880422.263083:0:7118:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257687552 00010000:00010000:3.0:1721880422.263095:0:7118:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880082e4d200/0x8a60d30f571886a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107458 expref: 1371 pid: 16107 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.263098:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.263113:0:7118:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257687808 00000100:00100000:3.0:1721880422.263114:0:7118:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257687808 00000100:00100000:1.0:1721880422.263118:0:16188:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257688064 00000100:00100000:0.0:1721880422.263119:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.263120:0:7118:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082c0ed00/0x8a60d30f571ec1bb lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a6e3 expref: 356 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.263123:0:16188:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257688064 00000100:00100000:2.0:1721880422.263123:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914094 00000100:00100000:2.0:1721880422.263128:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1372:2005:x1805522257687552:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.263131:0:7118:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257687424 00000100:00100000:3.0:1721880422.263133:0:7118:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257687424 00000100:00100000:0.0:1721880422.263134:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.263135:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.263138:0:16188:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0c661c0/0x8a60d30f57188d01 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb04:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1075ee expref: 1372 pid: 16049 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.263139:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082e4d200/0x8a60d30f571886a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb02:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107458 expref: 1372 pid: 16107 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.263139:0:7118:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099da8000/0x8a60d30f571ec198 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a6c0 expref: 357 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.263146:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082e4d200/0x8a60d30f571886a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb02:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107458 expref: 1372 pid: 16107 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.263148:0:7118:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257687680 00000100:00100000:3.0:1721880422.263149:0:7118:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257687680 00000100:00100000:0.0:1721880422.263154:0:15455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914095 00010000:00010000:3.0:1721880422.263155:0:7118:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800911446c0/0x8a60d30f57188996 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107523 expref: 1373 pid: 16059 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.263156:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082e4d200/0x8a60d30f571886a2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb02:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107458 expref: 1373 pid: 16107 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.263161:0:15455:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+357:2005:x1805522257687808:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.263165:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.263167:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.263169:0:15455:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.263169:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727b9c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.263173:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727b9c9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.263173:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914096 00010000:00010000:0.0:1721880422.263175:0:15455:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082c0ed00/0x8a60d30f571ec1bb lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a6e3 expref: 357 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.263177:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ab4d6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+357:2005:x1805522257687424:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.263178:0:16188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914097 00000100:00100000:1.0:1721880422.263183:0:16188:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+1372:2005:x1805522257688064:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.263183:0:7118:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.263184:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.263186:0:15455:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082c0ed00/0x8a60d30f571ec1bb lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a6e3 expref: 357 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.263186:0:7118:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099da8000/0x8a60d30f571ec198 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a6c0 expref: 357 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.263192:0:16188:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.263195:0:7118:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099da8000/0x8a60d30f571ec198 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a6c0 expref: 357 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.263196:0:16188:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0c661c0/0x8a60d30f57188d01 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb04:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1075ee expref: 1372 pid: 16049 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.263199:0:15455:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082c0ed00/0x8a60d30f571ec1bb lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a6e3 expref: 357 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.263200:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1372:2005:x1805522257687552:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 72us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.263204:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914094 00010000:00010000:3.0:1721880422.263205:0:7118:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099da8000/0x8a60d30f571ec198 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a6c0 expref: 357 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.263207:0:16188:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0c661c0/0x8a60d30f57188d01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb04:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1075ee expref: 1372 pid: 16049 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.263210:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.263212:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.263214:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.263215:0:15455:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009325e640/0x8a60d30f5727b9d0 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.263215:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.263216:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914098 00010000:00010000:3.0:1721880422.263217:0:7118:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727b9d7 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.263219:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1371:2005:x1805522257687680:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.263220:0:16188:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0c661c0/0x8a60d30f57188d01 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb04:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1075ee expref: 1371 pid: 16049 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.263222:0:7118:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727b9d7 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.263223:0:15455:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325e640/0x8a60d30f5727b9d0 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.263230:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.263231:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.263232:0:7118:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.263233:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.263234:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800911446c0/0x8a60d30f57188996 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb03:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107523 expref: 1370 pid: 16059 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.263236:0:16188:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727b9e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb04:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.263241:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800911446c0/0x8a60d30f57188996 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb03:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107523 expref: 1370 pid: 16059 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.263243:0:15455:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.263243:0:16188:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727b9e5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb04:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.263248:0:7118:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ab4d6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+355:2005:x1805522257687424:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 71us (129us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.263250:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800911446c0/0x8a60d30f57188996 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb03:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107523 expref: 1370 pid: 16059 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.263252:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914096 00010000:00010000:1.0:1721880422.263260:0:16188:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.263260:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1721880422.263261:0:15455:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+354:2005:x1805522257687808:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 100us (199us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.263261:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.263263:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727b9c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.263267:0:15455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914095 00010000:00010000:2.0:1721880422.263267:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727b9c2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.263276:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.263278:0:16188:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+1369:2005:x1805522257688064:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 94us (180us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.263284:0:16088:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727b9c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.263285:0:16188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914097 00000100:00100000:2.0:1721880422.263288:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1369:2005:x1805522257687680:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 68us (154us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.263289:0:16130:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727b9e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.263289:0:16088:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727b9c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.263292:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914098 00010000:00010000:3.0:1721880422.263293:0:16088:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727b9c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.263297:0:16130:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727b9e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.263300:0:16088:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727b9c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.263304:0:16130:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727b9e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.263305:0:16088:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727b9c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.263308:0:16088:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350000 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.263310:0:16088:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727b9c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.263311:0:16130:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727b9e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.263311:0:16113:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008854c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0001_UUID:16113:1805522011654272:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.263313:0:16088:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727b9c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.263317:0:16130:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727b9e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.263318:0:16113:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727b9f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.263319:0:16088:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727b9c2 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.263323:0:16130:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325cd80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.263323:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727b9c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.263326:0:16130:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727b9e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.263327:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727b9d7 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.263332:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727b9d7 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.263333:0:16130:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727b9e5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.263334:0:16098:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325e640/0x8a60d30f5727b9d0 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.263336:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727b9d7 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.263340:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727b9d7 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.263341:0:16098:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325e640/0x8a60d30f5727b9d0 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.263345:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727b9d7 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.263348:0:16130:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727b9e5 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.263348:0:16098:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325e640/0x8a60d30f5727b9d0 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.263349:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352880 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.263350:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727b9d7 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.263354:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727b9d7 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.263355:0:16130:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727b9e5 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.263355:0:16098:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325e640/0x8a60d30f5727b9d0 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.263360:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727b9d7 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.263361:0:16098:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325e640/0x8a60d30f5727b9d0 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.263363:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727b9d7 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.263367:0:16098:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325e640 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.263370:0:16098:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325e640/0x8a60d30f5727b9d0 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.263376:0:16098:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325e640/0x8a60d30f5727b9d0 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.263385:0:16098:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325e640/0x8a60d30f5727b9d0 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.263392:0:16098:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325e640/0x8a60d30f5727b9d0 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.263428:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d7a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+1890:3687:x1805522011652480:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3935us (4017us total) trans 4296019949 rc 0/0 00000100:00100000:3.0:1721880422.263433:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631901 00000100:00100000:2.0:1721880422.263450:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008854dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2702:3686:x1805522011652864:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3571us (3617us total) trans 4296061642 rc 0/0 00000100:00100000:2.0:1721880422.263455:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631904 00000004:00080000:3.0:1721880422.263459:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800966b1f80/2, rc 0, transno 1094346 00000100:00100000:3.0:1721880422.263465:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800966b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011652864:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1721880422.263469:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727b9c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.263474:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727b9c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.263478:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727b9c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.263480:0:16130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008854df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0000-mdtlov_UUID+1889:3687:x1805522011653632:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3311us (3479us total) trans 4296019950 rc 0/0 00010000:00010000:2.0:1721880422.263483:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727b9c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.263486:0:16130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631906 00010000:00010000:2.0:1721880422.263488:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727b9c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.263491:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b73c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.263492:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727b9c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.263492:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1721880422.263496:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727b9c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.263497:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fde0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011656448:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1721880422.263501:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727b9c9 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.263505:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727b9c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.263515:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.263521:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.263537:0:16098:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008777d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0000-mdtlov_UUID+2701:3688:x1805522011652992:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3743us (3796us total) trans 4296061643 rc 0/0 00000100:00100000:0.0:1721880422.263543:0:16130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011656448 00000004:00080000:3.0:1721880422.263544:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008777d180/2, rc 0, transno 1094347 00000100:00100000:0.0:1721880422.263547:0:16130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011656448 00000100:00100000:1.0:1721880422.263548:0:16098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631903 00000100:00100000:3.0:1721880422.263551:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008777d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011652992:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.263564:0:16130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631917 00000100:00100000:0.0:1721880422.263569:0:16130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a052d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0000-mdtlov_UUID+2701:3688:x1805522011656448:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1721880422.263576:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a052dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011656576:0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1721880422.263580:0:16130:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58087 count 1 00000100:00100000:2.0:1721880422.263586:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b176a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+1889:3689:x1805522011652352:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4081us (4140us total) trans 4296019951 rc 0/0 00000100:00100000:2.0:1721880422.263590:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631902 00010000:00010000:0.0:1721880422.263591:0:16130:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325d8c0/0x8a60d30f5727ba32 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.263595:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.263602:0:16130:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fc06ac0/0x8a60d30f571ec2da lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a7fb expref: 353 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.263608:0:16130:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.263609:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011656576 00010000:00010000:0.0:1721880422.263610:0:16130:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.263611:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011656576 00010000:00010000:0.0:1721880422.263612:0:16130:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325d8c0/0x8a60d30f5727ba32 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.263623:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631918 00000100:00100000:2.0:1721880422.263626:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2702:3686:x1805522011656576:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.263627:0:16130:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fc06ac0/0x8a60d30f571ec2da lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a7fb expref: 353 pid: 16126 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.263634:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58088 count 1 00010000:00010000:0.0:1721880422.263636:0:16130:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fc06ac0/0x8a60d30f571ec2da lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a7fb expref: 353 pid: 16126 timeout: 887 lvb_type: 0 00000004:00080000:3.0:1721880422.263640:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008854ce00/2, rc 0, transno 1052654 00010000:00010000:2.0:1721880422.263642:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801363533c0/0x8a60d30f5727ba39 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.263645:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008854ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011653632:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.263646:0:16130:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800919c3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0000_UUID:16130:1805522011656704:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.263650:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130970b40/0x8a60d30f571ec2fd lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a81e expref: 353 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.263654:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.263656:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.263657:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801363533c0/0x8a60d30f5727ba39 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.263662:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1721880422.263664:0:16130:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36e40 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.263666:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008c409880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011656832:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.263668:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130970b40/0x8a60d30f571ec2fd lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a81e expref: 353 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.263673:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130970b40/0x8a60d30f571ec2fd lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a81e expref: 353 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.263674:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257687936 00000100:00100000:0.0:1721880422.263676:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257687936 00000100:00100000:2.0:1721880422.263679:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135171f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0000_UUID:16028:1805522011656960:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.263685:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011f92e400/0x8a60d30f571ec1e5 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a70d expref: 354 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.263694:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdee40 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.263696:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.263705:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914099 00000100:00100000:2.0:1721880422.263705:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011656832 00000100:00100000:2.0:1721880422.263707:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011656832 00000100:00100000:0.0:1721880422.263708:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+354:2005:x1805522257687936:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.263713:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.263715:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011f92e400/0x8a60d30f571ec1e5 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a70d expref: 354 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.263720:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631919 00010000:00010000:0.0:1721880422.263721:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011f92e400/0x8a60d30f571ec1e5 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a70d expref: 354 pid: 16099 timeout: 887 lvb_type: 0 00000004:00080000:3.0:1721880422.263722:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009d7a1880/2, rc 0, transno 1052653 00000100:00100000:2.0:1721880422.263723:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c40b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1889:3686:x1805522011656832:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.263746:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64266 count 1 00000100:00100000:3.0:1721880422.263750:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d7a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011652480:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.263754:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727ba40 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb0a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.263756:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011f92e400/0x8a60d30f571ec1e5 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a70d expref: 354 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.263764:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b580b40/0x8a60d30f5718a573 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb0a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107a1d expref: 1367 pid: 16080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.263765:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.263766:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.263768:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727b9de lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.263769:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.263770:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.263772:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727ba40 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb0a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.263773:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727b9de lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.263780:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008c409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011657088:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.263781:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b580b40/0x8a60d30f5718a573 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb0a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107a1d expref: 1367 pid: 16080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.263785:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.263786:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b580b40/0x8a60d30f5718a573 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb0a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107a1d expref: 1367 pid: 16080 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.263792:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135170a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011657216:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.263802:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+353:2005:x1805522257687936:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 92us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.263808:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914099 00000100:00100000:2.0:1721880422.263809:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfded80 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.263811:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1721880422.263826:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009d7a1f80/2, rc 0, transno 1052655 00000100:00100000:1.0:1721880422.263827:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.263829:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727b9de lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.263832:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d7a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011652352:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.263834:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011657088 00010000:00010000:0.0:1721880422.263837:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727b9de lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.263837:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011657088 00010000:00010000:0.0:1721880422.263844:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727b9de lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.263851:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727b9de lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.263855:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135173800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011657344:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.263855:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631920 00010000:00010000:0.0:1721880422.263857:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727b9de lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.263859:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c40aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+1890:3688:x1805522011657088:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.263864:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b7cc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.263866:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727b9de lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.263873:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64267 count 1 00010000:00010000:0.0:1721880422.263878:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727b9de lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.263882:0:16120:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088efe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16120:1805522011654656:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.263883:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727ba47 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb0b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.263888:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727b9de lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.263891:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099c233c0/0x8a60d30f5718a86e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107aa9 expref: 1367 pid: 16073 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.263893:0:16120:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136353180/0x8a60d30f5727b9fa lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.263894:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727b9de lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.263899:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.263900:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.263901:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727ba47 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.263912:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.263915:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099c233c0/0x8a60d30f5718a86e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107aa9 expref: 1367 pid: 16073 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.263924:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099c233c0/0x8a60d30f5718a86e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107aa9 expref: 1367 pid: 16073 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.263933:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880092318e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011657472:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.263954:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec300 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.263961:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e9c8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0000_UUID:16075:1805522011655424:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.263970:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5b00/0x8a60d30f5727ba0f lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.263974:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011657344 00000100:00100000:3.0:1721880422.263976:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011657344 00000100:00100000:1.0:1721880422.263980:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.263993:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631921 00000100:00100000:1.0:1721880422.263995:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257688192 00000100:00100000:1.0:1721880422.263998:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257688192 00000100:00100000:3.0:1721880422.263998:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+1891:3689:x1805522011657344:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.264009:0:16088:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64268 count 1 00010000:00010000:1.0:1721880422.264010:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011f92d8c0/0x8a60d30f571ec20f lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a737 expref: 353 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.264038:0:16088:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727ba4e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb0c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.264042:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ebd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2703:3688:x1805522011653248:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4116us (4138us total) trans 4296061644 rc 0/0 00000100:00100000:1.0:1721880422.264042:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257688576 00000100:00100000:1.0:1721880422.264044:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257688576 00000004:00080000:2.0:1721880422.264045:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008777f800/2, rc 0, transno 1094348 00010000:00010000:3.0:1721880422.264047:0:16088:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008cf2c6c0/0x8a60d30f5718abd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb0c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107b51 expref: 1367 pid: 16019 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.264049:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631905 00010000:00010000:1.0:1721880422.264053:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880123983a80/0x8a60d30f571ec232 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a753 expref: 354 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.264055:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008777f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011653248:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1721880422.264056:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.264057:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.264060:0:16088:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727ba4e lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb0c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.264067:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914100 00000100:00100000:1.0:1721880422.264072:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+354:2005:x1805522257688192:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.264077:0:16100:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800919c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_087:lustre-OST0000_UUID:16100:1805522011655040:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.264079:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.264084:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011f92d8c0/0x8a60d30f571ec20f lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a737 expref: 354 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.264089:0:16100:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727ba08 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.264093:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011f92d8c0/0x8a60d30f571ec20f lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a737 expref: 354 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.264095:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880092319c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011657600:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.264105:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011f92d8c0/0x8a60d30f571ec20f lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a737 expref: 354 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.264106:0:16088:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008cf2c6c0/0x8a60d30f5718abd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb0c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107b51 expref: 1367 pid: 16019 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.264111:0:16040:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800919c3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_040:lustre-OST0001_UUID:16040:1805522011655296:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.264111:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.264114:0:16088:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008cf2c6c0/0x8a60d30f5718abd9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb0c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107b51 expref: 1367 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.264117:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.264120:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.264120:0:16088:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009231b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011657728:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.264121:0:16040:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727ba01 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb06:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.264122:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7a80/0x8a60d30f5727b9ec lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.264127:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011657600 00010000:00010000:1.0:1721880422.264129:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7a80/0x8a60d30f5727b9ec lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.264129:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011657600 00000100:00100000:3.0:1721880422.264136:0:16088:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdeccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.264140:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631922 00000100:00100000:2.0:1721880422.264142:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2703:3686:x1805522011657600:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.264150:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00002000:00080000:2.0:1721880422.264150:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58089 count 1 00010000:00010000:1.0:1721880422.264153:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.264155:0:16110:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7a80/0x8a60d30f5727b9ec lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.264157:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727ba55 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2e9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.264160:0:16110:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7a80/0x8a60d30f5727b9ec lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.264165:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130970480/0x8a60d30f571ec327 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a848 expref: 353 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.264165:0:16110:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7a80/0x8a60d30f5727b9ec lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.264168:0:16110:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7a80/0x8a60d30f5727b9ec lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.264169:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.264170:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.264172:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727ba55 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.264172:0:16110:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7a80/0x8a60d30f5727b9ec lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.264174:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+353:2005:x1805522257688192:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 100us (347us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.264175:0:16110:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b7a80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.264177:0:16110:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7a80/0x8a60d30f5727b9ec lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.264181:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.264181:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914100 00010000:00010000:2.0:1721880422.264181:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130970480/0x8a60d30f571ec327 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a848 expref: 353 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.264182:0:16110:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7a80/0x8a60d30f5727b9ec lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.264188:0:16110:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7a80/0x8a60d30f5727b9ec lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.264192:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130970480/0x8a60d30f571ec327 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a848 expref: 352 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.264192:0:16110:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7a80/0x8a60d30f5727b9ec lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.264198:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257688448 00000100:00100000:2.0:1721880422.264198:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088efe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0000_UUID:16089:1805522011657856:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.264201:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257688448 00000100:00100000:2.0:1721880422.264205:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257688320 00000100:00100000:2.0:1721880422.264207:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257688320 00000100:00100000:0.0:1721880422.264208:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.264212:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ef1cd80/0x8a60d30f571ec25c lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a77d expref: 353 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.264215:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a1de1c0/0x8a60d30f57188fc4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1076c7 expref: 1368 pid: 16018 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.264218:0:15455:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257688704 00000100:00100000:0.0:1721880422.264221:0:15455:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257688704 00000100:00100000:1.0:1721880422.264231:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914101 00010000:00010000:0.0:1721880422.264233:0:15455:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095b30480/0x8a60d30f5718923a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb06:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107737 expref: 1369 pid: 16058 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.264235:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+353:2007:x1805522257688576:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.264239:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914102 00010000:00010000:1.0:1721880422.264242:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.264243:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+353:2004:x1805522257688448:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.264246:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880123983a80/0x8a60d30f571ec232 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a753 expref: 353 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.264248:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.264249:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914103 00010000:00010000:2.0:1721880422.264251:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ef1cd80/0x8a60d30f571ec25c lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a77d expref: 353 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.264255:0:15455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914104 00010000:00010000:1.0:1721880422.264255:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880123983a80/0x8a60d30f571ec232 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a753 expref: 353 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.264256:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1369:2004:x1805522257688320:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.264258:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ef1cd80/0x8a60d30f571ec25c lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a77d expref: 353 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.264260:0:15455:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a70edc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+1369:2004:x1805522257688704:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.264264:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.264267:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880123983a80/0x8a60d30f571ec232 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a753 expref: 353 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.264267:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ef1cd80/0x8a60d30f571ec25c lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a77d expref: 353 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.264268:0:15455:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.264270:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a1de1c0/0x8a60d30f57188fc4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb05:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1076c7 expref: 1369 pid: 16018 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.264272:0:15455:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095b30480/0x8a60d30f5718923a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb06:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107737 expref: 1369 pid: 16058 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.264275:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.264277:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.264278:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727ba08 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.264279:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a1de1c0/0x8a60d30f57188fc4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb05:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1076c7 expref: 1369 pid: 16018 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.264281:0:15455:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095b30480/0x8a60d30f5718923a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb06:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107737 expref: 1369 pid: 16058 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.264282:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.264283:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.264286:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136353180/0x8a60d30f5727b9fa lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.264286:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727ba08 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.264292:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a1de1c0/0x8a60d30f57188fc4 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb05:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1076c7 expref: 1369 pid: 16018 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.264293:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136353180/0x8a60d30f5727b9fa lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.264294:0:15455:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095b30480/0x8a60d30f5718923a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb06:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107737 expref: 1369 pid: 16058 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.264296:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.264303:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.264305:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.264305:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.264307:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.264308:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.264308:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+351:2004:x1805522257688448:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 64us (159us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.264308:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727b9f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.264310:0:15455:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727ba01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb06:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.264312:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914102 00010000:00010000:0.0:1721880422.264317:0:15455:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727ba01 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb06:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.264318:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727b9f3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.264326:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+350:2007:x1805522257688576:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 89us (347us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.264327:0:16120:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136353180/0x8a60d30f5727b9fa lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.264330:0:15455:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.264332:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914101 00010000:00010000:2.0:1721880422.264332:0:16120:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136353180/0x8a60d30f5727b9fa lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.264335:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.264336:0:16120:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136353180/0x8a60d30f5727b9fa lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.264340:0:16120:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136353180/0x8a60d30f5727b9fa lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.264344:0:16120:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136353180/0x8a60d30f5727b9fa lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.264345:0:15455:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a70edc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+1367:2004:x1805522257688704:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 83us (136us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.264347:0:16120:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353180 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.264349:0:16120:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136353180/0x8a60d30f5727b9fa lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.264351:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1367:2004:x1805522257688320:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 95us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.264352:0:15455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914104 00010000:00010000:2.0:1721880422.264356:0:16120:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136353180/0x8a60d30f5727b9fa lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.264358:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914103 00010000:00010000:2.0:1721880422.264362:0:16120:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136353180/0x8a60d30f5727b9fa lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.264366:0:16120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136353180/0x8a60d30f5727b9fa lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.264377:0:15514:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800919c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:15514:1805522011655680:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.264388:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.264389:0:15514:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727ba16 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.264398:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257688832 00000100:00100000:3.0:1721880422.264401:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257688832 00010000:00010000:0.0:1721880422.264402:0:16100:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727ba08 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.264408:0:16100:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727ba08 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.264412:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bc60fc0/0x8a60d30f57189512 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1077ed expref: 1366 pid: 16114 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.264413:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.264415:0:16100:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727ba08 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.264421:0:16100:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727ba08 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.264428:0:16100:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727ba08 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.264436:0:16100:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325c480 already unused, calling callback (ffffffffa084e330) 00000100:00100000:3.0:1721880422.264438:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257688960 00010000:00010000:0.0:1721880422.264439:0:16100:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727ba08 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.264441:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257688960 00010000:00010000:0.0:1721880422.264446:0:16100:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727ba08 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.264452:0:16120:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088effb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+2704:3687:x1805522011654528:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3754us (3809us total) trans 4296061645 rc 0/0 00010000:00010000:3.0:1721880422.264452:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007b9edf80/0x8a60d30f571ec286 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a7a7 expref: 350 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.264454:0:16100:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727ba08 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.264457:0:16120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631909 00010000:00010000:0.0:1721880422.264461:0:16100:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325c480/0x8a60d30f5727ba08 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.264468:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914105 00000100:00100000:1.0:1721880422.264471:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.264471:0:16113:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727b9f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.264473:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1366:2004:x1805522257688832:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.264475:0:16113:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727b9f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.264479:0:16113:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727b9f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.264480:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.264483:0:16188:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257689216 00010000:00010000:2.0:1721880422.264483:0:16113:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727b9f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.264484:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bc60fc0/0x8a60d30f57189512 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb07:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1077ed expref: 1366 pid: 16114 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.264486:0:16188:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257689216 00010000:00010000:2.0:1721880422.264486:0:16113:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727b9f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.264488:0:15455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914106 00010000:00010000:3.0:1721880422.264493:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bc60fc0/0x8a60d30f57189512 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb07:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1077ed expref: 1367 pid: 16114 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.264494:0:15455:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+350:2004:x1805522257688960:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.264494:0:16113:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350fc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.264496:0:16113:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727b9f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.264498:0:16188:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801356b61c0/0x8a60d30f57189e81 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107960 expref: 1367 pid: 16076 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.264499:0:16113:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727b9f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.264502:0:15455:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.264505:0:16113:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727b9f3 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.264507:0:15455:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007b9edf80/0x8a60d30f571ec286 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a7a7 expref: 350 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.264508:0:16113:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727b9f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.264510:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bc60fc0/0x8a60d30f57189512 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb07:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1077ed expref: 1367 pid: 16114 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.264514:0:16188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914107 00010000:00010000:0.0:1721880422.264517:0:15455:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007b9edf80/0x8a60d30f571ec286 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a7a7 expref: 350 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.264519:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1721880422.264520:0:16188:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+1366:2007:x1805522257689216:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.264520:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.264522:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727ba16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.264527:0:16188:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.264527:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727ba16 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.264529:0:15455:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007b9edf80/0x8a60d30f571ec286 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a7a7 expref: 350 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.264531:0:16188:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801356b61c0/0x8a60d30f57189e81 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb09:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107960 expref: 1366 pid: 16076 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.264537:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.264539:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.264541:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.264543:0:15455:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5b00/0x8a60d30f5727ba0f lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.264544:0:16188:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801356b61c0/0x8a60d30f57189e81 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb09:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107960 expref: 1366 pid: 16076 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.264549:0:15455:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5b00/0x8a60d30f5727ba0f lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.264549:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1366:2004:x1805522257688832:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 77us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.264553:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914105 00010000:00010000:1.0:1721880422.264556:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.264557:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.264560:0:16188:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727ba24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb09:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.264563:0:15455:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.264566:0:16188:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727ba24 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb09:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.264576:0:16188:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.264578:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801356b61c0/0x8a60d30f57189e81 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107960 expref: 1365 pid: 16076 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.264580:0:15455:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+349:2004:x1805522257688960:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 86us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.264585:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009f52f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011656064:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.264591:0:15455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914106 00000100:00100000:2.0:1721880422.264593:0:16113:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008854ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0000-mdtlov_UUID+1892:3689:x1805522011654144:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4222us (4252us total) trans 4296019952 rc 0/0 00000100:00100000:1.0:1721880422.264594:0:16188:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+1364:2007:x1805522257689216:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 74us (122us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.264596:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727ba24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.264597:0:16113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631908 00000100:00100000:1.0:1721880422.264600:0:16188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914107 00010000:00010000:3.0:1721880422.264601:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727ba24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.264605:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727ba24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.264609:0:15514:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727ba16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.264610:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727ba24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.264614:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727ba24 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.264616:0:15514:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727ba16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.264616:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088efea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011655936:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.264618:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727ba24 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.264621:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b6f40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.264623:0:15514:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727ba16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.264623:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727ba24 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.264626:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727ba1d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb08:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.264627:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727ba24 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.264630:0:15514:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727ba16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.264632:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727ba24 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.264635:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727ba24 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.264637:0:15514:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727ba16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.264641:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.264641:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135170000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:15453:1805522011656320:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.264643:0:15514:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325ed00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.264646:0:15514:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727ba16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.264651:0:15514:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727ba16 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.264652:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257689088 00010000:00010000:2.0:1721880422.264653:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136350240/0x8a60d30f5727ba2b lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.264654:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257689088 00010000:00010000:0.0:1721880422.264660:0:15514:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727ba16 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.264661:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5b00/0x8a60d30f5727ba0f lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.264663:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8f1d40/0x8a60d30f571897b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb08:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1078a3 expref: 1364 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.264666:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727ba16 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.264666:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5b00/0x8a60d30f5727ba0f lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.264670:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5b00/0x8a60d30f5727ba0f lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.264674:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5b00/0x8a60d30f5727ba0f lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.264676:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914108 00010000:00010000:2.0:1721880422.264677:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5b00/0x8a60d30f5727ba0f lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.264680:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1364:2005:x1805522257689088:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.264681:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b5b00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.264682:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5b00/0x8a60d30f5727ba0f lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.264686:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5b00/0x8a60d30f5727ba0f lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.264689:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.264691:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5b00/0x8a60d30f5727ba0f lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.264692:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d8f1d40/0x8a60d30f571897b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb08:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1078a3 expref: 1364 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.264695:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5b00/0x8a60d30f5727ba0f lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.264706:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d8f1d40/0x8a60d30f571897b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb08:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1078a3 expref: 1364 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.264718:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8f1d40/0x8a60d30f571897b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb08:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1078a3 expref: 1364 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.264750:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.264752:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.264755:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727ba1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb08:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.264755:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f52d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1893:3686:x1805522011655808:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3491us (3520us total) trans 4296019953 rc 0/0 00000100:00100000:3.0:1721880422.264760:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631915 00010000:00010000:1.0:1721880422.264761:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727ba1d lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb08:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.264789:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088efd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2704:3689:x1805522011654912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3735us (3784us total) trans 4296061646 rc 0/0 00000100:00100000:2.0:1721880422.264794:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631912 00000100:00100000:0.0:1721880422.264803:0:15514:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088efe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+1892:3689:x1805522011655168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3648us (3717us total) trans 4296019954 rc 0/0 00000100:00100000:0.0:1721880422.264810:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631913 00000004:00080000:2.0:1721880422.264818:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e9cbb80/2, rc 0, transno 1052657 00000100:00100000:2.0:1721880422.264822:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e9cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011655808:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.264837:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1721880422.264841:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011657984:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.264853:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1721880422.264871:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088efce00/2, rc 0, transno 1052658 00000100:00100000:2.0:1721880422.264876:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088efce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011655168:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.264878:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.264891:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727ba1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.264896:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1363:2005:x1805522257689088:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 213us (253us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.264896:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727ba1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.264901:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727ba1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.264902:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914108 00010000:00010000:2.0:1721880422.264904:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727ba1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.264905:0:16100:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088efd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:lustre-MDT0000-mdtlov_UUID+2705:3687:x1805522011654784:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3958us (4054us total) trans 4296061647 rc 0/0 00010000:00010000:2.0:1721880422.264908:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727ba1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.264911:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136351200 already unused, calling callback (ffffffffa084e330) 00000100:00100000:0.0:1721880422.264912:0:16100:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631911 00010000:00010000:2.0:1721880422.264912:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727ba1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.264919:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727ba1d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.264923:0:16100:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011657984 00010000:00010000:2.0:1721880422.264926:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727ba1d lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.264927:0:16100:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011657984 00010000:00010000:2.0:1721880422.264929:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727ba1d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.264935:0:16110:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008854f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_094:lustre-MDT0000-mdtlov_UUID+2704:3686:x1805522011653760:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4742us (4862us total) trans 4296061648 rc 0/0 00000100:00100000:3.0:1721880422.264940:0:16110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631907 00000100:00100000:0.0:1721880422.264944:0:16100:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631923 00000100:00100000:0.0:1721880422.264948:0:16100:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135170000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:lustre-MDT0000-mdtlov_UUID+1892:3686:x1805522011657984:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.264959:0:16100:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64269 count 1 00000100:00100000:1.0:1721880422.264962:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000004:00080000:3.0:1721880422.264962:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088efd500/2, rc 0, transno 1094351 00000100:00100000:3.0:1721880422.264966:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011654784:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.264969:0:16100:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727ba5c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb0d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.264980:0:16100:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092051d40/0x8a60d30f5718b086 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb0d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107c1c expref: 1362 pid: 16058 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.264985:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088efdc00/2, rc 0, transno 1094349 00010000:00010000:0.0:1721880422.264987:0:16100:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.264988:0:16100:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1721880422.264989:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011654528:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.264991:0:16100:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727ba5c lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb0d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.264997:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1721880422.265001:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880092318380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011658368:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.265007:0:16100:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092051d40/0x8a60d30f5718b086 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb0d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107c1c expref: 1362 pid: 16058 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.265029:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088eff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+1893:3687:x1805522011655552:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3802us (3831us total) trans 4296019955 rc 0/0 00010000:00010000:0.0:1721880422.265030:0:16100:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092051d40/0x8a60d30f5718b086 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb0d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107c1c expref: 1362 pid: 16058 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.265033:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.265034:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631914 00000100:00100000:0.0:1721880422.265041:0:16100:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800919c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_087:lustre-OST0001_UUID:16100:1805522011658496:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.265044:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011658368 00000100:00100000:2.0:1721880422.265046:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011658368 00000004:00080000:3.0:1721880422.265059:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088efc700/2, rc 0, transno 1052659 00000100:00100000:2.0:1721880422.265063:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631924 00000100:00100000:3.0:1721880422.265065:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011655552:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.265066:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092318000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2704:3687:x1805522011658368:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.265069:0:16100:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36d80 going to sleep for 11 seconds 00002000:00080000:2.0:1721880422.265074:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58091 count 1 00010000:00010000:2.0:1721880422.265081:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136352400/0x8a60d30f5727ba63 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.265083:0:16040:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727ba01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.265084:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880092319500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011658624:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.265089:0:16040:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727ba01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.265089:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c279440/0x8a60d30f571ec374 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a895 expref: 348 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.265093:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1721880422.265094:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257689344 00010000:00010000:2.0:1721880422.265094:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.265095:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136352400/0x8a60d30f5727ba63 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.265095:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.265098:0:16040:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727ba01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.265098:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257689344 00010000:00010000:0.0:1721880422.265102:0:16040:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727ba01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.265102:0:16110:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011658624 00000100:00100000:3.0:1721880422.265104:0:16110:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011658624 00010000:00010000:0.0:1721880422.265106:0:16040:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727ba01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.265106:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c279440/0x8a60d30f571ec374 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a895 expref: 349 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.265109:0:16040:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325c000 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.265110:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007b9eef40/0x8a60d30f571ec2a9 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a7ca expref: 349 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.265111:0:16040:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727ba01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.265112:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c279440/0x8a60d30f571ec374 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a895 expref: 349 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.265115:0:16040:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727ba01 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.265116:0:16110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631925 00000100:00100000:2.0:1721880422.265118:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008854c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0000_UUID:16017:1805522011658752:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.265118:0:16110:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092319f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_094:lustre-MDT0000-mdtlov_UUID+1893:3687:x1805522011658624:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.265121:0:16040:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727ba01 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.265126:0:16040:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727ba01 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.265127:0:16110:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64271 count 1 00000100:00100000:1.0:1721880422.265132:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914109 00010000:00010000:3.0:1721880422.265134:0:16110:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727ba6a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb0f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.265135:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdeb40 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.265136:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+349:2005:x1805522257689344:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.265142:0:16110:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d123180/0x8a60d30f5718c4c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10879f expref: 1362 pid: 16031 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.265143:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.265146:0:16110:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.265147:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007b9eef40/0x8a60d30f571ec2a9 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a7ca expref: 349 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.265147:0:16110:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.265149:0:16110:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727ba6a lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.265150:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088efca80/2, rc 0, transno 1094350 00010000:00010000:1.0:1721880422.265155:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007b9eef40/0x8a60d30f571ec2a9 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a7ca expref: 349 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.265162:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011654912:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.265167:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007b9eef40/0x8a60d30f571ec2a9 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a7ca expref: 349 pid: 16126 timeout: 887 lvb_type: 0 00000004:00080000:2.0:1721880422.265169:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008854c700/2, rc 0, transno 1052656 00000100:00100000:2.0:1721880422.265173:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008854c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011654144:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.265176:0:16110:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d123180/0x8a60d30f5718c4c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10879f expref: 1362 pid: 16031 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.265178:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.265179:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.265181:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136350240/0x8a60d30f5727ba2b lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.265182:0:16110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d123180/0x8a60d30f5718c4c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10879f expref: 1362 pid: 16031 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.265187:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136350240/0x8a60d30f5727ba2b lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.265188:0:16110:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009231aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_094:lustre-OST0001_UUID:16110:1805522011659008:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.265195:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008854c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011658112:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.265202:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.265203:0:16110:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec180 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.265213:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.265219:0:16040:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088efc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:lustre-MDT0000-mdtlov_UUID+1894:3689:x1805522011654400:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4515us (4551us total) trans 4296019956 rc 0/0 00000004:00080000:3.0:1721880422.265221:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008854f100/2, rc 0, transno 1094352 00000100:00100000:1.0:1721880422.265222:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+348:2005:x1805522257689344:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 84us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.265223:0:16040:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631910 00000100:00100000:2.0:1721880422.265224:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009231a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011658880:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1721880422.265226:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008854f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011653760:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.265228:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914109 00000100:00100000:0.0:1721880422.265232:0:16040:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011658112 00000100:00100000:2.0:1721880422.265233:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.265235:0:16040:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011658112 00000100:00100000:2.0:1721880422.265242:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1721880422.265244:0:16040:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011658880 00000100:00100000:2.0:1721880422.265245:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008854d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011659136:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.265246:0:16040:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011658880 00000100:00100000:3.0:1721880422.265248:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631926 00000100:00100000:3.0:1721880422.265251:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bb46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1894:3688:x1805522011658112:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.265255:0:16040:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631927 00000100:00100000:0.0:1721880422.265258:0:16040:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bb44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:lustre-MDT0000-mdtlov_UUID+2705:3688:x1805522011658880:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.265258:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1721880422.265259:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64270 count 1 00010000:00010000:3.0:1721880422.265266:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727ba71 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb0e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1721880422.265267:0:16040:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58092 count 1 00000100:00100000:2.0:1721880422.265271:0:16120:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011659136 00000100:00100000:2.0:1721880422.265273:0:16120:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011659136 00010000:00010000:3.0:1721880422.265273:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ea346c0/0x8a60d30f5718bd1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb0e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b108163 expref: 1362 pid: 11675 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.265275:0:16040:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325df80/0x8a60d30f5727ba78 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.265276:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.265277:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.265278:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727ba71 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb0e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.265282:0:16040:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fc07840/0x8a60d30f571ec397 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a8b8 expref: 347 pid: 16099 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.265285:0:16120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631928 00010000:00010000:0.0:1721880422.265287:0:16040:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.265287:0:16120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096c9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+1895:3688:x1805522011659136:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.265288:0:16040:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.265289:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ea346c0/0x8a60d30f5718bd1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb0e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b108163 expref: 1362 pid: 11675 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.265290:0:16040:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325df80/0x8a60d30f5727ba78 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.265294:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ea346c0/0x8a60d30f5718bd1a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb0e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b108163 expref: 1362 pid: 11675 timeout: 887 lvb_type: 0 00002000:00080000:2.0:1721880422.265296:0:16120:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64272 count 1 00000100:00100000:3.0:1721880422.265299:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880092319180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011659392:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.265304:0:16120:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727ba7f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb10:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.265307:0:16040:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fc07840/0x8a60d30f571ec397 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a8b8 expref: 347 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.265313:0:16120:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011f92f600/0x8a60d30f5718c90d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1089c1 expref: 1362 pid: 16019 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.265314:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec540 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.265320:0:16120:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.265321:0:16040:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fc07840/0x8a60d30f571ec397 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a8b8 expref: 347 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.265321:0:16120:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.265324:0:16120:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727ba7f lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.265325:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1721880422.265329:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009231ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011659264:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.265331:0:16040:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800919c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_040:lustre-OST0000_UUID:16040:1805522011659520:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.265340:0:16120:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011f92f600/0x8a60d30f5718c90d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1089c1 expref: 1362 pid: 16019 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.265341:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.265350:0:16120:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011f92f600/0x8a60d30f5718c90d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1089c1 expref: 1362 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.265353:0:16040:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36540 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.265360:0:16120:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bb45180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0001_UUID:16120:1805522011659648:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.265366:0:15514:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011659264 00000100:00100000:0.0:1721880422.265370:0:15514:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011659264 00000100:00100000:2.0:1721880422.265390:0:16120:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdea80 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.265392:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631929 00000100:00100000:0.0:1721880422.265397:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f52f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+2706:3687:x1805522011659264:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1721880422.265404:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136350240/0x8a60d30f5727ba2b lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1721880422.265407:0:15514:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58093 count 1 00010000:00010000:2.0:1721880422.265412:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136350240/0x8a60d30f5727ba2b lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.265416:0:15514:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325c240/0x8a60d30f5727ba86 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.265420:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136350240/0x8a60d30f5727ba2b lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.265426:0:15514:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d9ae640/0x8a60d30f571ec3c1 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a8e2 expref: 347 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.265427:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136350240/0x8a60d30f5727ba2b lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.265433:0:15514:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.265434:0:15514:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.265434:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136350240/0x8a60d30f5727ba2b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.265437:0:15514:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325c240/0x8a60d30f5727ba86 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.265440:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350240 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.265443:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136350240/0x8a60d30f5727ba2b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.265449:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136350240/0x8a60d30f5727ba2b lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.265452:0:15514:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d9ae640/0x8a60d30f571ec3c1 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a8e2 expref: 347 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.265459:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136350240/0x8a60d30f5727ba2b lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.265461:0:15514:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d9ae640/0x8a60d30f571ec3c1 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a8e2 expref: 347 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.265467:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136350240/0x8a60d30f5727ba2b lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.265475:0:15514:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800919c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:15514:1805522011659776:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.265499:0:15514:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36240 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.265579:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f52ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2707:3688:x1805522011656192:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3893us (3921us total) trans 4296061649 rc 0/0 00000100:00100000:2.0:1721880422.265585:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631916 00000100:00100000:2.0:1721880422.265605:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880092318a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011658240:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.265625:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.265643:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011658240 00000004:00080000:2.0:1721880422.265644:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088efdf80/2, rc 0, transno 1052660 00000100:00100000:0.0:1721880422.265647:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011658240 00000100:00100000:2.0:1721880422.265650:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011654400:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.265651:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880092318e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011657472:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.265664:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631930 00000100:00100000:0.0:1721880422.265668:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bb47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2707:3689:x1805522011658240:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1721880422.265668:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727ba47 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1721880422.265678:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58090 count 1 00000100:00100000:3.0:1721880422.265684:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bb45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011659904:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.265689:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727ba8d lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.265699:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130970240/0x8a60d30f571ec351 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a872 expref: 347 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.265703:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.265704:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde840 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.265706:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.265707:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.265709:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727ba8d lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.265746:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130970240/0x8a60d30f571ec351 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a872 expref: 347 pid: 16101 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.265747:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800919c2d80/2, rc 0, transno 1094353 00010000:00010000:0.0:1721880422.265756:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130970240/0x8a60d30f571ec351 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a872 expref: 347 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.265756:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800919c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011656192:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.265766:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800919c1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0000_UUID:16075:1805522011660032:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.265777:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011659904 00000100:00100000:1.0:1721880422.265781:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011659904 00000100:00100000:0.0:1721880422.265793:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36a80 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.265796:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1721880422.265799:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631931 00000100:00100000:1.0:1721880422.265803:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092318e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1896:3687:x1805522011659904:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.265804:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088615c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011660160:0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1721880422.265815:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64273 count 1 00010000:00010000:1.0:1721880422.265825:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727ba94 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.265826:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.265836:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800966c9f80/0x8a60d30f5718cc32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b108aee expref: 1362 pid: 16046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.265842:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.265843:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.265845:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727ba94 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.265862:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800966c9f80/0x8a60d30f5718cc32 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b108aee expref: 1362 pid: 16046 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.265871:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800966c9f80/0x8a60d30f5718cc32 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b108aee expref: 1362 pid: 16046 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.265880:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801312d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011660288:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.265914:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.265929:0:16098:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011660160 00000100:00100000:1.0:1721880422.265932:0:16098:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011660160 00000100:00100000:1.0:1721880422.265958:0:16098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631932 00000100:00100000:1.0:1721880422.265962:0:16098:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bb44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0000-mdtlov_UUID+2708:3689:x1805522011660160:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1721880422.265973:0:16098:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58094 count 1 00010000:00010000:1.0:1721880422.265982:0:16098:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098aa9b00/0x8a60d30f5727ba9b lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.265992:0:16098:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801309721c0/0x8a60d30f571ec3dd lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a8fe expref: 347 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.265998:0:16098:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.266000:0:16098:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.266002:0:16098:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098aa9b00/0x8a60d30f5727ba9b lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.266033:0:16098:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801309721c0/0x8a60d30f571ec3dd lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a8fe expref: 347 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.266042:0:16098:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801309721c0/0x8a60d30f571ec3dd lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a8fe expref: 347 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.266051:0:16098:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801312d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0000_UUID:16098:1805522011660416:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.266082:0:16098:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eba80 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.266216:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135170a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011657216:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.266230:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727ba40 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb0a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.266264:0:16130:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800919c3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0000_UUID:16130:1805522011656704:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.266282:0:16130:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325d8c0/0x8a60d30f5727ba32 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.266463:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135171f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0000_UUID:16028:1805522011656960:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.266480:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801363533c0/0x8a60d30f5727ba39 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.266488:0:16088:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009231b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011657728:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.266503:0:16100:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800919c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_087:lustre-OST0001_UUID:16100:1805522011658496:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.266503:0:16088:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727ba4e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb0c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.266519:0:16100:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727ba5c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb0d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.266575:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.266595:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257689600 00000100:00100000:1.0:1721880422.266599:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257689600 00000100:00100000:2.0:1721880422.266604:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008854c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0000_UUID:16017:1805522011658752:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.266608:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.266612:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b580b40/0x8a60d30f5718a573 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb0a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107a1d expref: 1363 pid: 16080 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.266612:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136352400/0x8a60d30f5727ba63 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.266635:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.266646:0:16188:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257689472 00000100:00100000:1.0:1721880422.266647:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257689856 00000100:00100000:2.0:1721880422.266649:0:16188:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257689472 00000100:00100000:1.0:1721880422.266650:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257689856 00000100:00100000:0.0:1721880422.266651:0:15455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914110 00000100:00100000:0.0:1721880422.266657:0:15455:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+1363:2006:x1805522257689600:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.266658:0:16188:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc06ac0/0x8a60d30f571ec2da lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a7fb expref: 349 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.266662:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130970b40/0x8a60d30f571ec2fd lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a81e expref: 349 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.266666:0:15455:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.266672:0:15455:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b580b40/0x8a60d30f5718a573 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb0a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107a1d expref: 1363 pid: 16080 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.266679:0:16188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914111 00010000:00010000:0.0:1721880422.266682:0:15455:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b580b40/0x8a60d30f5718a573 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb0a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107a1d expref: 1363 pid: 16080 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.266683:0:16188:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e197450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+349:2004:x1805522257689472:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.266685:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914112 00000100:00100000:1.0:1721880422.266690:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+349:2004:x1805522257689856:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.266690:0:16188:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.266693:0:16188:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fc06ac0/0x8a60d30f571ec2da lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a7fb expref: 349 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.266696:0:15455:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b580b40/0x8a60d30f5718a573 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb0a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107a1d expref: 1363 pid: 16080 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.266697:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.266699:0:16188:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fc06ac0/0x8a60d30f571ec2da lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a7fb expref: 349 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.266701:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130970b40/0x8a60d30f571ec2fd lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a81e expref: 349 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.266708:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.266708:0:16188:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fc06ac0/0x8a60d30f571ec2da lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a7fb expref: 349 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.266710:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.266710:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130970b40/0x8a60d30f571ec2fd lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a81e expref: 349 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.266712:0:15455:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727ba40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb0a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.266717:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.266718:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.266720:0:15455:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727ba40 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb0a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.266720:0:16188:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009325d8c0/0x8a60d30f5727ba32 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.266722:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130970b40/0x8a60d30f571ec2fd lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a81e expref: 348 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.266724:0:16188:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325d8c0/0x8a60d30f5727ba32 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.266752:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.266754:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.266756:0:16188:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.266757:0:15455:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.266757:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801363533c0/0x8a60d30f5727ba39 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.266764:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801363533c0/0x8a60d30f5727ba39 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.266770:0:16130:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325d8c0/0x8a60d30f5727ba32 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.266771:0:16188:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e197450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+347:2004:x1805522257689472:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 87us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.266774:0:15455:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+1362:2006:x1805522257689600:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 116us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.266776:0:16188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914111 00010000:00010000:1.0:1721880422.266780:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.266780:0:16130:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325d8c0/0x8a60d30f5727ba32 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.266785:0:15455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914110 00010000:00010000:3.0:1721880422.266785:0:16130:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325d8c0/0x8a60d30f5727ba32 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.266788:0:16130:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325d8c0/0x8a60d30f5727ba32 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.266789:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727ba40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.266792:0:16130:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325d8c0/0x8a60d30f5727ba32 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.266794:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727ba40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.266795:0:16130:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325d8c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.266797:0:16130:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325d8c0/0x8a60d30f5727ba32 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.266800:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+346:2004:x1805522257689856:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 109us (164us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.266801:0:16130:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325d8c0/0x8a60d30f5727ba32 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.266802:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727ba40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.266806:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914112 00010000:00010000:2.0:1721880422.266807:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727ba40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.266809:0:16130:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325d8c0/0x8a60d30f5727ba32 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.266810:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727ba40 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.266812:0:16130:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325d8c0/0x8a60d30f5727ba32 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.266814:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353600 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.266815:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727ba40 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.266819:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727ba40 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.266825:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727ba40 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.266828:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727ba40 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.266833:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801363533c0/0x8a60d30f5727ba39 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.266841:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.266841:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801363533c0/0x8a60d30f5727ba39 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.266848:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801363533c0/0x8a60d30f5727ba39 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.266857:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801363533c0/0x8a60d30f5727ba39 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.266864:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801363533c0/0x8a60d30f5727ba39 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.266869:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801363533c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.266872:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801363533c0/0x8a60d30f5727ba39 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.266879:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801363533c0/0x8a60d30f5727ba39 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.266889:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801363533c0/0x8a60d30f5727ba39 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.266899:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801363533c0/0x8a60d30f5727ba39 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.266910:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.266912:0:16130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a052d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0000-mdtlov_UUID+2709:3688:x1805522011656448:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3342us (3395us total) trans 4296061650 rc 0/0 00000100:00100000:3.0:1721880422.266918:0:16130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631917 00000100:00100000:1.0:1721880422.266924:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257690112 00000100:00100000:2.0:1721880422.266926:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c40b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1897:3686:x1805522011656832:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3201us (3230us total) trans 4296019957 rc 0/0 00000100:00100000:1.0:1721880422.266927:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257690112 00000100:00100000:2.0:1721880422.266930:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631919 00010000:00010000:1.0:1721880422.266938:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092051d40/0x8a60d30f5718b086 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb0d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107c1c expref: 1362 pid: 16058 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.266944:0:16110:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009231aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_094:lustre-OST0001_UUID:16110:1805522011659008:192.168.201.24@tcp:104: 00000004:00080000:2.0:1721880422.266954:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008fde0000/2, rc 0, transno 1094354 00010000:00010000:3.0:1721880422.266954:0:16110:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727ba6a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.266963:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257690240 00000100:00100000:1.0:1721880422.266965:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257690240 00000100:00100000:2.0:1721880422.266967:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fde0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011656448:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.266971:0:15455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914113 00010000:00010000:1.0:1721880422.266975:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c279440/0x8a60d30f571ec374 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a895 expref: 346 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.266977:0:15455:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+1362:2007:x1805522257690112:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.266986:0:15455:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.266990:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914114 00010000:00010000:0.0:1721880422.266991:0:15455:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092051d40/0x8a60d30f5718b086 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb0d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107c1c expref: 1362 pid: 16058 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.266996:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+346:2004:x1805522257690240:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.267001:0:15455:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092051d40/0x8a60d30f5718b086 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb0d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107c1c expref: 1362 pid: 16058 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.267002:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.267002:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088617800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011660544:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.267007:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c279440/0x8a60d30f571ec374 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a895 expref: 346 pid: 16126 timeout: 887 lvb_type: 0 00000004:00080000:3.0:1721880422.267007:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008c409880/2, rc 0, transno 1052661 00000100:00100000:3.0:1721880422.267027:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008c409880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011656832:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.267030:0:15455:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092051d40/0x8a60d30f5718b086 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb0d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107c1c expref: 1362 pid: 16058 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.267032:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.267034:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c279440/0x8a60d30f571ec374 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a895 expref: 346 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.267042:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.267043:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.267046:0:15455:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727ba5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb0d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.267047:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c279440/0x8a60d30f571ec374 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a895 expref: 346 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.267047:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011660544 00000100:00100000:3.0:1721880422.267047:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088615500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011660672:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.267049:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011660544 00010000:00010000:0.0:1721880422.267054:0:15455:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727ba5c lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb0d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.267061:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.267063:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.267065:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631933 00010000:00010000:1.0:1721880422.267066:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136352400/0x8a60d30f5727ba63 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.267068:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bb44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2709:3689:x1805522011660544:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.267069:0:15455:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.267073:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136352400/0x8a60d30f5727ba63 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.267077:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58095 count 1 00000100:00100000:3.0:1721880422.267077:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.267085:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801363521c0/0x8a60d30f5727baa2 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.267085:0:16130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011660672 00000100:00100000:0.0:1721880422.267087:0:15455:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+1361:2007:x1805522257690112:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 110us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.267088:0:16130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011660672 00010000:00010000:1.0:1721880422.267089:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.267093:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880072879f80/0x8a60d30f571ec407 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a928 expref: 345 pid: 16099 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.267097:0:15455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914113 00010000:00010000:2.0:1721880422.267098:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.267099:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1721880422.267099:0:16130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631934 00010000:00010000:2.0:1721880422.267100:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801363521c0/0x8a60d30f5727baa2 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.267102:0:16130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088615880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0000-mdtlov_UUID+1897:3686:x1805522011660672:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.267108:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+345:2004:x1805522257690240:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 111us (197us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.267111:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880072879f80/0x8a60d30f571ec407 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a928 expref: 345 pid: 16099 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.267111:0:16130:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64274 count 1 00000100:00100000:1.0:1721880422.267114:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914114 00010000:00010000:2.0:1721880422.267116:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880072879f80/0x8a60d30f571ec407 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a928 expref: 345 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.267117:0:16100:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727ba5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.267119:0:16130:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727baa9 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.267122:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bb45f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:15466:1805522011660800:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.267124:0:16100:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727ba5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.267127:0:16130:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800842c58c0/0x8a60d30f5718cf73 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b108c06 expref: 1360 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.267131:0:16130:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.267132:0:16100:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727ba5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.267132:0:16130:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.267134:0:16130:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727baa9 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.267137:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdeb40 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.267139:0:16100:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727ba5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.267144:0:16130:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800842c58c0/0x8a60d30f5718cf73 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b108c06 expref: 1360 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.267146:0:16100:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727ba5c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.267147:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136352400/0x8a60d30f5727ba63 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.267150:0:16130:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800842c58c0/0x8a60d30f5718cf73 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b108c06 expref: 1360 pid: 16089 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.267152:0:16100:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325fa80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.267152:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136352400/0x8a60d30f5727ba63 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.267155:0:16100:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727ba5c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.267156:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136352400/0x8a60d30f5727ba63 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.267156:0:16130:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088615f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0001_UUID:16130:1805522011660928:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.267160:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136352400/0x8a60d30f5727ba63 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.267162:0:16100:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727ba5c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.267164:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136352400/0x8a60d30f5727ba63 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.267170:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352400 already unused, calling callback (ffffffffa084e330) 00000100:00100000:3.0:1721880422.267171:0:16130:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec180 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.267172:0:16100:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727ba5c lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.267172:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136352400/0x8a60d30f5727ba63 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.267178:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136352400/0x8a60d30f5727ba63 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.267179:0:16100:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727ba5c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.267187:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136352400/0x8a60d30f5727ba63 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.267193:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136352400/0x8a60d30f5727ba63 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.267233:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2710:3686:x1805522011656576:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3604us (3635us total) trans 4296061651 rc 0/0 00000004:00080000:3.0:1721880422.267236:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a052dc00/2, rc 0, transno 1094355 00000100:00100000:1.0:1721880422.267240:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631918 00000100:00100000:3.0:1721880422.267241:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a052dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011656576:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1721880422.267257:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088616d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011661056:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1721880422.267269:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.267279:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011661056 00000100:00100000:1.0:1721880422.267283:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011661056 00000004:00080000:3.0:1721880422.267291:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088efea00/2, rc 0, transno 1052662 00000100:00100000:0.0:1721880422.267295:0:16100:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135170000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:lustre-MDT0000-mdtlov_UUID+1898:3686:x1805522011657984:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2345us (2439us total) trans 4296019958 rc 0/0 00000100:00100000:3.0:1721880422.267295:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011657984:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.267299:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631935 00000100:00100000:0.0:1721880422.267303:0:16100:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631923 00000100:00100000:1.0:1721880422.267303:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088614000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2711:3687:x1805522011661056:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.267310:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880092318000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2711:3687:x1805522011658368:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2242us (2276us total) trans 4296061652 rc 0/0 00002000:00080000:1.0:1721880422.267315:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58096 count 1 00000100:00100000:2.0:1721880422.267315:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631924 00000004:00080000:3.0:1721880422.267318:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880092318380/2, rc 0, transno 1094356 00000100:00100000:3.0:1721880422.267321:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880092318380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011658368:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.267325:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098aabcc0/0x8a60d30f5727bab0 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.267332:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088614e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011661184:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.267336:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095d76880/0x8a60d30f571ec431 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a952 expref: 344 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.267347:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.267347:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.267348:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.267351:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098aabcc0/0x8a60d30f5727bab0 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.267357:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1721880422.267358:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011661184 00000100:00100000:2.0:1721880422.267360:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088616300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011661312:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1721880422.267361:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011661184 00010000:00010000:1.0:1721880422.267368:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095d76880/0x8a60d30f571ec431 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a952 expref: 344 pid: 16126 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.267370:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.267375:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011661312 00010000:00010000:1.0:1721880422.267376:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095d76880/0x8a60d30f571ec431 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a952 expref: 344 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.267376:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011661312 00000100:00100000:3.0:1721880422.267384:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631936 00000100:00100000:1.0:1721880422.267386:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801312d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0000_UUID:16028:1805522011661440:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.267387:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bb47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+1898:3688:x1805522011661184:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.267391:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00002000:00080000:3.0:1721880422.267395:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64275 count 1 00010000:00010000:3.0:1721880422.267403:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727bab7 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.267410:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094039d40/0x8a60d30f5718d94b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1093fb expref: 1360 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.267412:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.267413:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257689728 00010000:00010000:3.0:1721880422.267414:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.267415:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1721880422.267416:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257689728 00010000:00010000:3.0:1721880422.267416:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727bab7 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.267426:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099c233c0/0x8a60d30f5718a86e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107aa9 expref: 1361 pid: 16073 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.267426:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094039d40/0x8a60d30f5718d94b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1093fb expref: 1361 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.267430:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631937 00000100:00100000:2.0:1721880422.267430:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.267431:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094039d40/0x8a60d30f5718d94b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1093fb expref: 1361 pid: 16089 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.267436:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bb44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2711:3688:x1805522011661312:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1721880422.267437:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088617b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011661568:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.267450:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257689984 00000100:00100000:3.0:1721880422.267452:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdeccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.267454:0:15455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914115 00000100:00100000:1.0:1721880422.267454:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257689984 00000100:00100000:0.0:1721880422.267457:0:15455:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+1362:2004:x1805522257689728:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.267462:0:15455:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.267465:0:15455:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099c233c0/0x8a60d30f5718a86e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb0b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107aa9 expref: 1362 pid: 16073 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.267465:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008cf2c6c0/0x8a60d30f5718abd9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb0c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107b51 expref: 1362 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.267471:0:15455:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099c233c0/0x8a60d30f5718a86e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb0b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107aa9 expref: 1362 pid: 16073 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.267479:0:15455:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099c233c0/0x8a60d30f5718a86e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb0b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107aa9 expref: 1362 pid: 16073 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.267483:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914116 00000100:00100000:1.0:1721880422.267487:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bb44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1361:2004:x1805522257689984:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.267488:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.267489:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.267491:0:15455:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727ba47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.267494:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.267498:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008cf2c6c0/0x8a60d30f5718abd9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb0c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107b51 expref: 1361 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.267499:0:15455:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727ba47 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.267507:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008cf2c6c0/0x8a60d30f5718abd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb0c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107b51 expref: 1361 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.267510:0:15455:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.267515:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880092319180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011659392:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.267516:0:16120:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bb45180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0001_UUID:16120:1805522011659648:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.267519:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008cf2c6c0/0x8a60d30f5718abd9 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb0c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b107b51 expref: 1361 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.267524:0:15455:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+1361:2004:x1805522257689728:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 66us (134us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.267524:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727ba71 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb0e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.267528:0:15455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914115 00010000:00010000:2.0:1721880422.267529:0:16120:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727ba7f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.267530:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.267531:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.267534:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727ba4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb0c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.267537:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727ba47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.267540:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727ba4e lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb0c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.267541:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727ba47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.267545:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.267546:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727ba47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.267549:0:16040:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800919c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_040:lustre-OST0000_UUID:16040:1805522011659520:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.267553:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727ba47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.267554:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.267554:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257690368 00000100:00100000:2.0:1721880422.267556:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257690368 00010000:00010000:3.0:1721880422.267557:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727ba47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.267559:0:16040:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325df80/0x8a60d30f5727ba78 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.267560:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b5200 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.267562:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727ba47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.267565:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d123180/0x8a60d30f5718c4c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10879f expref: 1360 pid: 16031 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.267566:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727ba47 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.267571:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bb44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1360:2004:x1805522257689984:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 83us (140us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.267572:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727ba47 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.267575:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727ba47 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.267577:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914116 00000100:00100000:0.0:1721880422.267584:0:15455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914117 00000100:00100000:0.0:1721880422.267587:0:15455:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bb45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+1359:2005:x1805522257690368:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.267592:0:15455:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.267595:0:15455:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d123180/0x8a60d30f5718c4c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb0f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10879f expref: 1359 pid: 16031 timeout: 887 lvb_type: 0 00002000:00080000:1.0:1721880422.267595:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58097 count 1 00010000:00010000:0.0:1721880422.267601:0:15455:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d123180/0x8a60d30f5718c4c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb0f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10879f expref: 1359 pid: 16031 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.267604:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098aaba80/0x8a60d30f5727babe lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2f1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.267610:0:15455:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d123180/0x8a60d30f5718c4c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb0f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10879f expref: 1359 pid: 16031 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.267614:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880132d0d440/0x8a60d30f571ec45b lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a97c expref: 344 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.267618:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.267619:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.267619:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.267621:0:15455:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727ba6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.267621:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.267623:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098aaba80/0x8a60d30f5727babe lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.267625:0:15455:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727ba6a lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.267637:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880132d0d440/0x8a60d30f571ec45b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a97c expref: 344 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.267641:0:15455:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.267645:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880132d0d440/0x8a60d30f571ec45b lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a97c expref: 344 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.267647:0:16110:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727ba6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.267651:0:16110:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727ba6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.267653:0:15455:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bb45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+1358:2005:x1805522257690368:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 65us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.267654:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801312d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0000_UUID:16111:1805522011661696:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.267655:0:16110:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727ba6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.267657:0:15455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914117 00010000:00010000:3.0:1721880422.267659:0:16110:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727ba6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.267663:0:16110:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727ba6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.267666:0:16110:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4000 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.267667:0:16110:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727ba6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.267671:0:16110:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727ba6a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.267673:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302ebf00 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.267677:0:16110:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727ba6a lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.267683:0:16110:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727ba6a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.267690:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.267703:0:15455:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257690624 00000100:00100000:1.0:1721880422.267706:0:15455:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257690624 00000100:00100000:0.0:1721880422.267719:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.267720:0:15455:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ea346c0/0x8a60d30f5718bd1a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb0e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b108163 expref: 1358 pid: 11675 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.267743:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.267748:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257690496 00000100:00100000:2.0:1721880422.267753:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257690496 00000100:00100000:0.0:1721880422.267760:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.267765:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc07840/0x8a60d30f571ec397 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a8b8 expref: 345 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.267769:0:15455:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257690752 00000100:00100000:1.0:1721880422.267772:0:15455:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257690752 00000100:00100000:3.0:1721880422.267772:0:16188:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257690880 00000100:00100000:3.0:1721880422.267776:0:16188:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257690880 00010000:00010000:1.0:1721880422.267782:0:15455:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011f92f600/0x8a60d30f5718c90d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1089c1 expref: 1359 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.267788:0:16188:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d9ae640/0x8a60d30f571ec3c1 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe2ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a8e2 expref: 346 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.267789:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914118 00000100:00100000:0.0:1721880422.267793:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.267795:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ab4d4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1359:2005:x1805522257690624:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.267803:0:15455:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257691008 00010000:00010000:2.0:1721880422.267804:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.267805:0:15455:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257691008 00010000:00010000:2.0:1721880422.267809:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ea346c0/0x8a60d30f5718bd1a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb0e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b108163 expref: 1359 pid: 11675 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.267813:0:15455:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130970480/0x8a60d30f571ec327 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe2e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a848 expref: 347 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.267814:0:16188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914119 00000100:00100000:0.0:1721880422.267815:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.267819:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ea346c0/0x8a60d30f5718bd1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb0e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b108163 expref: 1359 pid: 11675 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.267819:0:16188:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+347:2005:x1805522257690496:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.267826:0:15455:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257691264 00010000:00010000:3.0:1721880422.267827:0:16188:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.267828:0:15455:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257691264 00010000:00010000:3.0:1721880422.267831:0:16188:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fc07840/0x8a60d30f571ec397 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a8b8 expref: 347 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.267832:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ea346c0/0x8a60d30f5718bd1a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb0e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b108163 expref: 1360 pid: 11675 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.267837:0:15455:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800966c9f80/0x8a60d30f5718cc32 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b108aee expref: 1360 pid: 16046 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.267840:0:16188:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fc07840/0x8a60d30f571ec397 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a8b8 expref: 347 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.267843:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1721880422.267844:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.267846:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.267848:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727ba71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb0e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.267851:0:15455:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257691136 00010000:00010000:3.0:1721880422.267851:0:16188:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fc07840/0x8a60d30f571ec397 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a8b8 expref: 347 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.267853:0:15455:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257691136 00010000:00010000:2.0:1721880422.267856:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727ba71 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb0e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.267860:0:15455:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130970240/0x8a60d30f571ec351 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe2ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a872 expref: 347 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.267861:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.267862:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.267865:0:16188:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009325df80/0x8a60d30f5727ba78 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.267872:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.267872:0:16188:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325df80/0x8a60d30f5727ba78 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.267875:0:15455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914120 00000100:00100000:1.0:1721880422.267880:0:15455:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+1359:2006:x1805522257690752:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.267885:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.267887:0:15455:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.267887:0:16188:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.267891:0:15455:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011f92f600/0x8a60d30f5718c90d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1089c1 expref: 1359 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.267896:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ab4d4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1359:2005:x1805522257690624:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 99us (203us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.267900:0:15455:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011f92f600/0x8a60d30f5718c90d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1089c1 expref: 1359 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.267903:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914118 00000100:00100000:3.0:1721880422.267905:0:16188:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+347:2005:x1805522257690496:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 85us (185us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.267912:0:15455:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011f92f600/0x8a60d30f5718c90d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1089c1 expref: 1359 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.267912:0:16188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914119 00010000:00010000:1.0:1721880422.267923:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.267924:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.267926:0:16188:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257691392 00010000:00010000:1.0:1721880422.267927:0:15455:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727ba7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.267929:0:16188:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257691392 00010000:00010000:1.0:1721880422.267934:0:15455:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727ba7f lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.267939:0:16188:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801309721c0/0x8a60d30f571ec3dd lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe2ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a8fe expref: 347 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.267941:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914121 00000100:00100000:2.0:1721880422.267944:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cd22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+347:2004:x1805522257690880:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.267950:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.267954:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d9ae640/0x8a60d30f571ec3c1 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe2ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a8e2 expref: 347 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.267955:0:16188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914122 00010000:00010000:1.0:1721880422.267956:0:15455:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.267959:0:16188:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cd23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+347:2005:x1805522257691008:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.267961:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d9ae640/0x8a60d30f571ec3c1 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a8e2 expref: 347 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.267963:0:15514:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800919c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:15514:1805522011659776:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.267970:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d9ae640/0x8a60d30f571ec3c1 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a8e2 expref: 347 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.267974:0:16188:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.267977:0:15514:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325c240/0x8a60d30f5727ba86 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.267978:0:15455:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+1357:2006:x1805522257690752:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 96us (232us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.267978:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.267978:0:16188:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130970480/0x8a60d30f571ec327 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe2e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a848 expref: 346 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.267979:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.267981:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009325c240/0x8a60d30f5727ba86 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.267984:0:15455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914120 00010000:00010000:2.0:1721880422.267985:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325c240/0x8a60d30f5727ba86 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.267987:0:16188:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130970480/0x8a60d30f571ec327 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a848 expref: 346 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.267993:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.267995:0:15514:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325c240/0x8a60d30f5727ba86 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.267998:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1721880422.267999:0:15455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914123 00010000:00010000:3.0:1721880422.267999:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.268002:0:15514:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325c240/0x8a60d30f5727ba86 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.268002:0:16188:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727ba55 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.268003:0:15455:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e616300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+1356:2005:x1805522257691264:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.268005:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cd22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+346:2004:x1805522257690880:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 60us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.268008:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914121 00010000:00010000:3.0:1721880422.268008:0:16188:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727ba55 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.268010:0:15455:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.268026:0:15514:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325c240/0x8a60d30f5727ba86 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.268029:0:15455:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800966c9f80/0x8a60d30f5718cc32 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b108aee expref: 1356 pid: 16046 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.268034:0:15514:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325c240/0x8a60d30f5727ba86 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.268034:0:16188:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.268035:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914124 00010000:00010000:1.0:1721880422.268038:0:15455:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800966c9f80/0x8a60d30f5718cc32 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b108aee expref: 1356 pid: 16046 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.268039:0:15514:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325c240/0x8a60d30f5727ba86 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.268039:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e616a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+345:2005:x1805522257691136:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.268042:0:15514:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325c240 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.268044:0:15514:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325c240/0x8a60d30f5727ba86 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.268045:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.268048:0:15514:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325c240/0x8a60d30f5727ba86 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.268048:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.268048:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130970240/0x8a60d30f571ec351 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe2ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a872 expref: 345 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.268049:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.268051:0:15455:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727ba94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.268054:0:15514:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325c240/0x8a60d30f5727ba86 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.268054:0:16188:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cd23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+345:2005:x1805522257691008:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 93us (259us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.268058:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325c240/0x8a60d30f5727ba86 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.268058:0:15455:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727ba94 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.268058:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130970240/0x8a60d30f571ec351 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a872 expref: 345 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.268060:0:16188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914122 00010000:00010000:2.0:1721880422.268067:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.268068:0:15455:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.268068:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.268071:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727ba8d lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.268077:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727ba8d lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.268077:0:16188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914125 00000100:00100000:3.0:1721880422.268080:0:16188:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ab4d7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+344:2005:x1805522257691392:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.268084:0:15455:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e616300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+1356:2005:x1805522257691264:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 79us (268us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.268087:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.268087:0:16188:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.268089:0:15455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914123 00010000:00010000:3.0:1721880422.268091:0:16188:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801309721c0/0x8a60d30f571ec3dd lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe2ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a8fe expref: 344 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.268100:0:16188:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801309721c0/0x8a60d30f571ec3dd lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a8fe expref: 344 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.268105:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e616a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+344:2005:x1805522257691136:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 64us (260us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.268110:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.268111:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.268112:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914124 00010000:00010000:3.0:1721880422.268114:0:16188:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098aa9b00/0x8a60d30f5727ba9b lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.268121:0:16188:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098aa9b00/0x8a60d30f5727ba9b lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.268129:0:16188:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.268137:0:16098:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801309721c0/0x8a60d30f571ec3dd lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a8fe expref: 343 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.268144:0:16188:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ab4d7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+342:2005:x1805522257691392:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 62us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.268146:0:16098:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801312d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0000_UUID:16098:1805522011660416:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.268146:0:16120:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727ba7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.268150:0:16188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914125 00010000:00010000:2.0:1721880422.268154:0:16120:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727ba7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.268158:0:16098:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880098aa9b00/0x8a60d30f5727ba9b lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.268161:0:16120:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727ba7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.268165:0:16098:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098aa9b00/0x8a60d30f5727ba9b lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.268168:0:16120:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727ba7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.268171:0:16098:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098aa9b00/0x8a60d30f5727ba9b lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.268179:0:16098:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098aa9b00/0x8a60d30f5727ba9b lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.268180:0:16120:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727ba7f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.268185:0:16098:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098aa9b00/0x8a60d30f5727ba9b lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.268186:0:16120:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353840 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.268189:0:16120:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727ba7f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.268192:0:16098:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098aa9b00/0x8a60d30f5727ba9b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.268192:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727ba71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.268196:0:16120:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727ba7f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.268198:0:16098:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa9b00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.268199:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727ba71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.268201:0:16098:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098aa9b00/0x8a60d30f5727ba9b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.268205:0:16120:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727ba7f lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.268206:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727ba71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.268208:0:16098:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098aa9b00/0x8a60d30f5727ba9b lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.268212:0:16120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727ba7f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.268212:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727ba71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.268218:0:16098:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098aa9b00/0x8a60d30f5727ba9b lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.268218:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727ba71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.268224:0:16098:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098aa9b00/0x8a60d30f5727ba9b lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.268228:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b46c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.268230:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727ba71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.268236:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727ba71 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.268245:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727ba71 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.268251:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727ba71 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.268264:0:15514:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f52f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+2712:3687:x1805522011659264:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2865us (2921us total) trans 4296061653 rc 0/0 00000100:00100000:0.0:1721880422.268268:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631929 00010000:00010000:0.0:1721880422.268284:0:16040:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325df80/0x8a60d30f5727ba78 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.268290:0:16040:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325df80/0x8a60d30f5727ba78 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.268294:0:16040:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325df80/0x8a60d30f5727ba78 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.268298:0:16040:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325df80/0x8a60d30f5727ba78 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.268298:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130970480/0x8a60d30f571ec327 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a848 expref: 341 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.268301:0:16040:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325df80/0x8a60d30f5727ba78 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.268304:0:16040:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325df80 already unused, calling callback (ffffffffa084e330) 00000100:00100000:2.0:1721880422.268304:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088efe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0000_UUID:16089:1805522011657856:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.268306:0:16040:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325df80/0x8a60d30f5727ba78 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.268310:0:16040:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325df80/0x8a60d30f5727ba78 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.268314:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727ba55 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.268316:0:16040:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325df80/0x8a60d30f5727ba78 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.268319:0:16040:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325df80/0x8a60d30f5727ba78 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.268319:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727ba55 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.268327:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727ba55 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.268331:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727ba55 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.268335:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727ba55 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.268339:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727ba55 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.268342:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353cc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.268343:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727ba55 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.268344:0:16098:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bb44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0000-mdtlov_UUID+2712:3689:x1805522011660160:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2380us (2517us total) trans 4296061654 rc 0/0 00010000:00010000:2.0:1721880422.268347:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727ba55 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.268351:0:16098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631932 00010000:00010000:2.0:1721880422.268353:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727ba55 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.268356:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727ba55 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.268363:0:16110:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880092319f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_094:lustre-MDT0000-mdtlov_UUID+1902:3687:x1805522011658624:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3242us (3265us total) trans 4296019960 rc 0/0 00000100:00100000:3.0:1721880422.268369:0:16110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631925 00000004:00080000:1.0:1721880422.268380:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088615c00/2, rc 0, transno 1094358 00000100:00100000:1.0:1721880422.268387:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088615c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011660160:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1721880422.268422:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c40aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+1901:3688:x1805522011657088:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4562us (4610us total) trans 4296019959 rc 0/0 00000100:00100000:3.0:1721880422.268428:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631920 00010000:00010000:1.0:1721880422.268430:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800966c9f80/0x8a60d30f5718cc32 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b108aee expref: 1355 pid: 16046 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.268438:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2713:3686:x1805522011657600:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4293us (4326us total) trans 4296061656 rc 0/0 00000100:00100000:1.0:1721880422.268441:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801312d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011660288:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.268443:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631922 00000100:00100000:3.0:1721880422.268445:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801312d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011661824:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.268452:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727ba94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.268459:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727ba94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.268461:0:16040:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bb44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:lustre-MDT0000-mdtlov_UUID+2712:3688:x1805522011658880:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3201us (3226us total) trans 4296061655 rc 0/0 00000100:00100000:3.0:1721880422.268463:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.268465:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727ba94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.268467:0:16040:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631927 00010000:00010000:1.0:1721880422.268473:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727ba94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.268478:0:16040:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011661824 00000100:00100000:0.0:1721880422.268480:0:16040:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011661824 00010000:00010000:1.0:1721880422.268480:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727ba94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.268486:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727ba94 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.268492:0:16040:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631938 00010000:00010000:1.0:1721880422.268492:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aaad00 already unused, calling callback (ffffffffa084e330) 00000100:00100000:0.0:1721880422.268495:0:16040:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088616680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:lustre-MDT0000-mdtlov_UUID+2712:3686:x1805522011661824:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.268495:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727ba94 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.268501:0:16120:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880096c9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+1900:3688:x1805522011659136:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3212us (3242us total) trans 4296019961 rc 0/0 00010000:00010000:1.0:1721880422.268502:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727ba94 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1721880422.268504:0:16040:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58098 count 1 00000100:00100000:2.0:1721880422.268505:0:16120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631928 00010000:00010000:0.0:1721880422.268511:0:16040:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325d440/0x8a60d30f5727bac5 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.268511:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727ba94 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.268518:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727ba94 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.268519:0:16040:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091144d80/0x8a60d30f571ec485 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9a6 expref: 340 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.268523:0:16040:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.268524:0:16040:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000004:00080000:2.0:1721880422.268525:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008854d880/2, rc 0, transno 1052665 00000100:00100000:3.0:1721880422.268525:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bb46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1899:3688:x1805522011658112:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3272us (3310us total) trans 4296019962 rc 0/0 00010000:00010000:0.0:1721880422.268526:0:16040:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325d440/0x8a60d30f5727bac5 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.268531:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008854d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011659136:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.268531:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631926 00010000:00010000:0.0:1721880422.268537:0:16040:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091144d80/0x8a60d30f571ec485 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9a6 expref: 340 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.268543:0:16040:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091144d80/0x8a60d30f571ec485 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9a6 expref: 340 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.268549:0:16040:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e616d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_040:lustre-OST0000_UUID:16040:1805522011661952:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.268551:0:16088:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727ba4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.268552:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008854c000/2, rc 0, transno 1052666 00000100:00100000:2.0:1721880422.268556:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008854c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011658112:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.268558:0:16088:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727ba4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.268564:0:16040:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36240 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.268566:0:16088:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727ba4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.268570:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009231a680/2, rc 0, transno 1094359 00010000:00010000:3.0:1721880422.268572:0:16088:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727ba4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.268578:0:16088:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727ba4e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.268579:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130970240/0x8a60d30f571ec351 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a872 expref: 340 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.268580:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009231a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011658880:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1721880422.268583:0:16088:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b5440 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.268586:0:16088:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727ba4e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.268588:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008c409500/2, rc 0, transno 1052663 00000100:00100000:0.0:1721880422.268589:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800919c1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0000_UUID:16075:1805522011660032:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.268590:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008c409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011657088:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.268592:0:16088:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727ba4e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.268598:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727ba8d lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.268602:0:16088:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727ba4e lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.268603:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727ba8d lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.268605:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801312d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011662336:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.268606:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727ba8d lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.268607:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bb45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011662208:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.268608:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727ba4e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.268611:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727ba8d lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.268614:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727ba8d lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.268618:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727ba8d lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.268622:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.268623:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325c6c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.268626:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727ba8d lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.268632:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727ba8d lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.268638:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011662208 00000100:00100000:2.0:1721880422.268640:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011662208 00010000:00010000:0.0:1721880422.268645:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727ba8d lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.268650:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631939 00010000:00010000:0.0:1721880422.268652:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727ba8d lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.268653:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bb47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+1900:3688:x1805522011662208:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.268683:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880092318e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1901:3687:x1805522011659904:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2877us (2977us total) trans 4296019963 rc 0/0 00000100:00100000:1.0:1721880422.268689:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631931 00000100:00100000:1.0:1721880422.268709:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.268719:0:16130:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088615f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0001_UUID:16130:1805522011660928:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.268746:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.268751:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011662336 00000100:00100000:2.0:1721880422.268755:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257691520 00000100:00100000:1.0:1721880422.268756:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011662336 00000100:00100000:2.0:1721880422.268757:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257691520 00010000:00010000:2.0:1721880422.268764:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880072879f80/0x8a60d30f571ec407 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe2ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a928 expref: 340 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.268766:0:16130:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727baa9 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.268775:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bb47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2714:3689:x1805522011658240:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3103us (3146us total) trans 4296061657 rc 0/0 00000100:00100000:2.0:1721880422.268781:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914126 00000100:00100000:0.0:1721880422.268783:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631930 00000100:00100000:2.0:1721880422.268785:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bb46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+340:2005:x1805522257691520:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.268789:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.268791:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880072879f80/0x8a60d30f571ec407 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe2ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a928 expref: 340 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.268795:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bb44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011662080:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.268798:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880072879f80/0x8a60d30f571ec407 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a928 expref: 340 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.268805:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.268806:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.268808:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801363521c0/0x8a60d30f5727baa2 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.268811:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801363521c0/0x8a60d30f5727baa2 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.268815:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.268819:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.268830:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bb46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+340:2005:x1805522257691520:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 45us (84us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.268834:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914126 00000004:00080000:3.0:1721880422.268836:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007bb45500/2, rc 0, transno 1052667 00000100:00100000:3.0:1721880422.268852:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bb45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011659904:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1721880422.268862:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009231ad80/2, rc 0, transno 1094357 00000100:00100000:3.0:1721880422.268867:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009231ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011659264:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1721880422.268874:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880072879f80/0x8a60d30f571ec407 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a928 expref: 339 pid: 16099 timeout: 887 lvb_type: 0 00000004:00080000:3.0:1721880422.268875:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880092319500/2, rc 0, transno 1052664 00000100:00100000:0.0:1721880422.268880:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011662080 00000100:00100000:2.0:1721880422.268882:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bb45f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:15466:1805522011660800:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.268884:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011662080 00000100:00100000:3.0:1721880422.268887:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880092319500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011658624:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.268894:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801363521c0/0x8a60d30f5727baa2 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.268897:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bb46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011662592:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.268904:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631940 00000100:00100000:0.0:1721880422.268909:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088615f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1901:3687:x1805522011662080:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.268914:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.268915:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801363521c0/0x8a60d30f5727baa2 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.268920:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801363521c0/0x8a60d30f5727baa2 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1721880422.268922:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64276 count 1 00010000:00010000:2.0:1721880422.268925:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801363521c0/0x8a60d30f5727baa2 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.268928:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801363521c0/0x8a60d30f5727baa2 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.268928:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1721880422.268932:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801363521c0/0x8a60d30f5727baa2 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.268933:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727bacc lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.268933:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bb45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011662464:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.268935:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801363521c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.268936:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801363521c0/0x8a60d30f5727baa2 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.268940:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801363521c0/0x8a60d30f5727baa2 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.268945:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ea69d40/0x8a60d30f5718e561 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b109dbe expref: 1354 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.268945:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801363521c0/0x8a60d30f5727baa2 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.268947:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.268949:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801363521c0/0x8a60d30f5727baa2 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.268951:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.268953:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.268955:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727bacc lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.268960:0:16110:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011662592 00000100:00100000:3.0:1721880422.268963:0:16110:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011662592 00010000:00010000:0.0:1721880422.268972:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ea69d40/0x8a60d30f5718e561 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b109dbe expref: 1354 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.268976:0:16110:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011662464 00000100:00100000:1.0:1721880422.268978:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801312d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011662848:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1721880422.268978:0:16110:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011662464 00010000:00010000:0.0:1721880422.268987:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ea69d40/0x8a60d30f5718e561 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b109dbe expref: 1354 pid: 16060 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.268989:0:16110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631941 00000100:00100000:3.0:1721880422.268993:0:16110:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088614a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_094:lustre-MDT0000-mdtlov_UUID+1903:3687:x1805522011662592:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.268997:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e615180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011662976:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.268998:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1721880422.269004:0:16110:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64279 count 1 00010000:00010000:3.0:1721880422.269024:0:16110:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727bad3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.269032:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36a80 going to sleep for 11 seconds 00000004:00080000:1.0:1721880422.269034:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880092318a80/2, rc 0, transno 1094361 00010000:00010000:3.0:1721880422.269039:0:16110:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009be20900/0x8a60d30f5718f81c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10aa91 expref: 1354 pid: 16091 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.269040:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bb44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2714:3689:x1805522011660544:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1969us (2006us total) trans 4296061658 rc 0/0 00000100:00100000:1.0:1721880422.269042:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880092318a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011658240:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.269045:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631933 00010000:00010000:3.0:1721880422.269045:0:16110:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.269046:0:16110:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.269049:0:16110:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727bad3 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.269054:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011662848 00000100:00100000:2.0:1721880422.269056:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011662848 00000100:00100000:0.0:1721880422.269058:0:15514:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631942 00000100:00100000:0.0:1721880422.269064:0:15514:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088614700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+1903:3687:x1805522011662464:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.269064:0:16110:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009be20900/0x8a60d30f5718f81c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10aa91 expref: 1354 pid: 16091 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.269067:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631943 00000100:00100000:2.0:1721880422.269070:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2714:3689:x1805522011662848:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1721880422.269073:0:16110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009be20900/0x8a60d30f5718f81c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10aa91 expref: 1354 pid: 16091 timeout: 887 lvb_type: 0 00002000:00080000:0.0:1721880422.269076:0:15514:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64278 count 1 00002000:00080000:2.0:1721880422.269078:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58100 count 1 00000100:00100000:3.0:1721880422.269082:0:16110:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088617100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_094:lustre-OST0001_UUID:16110:1805522011663232:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.269085:0:15514:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727bada lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.269085:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136353a80/0x8a60d30f5727bae1 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.269087:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088617800/2, rc 0, transno 1094362 00010000:00010000:2.0:1721880422.269093:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130978000/0x8a60d30f571ec4a1 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9c2 expref: 338 pid: 16039 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.269094:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088617800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011660544:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.269096:0:15514:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009105c000/0x8a60d30f5718e90b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10a248 expref: 1354 pid: 16025 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.269097:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.269098:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.269100:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136353a80/0x8a60d30f5727bae1 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.269101:0:15514:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1721880422.269102:0:16110:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec180 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.269103:0:15514:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.269105:0:15514:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727bada lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.269111:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130978000/0x8a60d30f571ec4a1 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9c2 expref: 338 pid: 16039 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.269112:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1721880422.269116:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130978000/0x8a60d30f571ec4a1 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9c2 expref: 338 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.269119:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bb45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011662720:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.269120:0:15514:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009105c000/0x8a60d30f5718e90b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10a248 expref: 1354 pid: 16025 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.269122:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bb47100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:15466:1805522011663488:192.168.201.24@tcp:104: 00000004:00080000:3.0:1721880422.269126:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880092319c00/2, rc 0, transno 1094360 00010000:00010000:0.0:1721880422.269129:0:15514:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009105c000/0x8a60d30f5718e90b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10a248 expref: 1354 pid: 16025 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.269139:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.269141:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880092319c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011657600:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.269144:0:15514:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e616300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:15514:1805522011663616:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.269150:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801312d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011663104:0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1721880422.269154:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64277 count 1 00000100:00100000:0.0:1721880422.269159:0:15514:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36540 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.269161:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727bae8 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.269167:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008bf70d80/0x8a60d30f5718e77c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b109e89 expref: 1354 pid: 15445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.269170:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.269171:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.269172:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.269173:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727bae8 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.269182:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008bf70d80/0x8a60d30f5718e77c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b109e89 expref: 1354 pid: 15445 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.269188:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008bf70d80/0x8a60d30f5718e77c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b109e89 expref: 1354 pid: 15445 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.269188:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1721880422.269190:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.269191:0:16120:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011663104 00000100:00100000:3.0:1721880422.269193:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801312d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011663360:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.269194:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bb46300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011663872:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.269195:0:16120:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011663104 00000100:00100000:2.0:1721880422.269203:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde840 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.269209:0:16120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631944 00000100:00100000:2.0:1721880422.269210:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257691648 00000100:00100000:2.0:1721880422.269212:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257691648 00000100:00100000:3.0:1721880422.269212:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.269213:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.269214:0:16120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+2715:3689:x1805522011662336:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1721880422.269219:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800842c58c0/0x8a60d30f5718cf73 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b108c06 expref: 1355 pid: 16089 timeout: 887 lvb_type: 0 00002000:00080000:1.0:1721880422.269225:0:16120:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58099 count 1 00000100:00100000:0.0:1721880422.269227:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257691776 00000100:00100000:0.0:1721880422.269231:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257691776 00000100:00100000:3.0:1721880422.269231:0:16100:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011663360 00000100:00100000:2.0:1721880422.269234:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914127 00000100:00100000:3.0:1721880422.269234:0:16100:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011663360 00010000:00010000:1.0:1721880422.269235:0:16120:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098aa9f80/0x8a60d30f5727baef lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.269237:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e616a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+1355:2007:x1805522257691648:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.269243:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095d76880/0x8a60d30f571ec431 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe2f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a952 expref: 339 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.269246:0:16120:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091146ac0/0x8a60d30f571ec493 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9b4 expref: 339 pid: 16039 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.269248:0:16100:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631945 00010000:00010000:2.0:1721880422.269249:0:7118:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.269252:0:16120:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.269252:0:7118:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800842c58c0/0x8a60d30f5718cf73 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b108c06 expref: 1355 pid: 16089 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.269253:0:16120:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1721880422.269253:0:16100:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088617480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:lustre-MDT0000-mdtlov_UUID+2716:3686:x1805522011663104:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.269255:0:16120:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098aa9f80/0x8a60d30f5727baef lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.269258:0:7118:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800842c58c0/0x8a60d30f5718cf73 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b108c06 expref: 1355 pid: 16089 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.269266:0:7118:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800842c58c0/0x8a60d30f5718cf73 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b108c06 expref: 1355 pid: 16089 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.269269:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914128 00010000:00010000:1.0:1721880422.269272:0:16120:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091146ac0/0x8a60d30f571ec493 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9b4 expref: 339 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.269274:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1721880422.269275:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094637480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+339:2005:x1805522257691776:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.269275:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.269277:0:7118:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727baa9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.269282:0:7118:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727baa9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.269283:0:16100:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58101 count 1 00010000:00010000:0.0:1721880422.269284:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.269286:0:16120:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091146ac0/0x8a60d30f571ec493 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9b4 expref: 339 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.269288:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095d76880/0x8a60d30f571ec431 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe2f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a952 expref: 339 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.269291:0:7118:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.269293:0:16100:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5680/0x8a60d30f5727baf6 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.269296:0:16120:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801312d2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16120:1805522011664000:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.269297:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095d76880/0x8a60d30f571ec431 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a952 expref: 339 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.269300:0:7118:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e616a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+1354:2007:x1805522257691648:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 63us (111us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.269303:0:16100:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096741680/0x8a60d30f571ec4af lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9d0 expref: 339 pid: 16039 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.269304:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914127 00010000:00010000:3.0:1721880422.269309:0:16100:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.269310:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.269311:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.269311:0:16100:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1721880422.269313:0:16120:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a780 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.269313:0:16100:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5680/0x8a60d30f5727baf6 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.269315:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098aabcc0/0x8a60d30f5727bab0 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.269320:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801312d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011663744:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.269322:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098aabcc0/0x8a60d30f5727bab0 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.269330:0:9458:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631946 00010000:00010000:3.0:1721880422.269330:0:16100:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096741680/0x8a60d30f571ec4af lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9d0 expref: 339 pid: 16039 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.269334:0:9458:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088616a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2716:3686:x1805522011663360:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.269335:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.269338:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.269339:0:16100:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096741680/0x8a60d30f571ec4af lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9d0 expref: 339 pid: 16039 timeout: 887 lvb_type: 0 00002000:00080000:1.0:1721880422.269346:0:9458:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58102 count 1 00000100:00100000:3.0:1721880422.269347:0:16100:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088615180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_087:lustre-OST0000_UUID:16100:1805522011664128:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.269351:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094637480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+339:2005:x1805522257691776:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 75us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.269352:0:16098:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011663744 00000100:00100000:2.0:1721880422.269354:0:16098:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011663744 00010000:00010000:1.0:1721880422.269356:0:9458:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098aab600/0x8a60d30f5727bafd lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2f6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.269357:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914128 00000100:00100000:2.0:1721880422.269364:0:16098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631947 00000100:00100000:3.0:1721880422.269364:0:16100:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec300 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.269366:0:9458:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f490b40/0x8a60d30f571ec4c4 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9e5 expref: 338 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.269367:0:16098:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088efe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0000-mdtlov_UUID+2717:3688:x1805522011663744:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.269372:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.269374:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00002000:00080000:2.0:1721880422.269375:0:16098:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58103 count 1 00010000:00010000:1.0:1721880422.269376:0:9458:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098aab600/0x8a60d30f5727bafd lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.269376:0:16130:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727baa9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.269382:0:16098:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136351680/0x8a60d30f5727bb04 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2f7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.269383:0:16130:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727baa9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.269390:0:16098:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130638900/0x8a60d30f571ec4e0 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa01 expref: 338 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.269391:0:9458:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f490b40/0x8a60d30f571ec4c4 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9e5 expref: 338 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.269394:0:16098:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.269394:0:16098:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.269395:0:16130:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727baa9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.269396:0:16098:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136351680/0x8a60d30f5727bb04 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.269401:0:9458:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f490b40/0x8a60d30f571ec4c4 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9e5 expref: 338 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.269402:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.269402:0:16130:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727baa9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.269405:0:16098:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130638900/0x8a60d30f571ec4e0 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa01 expref: 338 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.269408:0:16130:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727baa9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.269410:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257691904 00000100:00100000:0.0:1721880422.269412:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257691904 00010000:00010000:2.0:1721880422.269412:0:16098:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130638900/0x8a60d30f571ec4e0 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa01 expref: 338 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.269414:0:16130:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4900 already unused, calling callback (ffffffffa084e330) 00000100:00100000:1.0:1721880422.269416:0:9458:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801312d3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9458:1805522011664256:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.269417:0:16130:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727baa9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.269418:0:16098:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800919c1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0000_UUID:16098:1805522011664384:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.269422:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094039d40/0x8a60d30f5718d94b lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1093fb expref: 1354 pid: 16089 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.269424:0:16130:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727baa9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.269427:0:16098:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdee40 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.269433:0:9458:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a840 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.269434:0:16130:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727baa9 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.269439:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914129 00010000:00010000:3.0:1721880422.269439:0:16130:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727baa9 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.269444:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094637800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1354:2005:x1805522257691904:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.269447:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.269458:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.269462:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094039d40/0x8a60d30f5718d94b lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1093fb expref: 1354 pid: 16089 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.269472:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094039d40/0x8a60d30f5718d94b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1093fb expref: 1354 pid: 16089 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.269484:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.269485:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.269485:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095d76880/0x8a60d30f571ec431 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a952 expref: 338 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.269488:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727bab7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.269495:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727bab7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.269495:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801312d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0000_UUID:16028:1805522011661440:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.269508:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880098aabcc0/0x8a60d30f5727bab0 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.269510:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.269516:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098aabcc0/0x8a60d30f5727bab0 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.269522:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098aabcc0/0x8a60d30f5727bab0 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.269524:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094637800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1354:2005:x1805522257691904:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 79us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.269526:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.269529:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098aabcc0/0x8a60d30f5727bab0 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.269530:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914129 00010000:00010000:1.0:1721880422.269534:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098aabcc0/0x8a60d30f5727bab0 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.269538:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257692032 00000100:00100000:2.0:1721880422.269540:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257692032 00010000:00010000:1.0:1721880422.269541:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098aabcc0/0x8a60d30f5727bab0 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.269546:0:16130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088615880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0000-mdtlov_UUID+1904:3686:x1805522011660672:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2441us (2467us total) trans 4296019965 rc 0/0 00010000:00010000:2.0:1721880422.269548:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132d0d440/0x8a60d30f571ec45b lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe2f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a97c expref: 338 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.269551:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aabcc0 already unused, calling callback (ffffffffa084e330) 00000100:00100000:3.0:1721880422.269553:0:16130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631934 00010000:00010000:1.0:1721880422.269554:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098aabcc0/0x8a60d30f5727bab0 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.269559:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914130 00010000:00010000:1.0:1721880422.269560:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098aabcc0/0x8a60d30f5727bab0 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.269562:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+338:2004:x1805522257692032:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.269566:0:16130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011662720 00010000:00010000:2.0:1721880422.269567:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.269569:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098aabcc0/0x8a60d30f5727bab0 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.269569:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132d0d440/0x8a60d30f571ec45b lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe2f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a97c expref: 338 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.269570:0:16130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011662720 00010000:00010000:2.0:1721880422.269575:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132d0d440/0x8a60d30f571ec45b lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a97c expref: 338 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.269577:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098aabcc0/0x8a60d30f5727bab0 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.269583:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.269584:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.269585:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098aaba80/0x8a60d30f5727babe lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.269585:0:16130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631948 00000100:00100000:3.0:1721880422.269588:0:16130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008777ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0000-mdtlov_UUID+1904:3689:x1805522011662720:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.269589:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098aaba80/0x8a60d30f5727babe lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.269596:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00080000:3.0:1721880422.269598:0:16130:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64280 count 1 00000100:00100000:2.0:1721880422.269605:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+338:2004:x1805522257692032:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 42us (80us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.269608:0:16130:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727bb0b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.269609:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914130 00010000:00010000:3.0:1721880422.269618:0:16130:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880076ef58c0/0x8a60d30f5718fd1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ac7b expref: 1353 pid: 16096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.269624:0:16130:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.269625:0:16130:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.269627:0:16130:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727bb0b lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.269642:0:16130:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880076ef58c0/0x8a60d30f5718fd1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ac7b expref: 1353 pid: 16096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.269651:0:16130:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880076ef58c0/0x8a60d30f5718fd1d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ac7b expref: 1353 pid: 16096 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.269659:0:16130:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008cd22a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0001_UUID:16130:1805522011664512:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.269686:0:16130:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdece40 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.269694:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088614000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2718:3687:x1805522011661056:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2389us (2421us total) trans 4296061659 rc 0/0 00000100:00100000:1.0:1721880422.269701:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631935 00010000:00010000:3.0:1721880422.269707:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094039d40/0x8a60d30f5718d94b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1093fb expref: 1353 pid: 16089 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.269718:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088617b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011661568:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.269749:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132d0d440/0x8a60d30f571ec45b lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a97c expref: 337 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.269758:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727bab7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.269761:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801312d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0000_UUID:16111:1805522011661696:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.269766:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727bab7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.269771:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727bab7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.269774:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880098aaba80/0x8a60d30f5727babe lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.269778:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727bab7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.269782:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098aaba80/0x8a60d30f5727babe lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.269785:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727bab7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.269791:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727bab7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.269793:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098aaba80/0x8a60d30f5727babe lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.269796:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b6400 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.269798:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727bab7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.269800:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098aaba80/0x8a60d30f5727babe lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.269804:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727bab7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.269807:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098aaba80/0x8a60d30f5727babe lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.269813:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098aaba80/0x8a60d30f5727babe lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.269814:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727bab7 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.269819:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aaba80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.269821:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098aaba80/0x8a60d30f5727babe lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.269824:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727bab7 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.269827:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098aaba80/0x8a60d30f5727babe lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.269837:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098aaba80/0x8a60d30f5727babe lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.269843:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098aaba80/0x8a60d30f5727babe lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.269932:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bb47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+1905:3688:x1805522011661184:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2542us (2583us total) trans 4296019966 rc 0/0 00000100:00100000:3.0:1721880422.269938:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631936 00000100:00100000:1.0:1721880422.269942:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bb44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2718:3688:x1805522011661312:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2506us (2570us total) trans 4296061660 rc 0/0 00000100:00100000:1.0:1721880422.269948:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631937 00000004:00080000:2.0:1721880422.269968:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088616300/2, rc 0, transno 1094364 00000004:00080000:3.0:1721880422.269970:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088615500/2, rc 0, transno 1052669 00000100:00100000:2.0:1721880422.269977:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088616300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011661312:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1721880422.269987:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088615500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011660672:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.270026:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+1904:3689:x1805522011657344:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6013us (6098us total) trans 4296019964 rc 0/0 00000100:00100000:3.0:1721880422.270033:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631921 00000004:00080000:2.0:1721880422.270036:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088614e00/2, rc 0, transno 1052670 00000100:00100000:2.0:1721880422.270040:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088614e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011661184:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.270045:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1721880422.270059:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008777d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011664640:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1721880422.270061:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880135173800/2, rc 0, transno 1052668 00000100:00100000:0.0:1721880422.270076:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135173800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011657344:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.270082:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1721880422.270088:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800919c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011665024:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.270093:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.270111:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.270112:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011664640 00000100:00100000:1.0:1721880422.270116:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011664640 00000100:00100000:1.0:1721880422.270132:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011665024 00000100:00100000:1.0:1721880422.270135:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011665024 00000100:00100000:0.0:1721880422.270139:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631949 00000100:00100000:0.0:1721880422.270143:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2718:3688:x1805522011664640:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.270150:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631950 00002000:00080000:0.0:1721880422.270154:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58104 count 1 00000100:00100000:1.0:1721880422.270154:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+1904:3689:x1805522011665024:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.270162:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325cb40/0x8a60d30f5727bb12 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2f8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.270165:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800919c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011664768:0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.270166:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64283 count 1 00010000:00010000:0.0:1721880422.270170:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e995200/0x8a60d30f571ec503 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa24 expref: 336 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.270174:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.270175:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.270176:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727bb19 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.270177:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325cb40/0x8a60d30f5727bb12 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.270184:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.270187:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092021d40/0x8a60d30f571905f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ae7a expref: 1352 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.270188:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e995200/0x8a60d30f571ec503 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa24 expref: 336 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.270193:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.270194:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.270197:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727bb19 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.270198:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e995200/0x8a60d30f571ec503 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa24 expref: 336 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.270199:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1721880422.270204:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094635880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16125:1805522011665152:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.270204:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011664768 00000100:00100000:3.0:1721880422.270204:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800919c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011664896:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.270209:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011664768 00010000:00010000:1.0:1721880422.270213:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092021d40/0x8a60d30f571905f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ae7a expref: 1352 pid: 15467 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.270222:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.270223:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092021d40/0x8a60d30f571905f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ae7a expref: 1352 pid: 15467 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.270224:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec366c0 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.270229:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011664896 00000100:00100000:1.0:1721880422.270232:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008777d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011665280:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.270232:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011664896 00000100:00100000:2.0:1721880422.270245:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631951 00000004:00080000:3.0:1721880422.270247:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088616d80/2, rc 0, transno 1094363 00000100:00100000:2.0:1721880422.270250:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cd23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+1906:3686:x1805522011664768:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.270253:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a240 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.270254:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088616d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011661056:0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1721880422.270264:0:16088:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64281 count 1 00000100:00100000:1.0:1721880422.270268:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631952 00010000:00010000:2.0:1721880422.270273:0:16088:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727bb20 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.270274:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ebd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+1906:3686:x1805522011664896:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.270283:0:16088:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800913a3600/0x8a60d30f5719005e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ad1c expref: 1352 pid: 16117 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.270285:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64282 count 1 00000100:00100000:3.0:1721880422.270287:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011665408:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1721880422.270288:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.270290:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.270291:0:16088:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727bb20 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.270296:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727bb27 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.270303:0:16088:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800913a3600/0x8a60d30f5719005e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ad1c expref: 1352 pid: 16117 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.270305:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.270306:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880076ef5f80/0x8a60d30f571902f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ade0 expref: 1352 pid: 16032 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.270309:0:16088:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800913a3600/0x8a60d30f5719005e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ad1c expref: 1352 pid: 16117 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.270312:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.270313:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.270316:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727bb27 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.270316:0:16088:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800919c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011665536:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.270321:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011665408 00000100:00100000:0.0:1721880422.270324:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011665408 00010000:00010000:1.0:1721880422.270332:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880076ef5f80/0x8a60d30f571902f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ade0 expref: 1352 pid: 16032 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.270335:0:16088:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfded80 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.270336:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631953 00000100:00100000:0.0:1721880422.270339:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088efd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2719:3689:x1805522011665408:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.270342:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880076ef5f80/0x8a60d30f571902f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ade0 expref: 1352 pid: 16032 timeout: 887 lvb_type: 0 00002000:00080000:0.0:1721880422.270347:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58105 count 1 00000100:00100000:1.0:1721880422.270352:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801312d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011665664:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.270355:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325e400/0x8a60d30f5727bb2e lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2f9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.270363:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f493a80/0x8a60d30f571ec51f lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa40 expref: 336 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.270368:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.270368:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.270370:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325e400/0x8a60d30f5727bb2e lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.270372:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522af00 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.270441:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f493a80/0x8a60d30f571ec51f lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa40 expref: 336 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.270447:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f493a80/0x8a60d30f571ec51f lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa40 expref: 336 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.270457:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094634000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:15453:1805522011665792:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.270473:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36000 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.270481:0:16040:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e616d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_040:lustre-OST0000_UUID:16040:1805522011661952:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.270500:0:16040:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325d440/0x8a60d30f5727bac5 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.270503:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e615180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011662976:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.270514:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727bacc lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.270552:0:16110:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088617100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_094:lustre-OST0001_UUID:16110:1805522011663232:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.270561:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bb47100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:15466:1805522011663488:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.270564:0:16110:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727bad3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.270572:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136353a80/0x8a60d30f5727bae1 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.270906:0:15514:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e616300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:15514:1805522011663616:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.270917:0:15514:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727bada lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.271225:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bb46300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011663872:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.271235:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727bae8 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.271244:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.271250:0:16120:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801312d2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16120:1805522011664000:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.271258:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257692928 00000100:00100000:2.0:1721880422.271260:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257692928 00010000:00010000:1.0:1721880422.271265:0:16120:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880098aa9f80/0x8a60d30f5727baef lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.271268:0:16100:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088615180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_087:lustre-OST0000_UUID:16100:1805522011664128:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.271269:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091146ac0/0x8a60d30f571ec493 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9b4 expref: 337 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.271280:0:16100:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5680/0x8a60d30f5727baf6 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.271281:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.271290:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257692160 00000100:00100000:2.0:1721880422.271291:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257692160 00000100:00100000:2.0:1721880422.271298:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914131 00000100:00100000:2.0:1721880422.271301:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+338:2007:x1805522257692928:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.271307:0:7118:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.271309:0:7118:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091146ac0/0x8a60d30f571ec493 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9b4 expref: 338 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.271315:0:7118:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091146ac0/0x8a60d30f571ec493 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9b4 expref: 338 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.271317:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.271328:0:7118:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091146ac0/0x8a60d30f571ec493 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9b4 expref: 338 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.271330:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.271330:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257692416 00000100:00100000:1.0:1721880422.271334:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257692416 00010000:00010000:2.0:1721880422.271338:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.271339:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.271341:0:7118:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098aa9f80/0x8a60d30f5727baef lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.271343:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.271343:0:7117:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257692672 00010000:00010000:1.0:1721880422.271345:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009be20900/0x8a60d30f5718f81c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10aa91 expref: 1353 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.271345:0:7118:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098aa9f80/0x8a60d30f5727baef lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.271345:0:7117:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257692672 00010000:00010000:2.0:1721880422.271355:0:7118:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.271356:0:7117:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009105c000/0x8a60d30f5718e90b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10a248 expref: 1354 pid: 16025 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.271364:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257693056 00000100:00100000:1.0:1721880422.271366:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257693056 00000100:00100000:0.0:1721880422.271370:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.271370:0:7118:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+338:2007:x1805522257692928:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 67us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.271371:0:7117:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914132 00010000:00010000:1.0:1721880422.271373:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096741680/0x8a60d30f571ec4af lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9d0 expref: 338 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.271375:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914131 00000100:00100000:3.0:1721880422.271376:0:7117:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30425778-2709-4512-9d75-01ec53c4cfad+1354:2005:x1805522257692416:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.271382:0:7117:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.271384:0:7117:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009be20900/0x8a60d30f5718f81c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10aa91 expref: 1354 pid: 16091 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.271385:0:7118:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257692288 00000100:00100000:1.0:1721880422.271386:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914133 00000100:00100000:2.0:1721880422.271387:0:7118:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257692288 00000100:00100000:1.0:1721880422.271390:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1355:2005:x1805522257692672:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.271391:0:7117:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009be20900/0x8a60d30f5718f81c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10aa91 expref: 1355 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.271393:0:7118:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ea69d40/0x8a60d30f5718e561 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b109dbe expref: 1355 pid: 16060 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.271397:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.271400:0:7117:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009be20900/0x8a60d30f5718f81c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10aa91 expref: 1355 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.271401:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009105c000/0x8a60d30f5718e90b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10a248 expref: 1355 pid: 16025 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.271404:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914134 00000100:00100000:2.0:1721880422.271408:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+337:2005:x1805522257693056:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.271409:0:7117:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.271410:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009105c000/0x8a60d30f5718e90b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10a248 expref: 1354 pid: 16025 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.271410:0:7117:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.271412:0:7118:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.271413:0:7117:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727bad3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.271416:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.271416:0:7118:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096741680/0x8a60d30f571ec4af lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9d0 expref: 337 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.271422:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009105c000/0x8a60d30f5718e90b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10a248 expref: 1354 pid: 16025 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.271424:0:7117:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727bad3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.271425:0:7118:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096741680/0x8a60d30f571ec4af lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9d0 expref: 337 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.271430:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257692544 00010000:00010000:1.0:1721880422.271432:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.271432:0:7118:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096741680/0x8a60d30f571ec4af lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9d0 expref: 337 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.271433:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257692544 00010000:00010000:1.0:1721880422.271433:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.271435:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727bada lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.271437:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.271438:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.271439:0:7117:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.271440:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727bada lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.271440:0:7118:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5680/0x8a60d30f5727baf6 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.271444:0:7118:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5680/0x8a60d30f5727baf6 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.271445:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130978000/0x8a60d30f571ec4a1 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9c2 expref: 337 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.271450:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.271453:0:7118:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.271463:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914135 00000100:00100000:1.0:1721880422.271465:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1353:2005:x1805522257692672:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 75us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.271465:0:7117:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30425778-2709-4512-9d75-01ec53c4cfad+1353:2005:x1805522257692416:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 87us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.271466:0:7118:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+337:2005:x1805522257693056:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 57us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.271468:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1353:2005:x1805522257692288:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.271469:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914133 00000100:00100000:2.0:1721880422.271472:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914134 00010000:00010000:0.0:1721880422.271476:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.271476:0:7117:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914132 00010000:00010000:0.0:1721880422.271480:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ea69d40/0x8a60d30f5718e561 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b109dbe expref: 1352 pid: 16060 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.271480:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914136 00000100:00100000:1.0:1721880422.271483:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+336:2005:x1805522257692544:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.271488:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.271491:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130978000/0x8a60d30f571ec4a1 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9c2 expref: 336 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.271494:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ea69d40/0x8a60d30f5718e561 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b109dbe expref: 1351 pid: 16060 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.271494:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091144d80/0x8a60d30f571ec485 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9a6 expref: 336 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.271497:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130978000/0x8a60d30f571ec4a1 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9c2 expref: 336 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.271505:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130978000/0x8a60d30f571ec4a1 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9c2 expref: 336 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.271506:0:16188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914137 00010000:00010000:0.0:1721880422.271507:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ea69d40/0x8a60d30f5718e561 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b109dbe expref: 1351 pid: 16060 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.271511:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.271512:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.271512:0:16188:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8066c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+335:2005:x1805522257692160:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.271513:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136353a80/0x8a60d30f5727bae1 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.271517:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.271518:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136353a80/0x8a60d30f5727bae1 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.271519:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.271519:0:16098:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800919c1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0000_UUID:16098:1805522011664384:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.271520:0:16188:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.271521:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727bacc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.271525:0:16188:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091144d80/0x8a60d30f571ec485 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9a6 expref: 335 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.271527:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.271527:0:16098:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136351680/0x8a60d30f5727bb04 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.271528:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727bacc lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.271536:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+335:2005:x1805522257692544:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 52us (121us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.271538:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136353a80/0x8a60d30f5727bae1 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.271540:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914136 00010000:00010000:2.0:1721880422.271543:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136353a80/0x8a60d30f5727bae1 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.271544:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.271547:0:16188:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091144d80/0x8a60d30f571ec485 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9a6 expref: 335 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.271548:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136353a80/0x8a60d30f5727bae1 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.271552:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136353a80/0x8a60d30f5727bae1 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.271555:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136353a80/0x8a60d30f5727bae1 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.271558:0:16120:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098aa9f80/0x8a60d30f5727baef lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.271558:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353a80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.271558:0:16188:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091144d80/0x8a60d30f571ec485 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9a6 expref: 334 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.271560:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136353a80/0x8a60d30f5727bae1 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.271562:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1350:2005:x1805522257692288:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 92us (190us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.271563:0:16120:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098aa9f80/0x8a60d30f5727baef lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.271564:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136353a80/0x8a60d30f5727bae1 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.271567:0:16120:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098aa9f80/0x8a60d30f5727baef lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.271569:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914135 00010000:00010000:2.0:1721880422.271570:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136353a80/0x8a60d30f5727bae1 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.271570:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.271571:0:16120:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098aa9f80/0x8a60d30f5727baef lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.271571:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.271573:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136353a80/0x8a60d30f5727bae1 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.271574:0:16120:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098aa9f80/0x8a60d30f5727baef lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.271574:0:16188:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009325d440/0x8a60d30f5727bac5 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.271578:0:16120:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa9f80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.271579:0:16120:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098aa9f80/0x8a60d30f5727baef lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.271580:0:16188:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325d440/0x8a60d30f5727bac5 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.271583:0:16120:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098aa9f80/0x8a60d30f5727baef lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.271591:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727bacc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.271592:0:16120:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098aa9f80/0x8a60d30f5727baef lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.271595:0:16188:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.271596:0:16120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098aa9f80/0x8a60d30f5727baef lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.271599:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727bacc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.271606:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727bacc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.271613:0:16188:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8066c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+333:2005:x1805522257692160:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 101us (332us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.271617:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727bacc lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.271619:0:16188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914137 00010000:00010000:0.0:1721880422.271623:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727bacc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.271628:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325cfc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.271631:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727bacc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.271636:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727bacc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.271644:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727bacc lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.271650:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727bacc lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.271651:0:15514:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727bada lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.271655:0:15514:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727bada lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.271659:0:15514:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727bada lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.271663:0:15514:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727bada lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.271666:0:15514:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727bada lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.271670:0:15514:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325db00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.271671:0:15514:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727bada lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.271671:0:16110:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727bad3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.271675:0:15514:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727bada lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.271679:0:16110:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727bad3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.271681:0:15514:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727bada lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.271685:0:15514:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727bada lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.271686:0:16110:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727bad3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.271692:0:16110:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727bad3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.271699:0:16110:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727bad3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.271702:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2721:3689:x1805522011662848:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2629us (2703us total) trans 4296061661 rc 0/0 00010000:00010000:3.0:1721880422.271704:0:16110:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b6d00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.271707:0:16110:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727bad3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.271708:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631943 00010000:00010000:3.0:1721880422.271713:0:16110:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727bad3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.271747:0:16110:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727bad3 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.271754:0:16110:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727bad3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.271785:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088615f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1908:3687:x1805522011662080:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2875us (2969us total) trans 4296019967 rc 0/0 00000100:00100000:2.0:1721880422.271786:0:16120:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+2720:3689:x1805522011662336:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2572us (3076us total) trans 4296061662 rc 0/0 00000100:00100000:0.0:1721880422.271789:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631940 00000100:00100000:2.0:1721880422.271791:0:16120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631944 00000100:00100000:1.0:1721880422.271804:0:15514:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088614700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+1907:3687:x1805522011662464:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2740us (2855us total) trans 4296019968 rc 0/0 00000100:00100000:1.0:1721880422.271809:0:15514:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631942 00010000:00010000:1.0:1721880422.271823:0:16040:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325d440/0x8a60d30f5727bac5 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.271825:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.271828:0:16040:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325d440/0x8a60d30f5727bac5 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.271832:0:16040:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325d440/0x8a60d30f5727bac5 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.271836:0:16040:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325d440/0x8a60d30f5727bac5 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.271839:0:16040:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325d440/0x8a60d30f5727bac5 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.271842:0:16040:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325d440 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.271844:0:16040:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325d440/0x8a60d30f5727bac5 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.271848:0:16040:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325d440/0x8a60d30f5727bac5 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.271851:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257692800 00010000:00010000:1.0:1721880422.271854:0:16040:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325d440/0x8a60d30f5727bac5 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.271855:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257692800 00010000:00010000:1.0:1721880422.271857:0:16040:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325d440/0x8a60d30f5727bac5 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.271867:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094635880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16125:1805522011665152:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.271868:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008bf70d80/0x8a60d30f5718e77c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b109e89 expref: 1350 pid: 15445 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.271880:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325cb40/0x8a60d30f5727bb12 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.271883:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914138 00000100:00100000:2.0:1721880422.271887:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.271887:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+1350:2005:x1805522257692800:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.271894:0:15473:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.271899:0:15473:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008bf70d80/0x8a60d30f5718e77c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b109e89 expref: 1350 pid: 15445 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.271905:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257693184 00000100:00100000:0.0:1721880422.271907:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257693184 00010000:00010000:3.0:1721880422.271907:0:15473:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008bf70d80/0x8a60d30f5718e77c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b109e89 expref: 1350 pid: 15445 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.271916:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.271918:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130638900/0x8a60d30f571ec4e0 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa01 expref: 333 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.271918:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008bf70d80/0x8a60d30f5718e77c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b109e89 expref: 1350 pid: 15445 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.271929:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.271930:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1721880422.271931:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257693440 00000100:00100000:0.0:1721880422.271933:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257693440 00010000:00010000:3.0:1721880422.271934:0:15473:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727bae8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.271941:0:15473:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727bae8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.271942:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880076ef58c0/0x8a60d30f5718fd1d lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ac7b expref: 1350 pid: 16096 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.271943:0:16040:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088616680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:lustre-MDT0000-mdtlov_UUID+2720:3686:x1805522011661824:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3444us (3478us total) trans 4296061663 rc 0/0 00000100:00100000:1.0:1721880422.271948:0:16040:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631938 00000100:00100000:2.0:1721880422.271948:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.271956:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257693568 00010000:00010000:3.0:1721880422.271956:0:15473:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.271958:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257693568 00010000:00010000:0.0:1721880422.271964:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e995200/0x8a60d30f571ec503 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa24 expref: 334 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.271964:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914139 00000100:00100000:2.0:1721880422.271967:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a70ef850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+334:2005:x1805522257693184:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.271971:0:9458:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801312d3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9458:1805522011664256:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.271974:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1721880422.271976:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914140 00010000:00010000:2.0:1721880422.271977:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130638900/0x8a60d30f571ec4e0 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa01 expref: 334 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.271980:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1350:2007:x1805522257693440:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.271980:0:9458:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880098aab600/0x8a60d30f5727bafd lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.271984:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130638900/0x8a60d30f571ec4e0 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa01 expref: 334 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.271984:0:15473:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+1350:2005:x1805522257692800:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 95us (158us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.271987:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.271990:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880076ef58c0/0x8a60d30f5718fd1d lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ac7b expref: 1350 pid: 16096 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.271991:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914138 00010000:00010000:2.0:1721880422.271993:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130638900/0x8a60d30f571ec4e0 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa01 expref: 334 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.271994:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008777d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011665280:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.271998:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880076ef58c0/0x8a60d30f5718fd1d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ac7b expref: 1350 pid: 16096 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.272000:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.272001:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.272003:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136351680/0x8a60d30f5727bb04 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.272004:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727bb19 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.272006:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914141 00010000:00010000:2.0:1721880422.272007:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136351680/0x8a60d30f5727bb04 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.272008:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.272009:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.272027:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+333:2004:x1805522257693568:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.272028:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727bb0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.272032:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801312d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011665664:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.272035:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727bb0b lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.272036:0:15473:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.272041:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.272041:0:15473:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e995200/0x8a60d30f571ec503 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa24 expref: 333 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.272043:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727bb27 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.272047:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.272050:0:15473:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e995200/0x8a60d30f571ec503 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa24 expref: 333 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.272054:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a70ef850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+333:2005:x1805522257693184:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 86us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.272059:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914139 00000100:00100000:0.0:1721880422.272060:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1349:2007:x1805522257693440:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 79us (144us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.272062:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e995200/0x8a60d30f571ec503 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa24 expref: 333 pid: 16126 timeout: 887 lvb_type: 0 00000004:00080000:1.0:1721880422.272064:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801312d1180/2, rc 0, transno 1094367 00000100:00100000:0.0:1721880422.272065:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914140 00000100:00100000:1.0:1721880422.272071:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801312d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011661824:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1721880422.272071:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.272073:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.272075:0:15473:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009325cb40/0x8a60d30f5727bb12 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.272082:0:15473:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325cb40/0x8a60d30f5727bb12 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.272090:0:16098:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136351680/0x8a60d30f5727bb04 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.272095:0:16098:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136351680/0x8a60d30f5727bb04 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.272097:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801312d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011665920:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1721880422.272098:0:15473:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.272099:0:16098:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136351680/0x8a60d30f5727bb04 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.272103:0:16098:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136351680/0x8a60d30f5727bb04 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.272104:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325cb40/0x8a60d30f5727bb12 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.272107:0:16098:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136351680/0x8a60d30f5727bb04 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.272109:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325cb40/0x8a60d30f5727bb12 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.272110:0:16098:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136351680 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.272111:0:16098:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136351680/0x8a60d30f5727bb04 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.272114:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325cb40/0x8a60d30f5727bb12 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.272115:0:16098:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136351680/0x8a60d30f5727bb04 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.272116:0:15473:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+331:2004:x1805522257693568:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 104us (167us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.272118:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325cb40/0x8a60d30f5727bb12 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.272119:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.272121:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325cb40/0x8a60d30f5727bb12 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.272122:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914141 00010000:00010000:0.0:1721880422.272124:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325cb40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.272125:0:16098:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136351680/0x8a60d30f5727bb04 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.272126:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325cb40/0x8a60d30f5727bb12 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.272129:0:16098:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136351680/0x8a60d30f5727bb04 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.272133:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325cb40/0x8a60d30f5727bb12 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.272140:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325cb40/0x8a60d30f5727bb12 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.272140:0:16040:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011665920 00010000:00010000:0.0:1721880422.272143:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325cb40/0x8a60d30f5727bb12 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.272144:0:16040:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011665920 00000100:00100000:1.0:1721880422.272158:0:16040:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631954 00010000:00010000:3.0:1721880422.272158:0:16130:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880076ef58c0/0x8a60d30f5718fd1d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ac7b expref: 1348 pid: 16096 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.272162:0:16040:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:lustre-MDT0000-mdtlov_UUID+2720:3686:x1805522011665920:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1721880422.272167:0:16130:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008cd22a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0001_UUID:16130:1805522011664512:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.272181:0:16130:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727bb0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.272187:0:16130:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727bb0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.272194:0:16130:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727bb0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.272195:0:16040:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58106 count 1 00010000:00010000:3.0:1721880422.272201:0:16130:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727bb0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.272204:0:16040:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098aaaac0/0x8a60d30f5727bb35 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2fa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.272208:0:16130:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727bb0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.272214:0:16040:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801350d4480/0x8a60d30f571ec53b lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa5c expref: 330 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.272214:0:16130:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727bb0b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.272221:0:16040:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.272222:0:16040:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.272224:0:16040:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098aaaac0/0x8a60d30f5727bb35 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.272225:0:16098:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088efe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0000-mdtlov_UUID+2722:3688:x1805522011663744:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2856us (2888us total) trans 4296061664 rc 0/0 00010000:00010000:3.0:1721880422.272226:0:16130:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b5f80 already unused, calling callback (ffffffffa084e330) 00000100:00100000:2.0:1721880422.272229:0:16098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631947 00010000:00010000:3.0:1721880422.272229:0:16130:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727bb0b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.272235:0:16130:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727bb0b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.272237:0:16040:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801350d4480/0x8a60d30f571ec53b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa5c expref: 330 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.272242:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727bae8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.272243:0:16040:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801350d4480/0x8a60d30f571ec53b lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa5c expref: 330 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.272244:0:16130:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727bb0b lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.272247:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727bae8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.272250:0:16130:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727bb0b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.272252:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727bae8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.272253:0:16040:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801312d2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_040:lustre-OST0000_UUID:16040:1805522011666048:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.272255:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727bae8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.272259:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727bae8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.272262:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352d00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.272264:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727bae8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.272267:0:16040:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522af00 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.272269:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727bae8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.272275:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727bae8 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.272279:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727bae8 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.272286:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2721:3688:x1805522011664640:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2141us (2191us total) trans 4296061665 rc 0/0 00000100:00100000:0.0:1721880422.272291:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631949 00000100:00100000:3.0:1721880422.272366:0:16110:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088614a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_094:lustre-MDT0000-mdtlov_UUID+1909:3687:x1805522011662592:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3371us (3450us total) trans 4296019969 rc 0/0 00000100:00100000:2.0:1721880422.272369:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bb47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+1909:3688:x1805522011662208:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3714us (3745us total) trans 4296019971 rc 0/0 00000100:00100000:3.0:1721880422.272373:0:16110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631941 00000100:00100000:2.0:1721880422.272377:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631939 00000100:00100000:0.0:1721880422.272378:0:16130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008777ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0000-mdtlov_UUID+1909:3689:x1805522011662720:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2788us (2930us total) trans 4296019970 rc 0/0 00000100:00100000:0.0:1721880422.272384:0:16130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631948 00010000:00010000:3.0:1721880422.272394:0:16100:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5680/0x8a60d30f5727baf6 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.272397:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008777d500/2, rc 0, transno 1094369 00010000:00010000:3.0:1721880422.272401:0:16100:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5680/0x8a60d30f5727baf6 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.272408:0:16100:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5680/0x8a60d30f5727baf6 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.272410:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008777d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011664640:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1721880422.272415:0:16100:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5680/0x8a60d30f5727baf6 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.272416:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801312d0e00/2, rc 0, transno 1094368 00000100:00100000:2.0:1721880422.272418:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801312d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011663744:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1721880422.272422:0:16100:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5680/0x8a60d30f5727baf6 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.272424:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007bb45180/2, rc 0, transno 1052675 00000100:00100000:2.0:1721880422.272428:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bb45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011662208:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.272428:0:16100:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b5680 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.272431:0:16100:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5680/0x8a60d30f5727baf6 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.272437:0:16100:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5680/0x8a60d30f5727baf6 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.272447:0:16100:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5680/0x8a60d30f5727baf6 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.272452:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008777d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011666304:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.272453:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1721880422.272453:0:16100:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5680/0x8a60d30f5727baf6 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.272461:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801312d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011666176:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.272466:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.272468:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.272484:0:16188:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257693824 00000100:00100000:0.0:1721880422.272487:0:16130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011666304 00000100:00100000:1.0:1721880422.272488:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1721880422.272488:0:16188:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257693824 00000100:00100000:0.0:1721880422.272490:0:16130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011666304 00000100:00100000:1.0:1721880422.272491:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800919c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011666432:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.272498:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.272499:0:16188:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800913a3600/0x8a60d30f5719005e lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ad1c expref: 1348 pid: 16117 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.272502:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.272506:0:16130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011666432 00000100:00100000:0.0:1721880422.272508:0:16130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011666432 00000100:00100000:1.0:1721880422.272518:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631955 00000100:00100000:1.0:1721880422.272522:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2721:3688:x1805522011666304:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.272523:0:16130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631956 00000100:00100000:3.0:1721880422.272525:0:16188:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257693312 00000100:00100000:0.0:1721880422.272527:0:16130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0000-mdtlov_UUID+1907:3688:x1805522011666432:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.272528:0:16188:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257693312 00002000:00080000:1.0:1721880422.272531:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58108 count 1 00000100:00100000:2.0:1721880422.272531:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914142 00000100:00100000:2.0:1721880422.272535:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008854dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1348:2004:x1805522257693824:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.272538:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098aab840/0x8a60d30f5727bb3c lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.272539:0:16188:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f490b40/0x8a60d30f571ec4c4 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9e5 expref: 331 pid: 16101 timeout: 887 lvb_type: 0 00002000:00080000:0.0:1721880422.272540:0:16130:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64284 count 1 00010000:00010000:2.0:1721880422.272541:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.272544:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800913a3600/0x8a60d30f5719005e lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ad1c expref: 1348 pid: 16117 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.272545:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009735f840/0x8a60d30f571ec56c lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa8d expref: 331 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.272549:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.272550:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.272551:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098aab840/0x8a60d30f5727bb3c lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.272552:0:16130:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727bb43 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.272552:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800913a3600/0x8a60d30f5719005e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ad1c expref: 1348 pid: 16117 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.272560:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009735f840/0x8a60d30f571ec56c lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa8d expref: 331 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.272562:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.272563:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.272563:0:16188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914143 00010000:00010000:1.0:1721880422.272565:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009735f840/0x8a60d30f571ec56c lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa8d expref: 331 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.272565:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727bb20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.272566:0:16130:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098bb3600/0x8a60d30f57190868 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10af1b expref: 1348 pid: 15515 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.272568:0:16188:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008854df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+331:2004:x1805522257693312:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.272570:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727bb20 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.272571:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801341d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0000_UUID:16089:1805522011666560:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.272572:0:16130:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.272574:0:16130:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.272576:0:16130:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727bb43 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.272577:0:16188:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.272580:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.272581:0:16188:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f490b40/0x8a60d30f571ec4c4 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9e5 expref: 331 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.272584:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a240 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.272589:0:16188:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f490b40/0x8a60d30f571ec4c4 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9e5 expref: 331 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.272591:0:16130:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098bb3600/0x8a60d30f57190868 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10af1b expref: 1348 pid: 15515 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.272592:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008854dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1348:2004:x1805522257693824:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 57us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.272595:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914142 00010000:00010000:0.0:1721880422.272600:0:16130:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098bb3600/0x8a60d30f57190868 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10af1b expref: 1348 pid: 15515 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.272601:0:16188:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f490b40/0x8a60d30f571ec4c4 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9e5 expref: 331 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.272609:0:16130:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0001_UUID:16130:1805522011666688:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.272610:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.272612:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.272613:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.272616:0:16188:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098aab600/0x8a60d30f5727bafd lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.272618:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257693696 00000100:00100000:2.0:1721880422.272620:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257693696 00010000:00010000:3.0:1721880422.272623:0:16188:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098aab600/0x8a60d30f5727bafd lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.272626:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092021d40/0x8a60d30f571905f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ae7a expref: 1348 pid: 15467 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.272628:0:16130:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec366c0 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.272636:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914144 00010000:00010000:3.0:1721880422.272637:0:16188:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.272639:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008854ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1348:2004:x1805522257693696:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.272642:0:9458:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098aab600/0x8a60d30f5727bafd lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.272643:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.272646:0:9458:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098aab600/0x8a60d30f5727bafd lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.272646:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092021d40/0x8a60d30f571905f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ae7a expref: 1348 pid: 15467 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.272650:0:9458:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098aab600/0x8a60d30f5727bafd lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.272654:0:9458:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098aab600/0x8a60d30f5727bafd lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.272655:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092021d40/0x8a60d30f571905f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ae7a expref: 1348 pid: 15467 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.272657:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.272657:0:9458:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098aab600/0x8a60d30f5727bafd lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.272658:0:16188:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008854df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+330:2004:x1805522257693312:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 89us (158us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.272661:0:9458:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aab600 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.272662:0:9458:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098aab600/0x8a60d30f5727bafd lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.272662:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092021d40/0x8a60d30f571905f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ae7a expref: 1348 pid: 15467 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.272665:0:16188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914143 00010000:00010000:1.0:1721880422.272666:0:9458:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098aab600/0x8a60d30f5727bafd lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.272669:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.272670:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.272671:0:9458:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098aab600/0x8a60d30f5727bafd lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.272672:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727bb19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.272676:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098aab600/0x8a60d30f5727bafd lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.272676:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727bb19 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.272677:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011666176 00000100:00100000:0.0:1721880422.272679:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011666176 00010000:00010000:2.0:1721880422.272684:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.272693:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631957 00000100:00100000:2.0:1721880422.272694:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008854ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1347:2004:x1805522257693696:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 54us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.272697:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a65cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2722:3686:x1805522011666176:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.272698:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914144 00002000:00080000:0.0:1721880422.272707:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58107 count 1 00010000:00010000:0.0:1721880422.272717:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325f840/0x8a60d30f5727bb4a lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2fb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.272718:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727bb19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.272723:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727bb19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.272724:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.272745:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727bb19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.272747:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257693952 00010000:00010000:1.0:1721880422.272749:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727bb19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.272749:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257693952 00010000:00010000:1.0:1721880422.272753:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727bb19 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.272756:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880076ef5f80/0x8a60d30f571902f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ade0 expref: 1347 pid: 16032 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.272758:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aaa400 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.272759:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727bb19 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.272760:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801350d5f80/0x8a60d30f571ec550 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa71 expref: 329 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.272763:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727bb19 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.272766:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.272767:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914145 00010000:00010000:0.0:1721880422.272768:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.272769:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727bb19 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.272769:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008854f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1347:2004:x1805522257693952:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.272770:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325f840/0x8a60d30f5727bb4a lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.272773:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727bb19 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.272774:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.272776:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880076ef5f80/0x8a60d30f571902f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ade0 expref: 1347 pid: 16032 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.272781:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880076ef5f80/0x8a60d30f571902f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ade0 expref: 1347 pid: 16032 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.272787:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801350d5f80/0x8a60d30f571ec550 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa71 expref: 329 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.272789:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880076ef5f80/0x8a60d30f571902f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ade0 expref: 1347 pid: 16032 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.272790:0:16100:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088617480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:lustre-MDT0000-mdtlov_UUID+2724:3686:x1805522011663104:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3536us (3618us total) trans 4296061666 rc 0/0 00010000:00010000:2.0:1721880422.272794:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.272795:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.272795:0:16100:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631945 00010000:00010000:0.0:1721880422.272796:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801350d5f80/0x8a60d30f571ec550 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa71 expref: 329 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.272797:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727bb27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.272801:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727bb27 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.272805:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16125:1805522011666816:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.272810:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.272820:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008854f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1346:2004:x1805522257693952:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 50us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.272821:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36a80 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.272823:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914145 00010000:00010000:2.0:1721880422.272840:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800913a3600/0x8a60d30f5719005e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ad1c expref: 1345 pid: 16117 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.272849:0:16088:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800919c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011665536:192.168.201.24@tcp:104: 00000004:00080000:0.0:1721880422.272851:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801312d3480/2, rc 0, transno 1094370 00010000:00010000:2.0:1721880422.272858:0:16088:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727bb20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.272859:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801312d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011663104:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1721880422.272864:0:16088:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727bb20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.272868:0:16088:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727bb20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.272872:0:16088:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727bb20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.272876:0:16088:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727bb20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.272879:0:16088:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727bb20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.272882:0:16088:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350480 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.272884:0:16088:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727bb20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.272887:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011666944:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1721880422.272888:0:16088:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727bb20 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.272891:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007bb45c00/2, rc 0, transno 1052672 00010000:00010000:2.0:1721880422.272893:0:16088:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727bb20 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.272896:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727bb20 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.272897:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bb45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011662464:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.272908:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1721880422.272921:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007bb46680/2, rc 0, transno 1052673 00000100:00100000:0.0:1721880422.272923:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1721880422.272924:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bb46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011662592:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.272929:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011667072:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1721880422.272943:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007bb44e00/2, rc 0, transno 1052671 00000100:00100000:3.0:1721880422.272947:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bb44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011662080:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.272953:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.272953:0:9458:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088616a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2723:3686:x1805522011663360:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3618us (3740us total) trans 4296061667 rc 0/0 00000100:00100000:1.0:1721880422.272958:0:9458:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631946 00000100:00100000:1.0:1721880422.272968:0:9458:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011666944 00000100:00100000:0.0:1721880422.272969:0:16110:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011667072 00000100:00100000:1.0:1721880422.272970:0:9458:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011666944 00000100:00100000:0.0:1721880422.272972:0:16110:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011667072 00000100:00100000:3.0:1721880422.272973:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088eff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011667328:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.272989:0:9458:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631958 00000100:00100000:1.0:1721880422.272991:0:9458:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2723:3686:x1805522011666944:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.272995:0:16110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631959 00000100:00100000:3.0:1721880422.272996:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.272999:0:16110:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_094:lustre-MDT0000-mdtlov_UUID+1909:3686:x1805522011667072:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.272999:0:9458:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58109 count 1 00010000:00010000:1.0:1721880422.273007:0:9458:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098aab3c0/0x8a60d30f5727bb51 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2fd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1721880422.273010:0:16110:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64285 count 1 00010000:00010000:1.0:1721880422.273025:0:9458:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094100d80/0x8a60d30f571ec588 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aaa9 expref: 329 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.273029:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.273030:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.273031:0:9458:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098aab3c0/0x8a60d30f5727bb51 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.273037:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007bb45f80/2, rc 0, transno 1052674 00010000:00010000:0.0:1721880422.273038:0:16110:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727bb58 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.273042:0:9458:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094100d80/0x8a60d30f571ec588 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aaa9 expref: 329 pid: 16039 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.273042:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bb45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011662720:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.273047:0:9458:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094100d80/0x8a60d30f571ec588 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aaa9 expref: 329 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.273049:0:16110:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880084258900/0x8a60d30f57190bc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10afe6 expref: 1344 pid: 16054 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.273053:0:9458:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801341d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9458:1805522011667456:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.273056:0:16110:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.273057:0:16110:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1721880422.273058:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1721880422.273060:0:16110:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727bb58 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.273062:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008cd22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011667584:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.273068:0:9458:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a840 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.273076:0:16110:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880084258900/0x8a60d30f57190bc5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10afe6 expref: 1344 pid: 16054 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.273078:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088efd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011667200:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.273078:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.273080:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.273085:0:16110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880084258900/0x8a60d30f57190bc5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10afe6 expref: 1344 pid: 16054 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.273091:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.273092:0:16110:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_094:lustre-OST0001_UUID:16110:1805522011667712:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.273093:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257694080 00000100:00100000:2.0:1721880422.273095:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257694080 00000004:00080000:3.0:1721880422.273096:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801312d0a80/2, rc 0, transno 1094365 00000100:00100000:3.0:1721880422.273100:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801312d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011662848:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1721880422.273104:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f493a80/0x8a60d30f571ec51f lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe2f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa40 expref: 330 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.273106:0:16110:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36840 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.273116:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011667840:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.273117:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011667328 00000100:00100000:2.0:1721880422.273117:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914146 00000100:00100000:0.0:1721880422.273119:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011667328 00000100:00100000:2.0:1721880422.273119:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8065c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+330:2004:x1805522257694080:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.273124:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.273127:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f493a80/0x8a60d30f571ec51f lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe2f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa40 expref: 330 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.273127:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.273133:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011667584 00010000:00010000:2.0:1721880422.273133:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f493a80/0x8a60d30f571ec51f lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa40 expref: 330 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.273134:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011667584 00010000:00010000:2.0:1721880422.273140:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1721880422.273141:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011667200 00010000:00010000:2.0:1721880422.273141:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1721880422.273143:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011667200 00010000:00010000:2.0:1721880422.273143:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009325e400/0x8a60d30f5727bb2e lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.273146:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325e400/0x8a60d30f5727bb2e lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.273148:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011667840 00000100:00100000:3.0:1721880422.273151:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011667840 00000100:00100000:0.0:1721880422.273152:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631960 00010000:00010000:2.0:1721880422.273154:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.273155:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088efc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1913:3689:x1805522011667328:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.273162:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8065c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+330:2004:x1805522257694080:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 42us (84us total) trans 0 rc 0/0 00002000:00080000:0.0:1721880422.273163:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64287 count 1 00000100:00100000:2.0:1721880422.273169:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914146 00000100:00100000:3.0:1721880422.273169:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631961 00010000:00010000:0.0:1721880422.273171:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727bb5f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.273171:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+1913:3689:x1805522011665024:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3015us (3059us total) trans 4296019973 rc 0/0 00000100:00100000:3.0:1721880422.273174:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+1913:3687:x1805522011667584:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.273175:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631950 00010000:00010000:0.0:1721880422.273179:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fbdd8c0/0x8a60d30f57191167 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b121 expref: 1344 pid: 15515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.273183:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.273184:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.273185:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727bb5f lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.273186:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64288 count 1 00000100:00100000:1.0:1721880422.273187:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631962 00000100:00100000:1.0:1721880422.273189:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+1912:3688:x1805522011667200:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.273194:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fbdd8c0/0x8a60d30f57191167 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b121 expref: 1344 pid: 15515 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.273196:0:16113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631963 00002000:00080000:1.0:1721880422.273197:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64286 count 1 00010000:00010000:3.0:1721880422.273197:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727bb66 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.273199:0:16113:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0000-mdtlov_UUID+2724:3687:x1805522011667840:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.273200:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fbdd8c0/0x8a60d30f57191167 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b121 expref: 1344 pid: 15515 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.273203:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727bb6d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.273205:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011667968:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.273209:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097025440/0x8a60d30f57190eb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b080 expref: 1344 pid: 16130 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.273209:0:16113:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58110 count 1 00010000:00010000:3.0:1721880422.273209:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c5bad00/0x8a60d30f571913f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b1b4 expref: 1344 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.273213:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.273214:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1721880422.273215:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36540 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.273216:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727bb6d lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.273216:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.273217:0:16113:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136352ac0/0x8a60d30f5727bb74 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.273218:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.273221:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727bb66 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.273224:0:16113:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094100000/0x8a60d30f571ec5ab lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aac5 expref: 329 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.273225:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097025440/0x8a60d30f57190eb9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b080 expref: 1344 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.273227:0:16113:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.273228:0:16113:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.273230:0:16113:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136352ac0/0x8a60d30f5727bb74 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.273231:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097025440/0x8a60d30f57190eb9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b080 expref: 1344 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.273236:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c5bad00/0x8a60d30f571913f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b1b4 expref: 1344 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.273237:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801341d1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011668096:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.273239:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f493a80/0x8a60d30f571ec51f lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa40 expref: 329 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.273240:0:16113:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094100000/0x8a60d30f571ec5ab lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aac5 expref: 329 pid: 16099 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.273246:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094634000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:15453:1805522011665792:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.273246:0:16113:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094100000/0x8a60d30f571ec5ab lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aac5 expref: 328 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.273246:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c5bad00/0x8a60d30f571913f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b1b4 expref: 1344 pid: 15453 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.273247:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a780 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.273252:0:16113:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008854dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0000_UUID:16113:1805522011668352:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.273254:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727bb27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.273256:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325e400/0x8a60d30f5727bb2e lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.273257:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009f52d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011668224:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.273259:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727bb27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.273261:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325e400/0x8a60d30f5727bb2e lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.273263:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727bb27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.273264:0:16113:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde840 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.273267:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727bb27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.273269:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325e400/0x8a60d30f5727bb2e lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.273270:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727bb27 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.273273:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdece40 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.273274:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325e400/0x8a60d30f5727bb2e lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.273274:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8000 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.273275:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727bb27 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.273277:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325e400/0x8a60d30f5727bb2e lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.273279:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727bb27 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.273281:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325e400/0x8a60d30f5727bb2e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.273284:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325e400 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.273285:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727bb27 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.273286:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325e400/0x8a60d30f5727bb2e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.273289:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727bb27 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.273290:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325e400/0x8a60d30f5727bb2e lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.273294:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801312d0380/2, rc 0, transno 1094366 00010000:00010000:0.0:1721880422.273296:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325e400/0x8a60d30f5727bb2e lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.273300:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325e400/0x8a60d30f5727bb2e lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.273301:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801312d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011662336:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1721880422.273332:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800919c3800/2, rc 0, transno 1052677 00000100:00100000:3.0:1721880422.273337:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800919c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011665024:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.273341:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1721880422.273354:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ebd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+1913:3686:x1805522011664896:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3081us (3132us total) trans 4296019974 rc 0/0 00000100:00100000:1.0:1721880422.273358:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631952 00000100:00100000:3.0:1721880422.273358:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009f52ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011668480:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.273372:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1721880422.273376:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a052d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011668608:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.273378:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.273390:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cd23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+1912:3686:x1805522011664768:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3138us (3204us total) trans 4296019972 rc 0/0 00000100:00100000:2.0:1721880422.273396:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631951 00000100:00100000:1.0:1721880422.273400:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.273401:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088efd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2725:3689:x1805522011665408:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3060us (3095us total) trans 4296061668 rc 0/0 00000004:00080000:3.0:1721880422.273401:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088effb80/2, rc 0, transno 1094372 00000100:00100000:0.0:1721880422.273406:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631953 00000100:00100000:3.0:1721880422.273407:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011665408:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.273411:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011668480 00000100:00100000:2.0:1721880422.273414:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011668480 00000100:00100000:1.0:1721880422.273415:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011668608 00000100:00100000:1.0:1721880422.273418:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011668608 00000004:00080000:0.0:1721880422.273430:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800919c3b80/2, rc 0, transno 1052678 00000100:00100000:2.0:1721880422.273431:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631964 00000100:00100000:0.0:1721880422.273436:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800919c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011664896:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.273436:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631965 00000100:00100000:2.0:1721880422.273436:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c40b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2725:3689:x1805522011668480:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.273441:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+1912:3688:x1805522011668608:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.273446:0:16088:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58111 count 1 00000100:00100000:3.0:1721880422.273446:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00002000:00080000:1.0:1721880422.273450:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64289 count 1 00000100:00100000:3.0:1721880422.273452:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008c408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011668736:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1721880422.273456:0:16088:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727bb7b lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.273459:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800919c3480/2, rc 0, transno 1052676 00010000:00010000:1.0:1721880422.273459:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727bb82 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.273462:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800919c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011664768:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.273467:0:16088:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094101680/0x8a60d30f571ec5c7 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aae1 expref: 328 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.273469:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d2d33c0/0x8a60d30f571916a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b25c expref: 1344 pid: 16117 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.273470:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.273473:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.273475:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.273475:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.273477:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.273477:0:16088:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727bb7b lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.273479:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727bb82 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.273480:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801312d0700/2, rc 0, transno 1094371 00000100:00100000:3.0:1721880422.273485:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011668864:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.273492:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801312d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011663360:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1721880422.273492:0:16088:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094101680/0x8a60d30f571ec5c7 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aae1 expref: 328 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.273496:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d2d33c0/0x8a60d30f571916a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b25c expref: 1344 pid: 16117 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.273502:0:16088:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094101680/0x8a60d30f571ec5c7 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aae1 expref: 328 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.273505:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011668736 00010000:00010000:1.0:1721880422.273505:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d2d33c0/0x8a60d30f571916a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b25c expref: 1344 pid: 16117 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.273507:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011668736 00000100:00100000:2.0:1721880422.273510:0:16088:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008854df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0000_UUID:16088:1805522011669120:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.273514:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800952a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011669248:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.273514:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.273526:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011668864 00000100:00100000:0.0:1721880422.273527:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011668864 00000100:00100000:2.0:1721880422.273535:0:16120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631966 00000100:00100000:1.0:1721880422.273536:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a540 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.273538:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631967 00000100:00100000:2.0:1721880422.273538:0:16120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c40aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+2726:3687:x1805522011668736:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1721880422.273538:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bb46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011669376:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.273541:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bb46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+1913:3687:x1805522011668864:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.273546:0:16120:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58112 count 1 00000100:00100000:1.0:1721880422.273547:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011668992:0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.273548:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64290 count 1 00000100:00100000:3.0:1721880422.273548:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.273552:0:16120:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136350b40/0x8a60d30f5727bb89 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe300:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.273556:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727bb90 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.273560:0:16120:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c651200/0x8a60d30f571ec629 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe300:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab43 expref: 328 pid: 16126 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.273561:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.273561:0:16100:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011669376 00010000:00010000:2.0:1721880422.273563:0:16120:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1721880422.273563:0:16100:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011669376 00010000:00010000:0.0:1721880422.273564:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c98d200/0x8a60d30f5719199b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b327 expref: 1344 pid: 16022 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.273564:0:16120:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.273565:0:16120:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136350b40/0x8a60d30f5727bb89 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe300:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.273568:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.273569:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.273570:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727bb90 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.273574:0:16100:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011668992 00010000:00010000:2.0:1721880422.273575:0:16120:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c651200/0x8a60d30f571ec629 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe300:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab43 expref: 328 pid: 16126 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.273576:0:16100:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011668992 00010000:00010000:0.0:1721880422.273579:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c98d200/0x8a60d30f5719199b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b327 expref: 1344 pid: 16022 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.273579:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631968 00010000:00010000:2.0:1721880422.273581:0:16120:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c651200/0x8a60d30f571ec629 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe300:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab43 expref: 328 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.273582:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bb47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2727:3689:x1805522011669376:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.273586:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c98d200/0x8a60d30f5719199b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b327 expref: 1344 pid: 16022 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.273587:0:16120:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008854ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16120:1805522011669504:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.273591:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011669632:192.168.201.24@tcp:104: 00002000:00080000:1.0:1721880422.273591:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58113 count 1 00000100:00100000:3.0:1721880422.273591:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631969 00000100:00100000:3.0:1721880422.273595:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800952a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+1914:3688:x1805522011668992:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.273598:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098aa8d80/0x8a60d30f5727bb97 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe301:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.273600:0:16120:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdecc0 going to sleep for 11 seconds 00002000:00080000:3.0:1721880422.273604:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64291 count 1 00010000:00010000:1.0:1721880422.273605:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c232d00/0x8a60d30f571ec63e lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe301:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab58 expref: 328 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.273606:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36000 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.273608:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.273609:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.273611:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098aa8d80/0x8a60d30f5727bb97 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe301:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.273611:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727bb9e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.273612:0:16088:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdeb40 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.273619:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131b2ad00/0x8a60d30f57191cea lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b3f2 expref: 1344 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.273620:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c232d00/0x8a60d30f571ec63e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe301:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab58 expref: 328 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.273624:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.273625:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.273626:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c232d00/0x8a60d30f571ec63e lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe301:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab58 expref: 328 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.273626:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727bb9e lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.273632:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800952a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:15466:1805522011669760:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.273636:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131b2ad00/0x8a60d30f57191cea lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b3f2 expref: 1344 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.273641:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131b2ad00/0x8a60d30f57191cea lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b3f2 expref: 1344 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.273646:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.273652:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bb44a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011669888:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.273665:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec180 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.274079:0:16040:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801312d2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_040:lustre-OST0000_UUID:16040:1805522011666048:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.274092:0:16040:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880098aaaac0/0x8a60d30f5727bb35 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.274105:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801341d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0000_UUID:16089:1805522011666560:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.274110:0:16130:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d9ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0001_UUID:16130:1805522011666688:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.274119:0:16130:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727bb43 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.274121:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880098aab840/0x8a60d30f5727bb3c lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.274240:0:16110:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d9ebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_094:lustre-OST0001_UUID:16110:1805522011667712:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.274240:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d9e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16125:1805522011666816:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.274249:0:16110:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727bb58 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.274252:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325f840/0x8a60d30f5727bb4a lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.274259:0:9458:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801341d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9458:1805522011667456:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.274271:0:9458:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880098aab3c0/0x8a60d30f5727bb51 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.274432:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.274468:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257694336 00000100:00100000:2.0:1721880422.274473:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257694336 00010000:00010000:2.0:1721880422.274486:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009735f840/0x8a60d30f571ec56c lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa8d expref: 329 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.274513:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914147 00000100:00100000:1.0:1721880422.274516:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d9e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011667968:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.274518:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+329:2004:x1805522257694336:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.274526:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.274529:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727bb5f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.274531:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009735f840/0x8a60d30f571ec56c lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa8d expref: 329 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.274540:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009735f840/0x8a60d30f571ec56c lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa8d expref: 329 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.274552:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009735f840/0x8a60d30f571ec56c lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa8d expref: 329 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.274565:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.274566:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.274569:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098aab840/0x8a60d30f5727bb3c lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.274575:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098aab840/0x8a60d30f5727bb3c lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.274588:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.274594:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098aab840/0x8a60d30f5727bb3c lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.274600:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098aab840/0x8a60d30f5727bb3c lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.274604:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098aab840/0x8a60d30f5727bb3c lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.274608:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098aab840/0x8a60d30f5727bb3c lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.274610:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+328:2004:x1805522257694336:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 91us (177us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.274613:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098aab840/0x8a60d30f5727bb3c lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.274616:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aab840 already unused, calling callback (ffffffffa084e330) 00000100:00100000:2.0:1721880422.274617:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914147 00010000:00010000:0.0:1721880422.274618:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098aab840/0x8a60d30f5727bb3c lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.274622:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098aab840/0x8a60d30f5727bb3c lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.274628:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098aab840/0x8a60d30f5727bb3c lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.274631:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098aab840/0x8a60d30f5727bb3c lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.274920:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.274932:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2728:3688:x1805522011666304:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2407us (2460us total) trans 4296061669 rc 0/0 00000100:00100000:0.0:1721880422.274940:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631955 00000004:00080000:1.0:1721880422.274959:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008777d880/2, rc 0, transno 1094373 00000100:00100000:2.0:1721880422.274962:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.274969:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008777d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011666304:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.274998:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801341d1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011668096:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.275007:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727bb6d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.275011:0:16113:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008854dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0000_UUID:16113:1805522011668352:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.275036:0:16113:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136352ac0/0x8a60d30f5727bb74 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.275043:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257694592 00000100:00100000:3.0:1721880422.275047:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257694592 00000100:00100000:0.0:1721880422.275049:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bb46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011670016:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.275059:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.275059:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801350d5f80/0x8a60d30f571ec550 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa71 expref: 328 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.275071:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.275073:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257694848 00000100:00100000:3.0:1721880422.275074:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257694848 00000100:00100000:2.0:1721880422.275078:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.275081:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880084258900/0x8a60d30f57190bc5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10afe6 expref: 1345 pid: 16054 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.275084:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011670016 00000100:00100000:1.0:1721880422.275087:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011670016 00000100:00100000:3.0:1721880422.275098:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257694208 00000100:00100000:3.0:1721880422.275100:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257694208 00000100:00100000:1.0:1721880422.275104:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631970 00000100:00100000:2.0:1721880422.275104:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.275105:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257694464 00010000:00010000:3.0:1721880422.275105:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801350d4480/0x8a60d30f571ec53b lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa5c expref: 329 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.275108:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257694464 00000100:00100000:1.0:1721880422.275108:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2728:3686:x1805522011670016:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1721880422.275118:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58114 count 1 00000100:00100000:3.0:1721880422.275120:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257694720 00000100:00100000:3.0:1721880422.275122:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257694720 00010000:00010000:1.0:1721880422.275127:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098aa8480/0x8a60d30f5727bba5 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe302:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.275128:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094100d80/0x8a60d30f571ec588 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aaa9 expref: 330 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.275129:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914148 00000100:00100000:0.0:1721880422.275133:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008854f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+330:2004:x1805522257694592:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.275135:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099926400/0x8a60d30f571ec65a lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe302:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab74 expref: 330 pid: 16126 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.275139:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914149 00010000:00010000:1.0:1721880422.275140:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.275141:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.275142:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098aa8480/0x8a60d30f5727bba5 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe302:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.275142:0:16120:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008854ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16120:1805522011669504:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.275143:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.275143:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008854c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1346:2004:x1805522257694848:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.275147:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801350d5f80/0x8a60d30f571ec550 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa71 expref: 330 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.275149:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.275151:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880084258900/0x8a60d30f57190bc5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10afe6 expref: 1346 pid: 16054 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.275152:0:16120:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136350b40/0x8a60d30f5727bb89 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe300:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.275154:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099926400/0x8a60d30f571ec65a lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe302:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab74 expref: 330 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.275155:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801350d5f80/0x8a60d30f571ec550 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa71 expref: 330 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.275159:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880084258900/0x8a60d30f57190bc5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10afe6 expref: 1346 pid: 16054 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.275160:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099926400/0x8a60d30f571ec65a lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe302:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab74 expref: 330 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.275165:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801350d5f80/0x8a60d30f571ec550 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa71 expref: 330 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.275165:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800952a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011669248:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.275167:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800952a3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0000_UUID:16089:1805522011670144:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.275169:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880084258900/0x8a60d30f57190bc5 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10afe6 expref: 1346 pid: 16054 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.275172:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.275173:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.275174:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727bb82 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.275175:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009325f840/0x8a60d30f5727bb4a lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.275177:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.275178:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.275180:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727bb58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.275181:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325f840/0x8a60d30f5727bb4a lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.275185:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727bb58 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.275188:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a780 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.275191:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.275192:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.275195:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.275203:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257695232 00000100:00100000:0.0:1721880422.275205:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008854f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+329:2004:x1805522257694592:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 71us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.275206:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257695232 00000100:00100000:0.0:1721880422.275209:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914148 00000100:00100000:3.0:1721880422.275211:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008854c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1345:2004:x1805522257694848:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 68us (250us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.275215:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094100000/0x8a60d30f571ec5ab lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aac5 expref: 330 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.275216:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914149 00000100:00100000:0.0:1721880422.275221:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914150 00000100:00100000:0.0:1721880422.275225:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008854dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+329:2004:x1805522257694208:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.275226:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914151 00000100:00100000:3.0:1721880422.275230:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+329:2004:x1805522257694720:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.275235:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.275237:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.275239:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914152 00010000:00010000:3.0:1721880422.275239:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094100d80/0x8a60d30f571ec588 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aaa9 expref: 329 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.275241:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801350d4480/0x8a60d30f571ec53b lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa5c expref: 329 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.275245:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8066050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+329:2004:x1805522257695232:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.275245:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094100d80/0x8a60d30f571ec588 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aaa9 expref: 329 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.275249:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801350d4480/0x8a60d30f571ec53b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa5c expref: 329 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.275252:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094100d80/0x8a60d30f571ec588 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aaa9 expref: 329 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.275253:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.275257:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801350d4480/0x8a60d30f571ec53b lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa5c expref: 328 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.275257:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094100000/0x8a60d30f571ec5ab lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aac5 expref: 329 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.275259:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.275260:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.275261:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098aab3c0/0x8a60d30f5727bb51 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.275264:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.275265:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.275265:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098aab3c0/0x8a60d30f5727bb51 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.275266:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094100000/0x8a60d30f571ec5ab lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aac5 expref: 327 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.275267:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098aaaac0/0x8a60d30f5727bb35 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.275271:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098aaaac0/0x8a60d30f5727bb35 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.275273:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.275279:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094100000/0x8a60d30f571ec5ab lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aac5 expref: 327 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.275281:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.275285:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+327:2004:x1805522257694720:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 55us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.275289:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914151 00000100:00100000:1.0:1721880422.275290:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.275290:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.275292:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1721880422.275294:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008854dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+325:2004:x1805522257694208:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 69us (236us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.275294:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136352ac0/0x8a60d30f5727bb74 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.275297:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257694976 00000100:00100000:0.0:1721880422.275298:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914150 00000100:00100000:3.0:1721880422.275298:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257694976 00010000:00010000:2.0:1721880422.275301:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136352ac0/0x8a60d30f5727bb74 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.275304:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fbdd8c0/0x8a60d30f57191167 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b121 expref: 1345 pid: 15515 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.275308:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.275317:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.275322:0:15444:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257695104 00000100:00100000:3.0:1721880422.275324:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914153 00000100:00100000:0.0:1721880422.275326:0:15444:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257695104 00000100:00100000:3.0:1721880422.275327:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800952a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1345:2005:x1805522257694976:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.275331:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.275333:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fbdd8c0/0x8a60d30f57191167 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b121 expref: 1346 pid: 15515 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.275338:0:15444:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097025440/0x8a60d30f57190eb9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b080 expref: 1346 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.275338:0:16040:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098aaaac0/0x8a60d30f5727bb35 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.275339:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8066050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+324:2004:x1805522257695232:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 94us (145us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.275343:0:16040:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098aaaac0/0x8a60d30f5727bb35 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.275343:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fbdd8c0/0x8a60d30f57191167 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b121 expref: 1346 pid: 15515 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.275347:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914152 00010000:00010000:1.0:1721880422.275348:0:16040:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098aaaac0/0x8a60d30f5727bb35 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.275350:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fbdd8c0/0x8a60d30f57191167 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b121 expref: 1346 pid: 15515 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.275352:0:16040:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098aaaac0/0x8a60d30f5727bb35 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.275355:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.275356:0:16040:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098aaaac0/0x8a60d30f5727bb35 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.275356:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.275357:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727bb5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.275361:0:16040:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aaaac0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.275361:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727bb5f lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.275363:0:16040:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098aaaac0/0x8a60d30f5727bb35 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.275364:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914154 00010000:00010000:1.0:1721880422.275367:0:16040:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098aaaac0/0x8a60d30f5727bb35 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.275369:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800952a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1345:2005:x1805522257695104:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.275369:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.275373:0:16040:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098aaaac0/0x8a60d30f5727bb35 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.275377:0:16040:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098aaaac0/0x8a60d30f5727bb35 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.275378:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.275380:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800952a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1345:2005:x1805522257694976:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 52us (90us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.275382:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097025440/0x8a60d30f57190eb9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b080 expref: 1345 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.275384:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914153 00010000:00010000:0.0:1721880422.275386:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098bb3600/0x8a60d30f57190868 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10af1b expref: 1345 pid: 15515 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.275392:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097025440/0x8a60d30f57190eb9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b080 expref: 1344 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.275394:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727bb5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.275398:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727bb5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.275402:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727bb5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.275405:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097025440/0x8a60d30f57190eb9 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b080 expref: 1344 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.275406:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727bb5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.275410:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727bb5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.275413:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325ed00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.275414:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727bb5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.275417:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914155 00010000:00010000:1.0:1721880422.275417:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727bb5f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.275418:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.275420:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1721880422.275422:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1343:2004:x1805522257694464:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.275422:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727bb5f lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.275422:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727bb6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.275426:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727bb5f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.275429:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.275429:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727bb6d lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.275432:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098bb3600/0x8a60d30f57190868 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10af1b expref: 1343 pid: 15515 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.275437:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009f52d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011668224:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.275441:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098bb3600/0x8a60d30f57190868 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10af1b expref: 1343 pid: 15515 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.275446:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.275448:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727bb66 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.275452:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098bb3600/0x8a60d30f57190868 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10af1b expref: 1343 pid: 15515 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.275461:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.275462:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.275465:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727bb43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.275465:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800952a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1342:2005:x1805522257695104:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 95us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.275470:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914154 00010000:00010000:0.0:1721880422.275471:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727bb43 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.275485:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.275492:0:16113:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136352ac0/0x8a60d30f5727bb74 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.275496:0:16113:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136352ac0/0x8a60d30f5727bb74 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.275502:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1341:2004:x1805522257694464:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 79us (424us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.275502:0:16113:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136352ac0/0x8a60d30f5727bb74 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.275507:0:16113:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136352ac0/0x8a60d30f5727bb74 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.275508:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914155 00010000:00010000:2.0:1721880422.275510:0:16113:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136352ac0/0x8a60d30f5727bb74 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.275514:0:16113:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352ac0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.275515:0:16113:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136352ac0/0x8a60d30f5727bb74 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.275519:0:16113:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136352ac0/0x8a60d30f5727bb74 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.275525:0:16113:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136352ac0/0x8a60d30f5727bb74 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.275527:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088efc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1915:3689:x1805522011667328:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2370us (2531us total) trans 4296019975 rc 0/0 00010000:00010000:2.0:1721880422.275529:0:16113:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136352ac0/0x8a60d30f5727bb74 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.275531:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631960 00010000:00010000:0.0:1721880422.275546:0:16110:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727bb58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.275546:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088eff100/2, rc 0, transno 1052679 00010000:00010000:0.0:1721880422.275554:0:16110:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727bb58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.275555:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088eff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011667328:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.275562:0:16110:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727bb58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.275569:0:16110:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727bb58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.275575:0:16110:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727bb58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.275581:0:16110:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325dd40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.275584:0:16110:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727bb58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.275584:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009f52d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011670272:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.275607:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.275619:0:16040:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:lustre-MDT0000-mdtlov_UUID+2730:3686:x1805522011665920:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3456us (3499us total) trans 4296061670 rc 0/0 00000100:00100000:1.0:1721880422.275623:0:16040:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631954 00000100:00100000:1.0:1721880422.275633:0:16040:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011670272 00000100:00100000:1.0:1721880422.275635:0:16040:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011670272 00000100:00100000:1.0:1721880422.275645:0:16040:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631971 00000100:00100000:1.0:1721880422.275648:0:16040:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088615180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:lustre-MDT0000-mdtlov_UUID+1915:3687:x1805522011670272:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.275656:0:16040:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64292 count 1 00000100:00100000:2.0:1721880422.275659:0:16113:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0000-mdtlov_UUID+2729:3687:x1805522011667840:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2457us (2529us total) trans 4296061671 rc 0/0 00000004:00080000:3.0:1721880422.275662:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880094637480/2, rc 0, transno 1094375 00010000:00010000:1.0:1721880422.275663:0:16040:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727bbac lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb24:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.275666:0:16113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631963 00000100:00100000:3.0:1721880422.275669:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011667840:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.275671:0:16040:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098b25b00/0x8a60d30f57191fde lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b48c expref: 1340 pid: 16080 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.275675:0:16040:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.275676:0:16040:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.275678:0:16040:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727bbac lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.275685:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325f840/0x8a60d30f5727bb4a lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.275688:0:16040:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098b25b00/0x8a60d30f57191fde lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b48c expref: 1340 pid: 16080 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.275691:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325f840/0x8a60d30f5727bb4a lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.275693:0:16040:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098b25b00/0x8a60d30f57191fde lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b48c expref: 1340 pid: 16080 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.275695:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088617100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011670400:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1721880422.275696:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325f840/0x8a60d30f5727bb4a lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.275699:0:16040:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800952a2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_040:lustre-OST0001_UUID:16040:1805522011670528:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.275699:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325f840/0x8a60d30f5727bb4a lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.275702:0:16110:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727bb58 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.275704:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325f840/0x8a60d30f5727bb4a lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.275708:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325f840 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.275709:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325f840/0x8a60d30f5727bb4a lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.275713:0:16110:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727bb58 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.275713:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325f840/0x8a60d30f5727bb4a lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.275714:0:16040:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a840 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.275719:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325f840/0x8a60d30f5727bb4a lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.275720:0:16110:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727bb58 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.275723:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325f840/0x8a60d30f5727bb4a lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.275725:0:9458:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098aab3c0/0x8a60d30f5727bb51 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.275747:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.275755:0:9458:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098aab3c0/0x8a60d30f5727bb51 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.275760:0:9458:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098aab3c0/0x8a60d30f5727bb51 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.275763:0:9458:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098aab3c0/0x8a60d30f5727bb51 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.275767:0:9458:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098aab3c0/0x8a60d30f5727bb51 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.275770:0:9458:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aab3c0 already unused, calling callback (ffffffffa084e330) 00000100:00100000:3.0:1721880422.275770:0:16100:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011670400 00010000:00010000:1.0:1721880422.275772:0:9458:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098aab3c0/0x8a60d30f5727bb51 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.275773:0:16100:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011670400 00010000:00010000:1.0:1721880422.275776:0:9458:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098aab3c0/0x8a60d30f5727bb51 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.275782:0:9458:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098aab3c0/0x8a60d30f5727bb51 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.275785:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098aab3c0/0x8a60d30f5727bb51 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.275788:0:16100:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631972 00000100:00100000:3.0:1721880422.275793:0:16100:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088617b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:lustre-MDT0000-mdtlov_UUID+2730:3688:x1805522011670400:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1721880422.275804:0:16100:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58115 count 1 00010000:00010000:3.0:1721880422.275814:0:16100:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727bbb3 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe303:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.275824:0:16100:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880132dbdb00/0x8a60d30f571ec676 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab90 expref: 323 pid: 16126 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.275830:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a65cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2731:3686:x1805522011666176:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3131us (3172us total) trans 4296061672 rc 0/0 00010000:00010000:3.0:1721880422.275830:0:16100:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.275832:0:16100:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.275834:0:16100:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727bbb3 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.275835:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631957 00010000:00010000:3.0:1721880422.275849:0:16100:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880132dbdb00/0x8a60d30f571ec676 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab90 expref: 323 pid: 16126 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.275857:0:16088:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008854df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0000_UUID:16088:1805522011669120:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.275858:0:16100:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880132dbdb00/0x8a60d30f571ec676 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab90 expref: 323 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.275867:0:16088:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727bb7b lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.275873:0:9458:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2730:3686:x1805522011666944:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2880us (2964us total) trans 4296061673 rc 0/0 00000100:00100000:3.0:1721880422.275873:0:16100:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880092318000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_087:lustre-OST0000_UUID:16100:1805522011670656:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.275878:0:9458:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631958 00000100:00100000:2.0:1721880422.275887:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.275893:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727bb6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.275894:0:16100:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdece40 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.275897:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727bb6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.275897:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257695488 00000100:00100000:2.0:1721880422.275899:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257695488 00010000:00010000:1.0:1721880422.275902:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727bb6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.275905:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727bb6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.275907:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c651200/0x8a60d30f571ec629 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe300:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab43 expref: 324 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.275909:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727bb6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.275912:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8900 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.275913:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727bb6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.275917:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727bb6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.275920:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914156 00010000:00010000:1.0:1721880422.275922:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727bb6d lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.275923:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+324:2005:x1805522257695488:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.275926:0:16110:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_094:lustre-MDT0000-mdtlov_UUID+1916:3686:x1805522011667072:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2925us (2971us total) trans 4296019976 rc 0/0 00010000:00010000:1.0:1721880422.275926:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727bb6d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.275928:0:7118:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.275931:0:7118:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c651200/0x8a60d30f571ec629 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe300:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab43 expref: 324 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.275935:0:16110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631959 00010000:00010000:2.0:1721880422.275937:0:7118:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c651200/0x8a60d30f571ec629 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe300:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab43 expref: 324 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.275945:0:7118:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c651200/0x8a60d30f571ec629 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe300:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab43 expref: 324 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.275954:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.275955:0:16130:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727bb43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.275955:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.275958:0:7118:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136350b40/0x8a60d30f5727bb89 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe300:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.275962:0:16130:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727bb43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.275963:0:7118:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136350b40/0x8a60d30f5727bb89 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe300:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.275970:0:16130:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727bb43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.275971:0:7118:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.275977:0:16130:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727bb43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.275982:0:7118:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+323:2005:x1805522257695488:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 58us (95us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.275983:0:16120:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136350b40/0x8a60d30f5727bb89 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.275985:0:16130:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727bb43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.275985:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914156 00010000:00010000:3.0:1721880422.275990:0:16120:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136350b40/0x8a60d30f5727bb89 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.275992:0:16130:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325e880 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.275995:0:16130:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727bb43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.275997:0:16120:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136350b40/0x8a60d30f5727bb89 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.276001:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+1916:3688:x1805522011667200:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2810us (2909us total) trans 4296019977 rc 0/0 00010000:00010000:0.0:1721880422.276002:0:16130:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727bb43 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.276003:0:16120:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136350b40/0x8a60d30f5727bb89 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.276006:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631962 00000100:00100000:2.0:1721880422.276006:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.276009:0:16120:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136350b40/0x8a60d30f5727bb89 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.276030:0:16130:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727bb43 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.276030:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257695744 00010000:00010000:3.0:1721880422.276030:0:16120:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350b40 already unused, calling callback (ffffffffa084e330) 00000100:00100000:2.0:1721880422.276032:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257695744 00010000:00010000:3.0:1721880422.276033:0:16120:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136350b40/0x8a60d30f5727bb89 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.276037:0:16130:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727bb43 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.276039:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094101680/0x8a60d30f571ec5c7 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aae1 expref: 323 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.276039:0:16120:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136350b40/0x8a60d30f5727bb89 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.276049:0:16120:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136350b40/0x8a60d30f5727bb89 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.276052:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914157 00010000:00010000:3.0:1721880422.276055:0:16120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136350b40/0x8a60d30f5727bb89 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.276057:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.276057:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+323:2005:x1805522257695744:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.276064:0:7118:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.276068:0:7118:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094101680/0x8a60d30f571ec5c7 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aae1 expref: 323 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.276076:0:7118:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094101680/0x8a60d30f571ec5c7 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aae1 expref: 323 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.276085:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.276089:0:7118:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094101680/0x8a60d30f571ec5c7 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aae1 expref: 323 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.276103:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.276105:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.276106:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.276109:0:7118:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727bb7b lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.276116:0:7118:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727bb7b lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe2ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.276131:0:7118:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.276134:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.276143:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bb44a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011669888:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.276149:0:7118:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+322:2005:x1805522257695744:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 92us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.276154:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.276155:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727bb9e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.276156:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914157 00000100:00100000:0.0:1721880422.276163:0:16130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0000-mdtlov_UUID+1916:3688:x1805522011666432:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3633us (3658us total) trans 4296019978 rc 0/0 00000100:00100000:2.0:1721880422.276169:0:7118:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257695360 00000100:00100000:0.0:1721880422.276170:0:16130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631956 00000100:00100000:3.0:1721880422.276170:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257695616 00000100:00100000:2.0:1721880422.276172:0:7118:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257695360 00000100:00100000:3.0:1721880422.276173:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257695616 00010000:00010000:2.0:1721880422.276182:0:7118:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d2d33c0/0x8a60d30f571916a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b25c expref: 1342 pid: 16117 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.276185:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c98d200/0x8a60d30f5719199b lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b327 expref: 1342 pid: 16022 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.276197:0:7118:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257695872 00000100:00100000:2.0:1721880422.276200:0:7118:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257695872 00010000:00010000:2.0:1721880422.276209:0:7118:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c5bad00/0x8a60d30f571913f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b1b4 expref: 1343 pid: 15453 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.276211:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257696000 00000100:00100000:3.0:1721880422.276213:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257696000 00000100:00100000:1.0:1721880422.276222:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.276223:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c232d00/0x8a60d30f571ec63e lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe301:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab58 expref: 322 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.276224:0:7118:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257696128 00000100:00100000:2.0:1721880422.276227:0:7118:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257696128 00010000:00010000:2.0:1721880422.276236:0:7118:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131b2ad00/0x8a60d30f57191cea lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b3f2 expref: 1344 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.276237:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257696256 00000100:00100000:3.0:1721880422.276239:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257696256 00000100:00100000:1.0:1721880422.276242:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914158 00000100:00100000:1.0:1721880422.276246:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800952a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+1344:2004:x1805522257695360:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.276246:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099926400/0x8a60d30f571ec65a lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe302:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab74 expref: 323 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.276253:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.276257:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d2d33c0/0x8a60d30f571916a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b25c expref: 1344 pid: 16117 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.276258:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914159 00010000:00010000:1.0:1721880422.276264:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d2d33c0/0x8a60d30f571916a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b25c expref: 1344 pid: 16117 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.276264:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800952a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+1344:2004:x1805522257695616:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.276264:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914160 00000100:00100000:3.0:1721880422.276269:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ab4d4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+1344:2006:x1805522257695872:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.276271:0:7118:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.276272:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d2d33c0/0x8a60d30f571916a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b25c expref: 1344 pid: 16117 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.276275:0:7118:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c98d200/0x8a60d30f5719199b lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b327 expref: 1344 pid: 16022 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.276277:0:15473:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.276279:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.276280:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.276281:0:15473:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c5bad00/0x8a60d30f571913f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b1b4 expref: 1343 pid: 15453 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.276282:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727bb82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.276285:0:7118:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c98d200/0x8a60d30f5719199b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b327 expref: 1343 pid: 16022 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.276290:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727bb82 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.276290:0:15473:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c5bad00/0x8a60d30f571913f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b1b4 expref: 1343 pid: 15453 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.276297:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.276299:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.276301:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.276301:0:7118:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727bb90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.276302:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c5bad00/0x8a60d30f571913f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b1b4 expref: 1343 pid: 15453 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.276308:0:7118:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727bb90 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.276311:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800952a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+1342:2004:x1805522257695360:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 64us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.276312:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914161 00010000:00010000:3.0:1721880422.276312:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.276313:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.276316:0:15473:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727bb66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.276318:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800952a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+323:2004:x1805522257696000:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.276318:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914158 00010000:00010000:2.0:1721880422.276319:0:7118:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.276322:0:15473:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727bb66 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.276327:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.276333:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c232d00/0x8a60d30f571ec63e lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe301:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab58 expref: 323 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.276334:0:15473:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.276335:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914162 00000100:00100000:2.0:1721880422.276335:0:7118:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800952a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+1341:2004:x1805522257695616:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 71us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.276340:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+1341:2005:x1805522257696128:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.276342:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c232d00/0x8a60d30f571ec63e lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe301:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab58 expref: 323 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.276342:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914159 00010000:00010000:1.0:1721880422.276347:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.276348:0:15473:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ab4d4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+1341:2006:x1805522257695872:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 77us (244us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.276353:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131b2ad00/0x8a60d30f57191cea lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b3f2 expref: 1340 pid: 16098 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.276354:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.276354:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914160 00010000:00010000:0.0:1721880422.276356:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.276358:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914163 00010000:00010000:0.0:1721880422.276359:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098aa8d80/0x8a60d30f5727bb97 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe301:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.276362:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131b2ad00/0x8a60d30f57191cea lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b3f2 expref: 1340 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.276363:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+323:2004:x1805522257696256:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.276366:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098aa8d80/0x8a60d30f5727bb97 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe301:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.276370:0:7118:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.276375:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131b2ad00/0x8a60d30f57191cea lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b3f2 expref: 1339 pid: 16098 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.276376:0:7118:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099926400/0x8a60d30f571ec65a lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe302:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab74 expref: 323 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.276379:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.276386:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.276386:0:7118:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099926400/0x8a60d30f571ec65a lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe302:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab74 expref: 323 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.276387:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.276390:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727bb9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.276394:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800952a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+323:2004:x1805522257696000:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 75us (258us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.276397:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727bb9e lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.276397:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.276399:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1721880422.276400:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914161 00010000:00010000:2.0:1721880422.276402:0:7118:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098aa8480/0x8a60d30f5727bba5 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe302:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.276409:0:7118:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098aa8480/0x8a60d30f5727bba5 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe302:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.276415:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.276419:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727bb9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.276420:0:7118:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.276424:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727bb9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.276427:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+1338:2005:x1805522257696128:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 87us (272us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.276428:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727bb9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.276432:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914162 00010000:00010000:3.0:1721880422.276432:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727bb9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.276434:0:7118:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+322:2004:x1805522257696256:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 70us (211us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.276436:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727bb9e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.276440:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914163 00010000:00010000:3.0:1721880422.276440:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b6ac0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.276441:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727bb9e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.276445:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727bb9e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.276448:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c98d200/0x8a60d30f5719199b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b327 expref: 1337 pid: 16022 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.276451:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727bb9e lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.276454:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727bb9e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.276455:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c232d00/0x8a60d30f571ec63e lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe301:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab58 expref: 321 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.276460:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d9eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011669632:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.276463:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800952a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:15466:1805522011669760:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.276467:0:16088:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727bb7b lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.276471:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880098aa8d80/0x8a60d30f5727bb97 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.276474:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727bb90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.276474:0:16088:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727bb7b lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.276477:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098aa8d80/0x8a60d30f5727bb97 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.276480:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098aa8d80/0x8a60d30f5727bb97 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.276481:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727bb90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.276482:0:16088:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727bb7b lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.276484:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098aa8d80/0x8a60d30f5727bb97 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.276488:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727bb90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.276488:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098aa8d80/0x8a60d30f5727bb97 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.276489:0:16088:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727bb7b lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.276492:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098aa8d80/0x8a60d30f5727bb97 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.276495:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727bb90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.276496:0:16088:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727bb7b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.276499:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8d80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.276501:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098aa8d80/0x8a60d30f5727bb97 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.276502:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727bb90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.276502:0:16088:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352640 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.276505:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098aa8d80/0x8a60d30f5727bb97 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.276505:0:16088:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727bb7b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.276509:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727bb90 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.276510:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098aa8d80/0x8a60d30f5727bb97 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.276512:0:16088:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727bb7b lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.276514:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098aa8d80/0x8a60d30f5727bb97 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.276515:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325c480 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.276518:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727bb90 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.276522:0:16088:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727bb7b lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.276525:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727bb90 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.276528:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727bb7b lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.276539:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800952a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+1916:3688:x1805522011668992:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2943us (2977us total) trans 4296019979 rc 0/0 00010000:00010000:0.0:1721880422.276540:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727bb90 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.276543:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631969 00010000:00010000:0.0:1721880422.276547:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727bb90 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.276581:0:16120:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c40aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+2732:3687:x1805522011668736:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3043us (3110us total) trans 4296061674 rc 0/0 00000100:00100000:3.0:1721880422.276584:0:16120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631966 00010000:00010000:3.0:1721880422.276597:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727bb66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.276600:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bb47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2731:3689:x1805522011669376:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3016us (3050us total) trans 4296061675 rc 0/0 00010000:00010000:3.0:1721880422.276602:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727bb66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.276606:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631968 00010000:00010000:3.0:1721880422.276606:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727bb66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.276610:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727bb66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.276614:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727bb66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.276617:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b5d40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.276618:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727bb66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.276622:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727bb66 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.276628:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727bb66 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.276632:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727bb66 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.276633:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099926400/0x8a60d30f571ec65a lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe302:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab74 expref: 320 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.276641:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c40b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2730:3689:x1805522011668480:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3203us (3260us total) trans 4296061676 rc 0/0 00000100:00100000:1.0:1721880422.276646:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800952a3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0000_UUID:16089:1805522011670144:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.276648:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631964 00010000:00010000:1.0:1721880422.276655:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880098aa8480/0x8a60d30f5727bba5 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.276659:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098aa8480/0x8a60d30f5727bba5 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.276665:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bb46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+1916:3687:x1805522011668864:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3121us (3148us total) trans 4296019980 rc 0/0 00010000:00010000:1.0:1721880422.276667:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098aa8480/0x8a60d30f5727bba5 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.276669:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727bb82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.276671:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631967 00010000:00010000:1.0:1721880422.276671:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098aa8480/0x8a60d30f5727bba5 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.276674:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098aa8480/0x8a60d30f5727bba5 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.276676:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727bb82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.276678:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098aa8480/0x8a60d30f5727bba5 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.276681:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8480 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.276683:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098aa8480/0x8a60d30f5727bba5 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.276683:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727bb82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.276686:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098aa8480/0x8a60d30f5727bba5 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.276691:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727bb82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.276692:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098aa8480/0x8a60d30f5727bba5 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.276696:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098aa8480/0x8a60d30f5727bba5 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.276698:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727bb82 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.276701:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088efe300/2, rc 0, transno 1052680 00010000:00010000:2.0:1721880422.276703:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aaaf40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.276707:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727bb82 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.276710:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011667072:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.276710:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+1916:3687:x1805522011667584:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3536us (3630us total) trans 4296019981 rc 0/0 00010000:00010000:2.0:1721880422.276711:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727bb82 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.276715:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631961 00010000:00010000:2.0:1721880422.276718:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727bb82 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.276722:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727bb82 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.276753:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009d9e9500/2, rc 0, transno 1052683 00000004:00080000:0.0:1721880422.276764:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009d9ead80/2, rc 0, transno 1094377 00000100:00100000:3.0:1721880422.276764:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d9e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011668992:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.276771:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d9ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011666944:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1721880422.276771:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088efd180/2, rc 0, transno 1052681 00000100:00100000:3.0:1721880422.276773:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088efd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011667200:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1721880422.276779:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800919c1880/2, rc 0, transno 1052682 00000100:00100000:3.0:1721880422.276782:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800919c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011666432:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.276785:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1721880422.276790:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011670784:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.276793:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2730:3686:x1805522011670016:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1684us (1721us total) trans 4296061677 rc 0/0 00000100:00100000:1.0:1721880422.276798:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631970 00000100:00100000:3.0:1721880422.276804:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.276816:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011671168:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1721880422.276825:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801312d2a00/2, rc 0, transno 1094376 00000100:00100000:3.0:1721880422.276826:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.276832:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801312d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011666176:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1721880422.276832:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1721880422.276835:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011671296:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1721880422.276847:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1721880422.276858:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801312d3100/2, rc 0, transno 1094374 00000100:00100000:0.0:1721880422.276863:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801312d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011665920:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.276864:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+1916:3688:x1805522011668608:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3421us (3461us total) trans 4296019982 rc 0/0 00000004:00080000:3.0:1721880422.276865:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a052d180/2, rc 0, transno 1052686 00000100:00100000:3.0:1721880422.276870:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a052d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011668608:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.276871:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631965 00000100:00100000:3.0:1721880422.276879:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011670784 00000100:00100000:3.0:1721880422.276880:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011670784 00000100:00100000:2.0:1721880422.276886:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011671168 00000100:00100000:2.0:1721880422.276889:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011671168 00000100:00100000:3.0:1721880422.276892:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011671296 00000100:00100000:3.0:1721880422.276893:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011671296 00000100:00100000:0.0:1721880422.276909:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011670912:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.276909:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631973 00000100:00100000:3.0:1721880422.276914:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631974 00000100:00100000:2.0:1721880422.276915:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092319f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+1917:3688:x1805522011670784:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.276917:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092319180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+1917:3688:x1805522011671168:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.276927:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1721880422.276935:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64296 count 1 00000100:00100000:2.0:1721880422.276937:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011670912 00000100:00100000:2.0:1721880422.276940:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011670912 00010000:00010000:3.0:1721880422.276943:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727bbba lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb28:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.276946:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631975 00000100:00100000:0.0:1721880422.276950:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009231aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2730:3688:x1805522011671296:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1721880422.276951:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095b53a80/0x8a60d30f571928c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b6df expref: 1336 pid: 16062 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.276955:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.276956:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.276957:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727bbba lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.276958:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631976 00002000:00080000:0.0:1721880422.276961:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58116 count 1 00000100:00100000:2.0:1721880422.276963:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+1918:3686:x1805522011670912:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.276967:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095b53a80/0x8a60d30f571928c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b6df expref: 1336 pid: 16062 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.276971:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325e640/0x8a60d30f5727bbc1 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe304:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.276972:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095b53a80/0x8a60d30f571928c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b6df expref: 1336 pid: 16062 timeout: 887 lvb_type: 0 00002000:00080000:2.0:1721880422.276975:0:16088:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64294 count 1 00000100:00100000:3.0:1721880422.276978:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009231b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011671808:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.276980:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011eb95440/0x8a60d30f571ec692 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12abac expref: 319 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.276985:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.276986:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.276986:0:16088:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727bbc8 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb26:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.276987:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325e640/0x8a60d30f5727bbc1 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.276996:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdeccc0 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.276997:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011eb95440/0x8a60d30f571ec692 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12abac expref: 319 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.276997:0:16088:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ffcd200/0x8a60d30f571924ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b5c0 expref: 1336 pid: 16091 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.277003:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011eb95440/0x8a60d30f571ec692 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12abac expref: 319 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.277003:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.277005:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1721880422.277006:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011671680:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.277007:0:16088:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727bbc8 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.277009:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0000_UUID:16081:1805522011671936:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.277039:0:16088:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ffcd200/0x8a60d30f571924ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b5c0 expref: 1336 pid: 16091 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.277043:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36000 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.277043:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.277049:0:16088:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ffcd200/0x8a60d30f571924ed lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b5c0 expref: 1336 pid: 16091 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.277052:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011671424:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1721880422.277059:0:16120:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011671680 00000100:00100000:2.0:1721880422.277060:0:16088:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801341d1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011672064:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.277062:0:16120:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011671680 00000100:00100000:0.0:1721880422.277065:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.277076:0:16120:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011671424 00000100:00100000:3.0:1721880422.277079:0:16120:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011671424 00000100:00100000:2.0:1721880422.277081:0:16088:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdeb40 going to sleep for 11 seconds 00000004:00080000:0.0:1721880422.277084:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007bb46a00/2, rc 0, transno 1094381 00000100:00100000:1.0:1721880422.277087:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631977 00000100:00100000:1.0:1721880422.277091:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092318e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1919:3688:x1805522011671680:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.277097:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bb46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011670016:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1721880422.277099:0:16120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631978 00002000:00080000:1.0:1721880422.277101:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64297 count 1 00000100:00100000:3.0:1721880422.277103:0:16120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+2731:3686:x1805522011671424:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.277109:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727bbcf lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb29:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.277115:0:16120:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58117 count 1 00010000:00010000:1.0:1721880422.277116:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e99e1c0/0x8a60d30f57192ca3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b78e expref: 1336 pid: 16024 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.277118:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00010000:00010000:1.0:1721880422.277120:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.277121:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1721880422.277122:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011671040:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.277122:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727bbcf lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.277125:0:16120:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727bbd6 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe305:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.277134:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.277134:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e99e1c0/0x8a60d30f57192ca3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b78e expref: 1336 pid: 16024 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.277136:0:16120:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d4b1440/0x8a60d30f571ec6ae lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12abc8 expref: 319 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.277139:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e99e1c0/0x8a60d30f57192ca3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b78e expref: 1336 pid: 16024 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.277142:0:16120:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1721880422.277143:0:16130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011671040 00010000:00010000:3.0:1721880422.277143:0:16120:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1721880422.277145:0:16130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011671040 00010000:00010000:3.0:1721880422.277145:0:16120:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727bbd6 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.277146:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801312d1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011672320:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.277158:0:16130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631979 00010000:00010000:3.0:1721880422.277159:0:16120:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d4b1440/0x8a60d30f571ec6ae lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12abc8 expref: 319 pid: 16126 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.277161:0:16130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008777ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0000-mdtlov_UUID+1920:3686:x1805522011671040:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.277161:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64293 count 1 00000100:00100000:1.0:1721880422.277164:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a780 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.277167:0:16120:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d4b1440/0x8a60d30f571ec6ae lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12abc8 expref: 319 pid: 16126 timeout: 887 lvb_type: 0 00002000:00080000:0.0:1721880422.277169:0:16130:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64295 count 1 00010000:00010000:2.0:1721880422.277170:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727bbdd lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb25:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.277175:0:16120:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800952a3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16120:1805522011672448:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.277176:0:16130:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727bbe4 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb27:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.277182:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880123829f80/0x8a60d30f57192231 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b518 expref: 1336 pid: 11675 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.277184:0:16130:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800920bfcc0/0x8a60d30f571926c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b661 expref: 1336 pid: 16027 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.277187:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.277188:0:16130:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.277188:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.277189:0:16130:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.277189:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727bbdd lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.277191:0:16130:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727bbe4 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.277194:0:16120:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec3c0 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.277201:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880123829f80/0x8a60d30f57192231 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b518 expref: 1336 pid: 11675 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.277205:0:16130:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800920bfcc0/0x8a60d30f571926c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b661 expref: 1336 pid: 16027 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.277205:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1721880422.277207:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880123829f80/0x8a60d30f57192231 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b518 expref: 1336 pid: 11675 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.277211:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009f52f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011672192:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.277214:0:16130:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800920bfcc0/0x8a60d30f571926c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b661 expref: 1336 pid: 16027 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.277214:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801341d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011672576:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.277224:0:16130:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088615880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0001_UUID:16130:1805522011672704:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.277225:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.277236:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.277245:0:16130:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec366c0 going to sleep for 11 seconds 00000004:00080000:3.0:1721880422.277245:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009d9e8000/2, rc 0, transno 1052684 00000100:00100000:3.0:1721880422.277251:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d9e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011668864:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.277256:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011671552:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1721880422.277257:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008c408000/2, rc 0, transno 1094378 00000100:00100000:3.0:1721880422.277269:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008c408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011668736:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1721880422.277275:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008cd22a00/2, rc 0, transno 1052685 00000100:00100000:3.0:1721880422.277277:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008cd22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011667584:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.277278:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011672192 00000100:00100000:1.0:1721880422.277281:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011672192 00000100:00100000:3.0:1721880422.277281:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1721880422.277287:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088614000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011672960:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.277292:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631980 00000100:00100000:1.0:1721880422.277295:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800952a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2732:3688:x1805522011672192:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1721880422.277303:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58119 count 1 00000100:00100000:2.0:1721880422.277303:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801341d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011673088:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.277303:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.277309:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098aa8fc0/0x8a60d30f5727bbeb lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe307:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.277311:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801341d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011672832:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.277317:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ab558c0/0x8a60d30f571ec6e6 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe307:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac00 expref: 319 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.277318:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.277321:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.277322:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.277323:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098aa8fc0/0x8a60d30f5727bbeb lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe307:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.277331:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007bb46d80/2, rc 0, transno 1094379 00010000:00010000:1.0:1721880422.277333:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ab558c0/0x8a60d30f571ec6e6 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe307:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac00 expref: 319 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.277337:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bb46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011669376:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.277338:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ab558c0/0x8a60d30f571ec6e6 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe307:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac00 expref: 319 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.277344:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801312d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0000_UUID:16089:1805522011673216:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.277345:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.277359:0:16110:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011672960 00000100:00100000:3.0:1721880422.277360:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011671552 00000100:00100000:1.0:1721880422.277361:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.277362:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011671552 00000100:00100000:0.0:1721880422.277363:0:16110:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011672960 00000100:00100000:2.0:1721880422.277363:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1721880422.277368:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800952a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011673344:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.277369:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011673088 00000100:00100000:1.0:1721880422.277371:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011673088 00000100:00100000:3.0:1721880422.277374:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631981 00000100:00100000:3.0:1721880422.277377:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088615f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2734:3686:x1805522011671552:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.277382:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1721880422.277385:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58118 count 1 00000100:00100000:0.0:1721880422.277389:0:16110:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011673344 00000100:00100000:1.0:1721880422.277391:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631982 00010000:00010000:3.0:1721880422.277391:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b58c0/0x8a60d30f5727bbf2 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe306:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.277392:0:16110:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011673344 00000100:00100000:1.0:1721880422.277394:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800952a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2735:3687:x1805522011672960:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1721880422.277398:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e997840/0x8a60d30f571ec6ca lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe306:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12abe4 expref: 319 pid: 16101 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.277401:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58120 count 1 00000100:00100000:2.0:1721880422.277401:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631983 00010000:00010000:3.0:1721880422.277402:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.277402:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.277404:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b58c0/0x8a60d30f5727bbf2 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe306:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.277405:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+1921:3688:x1805522011673088:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.277406:0:16110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631984 00010000:00010000:1.0:1721880422.277407:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098aa8240/0x8a60d30f5727bbf9 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe308:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.277409:0:16110:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008854df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_094:lustre-MDT0000-mdtlov_UUID+2735:3688:x1805522011673344:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1721880422.277413:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e997840/0x8a60d30f571ec6ca lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe306:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12abe4 expref: 319 pid: 16101 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.277414:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64299 count 1 00010000:00010000:1.0:1721880422.277417:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007c9e4240/0x8a60d30f571ec702 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe308:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac1c expref: 319 pid: 16101 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1721880422.277418:0:16110:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58121 count 1 00010000:00010000:3.0:1721880422.277418:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e997840/0x8a60d30f571ec6ca lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe306:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12abe4 expref: 319 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.277420:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.277421:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.277422:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727bc00 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb2b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.277423:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098aa8240/0x8a60d30f5727bbf9 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe308:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.277426:0:16110:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325f3c0/0x8a60d30f5727bc07 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe309:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.277428:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800952a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:15452:1805522011673472:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.277431:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800999546c0/0x8a60d30f571942f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b8bb expref: 1336 pid: 16022 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.277432:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007c9e4240/0x8a60d30f571ec702 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe308:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac1c expref: 319 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.277434:0:16110:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007c9e4480/0x8a60d30f571ec71e lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe309:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac38 expref: 319 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.277435:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.277436:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.277437:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007c9e4240/0x8a60d30f571ec702 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe308:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac1c expref: 319 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.277438:0:16110:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.277438:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727bc00 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.277439:0:16110:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.277441:0:16110:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325f3c0/0x8a60d30f5727bc07 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe309:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.277441:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.277442:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba67800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0000_UUID:16111:1805522011673600:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.277449:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800999546c0/0x8a60d30f571942f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b8bb expref: 1336 pid: 16022 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.277452:0:16110:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007c9e4480/0x8a60d30f571ec71e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe309:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac38 expref: 319 pid: 16039 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.277453:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a900 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.277454:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800999546c0/0x8a60d30f571942f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b8bb expref: 1336 pid: 16022 timeout: 887 lvb_type: 0 00000004:00080000:3.0:1721880422.277455:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009f52ea00/2, rc 0, transno 1094380 00010000:00010000:0.0:1721880422.277457:0:16110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007c9e4480/0x8a60d30f571ec71e lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe309:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac38 expref: 319 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.277460:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008854f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011673728:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.277460:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009f52ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011668480:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.277463:0:16110:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088614700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_094:lustre-OST0000_UUID:16110:1805522011673856:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.277477:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde840 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.277479:0:16110:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36240 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.277480:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.277489:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1721880422.277491:0:16113:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011672832 00000100:00100000:3.0:1721880422.277492:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800952a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011673984:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.277493:0:16113:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011672832 00000100:00100000:0.0:1721880422.277504:0:16113:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631985 00000100:00100000:3.0:1721880422.277505:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.277507:0:16113:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bb44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0000-mdtlov_UUID+1922:3687:x1805522011672832:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.277513:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011673984 00002000:00080000:0.0:1721880422.277514:0:16113:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64298 count 1 00000100:00100000:1.0:1721880422.277515:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011673984 00010000:00010000:0.0:1721880422.277521:0:16113:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727bc0e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb2a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.277527:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631986 00010000:00010000:0.0:1721880422.277528:0:16113:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e2a7cc0/0x8a60d30f57193475 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b7f7 expref: 1336 pid: 16056 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.277530:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a65e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2736:3687:x1805522011673984:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1721880422.277536:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58122 count 1 00010000:00010000:1.0:1721880422.277543:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098aa86c0/0x8a60d30f5727bc15 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe30a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.277550:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800961e0000/0x8a60d30f571ec733 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe30a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac4d expref: 319 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.277557:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.277558:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.277559:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098aa86c0/0x8a60d30f5727bc15 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe30a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.277568:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800961e0000/0x8a60d30f571ec733 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe30a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac4d expref: 319 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.277573:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800961e0000/0x8a60d30f571ec733 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe30a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac4d expref: 319 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.277578:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba65f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:15453:1805522011674112:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.277594:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522af00 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.277624:0:16113:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.277625:0:16113:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.277627:0:16113:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727bc0e lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.277640:0:16113:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e2a7cc0/0x8a60d30f57193475 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b7f7 expref: 1336 pid: 16056 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.277647:0:16113:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e2a7cc0/0x8a60d30f57193475 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b7f7 expref: 1336 pid: 16056 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.277652:0:16113:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088616680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0001_UUID:16113:1805522011674240:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.277679:0:16040:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800952a2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_040:lustre-OST0001_UUID:16040:1805522011670528:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.277680:0:16113:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36d80 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.277690:0:16040:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727bbac lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.277720:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.277743:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257696512 00000100:00100000:0.0:1721880422.277744:0:16100:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880092318000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_087:lustre-OST0000_UUID:16100:1805522011670656:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.277746:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257696512 00010000:00010000:2.0:1721880422.277755:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132dbdb00/0x8a60d30f571ec676 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab90 expref: 320 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.277757:0:16100:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727bbb3 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.277759:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.277778:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257696384 00000100:00100000:2.0:1721880422.277781:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257696384 00010000:00010000:2.0:1721880422.277787:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098b25b00/0x8a60d30f57191fde lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b48c expref: 1337 pid: 16080 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.277797:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914164 00000100:00100000:2.0:1721880422.277801:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bb47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+320:2004:x1805522257696512:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.277808:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.277808:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914165 00010000:00010000:2.0:1721880422.277812:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132dbdb00/0x8a60d30f571ec676 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab90 expref: 320 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.277814:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bb44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+1337:2005:x1805522257696384:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.277820:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132dbdb00/0x8a60d30f571ec676 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab90 expref: 320 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.277823:0:7118:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.277828:0:7118:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098b25b00/0x8a60d30f57191fde lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b48c expref: 1337 pid: 16080 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.277832:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132dbdb00/0x8a60d30f571ec676 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe303:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab90 expref: 320 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.277837:0:7118:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098b25b00/0x8a60d30f57191fde lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b48c expref: 1337 pid: 16080 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.277842:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.277844:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.277847:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727bbb3 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.277849:0:7118:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098b25b00/0x8a60d30f57191fde lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b48c expref: 1337 pid: 16080 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.277853:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727bbb3 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe303:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.277858:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.277859:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.277863:0:7118:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727bbac lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.277864:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.277869:0:7118:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727bbac lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.277884:0:7118:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.277886:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bb47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+319:2004:x1805522257696512:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 84us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.277891:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914164 00000100:00100000:3.0:1721880422.277902:0:7118:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bb44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+1336:2005:x1805522257696384:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 88us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.277908:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914165 00010000:00010000:0.0:1721880422.277911:0:16100:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727bbb3 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.277915:0:16100:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727bbb3 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.277920:0:16100:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727bbb3 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.277924:0:16100:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727bbb3 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.277928:0:16100:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727bbb3 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.277929:0:16040:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727bbac lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.277931:0:16100:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b7cc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.277933:0:16100:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727bbb3 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.277935:0:16040:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727bbac lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.277936:0:16100:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727bbb3 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.277942:0:16100:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727bbb3 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.277942:0:16040:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727bbac lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.277946:0:16100:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727bbb3 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.277948:0:16040:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727bbac lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.277954:0:16040:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727bbac lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.277960:0:16040:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aaa880 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.277962:0:16040:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727bbac lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.277974:0:16040:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727bbac lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.277983:0:16040:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727bbac lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.277989:0:16040:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727bbac lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.278066:0:16100:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088617b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:lustre-MDT0000-mdtlov_UUID+2737:3688:x1805522011670400:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2272us (2339us total) trans 4296061678 rc 0/0 00000100:00100000:0.0:1721880422.278071:0:16100:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631972 00000004:00080000:2.0:1721880422.278081:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088617100/2, rc 0, transno 1094382 00000100:00100000:2.0:1721880422.278091:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088617100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011670400:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1721880422.278117:0:16040:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088615180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:lustre-MDT0000-mdtlov_UUID+1923:3687:x1805522011670272:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2466us (2508us total) trans 4296019983 rc 0/0 00000100:00100000:2.0:1721880422.278121:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088614a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011674368:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1721880422.278124:0:16040:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631971 00000100:00100000:2.0:1721880422.278144:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.278164:0:16040:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011674368 00000100:00100000:3.0:1721880422.278168:0:16040:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011674368 00000004:00080000:2.0:1721880422.278170:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009f52d180/2, rc 0, transno 1052687 00000100:00100000:2.0:1721880422.278177:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009f52d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011670272:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.278194:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088617480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011674496:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.278194:0:16040:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631987 00000100:00100000:3.0:1721880422.278199:0:16040:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008854c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:lustre-MDT0000-mdtlov_UUID+2737:3687:x1805522011674368:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.278214:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1721880422.278219:0:16040:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58123 count 1 00010000:00010000:3.0:1721880422.278228:0:16040:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4240/0x8a60d30f5727bc1c lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe30b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.278231:0:16100:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011674496 00000100:00100000:1.0:1721880422.278235:0:16100:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011674496 00010000:00010000:3.0:1721880422.278238:0:16040:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800961e3840/0x8a60d30f571ec74f lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe30b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac69 expref: 318 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.278243:0:16040:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.278245:0:16040:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.278247:0:16040:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4240/0x8a60d30f5727bc1c lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe30b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.278254:0:16100:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631988 00000100:00100000:1.0:1721880422.278259:0:16100:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008854dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:lustre-MDT0000-mdtlov_UUID+1923:3688:x1805522011674496:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.278262:0:16040:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800961e3840/0x8a60d30f571ec74f lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe30b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac69 expref: 318 pid: 16099 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.278270:0:16100:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64300 count 1 00010000:00010000:3.0:1721880422.278271:0:16040:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800961e3840/0x8a60d30f571ec74f lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe30b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac69 expref: 318 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.278280:0:16100:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727bc23 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb2c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.278280:0:16040:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bb47b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_040:lustre-OST0000_UUID:16040:1805522011674624:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.278291:0:16100:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134daa1c0/0x8a60d30f57194531 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b955 expref: 1335 pid: 16096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.278297:0:16100:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.278299:0:16100:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.278302:0:16100:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727bc23 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.278306:0:16040:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec0c0 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.278317:0:16100:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134daa1c0/0x8a60d30f57194531 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b955 expref: 1335 pid: 16096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.278326:0:16100:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134daa1c0/0x8a60d30f57194531 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b955 expref: 1335 pid: 16096 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.278335:0:16100:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba66d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_087:lustre-OST0001_UUID:16100:1805522011674752:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.278357:0:16100:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a480 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.278985:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.278997:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009231b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011671808:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.279006:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d9e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0000_UUID:16081:1805522011671936:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.279030:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727bbba lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.279032:0:16088:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801341d1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011672064:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.279034:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325e640/0x8a60d30f5727bbc1 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.279035:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.279046:0:16088:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727bbc8 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.279052:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801312d1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011672320:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.279053:0:7118:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257696768 00000100:00100000:0.0:1721880422.279054:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.279055:0:7118:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257696768 00010000:00010000:1.0:1721880422.279060:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727bbcf lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.279060:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257696896 00000100:00100000:2.0:1721880422.279063:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257696896 00000100:00100000:0.0:1721880422.279067:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.279069:0:7118:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011eb95440/0x8a60d30f571ec692 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12abac expref: 319 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.279071:0:7116:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257696640 00000100:00100000:2.0:1721880422.279073:0:7116:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257696640 00010000:00010000:2.0:1721880422.279081:0:7116:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095b53a80/0x8a60d30f571928c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b6df expref: 1337 pid: 16062 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.279084:0:7118:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257697024 00000100:00100000:3.0:1721880422.279087:0:7118:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257697024 00000100:00100000:1.0:1721880422.279093:0:8271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914166 00010000:00010000:3.0:1721880422.279096:0:7118:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e99e1c0/0x8a60d30f57192ca3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b78e expref: 1338 pid: 16024 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.279098:0:8271:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088616a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+319:2006:x1805522257696768:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.279098:0:7116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914167 00000100:00100000:0.0:1721880422.279101:0:16130:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088615880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0001_UUID:16130:1805522011672704:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.279101:0:7116:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009231b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1338:2005:x1805522257696640:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.279104:0:8271:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.279107:0:8271:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011eb95440/0x8a60d30f571ec692 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12abac expref: 319 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.279107:0:7116:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.279110:0:7116:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095b53a80/0x8a60d30f571928c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b6df expref: 1338 pid: 16062 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.279114:0:16130:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727bbe4 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.279117:0:8271:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011eb95440/0x8a60d30f571ec692 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12abac expref: 319 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.279120:0:7116:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095b53a80/0x8a60d30f571928c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b6df expref: 1338 pid: 16062 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.279120:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914168 00010000:00010000:1.0:1721880422.279125:0:8271:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011eb95440/0x8a60d30f571ec692 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe304:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12abac expref: 319 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.279126:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092318000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+1338:2004:x1805522257697024:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.279129:0:7116:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095b53a80/0x8a60d30f571928c8 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b6df expref: 1338 pid: 16062 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.279131:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.279132:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1721880422.279134:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.279134:0:8271:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009325e640/0x8a60d30f5727bbc1 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.279136:0:7118:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.279137:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.279138:0:8271:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325e640/0x8a60d30f5727bbc1 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe304:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.279138:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.279140:0:7116:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727bbba lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.279140:0:7118:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e99e1c0/0x8a60d30f57192ca3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb29:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b78e expref: 1337 pid: 16024 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.279144:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257697152 00010000:00010000:2.0:1721880422.279145:0:7116:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727bbba lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.279146:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257697152 00010000:00010000:1.0:1721880422.279148:0:8271:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.279148:0:7118:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e99e1c0/0x8a60d30f57192ca3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb29:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b78e expref: 1337 pid: 16024 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.279151:0:7116:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.279156:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d4b1440/0x8a60d30f571ec6ae lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12abc8 expref: 319 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.279159:0:7118:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e99e1c0/0x8a60d30f57192ca3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb29:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b78e expref: 1337 pid: 16024 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.279164:0:8271:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088616a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+319:2006:x1805522257696768:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 67us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.279165:0:7116:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009231b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1336:2005:x1805522257696640:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 63us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.279168:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914169 00010000:00010000:3.0:1721880422.279169:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.279170:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1721880422.279172:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088615880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+319:2004:x1805522257697152:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.279172:0:8271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914166 00010000:00010000:3.0:1721880422.279173:0:7118:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727bbcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.279177:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.279178:0:7116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914167 00010000:00010000:3.0:1721880422.279178:0:7118:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727bbcf lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.279180:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d4b1440/0x8a60d30f571ec6ae lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12abc8 expref: 318 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.279186:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d4b1440/0x8a60d30f571ec6ae lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12abc8 expref: 318 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.279192:0:7118:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.279193:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325e640/0x8a60d30f5727bbc1 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.279194:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.279195:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.279196:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ffcd200/0x8a60d30f571924ed lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b5c0 expref: 1335 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.279197:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727bbd6 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.279198:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325e640/0x8a60d30f5727bbc1 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.279202:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325e640/0x8a60d30f5727bbc1 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.279204:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727bbd6 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe305:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.279208:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914170 00010000:00010000:1.0:1721880422.279209:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325e640/0x8a60d30f5727bbc1 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.279211:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8064850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1335:2004:x1805522257696896:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.279211:0:7118:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880092318000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+1335:2004:x1805522257697024:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 85us (143us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.279212:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.279213:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325e640/0x8a60d30f5727bbc1 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.279217:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325e640 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.279217:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.279218:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325e640/0x8a60d30f5727bbc1 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.279218:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914168 00010000:00010000:2.0:1721880422.279219:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ffcd200/0x8a60d30f571924ed lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b5c0 expref: 1335 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.279222:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325e640/0x8a60d30f5727bbc1 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.279224:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088615880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+318:2004:x1805522257697152:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 51us (89us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.279226:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ffcd200/0x8a60d30f571924ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b5c0 expref: 1334 pid: 16091 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.279227:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914169 00010000:00010000:1.0:1721880422.279227:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325e640/0x8a60d30f5727bbc1 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.279230:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325e640/0x8a60d30f5727bbc1 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.279233:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ffcd200/0x8a60d30f571924ed lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b5c0 expref: 1334 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.279240:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.279241:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.279243:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727bbc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.279248:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727bbc8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.279248:0:16120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d4b1440/0x8a60d30f571ec6ae lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe305:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12abc8 expref: 317 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.279250:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.279253:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.279257:0:16120:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800952a3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16120:1805522011672448:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.279259:0:15444:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257697280 00000100:00100000:0.0:1721880422.279261:0:15444:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257697280 00000100:00100000:2.0:1721880422.279264:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8064850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1334:2004:x1805522257696896:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 52us (229us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.279267:0:15444:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880123829f80/0x8a60d30f57192231 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b518 expref: 1334 pid: 11675 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.279267:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914170 00010000:00010000:3.0:1721880422.279269:0:16120:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727bbd6 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.279276:0:16120:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727bbd6 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.279277:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914171 00000100:00100000:0.0:1721880422.279280:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ebd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1333:2005:x1805522257697280:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.279282:0:16120:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727bbd6 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.279284:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.279286:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880123829f80/0x8a60d30f57192231 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b518 expref: 1333 pid: 11675 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.279288:0:16120:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727bbd6 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.279292:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880123829f80/0x8a60d30f57192231 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b518 expref: 1333 pid: 11675 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.279293:0:16120:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727bbd6 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.279299:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.279299:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.279300:0:16120:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727bbd6 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.279301:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727bbdd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.279305:0:16120:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4fc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.279308:0:16120:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727bbd6 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.279309:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727bbdd lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.279313:0:16120:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727bbd6 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.279314:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123829f80/0x8a60d30f57192231 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b518 expref: 1333 pid: 11675 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.279315:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.279319:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009231aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2738:3688:x1805522011671296:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2368us (2469us total) trans 4296061679 rc 0/0 00010000:00010000:3.0:1721880422.279321:0:16120:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727bbd6 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.279324:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ebd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1332:2005:x1805522257697280:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 43us (73us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.279324:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631975 00000100:00100000:2.0:1721880422.279324:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801341d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011672576:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.279327:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914171 00010000:00010000:3.0:1721880422.279327:0:16120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727bbd6 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.279335:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727bbdd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.279337:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727bbcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.279341:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727bbcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.279346:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727bbcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.279347:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727bbdd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.279350:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727bbcf lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.279354:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727bbcf lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.279355:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727bbdd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.279357:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.279357:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa9d40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.279358:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727bbcf lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.279362:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727bbcf lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.279362:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727bbdd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.279365:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257697408 00000100:00100000:0.0:1721880422.279366:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257697408 00010000:00010000:1.0:1721880422.279367:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727bbcf lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.279369:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727bbdd lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.279371:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727bbcf lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.279372:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800920bfcc0/0x8a60d30f571926c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b661 expref: 1332 pid: 16027 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.279376:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727bbdd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.279381:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914172 00010000:00010000:2.0:1721880422.279382:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136351f80 already unused, calling callback (ffffffffa084e330) 00000100:00100000:0.0:1721880422.279384:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cd23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1332:2004:x1805522257697408:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.279384:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727bbdd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.279388:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.279389:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727bbdd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.279390:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800920bfcc0/0x8a60d30f571926c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b661 expref: 1332 pid: 16027 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.279395:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800920bfcc0/0x8a60d30f571926c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b661 expref: 1332 pid: 16027 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.279396:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727bbdd lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.279399:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727bbdd lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.279402:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800920bfcc0/0x8a60d30f571926c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b661 expref: 1332 pid: 16027 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.279413:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.279413:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.279415:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727bbe4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.279420:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727bbe4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.279427:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.279427:0:16120:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+2738:3686:x1805522011671424:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2322us (2360us total) trans 4296061680 rc 0/0 00000100:00100000:3.0:1721880422.279431:0:16120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631978 00000100:00100000:0.0:1721880422.279436:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cd23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1331:2004:x1805522257697408:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 51us (79us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.279439:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914172 00010000:00010000:3.0:1721880422.279444:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727bbba lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.279446:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880092318e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1925:3688:x1805522011671680:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2354us (2402us total) trans 4296019984 rc 0/0 00010000:00010000:3.0:1721880422.279448:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727bbba lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.279449:0:16130:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727bbe4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.279450:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631977 00010000:00010000:3.0:1721880422.279452:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727bbba lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.279454:0:16130:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727bbe4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.279456:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727bbba lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.279458:0:16130:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727bbe4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.279460:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727bbba lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.279462:0:16130:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727bbe4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.279463:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b61c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.279464:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727bbba lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.279465:0:16130:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727bbe4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.279468:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727bbba lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.279472:0:16130:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325cd80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.279474:0:16130:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727bbe4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.279474:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727bbba lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.279478:0:16130:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727bbe4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.279478:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727bbba lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.279483:0:16130:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727bbe4 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.279487:0:16130:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727bbe4 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.279497:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880092319f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+1924:3688:x1805522011670784:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2582us (2691us total) trans 4296019985 rc 0/0 00000100:00100000:2.0:1721880422.279502:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631973 00000004:00080000:2.0:1721880422.279524:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009d9e8700/2, rc 0, transno 1052688 00000100:00100000:2.0:1721880422.279529:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d9e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011671680:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1721880422.279552:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009d9e9c00/2, rc 0, transno 1094383 00000100:00100000:2.0:1721880422.279566:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d9e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011671296:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1721880422.279575:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009d9eb100/2, rc 0, transno 1052689 00000100:00100000:2.0:1721880422.279582:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d9eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011670784:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.279586:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1721880422.279591:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880092319180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+1925:3688:x1805522011671168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2672us (2762us total) trans 4296019986 rc 0/0 00000100:00100000:1.0:1721880422.279594:0:16130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008777ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0000-mdtlov_UUID+1925:3686:x1805522011671040:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2432us (2459us total) trans 4296019987 rc 0/0 00000100:00100000:3.0:1721880422.279597:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631974 00000100:00100000:1.0:1721880422.279600:0:16130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631979 00010000:00010000:2.0:1721880422.279609:0:16088:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727bbc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.279617:0:16088:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727bbc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.279623:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801312d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0000_UUID:16089:1805522011673216:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.279625:0:16088:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727bbc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.279631:0:16088:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727bbc8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.279631:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800952a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:15452:1805522011673472:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.279632:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880098aa8fc0/0x8a60d30f5727bbeb lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe307:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.279638:0:16088:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727bbc8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.279642:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009d8b58c0/0x8a60d30f5727bbf2 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe306:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.279643:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.279644:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012ba67800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0000_UUID:16111:1805522011673600:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.279649:0:16088:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136351b00 already unused, calling callback (ffffffffa084e330) 00000100:00100000:0.0:1721880422.279650:0:15444:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257697536 00000100:00100000:0.0:1721880422.279651:0:15444:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257697536 00010000:00010000:1.0:1721880422.279651:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880098aa8240/0x8a60d30f5727bbf9 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe308:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.279652:0:16088:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727bbc8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.279659:0:15444:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab558c0/0x8a60d30f571ec6e6 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe307:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac00 expref: 317 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.279659:0:16088:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727bbc8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.279666:0:16088:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727bbc8 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.279667:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011675008:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.279669:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914173 00010000:00010000:2.0:1721880422.279670:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727bbc8 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.279672:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088efd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+317:2005:x1805522257697536:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.279676:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.279678:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ab558c0/0x8a60d30f571ec6e6 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe307:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac00 expref: 317 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.279684:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.279687:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ab558c0/0x8a60d30f571ec6e6 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe307:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac00 expref: 317 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.279695:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ab558c0/0x8a60d30f571ec6e6 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe307:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac00 expref: 317 pid: 16101 timeout: 887 lvb_type: 0 00000004:00080000:3.0:1721880422.279698:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009d9e9180/2, rc 0, transno 1052691 00010000:00010000:0.0:1721880422.279700:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.279701:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.279703:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098aa8fc0/0x8a60d30f5727bbeb lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe307:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.279703:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d9e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011671040:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.279707:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098aa8fc0/0x8a60d30f5727bbeb lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe307:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.279716:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.279721:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098aa8fc0/0x8a60d30f5727bbeb lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.279724:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011675008 00000100:00100000:3.0:1721880422.279725:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011675008 00000100:00100000:0.0:1721880422.279743:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088efd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+316:2005:x1805522257697536:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 54us (84us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.279743:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098aa8fc0/0x8a60d30f5727bbeb lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.279747:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914173 00010000:00010000:1.0:1721880422.279748:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098aa8fc0/0x8a60d30f5727bbeb lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.279753:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098aa8fc0/0x8a60d30f5727bbeb lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.279757:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098aa8fc0/0x8a60d30f5727bbeb lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.279758:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631989 00010000:00010000:1.0:1721880422.279760:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8fc0 already unused, calling callback (ffffffffa084e330) 00000100:00100000:3.0:1721880422.279761:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007bb44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2738:3686:x1805522011675008:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.279762:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098aa8fc0/0x8a60d30f5727bbeb lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.279767:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098aa8fc0/0x8a60d30f5727bbeb lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.279769:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58124 count 1 00000100:00100000:0.0:1721880422.279770:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.279773:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098aa8fc0/0x8a60d30f5727bbeb lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.279773:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+1924:3686:x1805522011670912:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2809us (2844us total) trans 4296019988 rc 0/0 00010000:00010000:1.0:1721880422.279776:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098aa8fc0/0x8a60d30f5727bbeb lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.279776:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4d80/0x8a60d30f5727bc2a lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe30c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.279777:0:15444:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257697664 00000100:00100000:2.0:1721880422.279777:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631976 00000100:00100000:0.0:1721880422.279779:0:15444:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257697664 00010000:00010000:3.0:1721880422.279783:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880084f21200/0x8a60d30f571ec76b lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe30c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac85 expref: 316 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.279785:0:15444:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e997840/0x8a60d30f571ec6ca lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe306:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12abe4 expref: 316 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.279790:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008854ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011674880:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.279791:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.279792:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.279793:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4d80/0x8a60d30f5727bc2a lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe30c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.279794:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914174 00000100:00100000:0.0:1721880422.279798:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8066850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+316:2005:x1805522257697664:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.279803:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.279803:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.279803:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880084f21200/0x8a60d30f571ec76b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe30c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac85 expref: 316 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.279805:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e997840/0x8a60d30f571ec6ca lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe306:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12abe4 expref: 316 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.279809:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880084f21200/0x8a60d30f571ec76b lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe30c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac85 expref: 316 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.279811:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e997840/0x8a60d30f571ec6ca lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe306:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12abe4 expref: 316 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.279815:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bb44a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0000_UUID:16075:1805522011675392:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.279819:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e997840/0x8a60d30f571ec6ca lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe306:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12abe4 expref: 316 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.279821:0:16130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011674880 00000100:00100000:1.0:1721880422.279824:0:16130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011674880 00010000:00010000:0.0:1721880422.279825:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.279826:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000004:00080000:2.0:1721880422.279827:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009d9e9f80/2, rc 0, transno 1052690 00010000:00010000:0.0:1721880422.279828:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b58c0/0x8a60d30f5727bbf2 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe306:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.279831:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d9e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011671168:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.279832:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b58c0/0x8a60d30f5727bbf2 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe306:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.279833:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.279838:0:16130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631990 00000100:00100000:1.0:1721880422.279840:0:16130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0000-mdtlov_UUID+1924:3688:x1805522011674880:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.279848:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00080000:1.0:1721880422.279849:0:16130:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64301 count 1 00010000:00010000:3.0:1721880422.279854:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009d8b58c0/0x8a60d30f5727bbf2 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.279855:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bb47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011675264:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.279857:0:16130:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727bc31 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb2d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.279858:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d8b58c0/0x8a60d30f5727bbf2 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.279860:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8066850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+315:2005:x1805522257697664:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 62us (90us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.279862:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b58c0/0x8a60d30f5727bbf2 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.279864:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914174 00010000:00010000:1.0:1721880422.279864:0:16130:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009577af40/0x8a60d30f571947e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ba2e expref: 1330 pid: 16122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.279865:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b58c0/0x8a60d30f5727bbf2 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.279867:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.279868:0:16130:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.279868:0:16130:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.279869:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d8b58c0/0x8a60d30f5727bbf2 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.279870:0:16130:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727bc31 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.279873:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b58c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.279875:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b58c0/0x8a60d30f5727bbf2 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.279876:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1721880422.279878:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801341d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011675520:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.279878:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b58c0/0x8a60d30f5727bbf2 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.279880:0:16130:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009577af40/0x8a60d30f571947e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ba2e expref: 1330 pid: 16122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.279884:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d8b58c0/0x8a60d30f5727bbf2 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.279888:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b58c0/0x8a60d30f5727bbf2 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.279889:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.279890:0:16130:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009577af40/0x8a60d30f571947e6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ba2e expref: 1330 pid: 16122 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.279896:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.279896:0:16130:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba67800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0001_UUID:16130:1805522011675648:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.279902:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088616a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011675136:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.279903:0:15444:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257697792 00000100:00100000:0.0:1721880422.279905:0:15444:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257697792 00010000:00010000:0.0:1721880422.279911:0:15444:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007c9e4240/0x8a60d30f571ec702 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe308:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac1c expref: 315 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.279914:0:16130:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a900 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.279914:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.279927:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011675264 00000100:00100000:1.0:1721880422.279929:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011675520 00000100:00100000:2.0:1721880422.279929:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011675264 00000100:00100000:1.0:1721880422.279931:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011675520 00000100:00100000:0.0:1721880422.279933:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914175 00000100:00100000:0.0:1721880422.279935:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088efd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+315:2006:x1805522257697792:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.279939:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.279941:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007c9e4240/0x8a60d30f571ec702 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe308:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac1c expref: 315 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.279943:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011675136 00000100:00100000:2.0:1721880422.279944:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011675136 00010000:00010000:0.0:1721880422.279947:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007c9e4240/0x8a60d30f571ec702 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe308:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac1c expref: 315 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.279948:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631991 00000100:00100000:1.0:1721880422.279952:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800952a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1927:3688:x1805522011675264:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.279955:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007c9e4240/0x8a60d30f571ec702 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe308:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac1c expref: 315 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.279956:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631992 00002000:00080000:1.0:1721880422.279959:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64303 count 1 00000100:00100000:2.0:1721880422.279959:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800952a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+1927:3688:x1805522011675520:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.279961:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.279961:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088615f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2739:3686:x1805522011671552:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2583us (2646us total) trans 4296061681 rc 0/0 00010000:00010000:0.0:1721880422.279962:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.279964:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098aa8240/0x8a60d30f5727bbf9 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe308:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.279965:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727bc38 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb2f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.279966:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631981 00010000:00010000:0.0:1721880422.279968:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098aa8240/0x8a60d30f5727bbf9 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe308:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.279969:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64304 count 1 00010000:00010000:1.0:1721880422.279972:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e5c9680/0x8a60d30f57194ce7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10bb3f expref: 1330 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.279975:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631993 00010000:00010000:1.0:1721880422.279976:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.279977:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.279977:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.279977:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727bc3f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb30:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.279978:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800952a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1927:3687:x1805522011675136:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.279979:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727bc38 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.279985:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800993c58c0/0x8a60d30f57194ffe lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10bc11 expref: 1330 pid: 16045 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.279986:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64302 count 1 00010000:00010000:1.0:1721880422.279987:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e5c9680/0x8a60d30f57194ce7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10bb3f expref: 1330 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.279989:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088efd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+314:2006:x1805522257697792:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 52us (93us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.279989:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.279990:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.279992:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e5c9680/0x8a60d30f57194ce7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10bb3f expref: 1330 pid: 16113 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.279992:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727bc3f lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.279992:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727bc46 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb2e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.279993:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914175 00010000:00010000:3.0:1721880422.279999:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b6e21c0/0x8a60d30f57194a0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10baac expref: 1330 pid: 16119 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.280002:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba64e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011675776:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.280003:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.280004:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.280005:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800993c58c0/0x8a60d30f57194ffe lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10bc11 expref: 1330 pid: 16045 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.280006:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727bc46 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.280025:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800993c58c0/0x8a60d30f57194ffe lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10bc11 expref: 1330 pid: 16045 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.280031:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b6e21c0/0x8a60d30f57194a0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10baac expref: 1330 pid: 16119 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.280034:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.280035:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800952a2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011675904:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.280040:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b6e21c0/0x8a60d30f57194a0f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10baac expref: 1330 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.280047:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098aa8240/0x8a60d30f5727bbf9 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.280050:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bb47480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011676032:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.280052:0:16110:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088614700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_094:lustre-OST0000_UUID:16110:1805522011673856:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.280054:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdecc0 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.280055:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098aa8240/0x8a60d30f5727bbf9 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.280061:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098aa8240/0x8a60d30f5727bbf9 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.280063:0:16110:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325f3c0/0x8a60d30f5727bc07 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe309:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.280067:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098aa8240/0x8a60d30f5727bbf9 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.280067:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec3c0 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.280073:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098aa8240/0x8a60d30f5727bbf9 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.280076:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008854f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011673728:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.280079:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8240 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.280081:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098aa8240/0x8a60d30f5727bbf9 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.280087:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727bc00 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.280088:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098aa8240/0x8a60d30f5727bbf9 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.280095:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009d9ea300/2, rc 0, transno 1094385 00010000:00010000:1.0:1721880422.280097:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098aa8240/0x8a60d30f5727bbf9 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.280102:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d9ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011671552:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.280104:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098aa8240/0x8a60d30f5727bbf9 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.280112:0:16113:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088616680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_097:lustre-OST0001_UUID:16113:1805522011674240:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.280119:0:16113:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727bc0e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.280132:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1721880422.280134:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000004:00080000:3.0:1721880422.280134:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009d9ebb80/2, rc 0, transno 1052692 00000100:00100000:2.0:1721880422.280139:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bb44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011676160:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.280141:0:15444:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257698048 00000100:00100000:0.0:1721880422.280143:0:15444:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257698048 00000100:00100000:3.0:1721880422.280148:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d9ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011670912:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.280149:0:15444:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007c9e4480/0x8a60d30f571ec71e lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe309:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac38 expref: 314 pid: 16039 timeout: 887 lvb_type: 0 00000004:00080000:3.0:1721880422.280156:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009d9eb800/2, rc 0, transno 1094384 00000100:00100000:0.0:1721880422.280160:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914176 00000100:00100000:3.0:1721880422.280161:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d9eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011671424:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.280163:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009231b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+314:2004:x1805522257698048:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.280167:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.280169:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007c9e4480/0x8a60d30f571ec71e lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe309:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac38 expref: 314 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.280175:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007c9e4480/0x8a60d30f571ec71e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe309:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac38 expref: 314 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.280176:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.280182:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007c9e4480/0x8a60d30f571ec71e lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe309:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac38 expref: 314 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.280186:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1721880422.280187:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.280189:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.280191:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009325f3c0/0x8a60d30f5727bc07 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe309:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.280191:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011676416:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.280196:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800952a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2739:3687:x1805522011672960:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2800us (2891us total) trans 4296061682 rc 0/0 00000004:00080000:2.0:1721880422.280196:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088614000/2, rc 0, transno 1094386 00010000:00010000:0.0:1721880422.280198:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325f3c0/0x8a60d30f5727bc07 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe309:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.280200:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631982 00000100:00100000:2.0:1721880422.280208:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088614000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011672960:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.280210:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.280211:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011676160 00000100:00100000:1.0:1721880422.280213:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011676160 00000100:00100000:2.0:1721880422.280214:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008854f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011676288:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.280223:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009231b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+313:2004:x1805522257698048:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 58us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.280224:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631994 00000100:00100000:3.0:1721880422.280226:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.280227:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2739:3687:x1805522011676160:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.280229:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914176 00000100:00100000:2.0:1721880422.280232:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1721880422.280235:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011676544:0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1721880422.280241:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58125 count 1 00000100:00100000:3.0:1721880422.280244:0:16120:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011676416 00000100:00100000:2.0:1721880422.280246:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.280246:0:16120:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011676416 00010000:00010000:0.0:1721880422.280248:0:16110:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325f3c0/0x8a60d30f5727bc07 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.280248:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098aa9440/0x8a60d30f5727bc4d lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe30d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.280254:0:16110:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325f3c0/0x8a60d30f5727bc07 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.280255:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099fb98c0/0x8a60d30f571ec787 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe30d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aca1 expref: 312 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.280256:0:16120:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011676544 00000100:00100000:3.0:1721880422.280257:0:16120:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011676544 00010000:00010000:1.0:1721880422.280259:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.280260:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.280261:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098aa9440/0x8a60d30f5727bc4d lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe30d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.280263:0:16110:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325f3c0/0x8a60d30f5727bc07 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.280266:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631995 00010000:00010000:0.0:1721880422.280270:0:16110:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325f3c0/0x8a60d30f5727bc07 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.280270:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2741:3689:x1805522011676416:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1721880422.280271:0:16120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631996 00010000:00010000:1.0:1721880422.280272:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099fb98c0/0x8a60d30f571ec787 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe30d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aca1 expref: 312 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.280274:0:16120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+2741:3688:x1805522011676544:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.280276:0:16110:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325f3c0/0x8a60d30f5727bc07 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.280277:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099fb98c0/0x8a60d30f571ec787 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe30d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aca1 expref: 312 pid: 16101 timeout: 887 lvb_type: 0 00002000:00080000:2.0:1721880422.280281:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58126 count 1 00010000:00010000:0.0:1721880422.280282:0:16110:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325f3c0 already unused, calling callback (ffffffffa084e330) 00002000:00080000:3.0:1721880422.280282:0:16120:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58127 count 1 00000100:00100000:1.0:1721880422.280283:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba64700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0000_UUID:16111:1805522011676672:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.280285:0:16110:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325f3c0/0x8a60d30f5727bc07 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.280289:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801363518c0/0x8a60d30f5727bc54 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe30e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.280289:0:16120:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7840/0x8a60d30f5727bc5b lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe30f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.280292:0:16110:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325f3c0/0x8a60d30f5727bc07 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.280295:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a780 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.280296:0:16120:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097972880/0x8a60d30f571ec7b8 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe30f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12acd2 expref: 312 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.280298:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097971b00/0x8a60d30f571ec7a3 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe30e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12acbd expref: 312 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.280300:0:16120:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.280301:0:16110:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325f3c0/0x8a60d30f5727bc07 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.280301:0:16120:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.280302:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.280302:0:16120:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7840/0x8a60d30f5727bc5b lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe30f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.280303:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.280305:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801363518c0/0x8a60d30f5727bc54 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe30e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.280307:0:16110:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325f3c0/0x8a60d30f5727bc07 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.280310:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012ba65f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:15453:1805522011674112:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.280311:0:16120:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097972880/0x8a60d30f571ec7b8 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe30f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12acd2 expref: 312 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.280316:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097971b00/0x8a60d30f571ec7a3 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe30e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12acbd expref: 312 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.280317:0:16120:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097972880/0x8a60d30f571ec7b8 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe30f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12acd2 expref: 312 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.280323:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880098aa86c0/0x8a60d30f5727bc15 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe30a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.280323:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097971b00/0x8a60d30f571ec7a3 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe30e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12acbd expref: 312 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.280323:0:16120:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16120:1805522011676800:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.280329:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800919c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0000_UUID:16060:1805522011676928:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.280334:0:16120:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdeccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.280340:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde840 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.280353:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.280367:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011676288 00000100:00100000:3.0:1721880422.280369:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011676288 00000100:00100000:3.0:1721880422.280381:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631997 00000100:00100000:3.0:1721880422.280383:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+1928:3687:x1805522011676288:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.280390:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64305 count 1 00000100:00100000:1.0:1721880422.280397:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800952a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2743:3688:x1805522011672192:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3100us (3170us total) trans 4296061683 rc 0/0 00010000:00010000:3.0:1721880422.280397:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727bc62 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb31:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.280401:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631980 00000004:00080000:2.0:1721880422.280406:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009f52f800/2, rc 0, transno 1094387 00010000:00010000:3.0:1721880422.280407:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801356b6f40/0x8a60d30f571952b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10bcc7 expref: 1330 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.280412:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.280412:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.280416:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009f52f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011672192:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1721880422.280416:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727bc62 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.280424:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800952a1880/2, rc 0, transno 1094388 00000100:00100000:0.0:1721880422.280425:0:16110:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008854df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_094:lustre-MDT0000-mdtlov_UUID+2742:3688:x1805522011673344:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3014us (3041us total) trans 4296061684 rc 0/0 00000100:00100000:2.0:1721880422.280427:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800952a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011673344:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.280430:0:16110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631984 00000100:00100000:2.0:1721880422.280445:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011677184:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1721880422.280446:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011677056:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.280465:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.280466:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.280479:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257697920 00000100:00100000:1.0:1721880422.280481:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257697920 00000100:00100000:0.0:1721880422.280486:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.280488:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.280489:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800999546c0/0x8a60d30f571942f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b8bb expref: 1331 pid: 16022 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.280491:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801356b6f40/0x8a60d30f571952b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10bcc7 expref: 1331 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.280494:0:15444:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257698176 00010000:00010000:3.0:1721880422.280496:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801356b6f40/0x8a60d30f571952b3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10bcc7 expref: 1331 pid: 16088 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.280497:0:15444:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257698176 00000100:00100000:3.0:1721880422.280502:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c7fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011677312:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.280505:0:15444:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800961e0000/0x8a60d30f571ec733 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe30a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac4d expref: 313 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.280510:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914177 00000100:00100000:3.0:1721880422.280510:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec000 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.280514:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092318000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1331:2004:x1805522257697920:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.280516:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914178 00010000:00010000:1.0:1721880422.280519:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.280520:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088616680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+313:2004:x1805522257698176:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.280522:0:16110:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011677056 00010000:00010000:1.0:1721880422.280522:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800999546c0/0x8a60d30f571942f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb2b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b8bb expref: 1331 pid: 16022 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.280524:0:16110:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011677056 00010000:00010000:1.0:1721880422.280528:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800999546c0/0x8a60d30f571942f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb2b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b8bb expref: 1331 pid: 16022 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.280531:0:16110:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011677184 00000100:00100000:0.0:1721880422.280533:0:16110:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011677184 00010000:00010000:2.0:1721880422.280533:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.280536:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800961e0000/0x8a60d30f571ec733 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe30a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac4d expref: 313 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.280538:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800999546c0/0x8a60d30f571942f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb2b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b8bb expref: 1331 pid: 16022 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.280539:0:16110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631998 00000100:00100000:0.0:1721880422.280542:0:16110:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_094:lustre-MDT0000-mdtlov_UUID+2743:3686:x1805522011677056:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.280545:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.280546:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.280546:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800961e0000/0x8a60d30f571ec733 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe30a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac4d expref: 313 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.280548:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727bc00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1721880422.280550:0:16110:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58128 count 1 00010000:00010000:1.0:1721880422.280552:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727bc00 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.280558:0:16110:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325d200/0x8a60d30f5727bc69 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe310:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.280558:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800961e0000/0x8a60d30f571ec733 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe30a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac4d expref: 313 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.280562:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.280566:0:16110:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012328e400/0x8a60d30f571ec7d4 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe310:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12acee expref: 312 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.280566:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727bc00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.280568:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.280569:0:16110:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.280569:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.280570:0:16110:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1721880422.280570:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880092318000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1330:2004:x1805522257697920:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 56us (106us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.280571:0:16110:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325d200/0x8a60d30f5727bc69 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe310:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.280571:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727bc00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.280572:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098aa86c0/0x8a60d30f5727bc15 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe30a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.280574:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914177 00010000:00010000:3.0:1721880422.280576:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727bc00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.280580:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098aa86c0/0x8a60d30f5727bc15 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe30a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.280580:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727bc00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.280582:0:16110:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012328e400/0x8a60d30f571ec7d4 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe310:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12acee expref: 312 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.280584:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727bc00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.280587:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801363506c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.280589:0:16110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012328e400/0x8a60d30f571ec7d4 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe310:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12acee expref: 312 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.280589:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727bc00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.280592:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631999 00010000:00010000:3.0:1721880422.280592:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727bc00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.280594:0:16110:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088614700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_094:lustre-OST0000_UUID:16110:1805522011677440:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.280595:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135170000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2743:3687:x1805522011677184:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1721880422.280597:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.280598:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727bc00 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.280602:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727bc00 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.280603:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58129 count 1 00000100:00100000:0.0:1721880422.280607:0:16110:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36d80 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.280610:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009106e400/0x8a60d30f5727bc70 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe311:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.280613:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088616680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+312:2004:x1805522257698176:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 91us (125us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.280617:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ffcfa80/0x8a60d30f571ec7f0 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe311:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad0a expref: 312 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.280620:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.280620:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914178 00010000:00010000:1.0:1721880422.280621:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1721880422.280622:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.280622:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009106e400/0x8a60d30f5727bc70 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe311:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.280640:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257698304 00000100:00100000:1.0:1721880422.280642:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257698304 00010000:00010000:1.0:1721880422.280648:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e2a7cc0/0x8a60d30f57193475 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b7f7 expref: 1330 pid: 16056 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.280648:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098aa86c0/0x8a60d30f5727bc15 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.280653:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098aa86c0/0x8a60d30f5727bc15 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.280657:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.280658:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098aa86c0/0x8a60d30f5727bc15 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.280663:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098aa86c0/0x8a60d30f5727bc15 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.280669:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257698432 00000100:00100000:1.0:1721880422.280670:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257698432 00010000:00010000:2.0:1721880422.280671:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098aa86c0/0x8a60d30f5727bc15 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.280675:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa86c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.280676:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800961e3840/0x8a60d30f571ec74f lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe30b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac69 expref: 312 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.280677:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098aa86c0/0x8a60d30f5727bc15 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.280681:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098aa86c0/0x8a60d30f5727bc15 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.280683:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914179 00010000:00010000:2.0:1721880422.280686:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098aa86c0/0x8a60d30f5727bc15 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.280686:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088615880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1330:2007:x1805522257698304:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.280690:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098aa86c0/0x8a60d30f5727bc15 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.280692:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.280693:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914180 00010000:00010000:3.0:1721880422.280695:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e2a7cc0/0x8a60d30f57193475 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb2a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b7f7 expref: 1330 pid: 16056 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.280696:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ebd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+312:2005:x1805522257698432:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.280697:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.280700:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.280702:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800961e3840/0x8a60d30f571ec74f lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe30b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac69 expref: 312 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.280704:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e2a7cc0/0x8a60d30f57193475 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb2a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b7f7 expref: 1330 pid: 16056 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.280707:0:15444:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257698560 00010000:00010000:1.0:1721880422.280708:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800961e3840/0x8a60d30f571ec74f lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe30b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac69 expref: 312 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.280710:0:15444:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257698560 00010000:00010000:3.0:1721880422.280712:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e2a7cc0/0x8a60d30f57193475 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb2a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b7f7 expref: 1331 pid: 16056 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.280714:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.280715:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.280716:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4240/0x8a60d30f5727bc1c lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe30b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.280718:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.280719:0:15444:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134daa1c0/0x8a60d30f57194531 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b955 expref: 1330 pid: 16096 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.280719:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.280720:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4240/0x8a60d30f5727bc1c lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe30b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.280721:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727bc0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.280725:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727bc0e lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.280745:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.280747:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914181 00000100:00100000:0.0:1721880422.280751:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e194450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1330:2005:x1805522257698560:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.280752:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.280755:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ebd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+312:2005:x1805522257698432:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 58us (97us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.280757:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.280759:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134daa1c0/0x8a60d30f57194531 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b955 expref: 1330 pid: 16096 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.280760:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914180 00000100:00100000:3.0:1721880422.280762:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088615880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1330:2007:x1805522257698304:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 75us (139us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.280766:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134daa1c0/0x8a60d30f57194531 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b955 expref: 1330 pid: 16096 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.280766:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914179 00010000:00010000:0.0:1721880422.280775:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.280776:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.280777:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727bc23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.280782:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727bc23 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.280788:0:16100:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134daa1c0/0x8a60d30f57194531 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10b955 expref: 1329 pid: 16096 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.280789:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.280790:0:16040:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800961e3840/0x8a60d30f571ec74f lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe30b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac69 expref: 311 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.280794:0:16100:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012ba66d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_087:lustre-OST0001_UUID:16100:1805522011674752:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.280798:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e194450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1328:2005:x1805522257698560:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 46us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.280799:0:16040:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bb47b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_040:lustre-OST0000_UUID:16040:1805522011674624:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.280802:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914181 00010000:00010000:1.0:1721880422.280805:0:16100:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727bc23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.280807:0:16040:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4240/0x8a60d30f5727bc1c lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.280809:0:16100:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727bc23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.280813:0:16100:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727bc23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.280815:0:16040:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4240/0x8a60d30f5727bc1c lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.280817:0:16100:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727bc23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.280817:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a65e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2744:3687:x1805522011673984:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3286us (3310us total) trans 4296061685 rc 0/0 00010000:00010000:3.0:1721880422.280819:0:16040:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4240/0x8a60d30f5727bc1c lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.280821:0:16100:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727bc23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.280822:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631986 00010000:00010000:3.0:1721880422.280823:0:16040:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4240/0x8a60d30f5727bc1c lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.280824:0:16113:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727bc0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.280824:0:16100:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727bc23 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.280826:0:16040:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4240/0x8a60d30f5727bc1c lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.280827:0:16100:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa9200 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.280829:0:16113:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727bc0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.280829:0:16100:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727bc23 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.280830:0:16040:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4240/0x8a60d30f5727bc1c lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.280833:0:16040:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4240 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.280834:0:16113:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727bc0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.280835:0:16040:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4240/0x8a60d30f5727bc1c lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.280836:0:16100:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727bc23 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.280838:0:16113:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727bc0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.280838:0:16040:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4240/0x8a60d30f5727bc1c lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.280842:0:16113:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727bc0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.280842:0:16100:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727bc23 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.280844:0:16040:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4240/0x8a60d30f5727bc1c lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.280845:0:16113:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325e1c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.280845:0:16100:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727bc23 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.280847:0:16113:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727bc0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.280847:0:16040:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4240/0x8a60d30f5727bc1c lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.280849:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800952a1f80/2, rc 0, transno 1094389 00010000:00010000:0.0:1721880422.280851:0:16113:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727bc0e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.280856:0:16113:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727bc0e lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.280857:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800952a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011673984:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.280860:0:16113:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727bc0e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.280889:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011677568:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.280908:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.280927:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011677568 00000100:00100000:2.0:1721880422.280929:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011677568 00000100:00100000:3.0:1721880422.280930:0:16040:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008854c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:lustre-MDT0000-mdtlov_UUID+2744:3687:x1805522011674368:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2731us (2785us total) trans 4296061686 rc 0/0 00000100:00100000:3.0:1721880422.280934:0:16040:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631987 00000100:00100000:2.0:1721880422.280941:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632000 00000100:00100000:2.0:1721880422.280944:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2744:3688:x1805522011677568:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1721880422.280953:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58130 count 1 00000100:00100000:0.0:1721880422.280960:0:16113:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bb44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_097:lustre-MDT0000-mdtlov_UUID+1931:3687:x1805522011672832:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3452us (3478us total) trans 4296019991 rc 0/0 00000100:00100000:1.0:1721880422.280961:0:16100:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008854dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:lustre-MDT0000-mdtlov_UUID+1931:3688:x1805522011674496:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2700us (2745us total) trans 4296019990 rc 0/0 00010000:00010000:2.0:1721880422.280961:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136352f40/0x8a60d30f5727bc77 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe312:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.280963:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+1931:3688:x1805522011673088:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3557us (3618us total) trans 4296019989 rc 0/0 00000100:00100000:0.0:1721880422.280965:0:16113:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631985 00000100:00100000:3.0:1721880422.280968:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631983 00010000:00010000:2.0:1721880422.280969:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c2d8000/0x8a60d30f571ec80c lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe312:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad26 expref: 310 pid: 16099 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.280971:0:16100:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631988 00010000:00010000:2.0:1721880422.280973:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.280975:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.280976:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136352f40/0x8a60d30f5727bc77 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe312:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.280986:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c2d8000/0x8a60d30f571ec80c lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe312:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad26 expref: 310 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.280991:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c2d8000/0x8a60d30f571ec80c lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe312:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad26 expref: 310 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.280994:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ffcfa80/0x8a60d30f571ec7f0 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe311:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad0a expref: 310 pid: 16099 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.280998:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135171f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:15453:1805522011677696:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.281001:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ffcfa80/0x8a60d30f571ec7f0 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe311:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad0a expref: 310 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.281008:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba66d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0000_UUID:16028:1805522011677824:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.281010:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.281036:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a480 going to sleep for 11 seconds 00000004:00080000:2.0:1721880422.281050:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088617480/2, rc 0, transno 1052694 00000100:00100000:2.0:1721880422.281058:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088617480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011674496:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1721880422.281086:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801341d1180/2, rc 0, transno 1052693 00000100:00100000:3.0:1721880422.281087:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135170a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011677952:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.281092:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801341d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011673088:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.281100:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.281117:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011677952 00000100:00100000:3.0:1721880422.281119:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011677952 00000004:00080000:2.0:1721880422.281127:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801341d0000/2, rc 0, transno 1052695 00000100:00100000:3.0:1721880422.281129:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632001 00000100:00100000:2.0:1721880422.281132:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801341d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011672832:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.281132:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+1929:3689:x1805522011677952:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.281139:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64306 count 1 00010000:00010000:3.0:1721880422.281146:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727bc7e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb32:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.281148:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088614a80/2, rc 0, transno 1094390 00000100:00100000:2.0:1721880422.281152:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088614a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011674368:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1721880422.281154:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962e21c0/0x8a60d30f571954b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10bd61 expref: 1327 pid: 16037 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.281157:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f021c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011678208:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.281158:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.281159:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.281160:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727bc7e lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.281170:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800962e21c0/0x8a60d30f571954b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10bd61 expref: 1327 pid: 16037 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.281174:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.281179:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800962e21c0/0x8a60d30f571954b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10bd61 expref: 1327 pid: 16037 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.281184:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011678464:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.281185:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1721880422.281187:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011678208 00000100:00100000:2.0:1721880422.281188:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1721880422.281189:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011678208 00000100:00100000:2.0:1721880422.281193:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f020000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011678080:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.281194:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009ebd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011678336:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1721880422.281200:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.281203:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632002 00000100:00100000:0.0:1721880422.281206:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f022a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+1930:3687:x1805522011678208:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.281210:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1721880422.281214:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64308 count 1 00010000:00010000:0.0:1721880422.281222:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727bc85 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb34:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.281223:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011678080 00000100:00100000:1.0:1721880422.281226:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011678080 00010000:00010000:0.0:1721880422.281230:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880072be0240/0x8a60d30f57195a46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10beb8 expref: 1327 pid: 16073 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.281235:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.281236:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.281237:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727bc85 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.281245:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632003 00010000:00010000:0.0:1721880422.281248:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880072be0240/0x8a60d30f57195a46 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10beb8 expref: 1327 pid: 16073 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.281250:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f020380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+1931:3687:x1805522011678080:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.281253:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880072be0240/0x8a60d30f57195a46 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10beb8 expref: 1327 pid: 16073 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.281260:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088efc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011678592:192.168.201.24@tcp:104: 00002000:00080000:1.0:1721880422.281261:0:16088:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64307 count 1 00010000:00010000:1.0:1721880422.281271:0:16088:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106c6c0/0x8a60d30f5727bc8c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb33:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.281277:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36e40 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.281281:0:16088:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d55df80/0x8a60d30f571957b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10be02 expref: 1327 pid: 16043 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.281287:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.281288:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.281291:0:16088:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106c6c0/0x8a60d30f5727bc8c lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.281305:0:16088:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d55df80/0x8a60d30f571957b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10be02 expref: 1327 pid: 16043 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.281314:0:16088:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d55df80/0x8a60d30f571957b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10be02 expref: 1327 pid: 16043 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.281322:0:16088:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba65f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011678720:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.281345:0:16088:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522af00 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.281358:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.281370:0:9458:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011678336 00000100:00100000:2.0:1721880422.281374:0:9458:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011678336 00000100:00100000:2.0:1721880422.281387:0:9458:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632004 00000100:00100000:2.0:1721880422.281390:0:9458:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2745:3689:x1805522011678336:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1721880422.281401:0:9458:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58131 count 1 00010000:00010000:2.0:1721880422.281411:0:9458:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727bc93 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe313:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.281423:0:9458:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007b9b4fc0/0x8a60d30f571ec828 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe313:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad42 expref: 310 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.281430:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.281431:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.281433:0:9458:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727bc93 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe313:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.281451:0:9458:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007b9b4fc0/0x8a60d30f571ec828 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe313:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad42 expref: 310 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.281467:0:9458:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007b9b4fc0/0x8a60d30f571ec828 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe313:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad42 expref: 310 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.281476:0:9458:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f023800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9458:1805522011678848:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.281505:0:9458:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde540 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.282628:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bb44a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0000_UUID:16075:1805522011675392:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.282629:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.282638:0:15444:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257698688 00000100:00100000:0.0:1721880422.282641:0:15444:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257698688 00010000:00010000:3.0:1721880422.282641:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4d80/0x8a60d30f5727bc2a lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe30c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.282650:0:16130:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012ba67800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0001_UUID:16130:1805522011675648:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.282654:0:15444:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880084f21200/0x8a60d30f571ec76b lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe30c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac85 expref: 311 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.282656:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800952a2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011675904:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.282656:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bb47480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011676032:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.282663:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727bc46 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.282665:0:16130:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727bc31 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.282672:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727bc3f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.282675:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914182 00000100:00100000:0.0:1721880422.282679:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088efd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+311:2004:x1805522257698688:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.282685:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.282688:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880084f21200/0x8a60d30f571ec76b lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe30c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac85 expref: 311 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.282689:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012ba64e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011675776:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.282695:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880084f21200/0x8a60d30f571ec76b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe30c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac85 expref: 311 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.282704:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880084f21200/0x8a60d30f571ec76b lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe30c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac85 expref: 311 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.282705:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727bc38 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.282712:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.282713:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.282715:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4d80/0x8a60d30f5727bc2a lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe30c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.282720:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4d80/0x8a60d30f5727bc2a lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe30c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.282754:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.282770:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4d80/0x8a60d30f5727bc2a lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.282771:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088efd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+310:2004:x1805522257698688:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 91us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.282775:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914182 00010000:00010000:3.0:1721880422.282775:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4d80/0x8a60d30f5727bc2a lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.282780:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4d80/0x8a60d30f5727bc2a lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.282784:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4d80/0x8a60d30f5727bc2a lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.282792:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4d80/0x8a60d30f5727bc2a lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.282796:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4d80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.282798:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4d80/0x8a60d30f5727bc2a lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.282802:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4d80/0x8a60d30f5727bc2a lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.282808:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4d80/0x8a60d30f5727bc2a lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.282812:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4d80/0x8a60d30f5727bc2a lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.282824:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.282841:0:15444:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257698944 00000100:00100000:0.0:1721880422.282844:0:15444:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257698944 00000100:00100000:1.0:1721880422.282844:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.282853:0:15444:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e5c9680/0x8a60d30f57194ce7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10bb3f expref: 1328 pid: 16113 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.282869:0:15444:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257699072 00000100:00100000:1.0:1721880422.282869:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.282871:0:15444:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257699072 00000100:00100000:3.0:1721880422.282875:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257698816 00010000:00010000:0.0:1721880422.282877:0:15444:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800993c58c0/0x8a60d30f57194ffe lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10bc11 expref: 1329 pid: 16045 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.282878:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257698816 00000100:00100000:1.0:1721880422.282881:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.282884:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914183 00000100:00100000:2.0:1721880422.282889:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+1330:2004:x1805522257698944:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.282889:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009577af40/0x8a60d30f571947e6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ba2e expref: 1330 pid: 16122 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.282892:0:15444:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257699200 00000100:00100000:0.0:1721880422.282893:0:15444:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257699200 00010000:00010000:2.0:1721880422.282897:0:7118:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.282899:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914184 00010000:00010000:0.0:1721880422.282900:0:15444:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b6e21c0/0x8a60d30f57194a0f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10baac expref: 1331 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.282901:0:7118:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e5c9680/0x8a60d30f57194ce7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb2f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10bb3f expref: 1331 pid: 16113 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.282904:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914185 00000100:00100000:1.0:1721880422.282905:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1331:2007:x1805522257699072:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.282910:0:7118:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e5c9680/0x8a60d30f57194ce7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb2f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10bb3f expref: 1331 pid: 16113 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.282910:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1331:2005:x1805522257698816:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.282913:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914186 00010000:00010000:1.0:1721880422.282914:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1721880422.282916:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1331:2005:x1805522257699200:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.282916:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.282919:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009577af40/0x8a60d30f571947e6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ba2e expref: 1331 pid: 16122 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.282920:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800993c58c0/0x8a60d30f57194ffe lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb30:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10bc11 expref: 1331 pid: 16045 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.282920:0:7118:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e5c9680/0x8a60d30f57194ce7 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb2f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10bb3f expref: 1331 pid: 16113 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.282921:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.282924:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b6e21c0/0x8a60d30f57194a0f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb2e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10baac expref: 1331 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.282926:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009577af40/0x8a60d30f571947e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ba2e expref: 1330 pid: 16122 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.282930:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b6e21c0/0x8a60d30f57194a0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb2e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10baac expref: 1330 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.282930:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800993c58c0/0x8a60d30f57194ffe lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb30:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10bc11 expref: 1330 pid: 16045 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.282930:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.282931:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.282933:0:7118:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727bc38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.282935:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009577af40/0x8a60d30f571947e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ba2e expref: 1330 pid: 16122 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.282939:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b6e21c0/0x8a60d30f57194a0f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb2e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10baac expref: 1329 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.282940:0:7118:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727bc38 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.282942:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800993c58c0/0x8a60d30f57194ffe lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb30:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10bc11 expref: 1329 pid: 16045 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.282943:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.282944:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.282947:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727bc31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.282949:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.282949:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.282951:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727bc31 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.282952:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727bc46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.282953:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.282954:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.282955:0:7118:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.282956:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727bc46 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.282957:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727bc3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.282961:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.282963:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727bc3f lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.282969:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.282979:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1327:2005:x1805522257698816:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 70us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.282981:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1327:2005:x1805522257699200:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 65us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.282981:0:7118:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+1327:2004:x1805522257698944:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 89us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.282983:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914185 00010000:00010000:1.0:1721880422.282984:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.282986:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914186 00000100:00100000:2.0:1721880422.282989:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914183 00010000:00010000:3.0:1721880422.282996:0:16130:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727bc31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.283000:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727bc46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.283001:0:16130:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727bc31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.283003:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1324:2007:x1805522257699072:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 98us (157us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.283005:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727bc46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.283005:0:16130:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727bc31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.283010:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727bc46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.283010:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914184 00010000:00010000:2.0:1721880422.283026:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727bc3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.283028:0:16130:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727bc31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.283030:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727bc46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.283033:0:16130:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727bc31 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.283034:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727bc46 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.283034:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727bc3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.283037:0:16130:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8b40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.283038:0:16130:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727bc31 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.283039:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4b40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.283041:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727bc46 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.283042:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727bc3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.283042:0:16130:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727bc31 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.283045:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727bc46 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.283048:0:16130:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727bc31 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.283049:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727bc3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.283051:0:16130:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727bc31 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.283053:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727bc3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.283054:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727bc46 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.283056:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136351440 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.283058:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727bc3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.283059:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727bc46 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.283066:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727bc3f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.283073:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727bc3f lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.283077:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727bc3f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.283160:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.283172:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257699328 00000100:00100000:1.0:1721880422.283176:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257699328 00000100:00100000:3.0:1721880422.283177:0:16130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0000-mdtlov_UUID+1934:3688:x1805522011674880:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3334us (3371us total) trans 4296019992 rc 0/0 00000100:00100000:3.0:1721880422.283183:0:16130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631990 00010000:00010000:1.0:1721880422.283187:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099fb98c0/0x8a60d30f571ec787 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe30d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aca1 expref: 310 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.283196:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800952a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1933:3687:x1805522011675136:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3214us (3278us total) trans 4296019993 rc 0/0 00000100:00100000:0.0:1721880422.283204:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631993 00000100:00100000:2.0:1721880422.283205:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800952a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+1933:3688:x1805522011675520:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3242us (3312us total) trans 4296019994 rc 0/0 00000100:00100000:1.0:1721880422.283206:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914187 00000100:00100000:3.0:1721880422.283208:0:16120:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16120:1805522011676800:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.283210:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+310:2004:x1805522257699328:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.283212:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631992 00010000:00010000:1.0:1721880422.283217:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.283218:0:16120:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7840/0x8a60d30f5727bc5b lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe30f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.283221:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099fb98c0/0x8a60d30f571ec787 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe30d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aca1 expref: 310 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.283229:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099fb98c0/0x8a60d30f571ec787 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe30d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aca1 expref: 310 pid: 16101 timeout: 887 lvb_type: 0 00000004:00080000:0.0:1721880422.283236:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088616a00/2, rc 0, transno 1052697 00010000:00010000:1.0:1721880422.283240:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.283242:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.283243:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800919c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0000_UUID:16060:1805522011676928:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.283244:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088616a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011675136:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.283244:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098aa9440/0x8a60d30f5727bc4d lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe30d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.283251:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098aa9440/0x8a60d30f5727bc4d lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe30d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.283254:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801363518c0/0x8a60d30f5727bc54 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe30e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.283265:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727bc38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.283267:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.283269:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727bc38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.283273:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727bc38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.283276:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009231aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011678976:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.283281:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727bc38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.283283:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007bb44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2746:3686:x1805522011675008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3519us (3597us total) trans 4296061687 rc 0/0 00010000:00010000:2.0:1721880422.283285:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727bc38 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.283286:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+310:2004:x1805522257699328:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 75us (126us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.283288:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa9680 already unused, calling callback (ffffffffa084e330) 00000100:00100000:3.0:1721880422.283289:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631989 00010000:00010000:2.0:1721880422.283290:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727bc38 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.283292:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914187 00010000:00010000:2.0:1721880422.283293:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727bc38 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.283297:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.283299:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727bc38 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.283303:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727bc38 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.283311:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011678976 00000100:00100000:3.0:1721880422.283313:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011678976 00010000:00010000:1.0:1721880422.283320:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099fb98c0/0x8a60d30f571ec787 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe30d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aca1 expref: 309 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.283331:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012ba64700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0000_UUID:16111:1805522011676672:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.283331:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632005 00000100:00100000:3.0:1721880422.283335:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092318e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+1932:3689:x1805522011678976:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.283344:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880098aa9440/0x8a60d30f5727bc4d lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.283345:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64309 count 1 00000100:00100000:0.0:1721880422.283351:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.283351:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098aa9440/0x8a60d30f5727bc4d lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.283353:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727bc9a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb35:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.283357:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098aa9440/0x8a60d30f5727bc4d lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.283360:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130653180/0x8a60d30f57195cf4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10bf4b expref: 1323 pid: 15497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.283365:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098aa9440/0x8a60d30f5727bc4d lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.283365:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.283366:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.283367:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727bc9a lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.283371:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098aa9440/0x8a60d30f5727bc4d lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.283377:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098aa9440/0x8a60d30f5727bc4d lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.283378:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130653180/0x8a60d30f57195cf4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10bf4b expref: 1323 pid: 15497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.283383:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130653180/0x8a60d30f57195cf4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10bf4b expref: 1323 pid: 15497 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.283388:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa9440 already unused, calling callback (ffffffffa084e330) 00000100:00100000:3.0:1721880422.283390:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011679104:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.283391:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098aa9440/0x8a60d30f5727bc4d lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.283397:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098aa9440/0x8a60d30f5727bc4d lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.283405:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098aa9440/0x8a60d30f5727bc4d lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.283408:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdeccc0 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.283412:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098aa9440/0x8a60d30f5727bc4d lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.283420:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800952a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1933:3688:x1805522011675264:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3465us (3549us total) trans 4296019995 rc 0/0 00000100:00100000:2.0:1721880422.283426:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631991 00000100:00100000:1.0:1721880422.283433:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257699584 00000100:00100000:1.0:1721880422.283436:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257699584 00000100:00100000:3.0:1721880422.283439:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.283446:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097971b00/0x8a60d30f571ec7a3 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe30e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12acbd expref: 309 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.283451:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.283459:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135171f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:15453:1805522011677696:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.283470:0:16110:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088614700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_094:lustre-OST0000_UUID:16110:1805522011677440:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.283475:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257699456 00000100:00100000:1.0:1721880422.283478:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257699456 00010000:00010000:2.0:1721880422.283479:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136352f40/0x8a60d30f5727bc77 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe312:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.283481:0:16110:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325d200/0x8a60d30f5727bc69 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe310:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.283485:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.283486:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097972880/0x8a60d30f571ec7b8 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe30f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12acd2 expref: 310 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.283500:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.283502:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257699712 00000100:00100000:1.0:1721880422.283504:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257699712 00000100:00100000:0.0:1721880422.283505:0:7116:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257699840 00000100:00100000:2.0:1721880422.283505:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257699968 00000100:00100000:0.0:1721880422.283508:0:7116:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257699840 00000100:00100000:2.0:1721880422.283508:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257699968 00000100:00100000:3.0:1721880422.283511:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914188 00010000:00010000:1.0:1721880422.283512:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012328e400/0x8a60d30f571ec7d4 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe310:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12acee expref: 312 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.283515:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e195450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+312:2004:x1805522257699584:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.283518:0:7116:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801356b6f40/0x8a60d30f571952b3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10bcc7 expref: 1324 pid: 16088 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.283518:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c2d8000/0x8a60d30f571ec80c lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe312:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad26 expref: 312 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.283520:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.283524:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097971b00/0x8a60d30f571ec7a3 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe30e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12acbd expref: 312 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.283530:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097971b00/0x8a60d30f571ec7a3 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe30e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12acbd expref: 312 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.283532:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914189 00000100:00100000:0.0:1721880422.283537:0:7116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914190 00000100:00100000:1.0:1721880422.283537:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+312:2004:x1805522257699456:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.283539:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097971b00/0x8a60d30f571ec7a3 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe30e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12acbd expref: 312 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.283541:0:7116:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+312:2005:x1805522257699712:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.283541:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914191 00010000:00010000:1.0:1721880422.283544:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.283544:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1324:2005:x1805522257699840:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.283546:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.283548:0:7116:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.283548:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097972880/0x8a60d30f571ec7b8 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe30f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12acd2 expref: 311 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.283548:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.283549:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801363518c0/0x8a60d30f5727bc54 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe30e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.283550:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.283551:0:7116:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012328e400/0x8a60d30f571ec7d4 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe310:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12acee expref: 311 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.283553:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801356b6f40/0x8a60d30f571952b3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb31:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10bcc7 expref: 1324 pid: 16088 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.283554:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801363518c0/0x8a60d30f5727bc54 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe30e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.283557:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097972880/0x8a60d30f571ec7b8 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe30f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12acd2 expref: 311 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.283558:0:7116:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012328e400/0x8a60d30f571ec7d4 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe310:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12acee expref: 311 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.283559:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801356b6f40/0x8a60d30f571952b3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb31:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10bcc7 expref: 1324 pid: 16088 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.283564:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.283567:0:7116:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012328e400/0x8a60d30f571ec7d4 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe310:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12acee expref: 311 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.283569:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097972880/0x8a60d30f571ec7b8 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe30f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12acd2 expref: 311 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.283569:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.283570:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.283572:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727bc62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb31:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.283574:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e195450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+310:2004:x1805522257699584:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 59us (223us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.283576:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.283576:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727bc62 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb31:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.283577:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.283579:0:7116:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009325d200/0x8a60d30f5727bc69 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe310:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.283579:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.283579:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914188 00010000:00010000:1.0:1721880422.283580:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.283583:0:7116:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325d200/0x8a60d30f5727bc69 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe310:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.283583:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7840/0x8a60d30f5727bc5b lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe30f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.283583:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.283589:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7840/0x8a60d30f5727bc5b lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe30f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.283591:0:7116:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.283598:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1324:2005:x1805522257699840:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 53us (96us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.283601:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914191 00000100:00100000:0.0:1721880422.283604:0:7116:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+308:2005:x1805522257699712:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 62us (152us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.283605:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.283608:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914192 00000100:00100000:0.0:1721880422.283611:0:7116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914190 00000100:00100000:3.0:1721880422.283612:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+308:2007:x1805522257699968:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.283616:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.283618:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801363518c0/0x8a60d30f5727bc54 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.283619:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c2d8000/0x8a60d30f571ec80c lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe312:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad26 expref: 307 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.283623:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+307:2004:x1805522257699456:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 86us (183us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.283623:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801363518c0/0x8a60d30f5727bc54 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.283625:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c2d8000/0x8a60d30f571ec80c lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe312:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad26 expref: 307 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.283627:0:16110:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325d200/0x8a60d30f5727bc69 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.283629:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914189 00010000:00010000:2.0:1721880422.283631:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801363518c0/0x8a60d30f5727bc54 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.283632:0:16110:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325d200/0x8a60d30f5727bc69 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.283632:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c2d8000/0x8a60d30f571ec80c lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe312:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad26 expref: 307 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.283638:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801363518c0/0x8a60d30f5727bc54 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.283639:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.283640:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.283641:0:16110:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325d200/0x8a60d30f5727bc69 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.283642:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136352f40/0x8a60d30f5727bc77 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe312:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.283644:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801363518c0/0x8a60d30f5727bc54 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.283645:0:16110:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325d200/0x8a60d30f5727bc69 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.283646:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136352f40/0x8a60d30f5727bc77 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe312:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.283648:0:16110:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325d200/0x8a60d30f5727bc69 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.283650:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801363518c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.283651:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.283652:0:16110:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325d200 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.283653:0:16110:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325d200/0x8a60d30f5727bc69 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.283653:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801363518c0/0x8a60d30f5727bc54 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.283657:0:16110:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325d200/0x8a60d30f5727bc69 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.283659:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+305:2007:x1805522257699968:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 48us (175us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.283660:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801363518c0/0x8a60d30f5727bc54 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.283662:0:16110:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325d200/0x8a60d30f5727bc69 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.283663:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914192 00010000:00010000:0.0:1721880422.283666:0:16110:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325d200/0x8a60d30f5727bc69 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.283670:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801363518c0/0x8a60d30f5727bc54 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.283676:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801363518c0/0x8a60d30f5727bc54 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.283678:0:16120:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7840/0x8a60d30f5727bc5b lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.283683:0:16120:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7840/0x8a60d30f5727bc5b lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.283688:0:16120:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7840/0x8a60d30f5727bc5b lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.283691:0:16120:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7840/0x8a60d30f5727bc5b lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.283695:0:16120:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7840/0x8a60d30f5727bc5b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.283698:0:16120:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b7840 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.283700:0:16120:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7840/0x8a60d30f5727bc5b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.283704:0:16120:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7840/0x8a60d30f5727bc5b lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.283709:0:16120:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7840/0x8a60d30f5727bc5b lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.283712:0:16120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7840/0x8a60d30f5727bc5b lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.283782:0:16110:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_094:lustre-MDT0000-mdtlov_UUID+2748:3686:x1805522011677056:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3238us (3315us total) trans 4296061689 rc 0/0 00000100:00100000:0.0:1721880422.283786:0:16110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631998 00000100:00100000:2.0:1721880422.283830:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2747:3689:x1805522011676416:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3558us (3601us total) trans 4296061690 rc 0/0 00000100:00100000:2.0:1721880422.283837:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631995 00010000:00010000:2.0:1721880422.283854:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136352f40/0x8a60d30f5727bc77 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.283860:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136352f40/0x8a60d30f5727bc77 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.283864:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136352f40/0x8a60d30f5727bc77 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.283868:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136352f40/0x8a60d30f5727bc77 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.283871:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136352f40/0x8a60d30f5727bc77 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.283875:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352f40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.283876:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136352f40/0x8a60d30f5727bc77 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.283880:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136352f40/0x8a60d30f5727bc77 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.283886:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136352f40/0x8a60d30f5727bc77 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.283891:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136352f40/0x8a60d30f5727bc77 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.283898:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.283910:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257700096 00000100:00100000:0.0:1721880422.283912:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257700096 00010000:00010000:0.0:1721880422.283921:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ffcfa80/0x8a60d30f571ec7f0 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe311:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad0a expref: 305 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.283922:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012ba66d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0000_UUID:16028:1805522011677824:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.283937:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914193 00010000:00010000:1.0:1721880422.283937:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009106e400/0x8a60d30f5727bc70 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe311:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.283939:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092319f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+305:2005:x1805522257700096:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.283945:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.283947:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ffcfa80/0x8a60d30f571ec7f0 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe311:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad0a expref: 305 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.283953:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ffcfa80/0x8a60d30f571ec7f0 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe311:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad0a expref: 305 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.283961:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ffcfa80/0x8a60d30f571ec7f0 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe311:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad0a expref: 305 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.283968:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.283969:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1721880422.283970:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.283971:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009106e400/0x8a60d30f5727bc70 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe311:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.283971:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2748:3688:x1805522011677568:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3025us (3061us total) trans 4296061691 rc 0/0 00000100:00100000:2.0:1721880422.283975:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632000 00010000:00010000:0.0:1721880422.283976:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009106e400/0x8a60d30f5727bc70 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe311:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.283984:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257700352 00010000:00010000:0.0:1721880422.283986:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.283987:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257700352 00000100:00100000:2.0:1721880422.283994:0:9458:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f023800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9458:1805522011678848:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.283998:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880092319f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+304:2005:x1805522257700096:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 58us (100us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.283999:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d55df80/0x8a60d30f571957b4 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10be02 expref: 1324 pid: 16043 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.284005:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914193 00010000:00010000:2.0:1721880422.284006:0:9458:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727bc93 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe313:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.284011:0:16120:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+2747:3688:x1805522011676544:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3735us (3763us total) trans 4296061692 rc 0/0 00000100:00100000:0.0:1721880422.284030:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914194 00000100:00100000:0.0:1721880422.284033:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1324:2005:x1805522257700352:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.284035:0:16120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631996 00010000:00010000:0.0:1721880422.284038:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.284042:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d55df80/0x8a60d30f571957b4 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb33:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10be02 expref: 1324 pid: 16043 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.284043:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009106e400/0x8a60d30f5727bc70 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.284043:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880135170380/2, rc 0, transno 1094395 00010000:00010000:0.0:1721880422.284049:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d55df80/0x8a60d30f571957b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb33:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10be02 expref: 1324 pid: 16043 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.284049:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135170380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011677568:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.284050:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009106e400/0x8a60d30f5727bc70 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.284056:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.284057:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.284057:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009106e400/0x8a60d30f5727bc70 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.284059:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106c6c0/0x8a60d30f5727bc8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb33:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.284060:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011678464:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.284063:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106c6c0/0x8a60d30f5727bc8c lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb33:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.284063:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009106e400/0x8a60d30f5727bc70 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.284069:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.284069:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009106e400/0x8a60d30f5727bc70 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.284071:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727bc7e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.284072:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122c7d180/2, rc 0, transno 1094396 00010000:00010000:1.0:1721880422.284075:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106e400 already unused, calling callback (ffffffffa084e330) 00000100:00100000:2.0:1721880422.284075:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011676544:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.284077:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009106e400/0x8a60d30f5727bc70 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.284078:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1324:2005:x1805522257700352:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 44us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.284081:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914194 00000100:00100000:3.0:1721880422.284083:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f023800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011679232:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.284088:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009106e400/0x8a60d30f5727bc70 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.284089:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801341d1880/2, rc 0, transno 1052698 00000100:00100000:2.0:1721880422.284093:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801341d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011675520:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.284097:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009106e400/0x8a60d30f5727bc70 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.284099:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.284102:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088efc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011678592:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.284103:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009106e400/0x8a60d30f5727bc70 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.284106:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007bb47800/2, rc 0, transno 1052699 00000100:00100000:2.0:1721880422.284109:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bb47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011675264:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.284111:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727bc85 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.284114:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122c7f100/2, rc 0, transno 1094393 00000004:00080000:2.0:1721880422.284120:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008854ea00/2, rc 0, transno 1052696 00000100:00100000:0.0:1721880422.284125:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f021880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011679616:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.284127:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011677056:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.284129:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008854ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011674880:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1721880422.284133:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088efe680/2, rc 0, transno 1094391 00000100:00100000:3.0:1721880422.284136:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011675008:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.284142:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.284142:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1721880422.284147:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f022300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011679744:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1721880422.284157:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122c7ca80/2, rc 0, transno 1094394 00000100:00100000:2.0:1721880422.284159:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f020a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011679488:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.284161:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.284162:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011676416:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1721880422.284170:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f021f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011679360:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.284177:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.284182:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009231b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011680128:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1721880422.284185:0:16120:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011679232 00000100:00100000:3.0:1721880422.284187:0:16120:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011679232 00000100:00100000:2.0:1721880422.284193:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f023b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011680000:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.284194:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.284206:0:16120:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011679616 00000100:00100000:3.0:1721880422.284208:0:16120:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011679616 00000100:00100000:2.0:1721880422.284211:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011679744 00000100:00100000:2.0:1721880422.284214:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011679744 00000100:00100000:3.0:1721880422.284218:0:16120:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011679488 00000100:00100000:3.0:1721880422.284219:0:16120:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011679488 00000100:00100000:0.0:1721880422.284220:0:16110:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011680128 00000100:00100000:0.0:1721880422.284222:0:16110:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011680128 00000100:00100000:1.0:1721880422.284227:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135170000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2750:3687:x1805522011677184:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3630us (3738us total) trans 4296061693 rc 0/0 00000100:00100000:2.0:1721880422.284227:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632006 00000100:00100000:2.0:1721880422.284230:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2750:3686:x1805522011679232:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1721880422.284232:0:16120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632007 00000100:00100000:3.0:1721880422.284235:0:16120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092319180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+1934:3689:x1805522011679616:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.284236:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631999 00000100:00100000:0.0:1721880422.284240:0:16110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632008 00002000:00080000:2.0:1721880422.284240:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58132 count 1 00000100:00100000:0.0:1721880422.284243:0:16110:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_094:lustre-MDT0000-mdtlov_UUID+2750:3686:x1805522011679744:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1721880422.284245:0:16120:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64311 count 1 00010000:00010000:2.0:1721880422.284248:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136353840/0x8a60d30f5727bca1 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe314:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1721880422.284252:0:16110:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58134 count 1 00000100:00100000:1.0:1721880422.284253:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632009 00010000:00010000:3.0:1721880422.284253:0:16120:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727bca8 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb37:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.284257:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b68c240/0x8a60d30f571ec844 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe314:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad5e expref: 303 pid: 16039 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.284258:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f022680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+1934:3688:x1805522011679488:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.284260:0:16110:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325eac0/0x8a60d30f5727bcaf lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe316:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.284261:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.284261:0:16120:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cae2880/0x8a60d30f57196154 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c086 expref: 1323 pid: 16083 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.284262:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.284264:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136353840/0x8a60d30f5727bca1 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe314:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.284265:0:16120:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.284266:0:16120:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.284268:0:16120:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727bca8 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.284271:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64310 count 1 00010000:00010000:2.0:1721880422.284273:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b68c240/0x8a60d30f571ec844 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe314:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad5e expref: 303 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.284278:0:16120:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cae2880/0x8a60d30f57196154 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c086 expref: 1323 pid: 16083 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.284279:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b68c240/0x8a60d30f571ec844 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe314:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad5e expref: 303 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.284282:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727bcb6 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb36:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.284284:0:16120:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cae2880/0x8a60d30f57196154 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c086 expref: 1323 pid: 16083 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.284285:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f021500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0000_UUID:16081:1805522011680256:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.284290:0:16120:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0001_UUID:16120:1805522011680384:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.284292:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0e4a1c0/0x8a60d30f57195fa2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c00f expref: 1323 pid: 16073 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.284297:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.284298:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde540 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.284299:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.284301:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727bcb6 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.284306:0:16120:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.284309:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632010 00000100:00100000:2.0:1721880422.284311:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092318000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2749:3689:x1805522011680128:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.284317:0:16110:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880132cb8000/0x8a60d30f571ec87c lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe316:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad96 expref: 303 pid: 16039 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.284318:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58136 count 1 00010000:00010000:0.0:1721880422.284322:0:16110:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.284322:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0e4a1c0/0x8a60d30f57195fa2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c00f expref: 1323 pid: 16073 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.284322:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801356b6f40/0x8a60d30f571952b3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10bcc7 expref: 1323 pid: 16088 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.284323:0:16110:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.284324:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136352400/0x8a60d30f5727bcbd lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe318:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.284325:0:16110:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325eac0/0x8a60d30f5727bcaf lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe316:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.284330:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0e4a1c0/0x8a60d30f57195fa2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c00f expref: 1323 pid: 16073 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.284331:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091074fc0/0x8a60d30f571ec8ad lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe318:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12adc7 expref: 303 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.284336:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1721880422.284336:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c7fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011677312:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.284337:0:16110:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880132cb8000/0x8a60d30f571ec87c lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe316:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad96 expref: 303 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.284337:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1721880422.284339:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba64700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011680512:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.284339:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136352400/0x8a60d30f5727bcbd lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe318:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.284345:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727bc62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.284347:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091074fc0/0x8a60d30f571ec8ad lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe318:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12adc7 expref: 303 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.284350:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727bc62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.284352:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091074fc0/0x8a60d30f571ec8ad lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe318:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12adc7 expref: 303 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.284357:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f020e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0000_UUID:16060:1805522011680768:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.284358:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727bc62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.284359:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a480 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.284363:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727bc62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.284366:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727bc62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.284369:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde6c0 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.284370:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727bc62 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.284373:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b5440 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.284375:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727bc62 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.284378:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727bc62 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.284384:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727bc62 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.284387:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.284387:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727bc62 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.284388:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2749:3687:x1805522011676160:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4159us (4210us total) trans 4296061688 rc 0/0 00000100:00100000:1.0:1721880422.284394:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631994 00010000:00010000:0.0:1721880422.284396:0:16110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880132cb8000/0x8a60d30f571ec87c lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe316:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad96 expref: 303 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.284403:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011680000 00000100:00100000:0.0:1721880422.284405:0:16110:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088614700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_094:lustre-OST0000_UUID:16110:1805522011680640:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.284405:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011680000 00000100:00100000:2.0:1721880422.284417:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632011 00000100:00100000:2.0:1721880422.284419:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f020700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1935:3688:x1805522011680000:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.284423:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d55df80/0x8a60d30f571957b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10be02 expref: 1322 pid: 16043 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.284425:0:16110:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36e40 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.284429:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f023480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011679872:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.284434:0:16088:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012ba65f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011678720:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.284443:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.284448:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.284449:0:16088:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106c6c0/0x8a60d30f5727bc8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.284456:0:16088:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106c6c0/0x8a60d30f5727bc8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.284462:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011679872 00010000:00010000:1.0:1721880422.284462:0:16088:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106c6c0/0x8a60d30f5727bc8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.284465:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011679872 00000004:00080000:2.0:1721880422.284465:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122c7c380/2, rc 0, transno 1094397 00000100:00100000:2.0:1721880422.284470:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011677184:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.284474:0:16088:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106c6c0/0x8a60d30f5727bc8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.284475:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632012 00000100:00100000:3.0:1721880422.284476:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+1936:3687:x1805522011676288:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4091us (4121us total) trans 4296019996 rc 0/0 00000100:00100000:0.0:1721880422.284478:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f023100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2749:3687:x1805522011679872:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.284481:0:16088:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106c6c0/0x8a60d30f5727bc8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.284481:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631997 00002000:00080000:0.0:1721880422.284486:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58135 count 1 00010000:00010000:1.0:1721880422.284488:0:16088:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106c6c0/0x8a60d30f5727bc8c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.284490:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64312 count 1 00010000:00010000:1.0:1721880422.284493:0:16088:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106c6c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.284494:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325f600/0x8a60d30f5727bcc4 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe317:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.284495:0:16088:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106c6c0/0x8a60d30f5727bc8c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.284497:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727bccb lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb38:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.284501:0:16088:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106c6c0/0x8a60d30f5727bc8c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.284504:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c98df80/0x8a60d30f57196409 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c12e expref: 1321 pid: 10431 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.284505:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.284508:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.284509:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.284511:0:16088:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106c6c0/0x8a60d30f5727bc8c lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.284511:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727bccb lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.284516:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106c6c0/0x8a60d30f5727bc8c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.284519:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c98df80/0x8a60d30f57196409 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c12e expref: 1321 pid: 10431 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.284524:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c98df80/0x8a60d30f57196409 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c12e expref: 1321 pid: 10431 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.284525:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.284530:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800919c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011681024:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.284541:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801362033c0/0x8a60d30f571ec898 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe317:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12adab expref: 303 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.284543:0:8271:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257700608 00000100:00100000:2.0:1721880422.284544:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde840 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.284546:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.284547:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1721880422.284547:0:8271:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257700608 00010000:00010000:0.0:1721880422.284548:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325f600/0x8a60d30f5727bcc4 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe317:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.284555:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008854f800/2, rc 0, transno 1052700 00000100:00100000:0.0:1721880422.284558:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257700224 00010000:00010000:1.0:1721880422.284558:0:8271:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007b9b4fc0/0x8a60d30f571ec828 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe313:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad42 expref: 304 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.284560:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008854f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011676288:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.284561:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257700224 00010000:00010000:0.0:1721880422.284569:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880072be0240/0x8a60d30f57195a46 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10beb8 expref: 1322 pid: 16073 timeout: 887 lvb_type: 0 00000004:00080000:2.0:1721880422.284575:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007bb44380/2, rc 0, transno 1094392 00000100:00100000:2.0:1721880422.284578:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bb44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011676160:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.284579:0:8271:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257700480 00000100:00100000:1.0:1721880422.284582:0:8271:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257700480 00000100:00100000:0.0:1721880422.284586:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914195 00000100:00100000:0.0:1721880422.284590:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5276850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+304:2005:x1805522257700608:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.284591:0:8271:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800962e21c0/0x8a60d30f571954b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10bd61 expref: 1323 pid: 16037 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.284594:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076fddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011681280:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.284595:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.284598:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007b9b4fc0/0x8a60d30f571ec828 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe313:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad42 expref: 304 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.284605:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007b9b4fc0/0x8a60d30f571ec828 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe313:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad42 expref: 304 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.284607:0:8271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914196 00000100:00100000:2.0:1721880422.284607:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.284613:0:8271:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+1323:2005:x1805522257700224:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.284614:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007b9b4fc0/0x8a60d30f571ec828 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe313:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad42 expref: 304 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.284620:0:8271:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.284621:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.284622:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076fdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011681152:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.284623:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.284624:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.284625:0:8271:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880072be0240/0x8a60d30f57195a46 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb34:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10beb8 expref: 1323 pid: 16073 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.284626:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727bc93 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe313:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.284630:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727bc93 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe313:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.284633:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.284634:0:8271:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880072be0240/0x8a60d30f57195a46 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb34:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10beb8 expref: 1323 pid: 16073 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.284639:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.284640:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1721880422.284641:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011679104:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.284642:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011680896:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.284646:0:8271:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880072be0240/0x8a60d30f57195a46 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb34:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10beb8 expref: 1323 pid: 16073 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.284650:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5276850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+303:2005:x1805522257700608:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 59us (201us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.284651:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727bc9a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.284654:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914195 00000100:00100000:2.0:1721880422.284654:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.284656:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.284657:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.284660:0:8271:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727bc85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.284662:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.284665:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011681280 00010000:00010000:1.0:1721880422.284667:0:8271:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727bc85 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.284667:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011681280 00000100:00100000:2.0:1721880422.284680:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011681152 00010000:00010000:1.0:1721880422.284681:0:8271:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.284682:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011681152 00000100:00100000:3.0:1721880422.284682:0:16130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011680896 00000100:00100000:3.0:1721880422.284685:0:16130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011680896 00000100:00100000:0.0:1721880422.284690:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257700736 00000100:00100000:2.0:1721880422.284690:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011679360 00000100:00100000:2.0:1721880422.284691:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011679360 00000100:00100000:0.0:1721880422.284693:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257700736 00000100:00100000:1.0:1721880422.284695:0:8271:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+1322:2005:x1805522257700224:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 82us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.284699:0:16130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632013 00000100:00100000:1.0:1721880422.284702:0:8271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914196 00000100:00100000:3.0:1721880422.284703:0:16130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076fdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0000-mdtlov_UUID+2752:3688:x1805522011681280:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.284704:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130653180/0x8a60d30f57195cf4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10bf4b expref: 1323 pid: 15497 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.284714:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632014 00000100:00100000:1.0:1721880422.284716:0:8271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914197 00000100:00100000:2.0:1721880422.284717:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1936:3687:x1805522011681152:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.284718:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632015 00000100:00100000:1.0:1721880422.284721:0:8271:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+1322:2005:x1805522257700480:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.284721:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076fde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2752:3687:x1805522011680896:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.284723:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914198 00002000:00080000:2.0:1721880422.284725:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64313 count 1 00010000:00010000:1.0:1721880422.284746:0:8271:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1721880422.284747:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088efc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1322:2005:x1805522257700736:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.284748:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727bcd2 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb39:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.284750:0:8271:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800962e21c0/0x8a60d30f571954b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb32:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10bd61 expref: 1322 pid: 16037 timeout: 887 lvb_type: 0 00002000:00080000:3.0:1721880422.284752:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58137 count 1 00010000:00010000:2.0:1721880422.284755:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880120204900/0x8a60d30f5719667f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c1c1 expref: 1322 pid: 16016 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.284756:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.284760:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130653180/0x8a60d30f57195cf4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb35:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10bf4b expref: 1322 pid: 15497 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.284760:0:8271:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800962e21c0/0x8a60d30f571954b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb32:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10bd61 expref: 1322 pid: 16037 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.284760:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.284760:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5200/0x8a60d30f5727bcd9 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe319:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.284761:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.284762:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727bcd2 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.284768:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800729deac0/0x8a60d30f571ec8c9 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe319:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ade3 expref: 302 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.284770:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130653180/0x8a60d30f57195cf4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb35:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10bf4b expref: 1322 pid: 15497 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.284771:0:8271:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962e21c0/0x8a60d30f571954b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb32:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10bd61 expref: 1322 pid: 16037 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.284772:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.284773:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880120204900/0x8a60d30f5719667f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c1c1 expref: 1322 pid: 16016 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.284773:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.284775:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5200/0x8a60d30f5727bcd9 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe319:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.284780:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.284781:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.284782:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880120204900/0x8a60d30f5719667f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c1c1 expref: 1321 pid: 16016 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.284783:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130653180/0x8a60d30f57195cf4 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb35:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10bf4b expref: 1321 pid: 15497 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.284784:0:8271:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727bc7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.284788:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076fddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011681408:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.284789:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800729deac0/0x8a60d30f571ec8c9 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe319:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ade3 expref: 302 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.284790:0:8271:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727bc7e lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.284793:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.284794:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.284795:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800729deac0/0x8a60d30f571ec8c9 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe319:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ade3 expref: 302 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.284797:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727bc9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.284798:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.284801:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088efd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0000_UUID:16101:1805522011681536:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.284804:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727bc9a lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.284804:0:8271:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.284812:0:16098:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632016 00000100:00100000:3.0:1721880422.284813:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdeccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.284815:0:16098:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096c9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0000-mdtlov_UUID+2752:3686:x1805522011679360:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.284819:0:8271:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+1320:2005:x1805522257700480:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 97us (293us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.284820:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00080000:2.0:1721880422.284822:0:16098:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58133 count 1 00002000:00080000:3.0:1721880422.284824:0:16130:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58138 count 1 00000100:00100000:1.0:1721880422.284825:0:8271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914197 00010000:00010000:2.0:1721880422.284829:0:16098:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136351200/0x8a60d30f5727bce0 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe315:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.284830:0:16130:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6f40/0x8a60d30f5727bce7 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe31a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.284832:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088efc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1320:2005:x1805522257700736:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 104us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.284837:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914198 00010000:00010000:2.0:1721880422.284837:0:16098:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136202640/0x8a60d30f571ec859 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe315:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad73 expref: 302 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.284837:0:16130:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800729dfcc0/0x8a60d30f571ec8e5 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe31a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12adff expref: 302 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.284840:0:16098:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.284841:0:16098:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.284841:0:16130:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.284842:0:16098:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136351200/0x8a60d30f5727bce0 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe315:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.284842:0:16130:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.284843:0:16130:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6f40/0x8a60d30f5727bce7 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe31a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.284849:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727bc85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.284853:0:16130:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800729dfcc0/0x8a60d30f571ec8e5 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe31a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12adff expref: 302 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.284854:0:16098:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136202640/0x8a60d30f571ec859 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe315:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad73 expref: 302 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.284856:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727bc85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.284859:0:16130:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800729dfcc0/0x8a60d30f571ec8e5 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe31a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12adff expref: 302 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.284861:0:16098:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136202640/0x8a60d30f571ec859 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe315:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad73 expref: 302 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.284863:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727bc85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.284866:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801362033c0/0x8a60d30f571ec898 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe317:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12adab expref: 302 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.284869:0:16130:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c7c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0000_UUID:16130:1805522011681664:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.284870:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727bc85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.284871:0:16098:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076fdd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0000_UUID:16098:1805522011681792:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.284872:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801362033c0/0x8a60d30f571ec898 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe317:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12adab expref: 302 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.284876:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727bc85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.284877:0:16130:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec000 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.284879:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088617b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:15452:1805522011681920:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.284881:0:16098:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde3c0 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.284882:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325d680 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.284884:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727bc85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.284889:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec360c0 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.284889:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727bc7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.284891:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727bc85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.284891:0:9458:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727bc93 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.284894:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727bc7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.284895:0:9458:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727bc93 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.284898:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727bc7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.284900:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727bc85 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.284900:0:9458:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727bc93 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.284902:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727bc7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.284904:0:9458:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727bc93 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.284906:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727bc85 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.284906:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727bc7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.284907:0:9458:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727bc93 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.284909:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b46c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.284910:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727bc7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.284911:0:9458:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353cc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.284912:0:9458:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727bc93 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.284914:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727bc7e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.284916:0:9458:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727bc93 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.284920:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727bc7e lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.284922:0:9458:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727bc93 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.284925:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727bc7e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.284927:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136353cc0/0x8a60d30f5727bc93 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.284968:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727bc9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.284973:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727bc9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.284980:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727bc9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.284987:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727bc9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.284993:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727bc9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.284998:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4000 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.285001:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727bc9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.285008:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727bc9a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.285033:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727bc9a lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.285039:0:9458:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2753:3689:x1805522011678336:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3646us (3679us total) trans 4296061694 rc 0/0 00010000:00010000:3.0:1721880422.285041:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727bc9a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.285043:0:9458:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632004 00000100:00100000:1.0:1721880422.285057:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f022a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+1938:3687:x1805522011678208:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3848us (3880us total) trans 4296019997 rc 0/0 00000004:00080000:2.0:1721880422.285063:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009ebd8a80/2, rc 0, transno 1094398 00000100:00100000:1.0:1721880422.285064:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632002 00000100:00100000:2.0:1721880422.285068:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009ebd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011678336:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.285092:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1721880422.285096:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076fdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011682048:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.285111:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.285129:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880092318e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+1939:3689:x1805522011678976:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1793us (1832us total) trans 4296019999 rc 0/0 00000100:00100000:3.0:1721880422.285134:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632005 00000004:00080000:2.0:1721880422.285143:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009231aa00/2, rc 0, transno 1052703 00000100:00100000:3.0:1721880422.285143:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011682048 00000100:00100000:3.0:1721880422.285146:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011682048 00000100:00100000:2.0:1721880422.285147:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009231aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011678976:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.285166:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632017 00000100:00100000:1.0:1721880422.285169:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f020380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+1938:3687:x1805522011678080:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3917us (3957us total) trans 4296020000 rc 0/0 00000100:00100000:3.0:1721880422.285169:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076fdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2753:3688:x1805522011682048:12345-0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1721880422.285171:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012f020000/2, rc 0, transno 1052704 00000100:00100000:2.0:1721880422.285175:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f020000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011678080:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.285176:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632003 00002000:00080000:3.0:1721880422.285177:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58139 count 1 00010000:00010000:3.0:1721880422.285184:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b73c0/0x8a60d30f5727bcee lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe31b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.285188:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012f021c00/2, rc 0, transno 1052701 00000100:00100000:2.0:1721880422.285191:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f021c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011678208:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.285192:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fcccd80/0x8a60d30f571ec91d lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe31b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae37 expref: 302 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.285196:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.285197:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.285199:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b73c0/0x8a60d30f5727bcee lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe31b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.285209:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1721880422.285209:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fcccd80/0x8a60d30f571ec91d lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe31b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae37 expref: 302 pid: 16126 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.285212:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076fdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011682432:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.285214:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fcccd80/0x8a60d30f571ec91d lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe31b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae37 expref: 302 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.285221:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0000_UUID:16075:1805522011682560:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.285224:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.285239:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076fdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011682304:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.285240:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011682432 00000100:00100000:3.0:1721880422.285240:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.285243:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011682432 00000100:00100000:2.0:1721880422.285247:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.285254:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1721880422.285256:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011682304 00000100:00100000:2.0:1721880422.285257:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076fdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011682176:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.285258:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011682304 00000100:00100000:0.0:1721880422.285261:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632018 00000100:00100000:0.0:1721880422.285265:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076fdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+1939:3689:x1805522011682432:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.285266:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.285269:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632019 00000100:00100000:1.0:1721880422.285272:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076fde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+1939:3687:x1805522011682304:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.285275:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64316 count 1 00000100:00100000:2.0:1721880422.285279:0:16100:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011682176 00000100:00100000:2.0:1721880422.285281:0:16100:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011682176 00002000:00080000:1.0:1721880422.285282:0:16088:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64315 count 1 00010000:00010000:0.0:1721880422.285284:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727bcf5 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb3c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.285290:0:16088:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727bcfc lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb3b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.285292:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130bc4000/0x8a60d30f57196f00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c39d expref: 1318 pid: 16022 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.285294:0:16100:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632020 00000100:00100000:3.0:1721880422.285294:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+1940:3689:x1805522011677952:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4161us (4192us total) trans 4296019998 rc 0/0 00010000:00010000:0.0:1721880422.285297:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.285297:0:16088:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012335f600/0x8a60d30f57196c2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c2f5 expref: 1318 pid: 16091 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.285297:0:16100:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801362d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:lustre-MDT0000-mdtlov_UUID+1940:3687:x1805522011682176:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.285298:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.285299:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727bcf5 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.285299:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632001 00010000:00010000:1.0:1721880422.285301:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.285302:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.285304:0:16088:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727bcfc lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.285305:0:16100:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64314 count 1 00010000:00010000:0.0:1721880422.285310:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130bc4000/0x8a60d30f57196f00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c39d expref: 1318 pid: 16022 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.285312:0:16100:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727bd03 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb3a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.285315:0:16088:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012335f600/0x8a60d30f57196c2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c2f5 expref: 1318 pid: 16091 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.285316:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130bc4000/0x8a60d30f57196f00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c39d expref: 1318 pid: 16022 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.285320:0:16100:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fd1d440/0x8a60d30f571969b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c269 expref: 1318 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.285324:0:16088:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012335f600/0x8a60d30f57196c2f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c2f5 expref: 1318 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.285324:0:16100:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.285325:0:16100:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1721880422.285326:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088615180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011682688:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.285327:0:16100:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727bd03 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.285331:0:16088:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba65f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011682816:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.285338:0:16100:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fd1d440/0x8a60d30f571969b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c269 expref: 1318 pid: 16126 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.285341:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36000 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.285344:0:16100:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fd1d440/0x8a60d30f571969b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c269 expref: 1318 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.285347:0:16088:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522af00 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.285350:0:16100:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801362d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_087:lustre-OST0001_UUID:16100:1805522011682944:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.285364:0:16100:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde600 going to sleep for 11 seconds 00000004:00080000:2.0:1721880422.285386:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880135170a80/2, rc 0, transno 1052702 00000100:00100000:2.0:1721880422.285390:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135170a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011677952:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.285415:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088615f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011683072:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.285428:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.285442:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011683072 00000100:00100000:3.0:1721880422.285444:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011683072 00000100:00100000:3.0:1721880422.285461:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632021 00000100:00100000:3.0:1721880422.285464:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801362d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+1940:3689:x1805522011683072:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.285472:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64317 count 1 00010000:00010000:3.0:1721880422.285479:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727bd0a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb3d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.285486:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa59440/0x8a60d30f57197209 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb3d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c453 expref: 1318 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.285490:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.285491:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.285493:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727bd0a lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb3d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.285502:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fa59440/0x8a60d30f57197209 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb3d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c453 expref: 1318 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.285508:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fa59440/0x8a60d30f57197209 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb3d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c453 expref: 1318 pid: 16100 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.285517:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011683200:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.285539:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdecb40 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.285762:0:16120:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0001_UUID:16120:1805522011680384:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.285771:0:16120:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727bca8 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.285808:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f021500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0000_UUID:16081:1805522011680256:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.285823:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136353840/0x8a60d30f5727bca1 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe314:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.286772:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.286783:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257700992 00000100:00100000:0.0:1721880422.286786:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257700992 00000100:00100000:1.0:1721880422.286792:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012ba64700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011680512:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.286797:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b68c240/0x8a60d30f571ec844 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe314:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad5e expref: 303 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.286803:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727bcb6 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.286814:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914199 00000100:00100000:0.0:1721880422.286818:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088616680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+303:2004:x1805522257700992:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.286824:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.286827:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b68c240/0x8a60d30f571ec844 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe314:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad5e expref: 303 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.286834:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b68c240/0x8a60d30f571ec844 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe314:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad5e expref: 303 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.286842:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b68c240/0x8a60d30f571ec844 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe314:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad5e expref: 303 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.286850:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.286851:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.286853:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136353840/0x8a60d30f5727bca1 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe314:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.286861:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136353840/0x8a60d30f5727bca1 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe314:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.286872:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.286880:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136353840/0x8a60d30f5727bca1 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.286891:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136353840/0x8a60d30f5727bca1 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.286895:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088616680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+302:2004:x1805522257700992:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 76us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.286899:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914199 00010000:00010000:2.0:1721880422.286900:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136353840/0x8a60d30f5727bca1 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.286907:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136353840/0x8a60d30f5727bca1 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.286914:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136353840/0x8a60d30f5727bca1 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.286920:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353840 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.286923:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136353840/0x8a60d30f5727bca1 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.286930:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136353840/0x8a60d30f5727bca1 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.286941:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136353840/0x8a60d30f5727bca1 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.286948:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136353840/0x8a60d30f5727bca1 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.286985:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.286993:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257701120 00000100:00100000:0.0:1721880422.286995:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257701120 00000100:00100000:1.0:1721880422.286997:0:16110:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088614700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_094:lustre-OST0000_UUID:16110:1805522011680640:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.287003:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0e4a1c0/0x8a60d30f57195fa2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c00f expref: 1319 pid: 16073 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.287010:0:16110:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325eac0/0x8a60d30f5727bcaf lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe316:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.287032:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914200 00000100:00100000:0.0:1721880422.287035:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088615880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1319:2005:x1805522257701120:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.287040:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.287042:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0e4a1c0/0x8a60d30f57195fa2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c00f expref: 1319 pid: 16073 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.287048:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0e4a1c0/0x8a60d30f57195fa2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c00f expref: 1319 pid: 16073 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.287051:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f020e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0000_UUID:16060:1805522011680768:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.287057:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0e4a1c0/0x8a60d30f57195fa2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c00f expref: 1319 pid: 16073 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.287067:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136352400/0x8a60d30f5727bcbd lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe318:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.287070:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.287071:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.287073:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727bcb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.287077:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727bcb6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.287081:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2754:3686:x1805522011679232:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2848us (2979us total) trans 4296061695 rc 0/0 00010000:00010000:0.0:1721880422.287086:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.287086:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632006 00000004:00080000:3.0:1721880422.287091:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012f023800/2, rc 0, transno 1094399 00010000:00010000:1.0:1721880422.287097:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727bcb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.287099:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088615880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1318:2005:x1805522257701120:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 64us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.287099:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f023800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011679232:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.287103:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914200 00010000:00010000:1.0:1721880422.287104:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727bcb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.287111:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727bcb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.287118:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727bcb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.287122:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.287127:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801362daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011683328:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.287129:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257701248 00010000:00010000:1.0:1721880422.287129:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727bcb6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.287131:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257701248 00010000:00010000:1.0:1721880422.287135:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106f180 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.287137:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091074fc0/0x8a60d30f571ec8ad lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe318:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12adc7 expref: 302 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.287138:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727bcb6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.287145:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727bcb6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.287147:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914201 00000100:00100000:3.0:1721880422.287147:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.287150:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088614700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+302:2005:x1805522257701248:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.287154:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.287155:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727bcb6 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.287156:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091074fc0/0x8a60d30f571ec8ad lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe318:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12adc7 expref: 302 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.287161:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727bcb6 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.287162:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091074fc0/0x8a60d30f571ec8ad lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe318:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12adc7 expref: 302 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.287163:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011683328 00000100:00100000:2.0:1721880422.287166:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011683328 00010000:00010000:0.0:1721880422.287173:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091074fc0/0x8a60d30f571ec8ad lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe318:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12adc7 expref: 302 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.287178:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632022 00000100:00100000:2.0:1721880422.287182:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2754:3686:x1805522011683328:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.287183:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.287184:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.287186:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136352400/0x8a60d30f5727bcbd lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe318:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.287190:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136352400/0x8a60d30f5727bcbd lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe318:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.287191:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58140 count 1 00010000:00010000:0.0:1721880422.287198:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.287199:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136353180/0x8a60d30f5727bd11 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe31c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.287203:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136352400/0x8a60d30f5727bcbd lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.287206:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088614700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+301:2005:x1805522257701248:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 56us (84us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.287208:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa8ba80/0x8a60d30f571ec939 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe31c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae53 expref: 301 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.287209:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136352400/0x8a60d30f5727bcbd lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.287210:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914201 00010000:00010000:2.0:1721880422.287212:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.287213:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.287215:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136353180/0x8a60d30f5727bd11 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe31c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.287215:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136352400/0x8a60d30f5727bcbd lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.287222:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136352400/0x8a60d30f5727bcbd lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.287226:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa8ba80/0x8a60d30f571ec939 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe31c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae53 expref: 300 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.287226:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136352400/0x8a60d30f5727bcbd lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.287229:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352400 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.287231:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136352400/0x8a60d30f5727bcbd lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.287234:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136352400/0x8a60d30f5727bcbd lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.287236:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa8ba80/0x8a60d30f571ec939 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe31c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae53 expref: 300 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.287241:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136352400/0x8a60d30f5727bcbd lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.287243:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801362db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0000_UUID:16081:1805522011683456:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.287245:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136352400/0x8a60d30f5727bcbd lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.287266:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde540 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.287278:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f022680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+1941:3688:x1805522011679488:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3019us (3099us total) trans 4296020001 rc 0/0 00000100:00100000:2.0:1721880422.287282:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076fddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011681408:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.287285:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632009 00010000:00010000:2.0:1721880422.287294:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727bcd2 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.287296:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.287302:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257701376 00000100:00100000:0.0:1721880422.287304:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257701376 00000100:00100000:2.0:1721880422.287309:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800919c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011681024:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.287312:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132cb8000/0x8a60d30f571ec87c lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe316:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad96 expref: 301 pid: 16039 timeout: 887 lvb_type: 0 00000004:00080000:1.0:1721880422.287313:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012f020a80/2, rc 0, transno 1052705 00010000:00010000:2.0:1721880422.287315:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727bccb lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.287321:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f020a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011679488:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.287323:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914202 00000100:00100000:0.0:1721880422.287326:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8065850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+301:2005:x1805522257701376:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.287331:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.287333:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132cb8000/0x8a60d30f571ec87c lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe316:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad96 expref: 301 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.287342:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132cb8000/0x8a60d30f571ec87c lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe316:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad96 expref: 301 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.287349:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132cb8000/0x8a60d30f571ec87c lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe316:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad96 expref: 301 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.287349:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880092318000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2755:3689:x1805522011680128:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3036us (3153us total) trans 4296061696 rc 0/0 00000100:00100000:3.0:1721880422.287354:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632010 00010000:00010000:0.0:1721880422.287355:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.287356:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000004:00080000:2.0:1721880422.287357:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009231b100/2, rc 0, transno 1094400 00010000:00010000:0.0:1721880422.287358:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009325eac0/0x8a60d30f5727bcaf lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe316:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.287363:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325eac0/0x8a60d30f5727bcaf lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe316:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.287363:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009231b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011680128:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1721880422.287369:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1721880422.287375:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011683584:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.287378:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.287383:0:16110:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325eac0/0x8a60d30f5727bcaf lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.287383:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1721880422.287389:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801362da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011683712:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.287390:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8065850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+300:2005:x1805522257701376:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 64us (95us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.287391:0:16110:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325eac0/0x8a60d30f5727bcaf lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.287391:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.287394:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914202 00010000:00010000:1.0:1721880422.287398:0:16110:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325eac0/0x8a60d30f5727bcaf lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.287403:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011683584 00010000:00010000:1.0:1721880422.287405:0:16110:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325eac0/0x8a60d30f5727bcaf lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.287405:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.287406:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011683584 00010000:00010000:1.0:1721880422.287412:0:16110:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325eac0/0x8a60d30f5727bcaf lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.287416:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011683712 00000100:00100000:3.0:1721880422.287417:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011683712 00010000:00010000:1.0:1721880422.287418:0:16110:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325eac0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.287421:0:16110:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325eac0/0x8a60d30f5727bcaf lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.287426:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632023 00010000:00010000:1.0:1721880422.287427:0:16110:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325eac0/0x8a60d30f5727bcaf lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.287429:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+1941:3686:x1805522011683584:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.287432:0:16040:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632024 00010000:00010000:1.0:1721880422.287436:0:16110:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325eac0/0x8a60d30f5727bcaf lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.287436:0:16040:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801362db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:lustre-MDT0000-mdtlov_UUID+2755:3689:x1805522011683712:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1721880422.287439:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64318 count 1 00010000:00010000:1.0:1721880422.287443:0:16110:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325eac0/0x8a60d30f5727bcaf lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.287445:0:16040:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58141 count 1 00010000:00010000:3.0:1721880422.287447:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727bd18 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb3e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.287453:0:16040:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727bd1f lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe31d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.287455:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134b21d40/0x8a60d30f57197582 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c54f expref: 1317 pid: 10431 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.287459:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.287460:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.287462:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727bd18 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.287464:0:16040:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009431cfc0/0x8a60d30f571ec955 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae6f expref: 299 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.287468:0:16040:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.287469:0:16040:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.287471:0:16040:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727bd1f lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.287473:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134b21d40/0x8a60d30f57197582 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c54f expref: 1317 pid: 10431 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.287478:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134b21d40/0x8a60d30f57197582 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c54f expref: 1317 pid: 10431 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.287481:0:16040:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009431cfc0/0x8a60d30f571ec955 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae6f expref: 299 pid: 16039 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.287484:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011683840:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.287487:0:16040:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009431cfc0/0x8a60d30f571ec955 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae6f expref: 299 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.287493:0:16040:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801362db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_040:lustre-OST0000_UUID:16040:1805522011683968:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.287503:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.287507:0:16040:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde840 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.287552:0:16110:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_094:lustre-MDT0000-mdtlov_UUID+2756:3686:x1805522011679744:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3306us (3388us total) trans 4296061697 rc 0/0 00000004:00080000:3.0:1721880422.287555:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012f022300/2, rc 0, transno 1094401 00000100:00100000:1.0:1721880422.287559:0:16110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632008 00000100:00100000:3.0:1721880422.287560:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f022300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011679744:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.287578:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1721880422.287587:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801362d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011684096:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.287605:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.287618:0:16110:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011684096 00000100:00100000:2.0:1721880422.287622:0:16110:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011684096 00000100:00100000:1.0:1721880422.287630:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.287639:0:16110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632025 00000100:00100000:2.0:1721880422.287644:0:16110:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_094:lustre-MDT0000-mdtlov_UUID+2756:3688:x1805522011684096:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1721880422.287663:0:16110:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58142 count 1 00000100:00100000:3.0:1721880422.287665:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088efd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0000_UUID:16101:1805522011681536:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.287666:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.287673:0:16110:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136350000/0x8a60d30f5727bd26 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe31e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.287675:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5200/0x8a60d30f5727bcd9 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe319:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.287684:0:16110:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009431f840/0x8a60d30f571ec971 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe31e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae8b expref: 299 pid: 16039 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.287691:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257700864 00000100:00100000:0.0:1721880422.287695:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257700864 00010000:00010000:2.0:1721880422.287695:0:16110:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1721880422.287695:0:16130:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c7c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_114:lustre-OST0000_UUID:16130:1805522011681664:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.287696:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.287696:0:16110:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.287699:0:16110:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136350000/0x8a60d30f5727bd26 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe31e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.287702:0:16130:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6f40/0x8a60d30f5727bce7 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe31a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.287705:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cae2880/0x8a60d30f57196154 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c086 expref: 1318 pid: 16083 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.287712:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.287718:0:16110:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009431f840/0x8a60d30f571ec971 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe31e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae8b expref: 299 pid: 16039 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.287719:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257701632 00000100:00100000:0.0:1721880422.287720:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257701632 00010000:00010000:0.0:1721880422.287742:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c98df80/0x8a60d30f57196409 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c12e expref: 1319 pid: 10431 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.287753:0:16110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009431f840/0x8a60d30f571ec971 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe31e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae8b expref: 299 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.287761:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257701760 00000100:00100000:0.0:1721880422.287762:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257701760 00000100:00100000:2.0:1721880422.287764:0:16110:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801362d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_094:lustre-OST0000_UUID:16110:1805522011684224:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.287766:0:7116:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257701504 00000100:00100000:3.0:1721880422.287768:0:7116:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257701504 00000100:00100000:1.0:1721880422.287772:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914203 00000100:00100000:1.0:1721880422.287778:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1320:2004:x1805522257700864:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.287778:0:7116:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880120204900/0x8a60d30f5719667f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c1c1 expref: 1320 pid: 16016 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.287787:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.287790:0:16110:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdecc0 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.287791:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cae2880/0x8a60d30f57196154 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb37:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c086 expref: 1320 pid: 16083 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.287791:0:7116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914204 00000100:00100000:3.0:1721880422.287794:0:7116:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1320:2005:x1805522257701632:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.287799:0:7116:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.287801:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cae2880/0x8a60d30f57196154 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb37:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c086 expref: 1320 pid: 16083 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.287802:0:7116:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c98df80/0x8a60d30f57196409 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb38:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c12e expref: 1320 pid: 10431 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.287808:0:7116:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c98df80/0x8a60d30f57196409 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb38:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c12e expref: 1320 pid: 10431 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.287814:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cae2880/0x8a60d30f57196154 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb37:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c086 expref: 1320 pid: 16083 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.287817:0:7116:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c98df80/0x8a60d30f57196409 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb38:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c12e expref: 1320 pid: 10431 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.287821:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800729deac0/0x8a60d30f571ec8c9 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe319:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ade3 expref: 300 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.287824:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.287824:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.287826:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.287826:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.287828:0:7116:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727bccb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.287829:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727bca8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.287832:0:7116:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727bccb lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.287835:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914205 00010000:00010000:1.0:1721880422.287836:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727bca8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.287838:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1318:2004:x1805522257701504:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.287842:0:7116:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.287844:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.287847:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880120204900/0x8a60d30f5719667f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c1c1 expref: 1318 pid: 16016 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.287851:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.287859:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727bccb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.287861:0:7116:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1318:2005:x1805522257701632:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 66us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.287865:0:7116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914204 00010000:00010000:2.0:1721880422.287866:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727bccb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.287867:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1318:2004:x1805522257700864:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 89us (237us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.287871:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727bccb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.287873:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914203 00010000:00010000:2.0:1721880422.287874:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727bccb lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.287877:0:7116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914206 00010000:00010000:2.0:1721880422.287879:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727bccb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.287880:0:7116:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+300:2005:x1805522257701760:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.287883:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353600 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.287884:0:7116:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.287885:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727bccb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.287887:0:7116:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800729deac0/0x8a60d30f571ec8c9 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe319:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ade3 expref: 300 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.287889:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727bccb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.287893:0:7116:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800729deac0/0x8a60d30f571ec8c9 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe319:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ade3 expref: 300 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.287895:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727bccb lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.287899:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727bccb lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.287901:0:7116:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800729deac0/0x8a60d30f571ec8c9 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe319:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ade3 expref: 300 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.287904:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880120204900/0x8a60d30f5719667f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c1c1 expref: 1316 pid: 16016 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.287907:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.287908:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.287910:0:7116:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5200/0x8a60d30f5727bcd9 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe319:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.287914:0:7116:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5200/0x8a60d30f5727bcd9 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe319:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.287915:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880120204900/0x8a60d30f5719667f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c1c1 expref: 1316 pid: 16016 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.287918:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.287922:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.287923:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.287923:0:7116:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.287925:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727bcd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.287930:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727bcd2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.287931:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257701888 00000100:00100000:3.0:1721880422.287932:0:7116:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+299:2005:x1805522257701760:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 51us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.287934:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257701888 00000100:00100000:3.0:1721880422.287936:0:7116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914206 00010000:00010000:0.0:1721880422.287940:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.287945:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800729dfcc0/0x8a60d30f571ec8e5 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe31a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12adff expref: 299 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.287961:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914207 00000100:00100000:3.0:1721880422.287964:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+299:2006:x1805522257701888:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.287968:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.287971:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800729dfcc0/0x8a60d30f571ec8e5 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe31a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12adff expref: 299 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.287977:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800729dfcc0/0x8a60d30f571ec8e5 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe31a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12adff expref: 299 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.287984:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800729dfcc0/0x8a60d30f571ec8e5 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe31a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12adff expref: 299 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.287989:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.287990:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.287992:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6f40/0x8a60d30f5727bce7 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe31a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.287993:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1315:2004:x1805522257701504:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 116us (243us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.287996:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6f40/0x8a60d30f5727bce7 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe31a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.287999:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914205 00000100:00100000:2.0:1721880422.288000:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f020700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1942:3688:x1805522011680000:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3578us (3611us total) trans 4296020002 rc 0/0 00010000:00010000:3.0:1721880422.288003:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.288004:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632011 00000100:00100000:3.0:1721880422.288029:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+298:2006:x1805522257701888:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 63us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.288033:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914207 00010000:00010000:2.0:1721880422.288036:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727bcd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.288041:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727bcd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.288045:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727bcd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.288047:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5200/0x8a60d30f5727bcd9 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.288050:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727bcd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.288051:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5200/0x8a60d30f5727bcd9 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.288056:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5200/0x8a60d30f5727bcd9 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.288058:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727bcd2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.288060:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5200/0x8a60d30f5727bcd9 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.288063:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5200/0x8a60d30f5727bcd9 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.288064:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350240 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.288066:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727bcd2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.288067:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b5200 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.288068:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5200/0x8a60d30f5727bcd9 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.288072:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5200/0x8a60d30f5727bcd9 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.288073:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727bcd2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.288078:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5200/0x8a60d30f5727bcd9 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.288082:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727bcd2 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.288085:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5200/0x8a60d30f5727bcd9 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.288089:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727bcd2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.288155:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.288165:0:7116:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257702144 00000100:00100000:1.0:1721880422.288167:0:7116:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257702144 00000100:00100000:3.0:1721880422.288171:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880076fde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2757:3687:x1805522011680896:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3449us (3516us total) trans 4296061698 rc 0/0 00000100:00100000:3.0:1721880422.288175:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632015 00010000:00010000:1.0:1721880422.288177:0:7116:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fcccd80/0x8a60d30f571ec91d lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe31b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae37 expref: 298 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.288193:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880076fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1942:3687:x1805522011681152:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3473us (3557us total) trans 4296020003 rc 0/0 00000100:00100000:3.0:1721880422.288196:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088617b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:15452:1805522011681920:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.288197:0:7116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914208 00000100:00100000:2.0:1721880422.288198:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632014 00000100:00100000:1.0:1721880422.288201:0:7116:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+298:2004:x1805522257702144:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.288205:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325f600/0x8a60d30f5727bcc4 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe317:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.288207:0:7116:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.288209:0:7116:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fcccd80/0x8a60d30f571ec91d lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe31b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae37 expref: 298 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.288215:0:7116:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fcccd80/0x8a60d30f571ec91d lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe31b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae37 expref: 298 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.288220:0:16130:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6f40/0x8a60d30f5727bce7 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.288222:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.288223:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.288223:0:16098:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076fdd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_085:lustre-OST0000_UUID:16098:1805522011681792:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.288224:0:16130:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6f40/0x8a60d30f5727bce7 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.288225:0:7116:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b73c0/0x8a60d30f5727bcee lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe31b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.288228:0:16130:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6f40/0x8a60d30f5727bce7 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.288231:0:16130:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6f40/0x8a60d30f5727bce7 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.288233:0:7116:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b73c0/0x8a60d30f5727bcee lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe31b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.288235:0:16130:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6f40/0x8a60d30f5727bce7 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.288238:0:16098:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136351200/0x8a60d30f5727bce0 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe315:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.288241:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.288241:0:7116:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.288241:0:16130:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b6f40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.288243:0:16130:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6f40/0x8a60d30f5727bce7 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.288247:0:16130:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6f40/0x8a60d30f5727bce7 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.288253:0:7116:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+298:2004:x1805522257702144:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 52us (100us total) trans 0 rc 0/0 00000004:00080000:2.0:1721880422.288253:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012f023b80/2, rc 0, transno 1052706 00010000:00010000:3.0:1721880422.288253:0:16130:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6f40/0x8a60d30f5727bce7 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.288256:0:16130:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6f40/0x8a60d30f5727bce7 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.288257:0:7116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914208 00000100:00100000:2.0:1721880422.288258:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f023b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011680000:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1721880422.288287:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880135171f80/2, rc 0, transno 1094402 00000100:00100000:2.0:1721880422.288291:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011680896:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1721880422.288304:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880076fdf100/2, rc 0, transno 1052707 00000100:00100000:2.0:1721880422.288307:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076fdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011681152:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.288320:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800919c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011684608:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.288327:0:16130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880076fdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_114:lustre-MDT0000-mdtlov_UUID+2757:3688:x1805522011681280:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3623us (3719us total) trans 4296061699 rc 0/0 00000100:00100000:1.0:1721880422.288330:0:7116:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257702016 00000100:00100000:3.0:1721880422.288331:0:16130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632013 00000100:00100000:1.0:1721880422.288334:0:7116:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257702016 00000100:00100000:2.0:1721880422.288335:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.288342:0:16130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011684608 00010000:00010000:1.0:1721880422.288344:0:7116:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801362033c0/0x8a60d30f571ec898 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe317:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12adab expref: 298 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.288344:0:16130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011684608 00000100:00100000:0.0:1721880422.288346:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088615180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011682688:192.168.201.24@tcp:104: 00000004:00080000:2.0:1721880422.288346:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880076fddf80/2, rc 0, transno 1094403 00000100:00100000:2.0:1721880422.288349:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076fddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011681280:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.288357:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727bcf5 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.288358:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632026 00000100:00100000:3.0:1721880422.288361:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076fdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+1942:3688:x1805522011684608:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.288363:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1721880422.288366:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076fddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011684736:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.288367:0:7116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914209 00002000:00080000:3.0:1721880422.288369:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64320 count 1 00000100:00100000:1.0:1721880422.288370:0:7116:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e197050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+298:2004:x1805522257702016:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.288375:0:7116:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.288376:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.288376:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727bd2d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb40:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.288378:0:7116:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801362033c0/0x8a60d30f571ec898 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe317:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12adab expref: 298 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.288383:0:7116:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801362033c0/0x8a60d30f571ec898 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe317:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12adab expref: 298 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.288383:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f65e880/0x8a60d30f5719843f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c698 expref: 1314 pid: 16049 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.288385:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011684736 00000100:00100000:2.0:1721880422.288387:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011684736 00010000:00010000:3.0:1721880422.288390:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.288391:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.288392:0:7116:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801362033c0/0x8a60d30f571ec898 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe317:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12adab expref: 298 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.288393:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727bd2d lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.288397:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632027 00000100:00100000:2.0:1721880422.288400:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f020e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2757:3688:x1805522011684736:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.288401:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.288403:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.288403:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f65e880/0x8a60d30f5719843f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c698 expref: 1314 pid: 16049 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.288405:0:7116:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009325f600/0x8a60d30f5727bcc4 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe317:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.288408:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58144 count 1 00010000:00010000:3.0:1721880422.288409:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f65e880/0x8a60d30f5719843f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c698 expref: 1314 pid: 16049 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.288412:0:7116:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325f600/0x8a60d30f5727bcc4 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe317:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.288415:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136350d80/0x8a60d30f5727bd34 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe320:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.288415:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c7c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011684864:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.288423:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c4a9b00/0x8a60d30f571ec9a9 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe320:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aec3 expref: 297 pid: 16039 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.288427:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.288427:0:7116:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.288428:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.288429:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.288430:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136350d80/0x8a60d30f5727bd34 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe320:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.288431:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec000 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.288436:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257702272 00000100:00100000:0.0:1721880422.288439:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257702272 00010000:00010000:3.0:1721880422.288441:0:16120:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727bca8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.288444:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c4a9b00/0x8a60d30f571ec9a9 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe320:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aec3 expref: 298 pid: 16039 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.288445:0:7116:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e197050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+298:2004:x1805522257702016:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 72us (204us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.288445:0:16120:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727bca8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.288448:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136202640/0x8a60d30f571ec859 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe315:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad73 expref: 298 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.288449:0:16120:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727bca8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.288450:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c4a9b00/0x8a60d30f571ec9a9 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe320:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aec3 expref: 298 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.288451:0:7116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914209 00010000:00010000:3.0:1721880422.288453:0:16120:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727bca8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.288456:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f021500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:15466:1805522011684992:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.288456:0:16120:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727bca8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.288460:0:16120:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b5b00 already unused, calling callback (ffffffffa084e330) 00000100:00100000:0.0:1721880422.288462:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914210 00010000:00010000:3.0:1721880422.288462:0:16120:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727bca8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.288465:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088615180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+297:2004:x1805522257702272:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.288465:0:16120:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727bca8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.288470:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde3c0 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.288471:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.288471:0:16120:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727bca8 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.288474:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136202640/0x8a60d30f571ec859 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe315:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad73 expref: 297 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.288474:0:16120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727bca8 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.288479:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801362d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011684480:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.288480:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136202640/0x8a60d30f571ec859 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe315:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad73 expref: 297 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.288488:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136202640/0x8a60d30f571ec859 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe315:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad73 expref: 297 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.288490:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325f600/0x8a60d30f5727bcc4 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.288491:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.288495:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325f600/0x8a60d30f5727bcc4 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.288498:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.288499:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.288499:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325f600/0x8a60d30f5727bcc4 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.288500:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136351200/0x8a60d30f5727bce0 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe315:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.288501:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1721880422.288503:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325f600/0x8a60d30f5727bcc4 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.288504:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801362d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011684352:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.288505:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136351200/0x8a60d30f5727bce0 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe315:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.288507:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325f600/0x8a60d30f5727bcc4 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.288510:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325f600 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.288512:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325f600/0x8a60d30f5727bcc4 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.288513:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.288518:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325f600/0x8a60d30f5727bcc4 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.288520:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.288523:0:16098:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136351200/0x8a60d30f5727bce0 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.288528:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325f600/0x8a60d30f5727bcc4 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.288528:0:16098:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136351200/0x8a60d30f5727bce0 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.288532:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088615180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+296:2004:x1805522257702272:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 65us (105us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.288533:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325f600/0x8a60d30f5727bcc4 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.288533:0:16098:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136351200/0x8a60d30f5727bce0 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.288536:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914210 00010000:00010000:2.0:1721880422.288537:0:16098:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136351200/0x8a60d30f5727bce0 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.288544:0:16098:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136351200/0x8a60d30f5727bce0 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.288548:0:16098:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136351200 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.288550:0:16098:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136351200/0x8a60d30f5727bce0 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.288554:0:16098:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136351200/0x8a60d30f5727bce0 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.288557:0:16120:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880092319180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+1943:3689:x1805522011679616:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4320us (4413us total) trans 4296020004 rc 0/0 00000100:00100000:0.0:1721880422.288558:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.288559:0:16098:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136351200/0x8a60d30f5727bce0 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.288563:0:16098:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136351200/0x8a60d30f5727bce0 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.288563:0:16120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632007 00000100:00100000:0.0:1721880422.288566:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257702400 00000100:00100000:0.0:1721880422.288568:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257702400 00010000:00010000:0.0:1721880422.288574:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130bc4000/0x8a60d30f57196f00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c39d expref: 1315 pid: 16022 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.288575:0:16120:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011684480 00000100:00100000:3.0:1721880422.288578:0:16120:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011684480 00000100:00100000:0.0:1721880422.288584:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914211 00000100:00100000:0.0:1721880422.288587:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088616680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1315:2005:x1805522257702400:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.288591:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.288591:0:16120:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011684352 00000100:00100000:3.0:1721880422.288593:0:16120:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011684352 00010000:00010000:0.0:1721880422.288594:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130bc4000/0x8a60d30f57196f00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb3c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c39d expref: 1315 pid: 16022 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.288599:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130bc4000/0x8a60d30f57196f00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb3c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c39d expref: 1315 pid: 16022 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.288605:0:16120:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632028 00000100:00100000:3.0:1721880422.288608:0:16120:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+2760:3687:x1805522011684480:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.288611:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130bc4000/0x8a60d30f57196f00 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb3c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c39d expref: 1315 pid: 16022 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.288618:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.288619:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00002000:00080000:3.0:1721880422.288619:0:16120:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58143 count 1 00010000:00010000:0.0:1721880422.288620:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727bcf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.288625:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727bcf5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.288629:0:16120:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727bd3b lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe31f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.288632:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.288639:0:16120:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c4aa880/0x8a60d30f571ec98d lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aea7 expref: 295 pid: 16039 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.288642:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088616680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1314:2005:x1805522257702400:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 55us (84us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.288644:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f023100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2760:3687:x1805522011679872:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4163us (4199us total) trans 4296061700 rc 0/0 00010000:00010000:3.0:1721880422.288645:0:16120:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1721880422.288646:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914211 00010000:00010000:3.0:1721880422.288646:0:16120:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1721880422.288649:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632012 00010000:00010000:3.0:1721880422.288649:0:16120:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727bd3b lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.288652:0:16098:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880096c9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_085:lustre-MDT0000-mdtlov_UUID+2760:3686:x1805522011679360:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3836us (3988us total) trans 4296061701 rc 0/0 00010000:00010000:0.0:1721880422.288656:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727bcf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.288657:0:16098:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632016 00010000:00010000:0.0:1721880422.288661:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727bcf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.288662:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632029 00000100:00100000:1.0:1721880422.288665:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1943:3687:x1805522011684352:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.288665:0:16120:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c4aa880/0x8a60d30f571ec98d lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aea7 expref: 295 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.288666:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727bcf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.288669:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727bcf5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.288673:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64319 count 1 00010000:00010000:3.0:1721880422.288674:0:16120:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c4aa880/0x8a60d30f571ec98d lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aea7 expref: 295 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.288677:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727bcf5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.288680:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727bd42 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb3f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.288681:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325d440 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.288683:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727bcf5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.288683:0:16120:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c7fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16120:1805522011685120:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.288686:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727bcf5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.288687:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ea19b00/0x8a60d30f57197861 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb3f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c5fe expref: 1313 pid: 15497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.288691:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727bcf5 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.288691:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.288692:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.288694:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727bd42 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb3f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.288695:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727bcf5 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.288697:0:16120:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdeccc0 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.288706:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ea19b00/0x8a60d30f57197861 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb3f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c5fe expref: 1313 pid: 15497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.288714:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ea19b00/0x8a60d30f57197861 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb3f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c5fe expref: 1313 pid: 15497 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.288719:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fcccd80/0x8a60d30f571ec91d lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe31b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae37 expref: 295 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.288723:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba66d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011685248:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.288745:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0000_UUID:16075:1805522011682560:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.288754:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009d8b73c0/0x8a60d30f5727bcee lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.288759:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009d8b73c0/0x8a60d30f5727bcee lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.288760:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a780 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.288763:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d8b73c0/0x8a60d30f5727bcee lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.288770:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b73c0/0x8a60d30f5727bcee lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.288774:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b73c0/0x8a60d30f5727bcee lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.288778:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d8b73c0/0x8a60d30f5727bcee lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.288781:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b73c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.288783:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b73c0/0x8a60d30f5727bcee lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.288786:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b73c0/0x8a60d30f5727bcee lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.288788:0:16088:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012ba65f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011682816:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.288792:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d8b73c0/0x8a60d30f5727bcee lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.288795:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012f021880/2, rc 0, transno 1052708 00010000:00010000:3.0:1721880422.288795:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b73c0/0x8a60d30f5727bcee lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.288802:0:16088:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727bcfc lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.288802:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f021880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011679616:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.288821:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880076fdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+1944:3689:x1805522011682432:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3554us (3595us total) trans 4296020005 rc 0/0 00000100:00100000:0.0:1721880422.288825:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632018 00000004:00080000:2.0:1721880422.288833:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012f023480/2, rc 0, transno 1094404 00000100:00100000:2.0:1721880422.288839:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f023480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011679872:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.288843:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1721880422.288876:0:16100:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801362d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_087:lustre-OST0001_UUID:16100:1805522011682944:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.288878:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.288881:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880076fdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2759:3688:x1805522011682048:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3710us (3768us total) trans 4296061702 rc 0/0 00000100:00100000:3.0:1721880422.288885:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632017 00010000:00010000:2.0:1721880422.288890:0:16100:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727bd03 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.288898:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257702528 00000100:00100000:1.0:1721880422.288898:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.288900:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257702528 00000100:00100000:0.0:1721880422.288910:0:15444:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257702784 00000100:00100000:0.0:1721880422.288911:0:15444:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257702784 00000004:00080000:3.0:1721880422.288911:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880076fdea00/2, rc 0, transno 1094406 00000004:00080000:2.0:1721880422.288913:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880076fdf480/2, rc 0, transno 1052709 00000100:00100000:1.0:1721880422.288914:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.288919:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076fdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011682432:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.288920:0:15444:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa59440/0x8a60d30f57197209 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb3d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c453 expref: 1315 pid: 16100 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.288921:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076fdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011682048:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.288922:0:7116:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257702656 00000100:00100000:1.0:1721880422.288924:0:7116:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257702656 00010000:00010000:1.0:1721880422.288933:0:7116:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd1d440/0x8a60d30f571969b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c269 expref: 1316 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.288937:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914212 00000100:00100000:0.0:1721880422.288941:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1316:2005:x1805522257702784:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.288946:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.288948:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fa59440/0x8a60d30f57197209 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb3d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c453 expref: 1316 pid: 16100 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.288949:0:7116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914213 00000100:00100000:3.0:1721880422.288949:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011685632:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.288952:0:7116:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1316:2005:x1805522257702656:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.288952:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011685376:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.288955:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fa59440/0x8a60d30f57197209 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb3d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c453 expref: 1316 pid: 16100 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.288957:0:7116:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.288959:0:7116:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fd1d440/0x8a60d30f571969b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb3a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c269 expref: 1316 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.288963:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.288964:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.288965:0:7116:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fd1d440/0x8a60d30f571969b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb3a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c269 expref: 1316 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.288966:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727bd0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb3d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.288970:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727bd0a lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb3d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.288973:0:7116:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fd1d440/0x8a60d30f571969b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb3a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c269 expref: 1316 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.288973:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.288977:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.288977:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011685760:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.288991:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1315:2005:x1805522257702784:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 49us (93us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.288993:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.288994:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1721880422.288995:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914212 00000100:00100000:2.0:1721880422.288995:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.288996:0:7116:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727bd03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.289000:0:7116:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727bd03 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.289008:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012335f600/0x8a60d30f57196c2f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c2f5 expref: 1314 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.289010:0:7116:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:3.0:1721880422.289028:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012f021f80/2, rc 0, transno 1094405 00010000:00010000:2.0:1721880422.289032:0:16100:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727bd03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.289035:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914214 00000100:00100000:1.0:1721880422.289035:0:7116:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1314:2005:x1805522257702656:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 82us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.289038:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1314:2005:x1805522257702528:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.289039:0:7116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914213 00010000:00010000:2.0:1721880422.289040:0:16100:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727bd03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.289040:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f021f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011679360:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.289042:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.289044:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1721880422.289045:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012335f600/0x8a60d30f57196c2f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb3b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c2f5 expref: 1314 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.289045:0:16100:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727bd03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.289049:0:16100:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727bd03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.289049:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011685504:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.289052:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012335f600/0x8a60d30f57196c2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb3b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c2f5 expref: 1313 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.289053:0:16100:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727bd03 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.289056:0:16100:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350fc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.289058:0:16100:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727bd03 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.289060:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012335f600/0x8a60d30f57196c2f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb3b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c2f5 expref: 1313 pid: 16091 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.289065:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.289066:0:16100:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727bd03 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.289067:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.289068:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.289070:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727bcfc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.289072:0:16100:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727bd03 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.289074:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727bcfc lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.289076:0:16100:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727bd03 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.289083:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.289084:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011683840:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.289086:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.289093:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727bd18 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.289094:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1312:2005:x1805522257702528:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 56us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.289096:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257702912 00000100:00100000:0.0:1721880422.289097:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914214 00000100:00100000:1.0:1721880422.289098:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257702912 00010000:00010000:1.0:1721880422.289105:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa8ba80/0x8a60d30f571ec939 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe31c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae53 expref: 295 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.289107:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fa59440/0x8a60d30f57197209 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb3d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c453 expref: 1311 pid: 16100 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.289115:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011683200:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.289121:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727bd0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.289122:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801362db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0000_UUID:16081:1805522011683456:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.289123:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914215 00010000:00010000:3.0:1721880422.289125:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727bd0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.289127:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+295:2004:x1805522257702912:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.289129:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727bd0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.289131:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.289131:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136353180/0x8a60d30f5727bd11 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe31c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.289133:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa8ba80/0x8a60d30f571ec939 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe31c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae53 expref: 295 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.289136:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727bd0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.289139:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa8ba80/0x8a60d30f571ec939 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe31c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae53 expref: 295 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.289141:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.289141:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727bd0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.289144:0:16040:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801362db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_040:lustre-OST0000_UUID:16040:1805522011683968:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.289144:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727bd0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.289147:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa8ba80/0x8a60d30f571ec939 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe31c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae53 expref: 295 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.289147:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b7a80 already unused, calling callback (ffffffffa084e330) 00000100:00100000:0.0:1721880422.289148:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257703040 00010000:00010000:3.0:1721880422.289149:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727bd0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.289150:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257703040 00010000:00010000:2.0:1721880422.289150:0:16040:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727bd1f lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.289153:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727bd0a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.289154:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.289155:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.289156:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136353180/0x8a60d30f5727bd11 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe31c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.289157:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009431cfc0/0x8a60d30f571ec955 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae6f expref: 295 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.289159:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727bd0a lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.289161:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136353180/0x8a60d30f5727bd11 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe31c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.289162:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727bd0a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.289168:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914216 00000100:00100000:0.0:1721880422.289171:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8065050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+295:2004:x1805522257703040:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.289174:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.289175:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.289177:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136353180/0x8a60d30f5727bd11 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.289178:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009431cfc0/0x8a60d30f571ec955 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae6f expref: 295 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.289182:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136353180/0x8a60d30f5727bd11 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.289183:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009431cfc0/0x8a60d30f571ec955 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae6f expref: 295 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.289185:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+295:2004:x1805522257702912:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 58us (98us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.289186:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136353180/0x8a60d30f5727bd11 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.289189:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914215 00010000:00010000:0.0:1721880422.289191:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009431cfc0/0x8a60d30f571ec955 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe31d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae6f expref: 295 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.289194:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136353180/0x8a60d30f5727bd11 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.289197:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.289198:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.289198:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136353180/0x8a60d30f5727bd11 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.289199:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727bd1f lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.289201:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353180 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.289202:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136353180/0x8a60d30f5727bd11 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.289203:0:16088:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727bcfc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.289204:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727bd1f lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe31d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.289206:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136353180/0x8a60d30f5727bd11 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.289209:0:16088:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727bcfc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.289211:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136353180/0x8a60d30f5727bd11 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.289212:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.289215:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136353180/0x8a60d30f5727bd11 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.289220:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8065050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+293:2004:x1805522257703040:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 49us (79us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.289221:0:16088:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727bcfc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.289224:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914216 00010000:00010000:1.0:1721880422.289227:0:16088:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727bcfc lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.289233:0:16088:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727bcfc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.289238:0:16088:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106fa80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.289241:0:16088:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727bcfc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.289247:0:16040:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727bd1f lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.289247:0:16088:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727bcfc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.289251:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801362d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+1944:3689:x1805522011683072:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3786us (3821us total) trans 4296020006 rc 0/0 00010000:00010000:0.0:1721880422.289254:0:16040:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727bd1f lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.289255:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632021 00010000:00010000:1.0:1721880422.289256:0:16088:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727bcfc lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.289261:0:16040:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727bd1f lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.289262:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727bcfc lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.289264:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011685632 00000100:00100000:3.0:1721880422.289266:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011685632 00010000:00010000:0.0:1721880422.289268:0:16040:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727bd1f lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.289275:0:16040:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727bd1f lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.289275:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011685760 00000100:00100000:3.0:1721880422.289276:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011685760 00010000:00010000:0.0:1721880422.289281:0:16040:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352880 already unused, calling callback (ffffffffa084e330) 00000100:00100000:3.0:1721880422.289283:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011685504 00010000:00010000:0.0:1721880422.289284:0:16040:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727bd1f lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.289284:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011685504 00000100:00100000:3.0:1721880422.289290:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632030 00010000:00010000:0.0:1721880422.289291:0:16040:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727bd1f lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.289291:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2761:3686:x1805522011683328:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2108us (2143us total) trans 4296061703 rc 0/0 00000100:00100000:3.0:1721880422.289293:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+1944:3688:x1805522011685632:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.289295:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632022 00010000:00010000:0.0:1721880422.289300:0:16040:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727bd1f lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.289301:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64322 count 1 00010000:00010000:0.0:1721880422.289306:0:16040:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136352880/0x8a60d30f5727bd1f lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.289308:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632031 00010000:00010000:3.0:1721880422.289308:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727bd49 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.289312:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2760:3689:x1805522011685760:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1721880422.289315:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abeb3c0/0x8a60d30f5719a32c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c835 expref: 1310 pid: 16123 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.289319:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.289320:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.289322:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727bd49 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.289325:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58146 count 1 00010000:00010000:3.0:1721880422.289330:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009abeb3c0/0x8a60d30f5719a32c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c835 expref: 1310 pid: 16123 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.289335:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009abeb3c0/0x8a60d30f5719a32c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c835 expref: 1310 pid: 16123 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.289337:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727bd50 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe322:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.289341:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011686016:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.289348:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e76a880/0x8a60d30f571ec9e1 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aefb expref: 292 pid: 16039 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.289352:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdecb40 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.289354:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.289356:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.289358:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727bd50 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.289362:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011685888:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.289365:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880076fde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+1945:3687:x1805522011682304:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4090us (4115us total) trans 4296020007 rc 0/0 00000100:00100000:1.0:1721880422.289369:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632019 00000100:00100000:3.0:1721880422.289374:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.289375:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e76a880/0x8a60d30f571ec9e1 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aefb expref: 292 pid: 16039 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.289378:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011685888 00000100:00100000:1.0:1721880422.289380:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011685888 00010000:00010000:2.0:1721880422.289385:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e76a880/0x8a60d30f571ec9e1 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aefb expref: 292 pid: 16039 timeout: 887 lvb_type: 0 00000004:00080000:3.0:1721880422.289387:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801362daa00/2, rc 0, transno 1094407 00000100:00100000:1.0:1721880422.289390:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632032 00000100:00100000:1.0:1721880422.289393:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2762:3686:x1805522011685504:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1721880422.289393:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801362daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011683328:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.289395:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0000_UUID:16081:1805522011686144:192.168.201.24@tcp:104: 00002000:00080000:1.0:1721880422.289402:0:16088:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58145 count 1 00000100:00100000:3.0:1721880422.289405:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632033 00000100:00100000:3.0:1721880422.289407:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2762:3686:x1805522011685888:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.289409:0:16088:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009106c240/0x8a60d30f5727bd57 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe321:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.289412:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde840 going to sleep for 11 seconds 00002000:00080000:3.0:1721880422.289415:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58147 count 1 00000100:00100000:0.0:1721880422.289416:0:16040:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801362db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_040:lustre-MDT0000-mdtlov_UUID+2762:3689:x1805522011683712:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1978us (2008us total) trans 4296061704 rc 0/0 00010000:00010000:1.0:1721880422.289419:0:16088:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c4a9f80/0x8a60d30f571ec9c5 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aedf expref: 292 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.289422:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5f80/0x8a60d30f5727bd5e lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe323:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.289423:0:16040:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632024 00010000:00010000:1.0:1721880422.289424:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.289425:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.289428:0:16088:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009106c240/0x8a60d30f5727bd57 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.289428:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800729dd440/0x8a60d30f571ec9fd lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af17 expref: 292 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.289432:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.289433:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.289435:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5f80/0x8a60d30f5727bd5e lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.289444:0:16088:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c4a9f80/0x8a60d30f571ec9c5 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aedf expref: 292 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.289444:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800729dd440/0x8a60d30f571ec9fd lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af17 expref: 292 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.289449:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800729dd440/0x8a60d30f571ec9fd lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af17 expref: 292 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.289452:0:16088:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c4a9f80/0x8a60d30f571ec9c5 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aedf expref: 292 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.289455:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c7ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16125:1805522011686528:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.289462:0:16088:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba64e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0000_UUID:16088:1805522011686400:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.289465:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.289475:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1721880422.289478:0:16088:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522af00 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.289479:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011686272:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1721880422.289489:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.289498:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011686272 00000100:00100000:1.0:1721880422.289501:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011686272 00000004:00080000:3.0:1721880422.289509:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801362da300/2, rc 0, transno 1094408 00000100:00100000:0.0:1721880422.289514:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.289514:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801362da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011683712:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.289517:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632034 00000100:00100000:1.0:1721880422.289521:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2762:3686:x1805522011686272:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.289526:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257703168 00000100:00100000:2.0:1721880422.289528:0:16100:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801362d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:lustre-MDT0000-mdtlov_UUID+1945:3687:x1805522011682176:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4229us (4260us total) trans 4296020008 rc 0/0 00000100:00100000:0.0:1721880422.289529:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257703168 00002000:00080000:1.0:1721880422.289531:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58148 count 1 00000100:00100000:2.0:1721880422.289533:0:16100:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632020 00000100:00100000:3.0:1721880422.289534:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011686656:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.289540:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134b21d40/0x8a60d30f57197582 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c54f expref: 1311 pid: 10431 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.289540:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009106e640/0x8a60d30f5727bd65 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe324:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.289544:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.289550:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800729de640/0x8a60d30f571eca12 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe324:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af2c expref: 292 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.289556:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.289556:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011686656 00010000:00010000:1.0:1721880422.289557:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1721880422.289558:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914217 00000100:00100000:2.0:1721880422.289558:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011686656 00010000:00010000:1.0:1721880422.289560:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009106e640/0x8a60d30f5727bd65 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe324:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.289562:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088615180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1311:2004:x1805522257703168:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000004:00080000:3.0:1721880422.289569:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088615f80/2, rc 0, transno 1052710 00010000:00010000:0.0:1721880422.289570:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.289570:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632035 00010000:00010000:0.0:1721880422.289573:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134b21d40/0x8a60d30f57197582 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb3e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c54f expref: 1311 pid: 10431 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.289573:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2763:3688:x1805522011686656:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.289575:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800729de640/0x8a60d30f571eca12 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe324:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af2c expref: 292 pid: 16099 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.289580:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088615f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011683072:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.289582:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134b21d40/0x8a60d30f57197582 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb3e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c54f expref: 1311 pid: 10431 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.289584:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800729de640/0x8a60d30f571eca12 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe324:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af2c expref: 292 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.289593:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba67800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0000_UUID:16028:1805522011686784:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.289594:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134b21d40/0x8a60d30f57197582 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb3e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c54f expref: 1311 pid: 10431 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.289603:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.289605:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.289607:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727bd18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.289607:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.289608:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011686912:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.289613:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727bd18 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.289615:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.289624:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.289628:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.289634:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088615180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1310:2004:x1805522257703168:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 72us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.289641:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914217 00000004:00080000:2.0:1721880422.289641:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880076fdc380/2, rc 0, transno 1052712 00010000:00010000:3.0:1721880422.289645:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727bd18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.289648:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076fdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011682176:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.289650:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727bd18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.289655:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727bd18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.289656:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011685376 00000100:00100000:0.0:1721880422.289658:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011685376 00010000:00010000:3.0:1721880422.289658:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727bd18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.289662:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727bd18 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.289665:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b6640 already unused, calling callback (ffffffffa084e330) 00000100:00100000:0.0:1721880422.289667:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011686912 00010000:00010000:3.0:1721880422.289667:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727bd18 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.289668:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011686912 00010000:00010000:3.0:1721880422.289671:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727bd18 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.289676:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632036 00010000:00010000:3.0:1721880422.289678:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727bd18 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.289679:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+1946:3687:x1805522011685376:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.289682:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727bd18 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1721880422.289688:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64321 count 1 00000100:00100000:1.0:1721880422.289690:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.289691:0:16110:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801362d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_094:lustre-OST0000_UUID:16110:1805522011684224:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.289700:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727bd6c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb41:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.289704:0:16110:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136350000/0x8a60d30f5727bd26 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe31e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.289705:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257703296 00000100:00100000:1.0:1721880422.289708:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257703296 00010000:00010000:0.0:1721880422.289710:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fde1440/0x8a60d30f57198a97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb41:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c763 expref: 1309 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.289716:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.289717:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.289719:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727bd6c lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb41:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.289720:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009431f840/0x8a60d30f571ec971 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe31e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae8b expref: 293 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.289720:0:16100:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632037 00000100:00100000:2.0:1721880422.289725:0:16100:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:lustre-MDT0000-mdtlov_UUID+1947:3689:x1805522011686912:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.289755:0:16100:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64323 count 1 00000100:00100000:1.0:1721880422.289762:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914218 00010000:00010000:2.0:1721880422.289766:0:16100:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727bd73 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb43:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.289768:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+293:2004:x1805522257703296:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.289770:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+1947:3686:x1805522011683584:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2340us (2378us total) trans 4296020009 rc 0/0 00010000:00010000:1.0:1721880422.289775:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.289775:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632023 00010000:00010000:2.0:1721880422.289777:0:16100:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d1cc000/0x8a60d30f5719a5be lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c8f9 expref: 1309 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.289780:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009431f840/0x8a60d30f571ec971 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe31e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae8b expref: 293 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.289784:0:16100:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.289785:0:16100:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.289786:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fde1440/0x8a60d30f57198a97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb41:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c763 expref: 1309 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.289787:0:16100:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727bd73 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.289789:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009431f840/0x8a60d30f571ec971 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe31e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae8b expref: 293 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.289795:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fde1440/0x8a60d30f57198a97 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb41:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c763 expref: 1309 pid: 16060 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.289796:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011687040:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.289802:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009431f840/0x8a60d30f571ec971 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe31e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae8b expref: 293 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.289804:0:16100:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d1cc000/0x8a60d30f5719a5be lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c8f9 expref: 1309 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.289806:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088616680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011687168:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.289808:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.289812:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.289814:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.289814:0:16100:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d1cc000/0x8a60d30f5719a5be lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c8f9 expref: 1309 pid: 16100 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.289816:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136350000/0x8a60d30f5727bd26 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe31e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.289821:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012ba64700/2, rc 0, transno 1052713 00010000:00010000:1.0:1721880422.289824:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136350000/0x8a60d30f5727bd26 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe31e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.289824:0:16100:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_087:lustre-OST0001_UUID:16100:1805522011687296:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.289825:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36a80 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.289825:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012ba64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011683584:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.289840:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.289843:0:16100:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.289845:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011687040 00000100:00100000:3.0:1721880422.289847:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011687040 00000100:00100000:1.0:1721880422.289854:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+292:2004:x1805522257703296:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 86us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.289855:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632038 00010000:00010000:2.0:1721880422.289857:0:16110:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136350000/0x8a60d30f5727bd26 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.289858:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c40aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+1947:3686:x1805522011687040:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.289860:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914218 00010000:00010000:2.0:1721880422.289864:0:16110:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136350000/0x8a60d30f5727bd26 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.289865:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64324 count 1 00010000:00010000:3.0:1721880422.289871:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727bd7a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb44:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.289873:0:16110:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136350000/0x8a60d30f5727bd26 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.289878:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a50b8b40/0x8a60d30f5719a881 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c9a8 expref: 1309 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.289880:0:16110:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136350000/0x8a60d30f5727bd26 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.289882:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.289883:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.289884:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727bd7a lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.289886:0:16110:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136350000/0x8a60d30f5727bd26 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.289892:0:16110:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350000 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.289894:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a50b8b40/0x8a60d30f5719a881 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c9a8 expref: 1309 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.289895:0:16110:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136350000/0x8a60d30f5727bd26 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.289899:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a50b8b40/0x8a60d30f5719a881 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c9a8 expref: 1309 pid: 15506 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.289903:0:16110:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136350000/0x8a60d30f5727bd26 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.289905:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008777ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011687552:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.289913:0:16110:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136350000/0x8a60d30f5727bd26 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.289915:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec9c0 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.289920:0:16110:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136350000/0x8a60d30f5727bd26 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.289922:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1721880422.289925:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008c40b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011687424:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.289935:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.289947:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011687424 00000100:00100000:3.0:1721880422.289948:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011687424 00000100:00100000:3.0:1721880422.289965:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632039 00000100:00100000:3.0:1721880422.289968:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800952a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+1948:3686:x1805522011687424:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.289975:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64325 count 1 00010000:00010000:3.0:1721880422.289981:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727bd81 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb45:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.289987:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008cc1b180/0x8a60d30f5719abb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ca65 expref: 1309 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.289994:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.289995:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.289997:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727bd81 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.290006:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008cc1b180/0x8a60d30f5719abb4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ca65 expref: 1309 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.290010:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008cc1b180/0x8a60d30f5719abb4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ca65 expref: 1309 pid: 16100 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.290032:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800952a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011687680:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.290040:0:16110:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_094:lustre-MDT0000-mdtlov_UUID+2764:3688:x1805522011684096:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2395us (2434us total) trans 4296061705 rc 0/0 00000100:00100000:2.0:1721880422.290045:0:16110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632025 00000100:00100000:3.0:1721880422.290049:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec480 going to sleep for 11 seconds 00002000:00080000:2.0:1721880422.290063:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58149 count 1 00000004:00080000:3.0:1721880422.290064:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801362d8380/2, rc 0, transno 1094409 00000100:00100000:3.0:1721880422.290067:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801362d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011684096:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1721880422.290070:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136350480/0x8a60d30f5727bd88 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe325:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.290078:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095e80fc0/0x8a60d30f571eca2e lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af48 expref: 291 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.290082:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.290084:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1721880422.290084:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800952a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011687808:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1721880422.290085:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136350480/0x8a60d30f5727bd88 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.290096:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095e80fc0/0x8a60d30f571eca2e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af48 expref: 291 pid: 16099 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.290098:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.290101:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095e80fc0/0x8a60d30f571eca2e lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af48 expref: 291 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.290107:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:15453:1805522011687936:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.290116:0:16110:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011687808 00000100:00100000:0.0:1721880422.290120:0:16110:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011687808 00000100:00100000:2.0:1721880422.290133:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde540 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.290139:0:16110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632040 00000100:00100000:0.0:1721880422.290143:0:16110:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800952a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_094:lustre-MDT0000-mdtlov_UUID+2764:3688:x1805522011687808:12345-0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1721880422.290150:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880076fdca80/2, rc 0, transno 1052711 00000100:00100000:2.0:1721880422.290157:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076fdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011682304:0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.290163:0:16110:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58150 count 1 00010000:00010000:0.0:1721880422.290174:0:16110:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325cb40/0x8a60d30f5727bd8f lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe326:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.290182:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1721880422.290184:0:16110:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d0bbcc0/0x8a60d30f571eca4a lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe326:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af64 expref: 291 pid: 16099 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.290187:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800952a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011688064:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.290191:0:16110:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.290192:0:16110:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.290194:0:16110:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325cb40/0x8a60d30f5727bd8f lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe326:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.290206:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.290212:0:16110:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d0bbcc0/0x8a60d30f571eca4a lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe326:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af64 expref: 291 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.290221:0:16110:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d0bbcc0/0x8a60d30f571eca4a lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe326:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af64 expref: 291 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.290224:0:9458:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011688064 00000100:00100000:2.0:1721880422.290228:0:9458:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011688064 00000100:00100000:0.0:1721880422.290230:0:16110:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088615880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_094:lustre-OST0000_UUID:16110:1805522011688192:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.290243:0:9458:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632041 00000100:00100000:2.0:1721880422.290246:0:9458:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800952a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1949:3688:x1805522011688064:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.290254:0:16110:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec360c0 going to sleep for 11 seconds 00002000:00080000:2.0:1721880422.290254:0:9458:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64326 count 1 00010000:00010000:2.0:1721880422.290263:0:9458:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727bd96 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb46:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.290270:0:9458:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880123bfb3c0/0x8a60d30f5719ae38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10cb29 expref: 1309 pid: 16016 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.290274:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.290275:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.290277:0:9458:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727bd96 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.290286:0:9458:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880123bfb3c0/0x8a60d30f5719ae38 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10cb29 expref: 1309 pid: 16016 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.290291:0:9458:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880123bfb3c0/0x8a60d30f5719ae38 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10cb29 expref: 1309 pid: 16016 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.290298:0:9458:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011688320:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.290315:0:9458:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde600 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.290797:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f021500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:15466:1805522011684992:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.290807:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136350d80/0x8a60d30f5727bd34 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe320:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.290818:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.290962:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257703552 00000100:00100000:0.0:1721880422.290963:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.290967:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257703552 00000100:00100000:3.0:1721880422.290969:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c7c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011684864:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.290981:0:15444:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257703424 00010000:00010000:1.0:1721880422.290982:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c4a9b00/0x8a60d30f571ec9a9 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe320:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aec3 expref: 292 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.290982:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727bd2d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.290984:0:15444:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257703424 00010000:00010000:0.0:1721880422.290995:0:15444:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f65e880/0x8a60d30f5719843f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c698 expref: 1310 pid: 16049 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.290999:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914219 00000100:00100000:1.0:1721880422.291003:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088614700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+292:2005:x1805522257703552:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.291009:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.291032:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c4a9b00/0x8a60d30f571ec9a9 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe320:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aec3 expref: 292 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.291035:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914220 00000100:00100000:0.0:1721880422.291039:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088617b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1310:2004:x1805522257703424:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.291039:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c4a9b00/0x8a60d30f571ec9a9 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe320:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aec3 expref: 292 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.291045:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.291048:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f65e880/0x8a60d30f5719843f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb40:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c698 expref: 1310 pid: 16049 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.291049:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c4a9b00/0x8a60d30f571ec9a9 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe320:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aec3 expref: 292 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.291055:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f65e880/0x8a60d30f5719843f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb40:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c698 expref: 1310 pid: 16049 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.291057:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.291058:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.291060:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136350d80/0x8a60d30f5727bd34 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe320:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.291065:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f65e880/0x8a60d30f5719843f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb40:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c698 expref: 1310 pid: 16049 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.291065:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136350d80/0x8a60d30f5727bd34 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe320:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.291072:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.291073:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.291075:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727bd2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.291076:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.291080:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727bd2d lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.291083:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136350d80/0x8a60d30f5727bd34 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.291090:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136350d80/0x8a60d30f5727bd34 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.291095:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136350d80/0x8a60d30f5727bd34 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.291096:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.291096:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088614700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+291:2005:x1805522257703552:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 92us (279us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.291098:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136350d80/0x8a60d30f5727bd34 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.291100:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914219 00010000:00010000:2.0:1721880422.291103:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136350d80/0x8a60d30f5727bd34 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.291107:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350d80 already unused, calling callback (ffffffffa084e330) 00000100:00100000:0.0:1721880422.291109:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088617b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1309:2004:x1805522257703424:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 70us (147us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.291109:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136350d80/0x8a60d30f5727bd34 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.291112:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136350d80/0x8a60d30f5727bd34 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.291113:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914220 00010000:00010000:2.0:1721880422.291119:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136350d80/0x8a60d30f5727bd34 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.291122:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136350d80/0x8a60d30f5727bd34 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.291126:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727bd2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.291134:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727bd2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.291142:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727bd2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.291148:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727bd2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.291154:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727bd2d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.291160:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b5d40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.291163:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727bd2d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.291170:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727bd2d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.291179:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727bd2d lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.291186:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727bd2d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.291187:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.291197:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012ba66d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011685248:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.291210:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727bd42 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb3f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.291212:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f020e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2765:3688:x1805522011684736:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2810us (2835us total) trans 4296061706 rc 0/0 00000100:00100000:1.0:1721880422.291215:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.291217:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632027 00000100:00100000:0.0:1721880422.291221:0:15444:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257703680 00000100:00100000:0.0:1721880422.291223:0:15444:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257703680 00000100:00100000:1.0:1721880422.291224:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257703808 00000100:00100000:1.0:1721880422.291226:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257703808 00010000:00010000:0.0:1721880422.291232:0:15444:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c4aa880/0x8a60d30f571ec98d lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aea7 expref: 291 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.291236:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ea19b00/0x8a60d30f57197861 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb3f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c5fe expref: 1309 pid: 15497 timeout: 887 lvb_type: 0 00000004:00080000:2.0:1721880422.291239:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880076fddc00/2, rc 0, transno 1094410 00000100:00100000:2.0:1721880422.291245:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076fddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011684736:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1721880422.291250:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914221 00000100:00100000:0.0:1721880422.291253:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+291:2004:x1805522257703680:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.291258:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.291259:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914222 00010000:00010000:0.0:1721880422.291261:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c4aa880/0x8a60d30f571ec98d lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aea7 expref: 291 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.291262:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1309:2005:x1805522257703808:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.291267:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c4aa880/0x8a60d30f571ec98d lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aea7 expref: 291 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.291267:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.291270:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ea19b00/0x8a60d30f57197861 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb3f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c5fe expref: 1309 pid: 15497 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.291275:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.291276:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.291276:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ea19b00/0x8a60d30f57197861 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb3f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c5fe expref: 1309 pid: 15497 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.291277:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1721880422.291278:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727bd3b lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.291281:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727bd3b lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe31f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.291282:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011688448:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.291283:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ea19b00/0x8a60d30f57197861 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb3f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c5fe expref: 1309 pid: 15497 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.291289:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.291289:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.291290:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.291292:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727bd42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb3f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.291296:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727bd42 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb3f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.291298:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880076fdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+1950:3688:x1805522011684608:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2934us (2960us total) trans 4296020010 rc 0/0 00000100:00100000:2.0:1721880422.291300:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.291304:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+291:2004:x1805522257703680:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 50us (117us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.291304:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.291305:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632026 00000100:00100000:0.0:1721880422.291309:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914221 00000100:00100000:2.0:1721880422.291313:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011688448 00000100:00100000:2.0:1721880422.291315:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011688448 00000100:00100000:1.0:1721880422.291316:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1308:2005:x1805522257703808:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 53us (101us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.291320:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727bd42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.291320:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914222 00010000:00010000:0.0:1721880422.291324:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727bd42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.291329:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727bd42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.291333:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727bd42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.291335:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632042 00010000:00010000:0.0:1721880422.291336:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727bd42 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.291338:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801362d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2765:3687:x1805522011688448:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.291340:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106cb40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.291341:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727bd42 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.291345:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727bd42 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.291351:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727bd42 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.291353:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58151 count 1 00010000:00010000:3.0:1721880422.291355:0:16120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c4aa880/0x8a60d30f571ec98d lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe31f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aea7 expref: 290 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.291358:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727bd42 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.291361:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136351680/0x8a60d30f5727bd9d lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe327:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.291367:0:16120:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c7fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_104:lustre-OST0000_UUID:16120:1805522011685120:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.291369:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801353473c0/0x8a60d30f571eca66 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe327:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af80 expref: 289 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.291374:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.291375:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.291377:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136351680/0x8a60d30f5727bd9d lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe327:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.291379:0:16120:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727bd3b lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.291385:0:16120:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727bd3b lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.291387:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801353473c0/0x8a60d30f571eca66 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe327:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af80 expref: 289 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.291391:0:16120:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727bd3b lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.291398:0:16120:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727bd3b lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.291401:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801353473c0/0x8a60d30f571eca66 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe327:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af80 expref: 289 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.291405:0:16120:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727bd3b lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.291408:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801362db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:15466:1805522011688576:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.291411:0:16120:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727bd3b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.291421:0:16120:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b6ac0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.291424:0:16120:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727bd3b lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.291430:0:16120:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727bd3b lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.291433:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde3c0 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.291440:0:16120:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727bd3b lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.291446:0:16120:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727bd3b lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.291450:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800919c0000/2, rc 0, transno 1052714 00000100:00100000:2.0:1721880422.291455:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800919c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011684608:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.291476:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801362db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011688704:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.291489:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.291509:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011688704 00000100:00100000:3.0:1721880422.291513:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011688704 00000100:00100000:2.0:1721880422.291520:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f09ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0000_UUID:16081:1805522011686144:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.291531:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727bd50 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.291533:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632043 00000100:00100000:3.0:1721880422.291537:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801362d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+1951:3687:x1805522011688704:12345-0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1721880422.291543:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801362d8e00/2, rc 0, transno 1052715 00000100:00100000:2.0:1721880422.291547:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801362d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011684352:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.291548:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1951:3687:x1805522011684352:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2881us (3032us total) trans 4296020011 rc 0/0 00002000:00080000:3.0:1721880422.291549:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64327 count 1 00000100:00100000:0.0:1721880422.291555:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632029 00010000:00010000:3.0:1721880422.291559:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727bda4 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb47:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.291562:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.291570:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257703936 00000100:00100000:2.0:1721880422.291570:0:16100:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f09df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_087:lustre-OST0001_UUID:16100:1805522011687296:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.291570:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011eb7db00/0x8a60d30f5719b0ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10cbc3 expref: 1307 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.291572:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257703936 00010000:00010000:3.0:1721880422.291576:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.291577:0:16100:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727bd73 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.291577:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.291580:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727bda4 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.291581:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e76a880/0x8a60d30f571ec9e1 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aefb expref: 290 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.291586:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011688832:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.291590:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088616680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011687168:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.291592:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914223 00000100:00100000:1.0:1721880422.291595:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5276050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+290:2004:x1805522257703936:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.291597:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011eb7db00/0x8a60d30f5719b0ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10cbc3 expref: 1307 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.291600:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.291601:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.291602:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e76a880/0x8a60d30f571ec9e1 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aefb expref: 290 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.291603:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727bd6c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb41:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.291606:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011eb7db00/0x8a60d30f5719b0ed lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10cbc3 expref: 1307 pid: 16100 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.291608:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e76a880/0x8a60d30f571ec9e1 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aefb expref: 290 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.291615:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800952a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011688960:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.291616:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e76a880/0x8a60d30f571ec9e1 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe322:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aefb expref: 290 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.291619:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011688832 00000100:00100000:0.0:1721880422.291623:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011688832 00010000:00010000:1.0:1721880422.291624:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.291625:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.291627:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727bd50 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.291632:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727bd50 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe322:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.291639:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632044 00010000:00010000:1.0:1721880422.291640:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.291641:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdeccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.291644:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+1951:3688:x1805522011688832:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.291647:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727bd50 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.291651:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5276050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+289:2004:x1805522257703936:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 55us (89us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.291653:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727bd50 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1721880422.291655:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64328 count 1 00000100:00100000:1.0:1721880422.291657:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914223 00010000:00010000:2.0:1721880422.291658:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727bd50 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.291661:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727bd50 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.291665:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727bd50 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.291668:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352640 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.291670:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727bd50 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.291674:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727bd50 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.291680:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727bd50 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.291685:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136352640/0x8a60d30f5727bd50 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.291694:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012ba67800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0000_UUID:16028:1805522011686784:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.291704:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009106e640/0x8a60d30f5727bd65 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe324:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.291714:0:16088:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012ba64e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0000_UUID:16088:1805522011686400:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.291721:0:16088:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009106c240/0x8a60d30f5727bd57 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.291721:0:16120:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_104:lustre-MDT0000-mdtlov_UUID+2766:3687:x1805522011684480:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3110us (3227us total) trans 4296061707 rc 0/0 00000100:00100000:3.0:1721880422.291749:0:16120:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632028 00000100:00100000:1.0:1721880422.291757:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.291765:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257704064 00000100:00100000:1.0:1721880422.291767:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257704064 00010000:00010000:1.0:1721880422.291774:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009abeb3c0/0x8a60d30f5719a32c lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c835 expref: 1308 pid: 16123 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.291778:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c7ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16125:1805522011686528:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.291784:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914224 00000100:00100000:1.0:1721880422.291787:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1308:2005:x1805522257704064:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.291790:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5f80/0x8a60d30f5727bd5e lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.291791:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.291793:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009abeb3c0/0x8a60d30f5719a32c lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c835 expref: 1308 pid: 16123 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.291799:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009abeb3c0/0x8a60d30f5719a32c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c835 expref: 1308 pid: 16123 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.291806:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727bdab lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb48:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.291806:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.291807:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.291808:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727bd49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.291813:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727bd49 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.291816:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009202b840/0x8a60d30f5719b3fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10cc72 expref: 1308 pid: 16090 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.291816:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008777ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011687552:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.291819:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.291820:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.291820:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2766:3689:x1805522011685760:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2506us (2822us total) trans 4296061708 rc 0/0 00010000:00010000:0.0:1721880422.291821:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.291823:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727bdab lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.291828:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632031 00000100:00100000:1.0:1721880422.291829:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1308:2005:x1805522257704064:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 40us (71us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.291830:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727bd7a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.291833:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914224 00010000:00010000:0.0:1721880422.291839:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009202b840/0x8a60d30f5719b3fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10cc72 expref: 1307 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.291846:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009202b840/0x8a60d30f5719b3fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10cc72 expref: 1307 pid: 16090 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.291847:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abeb3c0/0x8a60d30f5719a32c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c835 expref: 1307 pid: 16123 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.291852:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088616680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011689088:192.168.201.24@tcp:104: 00000004:00080000:2.0:1721880422.291853:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012f09ce00/2, rc 0, transno 1094412 00000100:00100000:2.0:1721880422.291858:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f09ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011685760:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1721880422.291860:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011686016:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.291868:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36a80 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.291870:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727bd49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.291871:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.291875:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1721880422.291878:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727bd49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.291880:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257704320 00000100:00100000:2.0:1721880422.291880:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011689216:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.291882:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257704320 00010000:00010000:3.0:1721880422.291885:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727bd49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.291888:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c4a9f80/0x8a60d30f571ec9c5 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aedf expref: 289 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.291892:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.291892:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727bd49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.291895:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.291900:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727bd49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.291906:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727bd49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.291912:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257704576 00010000:00010000:3.0:1721880422.291912:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b5680 already unused, calling callback (ffffffffa084e330) 00000100:00100000:1.0:1721880422.291914:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257704576 00010000:00010000:3.0:1721880422.291915:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727bd49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.291919:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fde1440/0x8a60d30f57198a97 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb41:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c763 expref: 1307 pid: 16060 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.291922:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727bd49 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.291924:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801362d9c00/2, rc 0, transno 1094411 00010000:00010000:3.0:1721880422.291932:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727bd49 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.291933:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914225 00000100:00100000:2.0:1721880422.291934:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801362d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011684480:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1721880422.291937:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+289:2005:x1805522257704320:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.291941:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.291943:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c4a9f80/0x8a60d30f571ec9c5 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aedf expref: 289 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.291943:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727bd49 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.291946:0:7116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914226 00000100:00100000:2.0:1721880422.291950:0:7116:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088615180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1307:2005:x1805522257704576:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.291952:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c4a9f80/0x8a60d30f571ec9c5 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aedf expref: 289 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.291954:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011689216 00010000:00010000:2.0:1721880422.291956:0:7116:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1721880422.291957:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011689216 00010000:00010000:2.0:1721880422.291959:0:7116:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fde1440/0x8a60d30f57198a97 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb41:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c763 expref: 1307 pid: 16060 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.291960:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c4a9f80/0x8a60d30f571ec9c5 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe321:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aedf expref: 289 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.291965:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.291966:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.291967:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009106c240/0x8a60d30f5727bd57 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.291967:0:7116:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fde1440/0x8a60d30f57198a97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb41:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c763 expref: 1307 pid: 16060 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.291969:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632045 00010000:00010000:1.0:1721880422.291971:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009106c240/0x8a60d30f5727bd57 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe321:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.291973:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2766:3688:x1805522011689216:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1721880422.291976:0:7116:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fde1440/0x8a60d30f57198a97 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb41:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c763 expref: 1307 pid: 16060 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.291979:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00080000:0.0:1721880422.291981:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58152 count 1 00010000:00010000:2.0:1721880422.291984:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.291986:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.291988:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727bdb2 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe328:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.291988:0:7116:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727bd6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb41:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.291991:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+288:2005:x1805522257704320:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 53us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.291994:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914225 00010000:00010000:0.0:1721880422.291996:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e768000/0x8a60d30f571eca89 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe328:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12afa3 expref: 288 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.291996:0:7116:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727bd6c lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb41:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.292000:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.292001:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.292003:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727bdb2 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe328:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.292006:0:7116:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.292007:0:16088:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009106c240/0x8a60d30f5727bd57 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.292028:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e768000/0x8a60d30f571eca89 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe328:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12afa3 expref: 287 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.292029:0:16088:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009106c240/0x8a60d30f5727bd57 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.292035:0:16088:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009106c240/0x8a60d30f5727bd57 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.292036:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e768000/0x8a60d30f571eca89 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe328:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12afa3 expref: 287 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.292036:0:7116:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088615180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1306:2005:x1805522257704576:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 85us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.292041:0:7116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914226 00000100:00100000:0.0:1721880422.292042:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088614700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:15452:1805522011689344:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.292042:0:16088:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009106c240/0x8a60d30f5727bd57 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.292046:0:16088:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009106c240/0x8a60d30f5727bd57 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.292049:0:16088:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106c240 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.292051:0:16088:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009106c240/0x8a60d30f5727bd57 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.292055:0:16088:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009106c240/0x8a60d30f5727bd57 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.292060:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009ec36e40 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.292060:0:16088:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009106c240/0x8a60d30f5727bd57 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.292064:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009106c240/0x8a60d30f5727bd57 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.292068:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1721880422.292072:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135170000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011689472:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.292077:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727bd6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.292079:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+1952:3688:x1805522011685632:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2782us (3104us total) trans 4296020012 rc 0/0 00010000:00010000:0.0:1721880422.292082:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727bd6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.292085:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632030 00010000:00010000:0.0:1721880422.292086:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727bd6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.292088:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.292090:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727bd6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.292095:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727bd6c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.292098:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325f840 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.292100:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727bd6c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.292102:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011689472 00010000:00010000:0.0:1721880422.292104:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727bd6c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.292106:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011689472 00010000:00010000:0.0:1721880422.292112:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727bd6c lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.292115:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012f09e300/2, rc 0, transno 1052716 00010000:00010000:0.0:1721880422.292116:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727bd6c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.292119:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f09e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011685632:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.292122:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632046 00000100:00100000:3.0:1721880422.292126:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2768:3687:x1805522011689472:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.292137:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800919c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011689600:0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.292147:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58153 count 1 00000100:00100000:2.0:1721880422.292149:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.292158:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2768:3686:x1805522011685504:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2763us (3091us total) trans 4296061709 rc 0/0 00010000:00010000:3.0:1721880422.292158:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4b40/0x8a60d30f5727bdb9 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe329:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.292162:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011689600 00000100:00100000:1.0:1721880422.292162:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632032 00000100:00100000:0.0:1721880422.292164:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011689600 00010000:00010000:3.0:1721880422.292168:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b02a400/0x8a60d30f571eca9e lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe329:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12afb8 expref: 287 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.292174:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.292176:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.292178:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4b40/0x8a60d30f5727bdb9 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe329:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.292181:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632047 00000100:00100000:0.0:1721880422.292184:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+1952:3687:x1805522011689600:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.292192:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64329 count 1 00000100:00100000:1.0:1721880422.292195:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.292195:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b02a400/0x8a60d30f571eca9e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe329:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12afb8 expref: 287 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.292199:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727bdc0 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb49:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.292204:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b02a400/0x8a60d30f571eca9e lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe329:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12afb8 expref: 287 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.292207:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099daf3c0/0x8a60d30f5719b5a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10cd0c expref: 1305 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.292211:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.292212:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.292213:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727bdc0 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.292213:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.292213:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800952a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011687680:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.292214:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008777ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0000_UUID:16017:1805522011689728:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.292220:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257704704 00000100:00100000:1.0:1721880422.292222:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257704704 00010000:00010000:0.0:1721880422.292223:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099daf3c0/0x8a60d30f5719b5a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10cd0c expref: 1305 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.292226:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727bd81 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.292229:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099daf3c0/0x8a60d30f5719b5a1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10cd0c expref: 1306 pid: 16125 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.292231:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d1cc000/0x8a60d30f5719a5be lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c8f9 expref: 1306 pid: 16100 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.292235:0:7116:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257704192 00000100:00100000:3.0:1721880422.292236:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdecb40 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.292237:0:7116:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257704192 00000100:00100000:0.0:1721880422.292239:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088617b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011689856:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.292243:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914227 00000100:00100000:1.0:1721880422.292247:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1306:2005:x1805522257704704:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.292247:0:7116:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800729dd440/0x8a60d30f571ec9fd lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af17 expref: 288 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.292252:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1721880422.292254:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e480 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.292254:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d1cc000/0x8a60d30f5719a5be lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c8f9 expref: 1306 pid: 16100 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.292258:0:7116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914228 00010000:00010000:1.0:1721880422.292260:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d1cc000/0x8a60d30f5719a5be lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c8f9 expref: 1306 pid: 16100 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.292262:0:7116:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+288:2004:x1805522257704192:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000004:00080000:3.0:1721880422.292262:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012f09d180/2, rc 0, transno 1094413 00010000:00010000:1.0:1721880422.292267:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d1cc000/0x8a60d30f5719a5be lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c8f9 expref: 1306 pid: 16100 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.292267:0:7116:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.292270:0:7116:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800729dd440/0x8a60d30f571ec9fd lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af17 expref: 288 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.292270:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f09d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011685504:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.292274:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.292275:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.292276:0:7116:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800729dd440/0x8a60d30f571ec9fd lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af17 expref: 288 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.292277:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727bd73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.292280:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.292281:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727bd73 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.292285:0:7116:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800729dd440/0x8a60d30f571ec9fd lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe323:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af17 expref: 288 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.292290:0:8271:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257704448 00010000:00010000:1.0:1721880422.292291:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.292292:0:8271:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257704448 00010000:00010000:2.0:1721880422.292292:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.292293:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.292295:0:7116:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5f80/0x8a60d30f5727bd5e lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.292299:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1305:2005:x1805522257704704:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 53us (105us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.292300:0:7116:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5f80/0x8a60d30f5727bd5e lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe323:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.292301:0:8271:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800729de640/0x8a60d30f571eca12 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe324:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af2c expref: 288 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.292303:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914227 00010000:00010000:2.0:1721880422.292309:0:7116:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.292313:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914229 00000100:00100000:1.0:1721880422.292318:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088efd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+288:2004:x1805522257704448:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.292318:0:7116:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+288:2004:x1805522257704192:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 55us (104us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.292322:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.292322:0:7116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914228 00010000:00010000:1.0:1721880422.292325:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800729de640/0x8a60d30f571eca12 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe324:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af2c expref: 288 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.292326:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5f80/0x8a60d30f5727bd5e lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.292331:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800729de640/0x8a60d30f571eca12 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe324:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af2c expref: 287 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.292333:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5f80/0x8a60d30f5727bd5e lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.292338:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800729de640/0x8a60d30f571eca12 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe324:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af2c expref: 287 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.292338:0:16100:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727bd73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.292340:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5f80/0x8a60d30f5727bd5e lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.292343:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.292343:0:16100:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727bd73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.292344:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.292346:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009106e640/0x8a60d30f5727bd65 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe324:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.292346:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5f80/0x8a60d30f5727bd5e lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.292350:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009106e640/0x8a60d30f5727bd65 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe324:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.292352:0:16100:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727bd73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.292352:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5f80/0x8a60d30f5727bd5e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.292356:0:16100:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727bd73 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.292357:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.292358:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b5f80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.292360:0:16100:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727bd73 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.292360:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5f80/0x8a60d30f5727bd5e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.292363:0:16100:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352ac0 already unused, calling callback (ffffffffa084e330) 00000100:00100000:1.0:1721880422.292364:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088efd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+286:2004:x1805522257704448:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 46us (83us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.292365:0:16100:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727bd73 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.292367:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914229 00010000:00010000:3.0:1721880422.292367:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5f80/0x8a60d30f5727bd5e lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.292368:0:16100:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727bd73 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.292374:0:16100:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727bd73 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.292377:0:16100:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727bd73 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.292379:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009106e640/0x8a60d30f5727bd65 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.292381:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5f80/0x8a60d30f5727bd5e lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.292383:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009106e640/0x8a60d30f5727bd65 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.292387:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b5f80/0x8a60d30f5727bd5e lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.292388:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009106e640/0x8a60d30f5727bd65 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.292392:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009106e640/0x8a60d30f5727bd65 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.292396:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009106e640/0x8a60d30f5727bd65 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.292399:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106e640 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.292401:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009106e640/0x8a60d30f5727bd65 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.292402:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+1953:3687:x1805522011685376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2721us (2786us total) trans 4296020013 rc 0/0 00010000:00010000:1.0:1721880422.292405:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009106e640/0x8a60d30f5727bd65 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.292407:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632036 00010000:00010000:1.0:1721880422.292410:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009106e640/0x8a60d30f5727bd65 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.292413:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009106e640/0x8a60d30f5727bd65 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.292439:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.292447:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257704832 00000100:00100000:0.0:1721880422.292450:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257704832 00010000:00010000:0.0:1721880422.292458:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a50b8b40/0x8a60d30f5719a881 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c9a8 expref: 1305 pid: 15506 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.292461:0:16100:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_087:lustre-MDT0000-mdtlov_UUID+1953:3689:x1805522011686912:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2736us (2832us total) trans 4296020014 rc 0/0 00000100:00100000:2.0:1721880422.292465:0:16100:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632037 00000100:00100000:0.0:1721880422.292472:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914230 00000100:00100000:0.0:1721880422.292475:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ab4d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1305:2004:x1805522257704832:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.292480:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.292482:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2769:3686:x1805522011685888:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3072us (3105us total) trans 4296061710 rc 0/0 00010000:00010000:0.0:1721880422.292483:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a50b8b40/0x8a60d30f5719a881 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb44:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c9a8 expref: 1305 pid: 15506 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.292486:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f09c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:15453:1805522011687936:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.292486:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632033 00010000:00010000:0.0:1721880422.292490:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a50b8b40/0x8a60d30f5719a881 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb44:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c9a8 expref: 1305 pid: 15506 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.292491:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2769:3686:x1805522011686272:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2968us (2999us total) trans 4296061711 rc 0/0 00000100:00100000:1.0:1721880422.292495:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632034 00010000:00010000:2.0:1721880422.292495:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136350480/0x8a60d30f5727bd88 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.292502:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a50b8b40/0x8a60d30f5719a881 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb44:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10c9a8 expref: 1305 pid: 15506 timeout: 887 lvb_type: 0 00000004:00080000:3.0:1721880422.292506:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012f09e680/2, rc 0, transno 1094415 00000004:00080000:2.0:1721880422.292507:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012f09d500/2, rc 0, transno 1052717 00010000:00010000:0.0:1721880422.292509:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.292509:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f09e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011686272:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.292510:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.292511:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f09d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011685376:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.292512:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727bd7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.292516:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012f09fb80/2, rc 0, transno 1094414 00010000:00010000:0.0:1721880422.292517:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727bd7a lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.292519:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f09fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011685888:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1721880422.292526:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.292534:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727bd7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.292535:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ab4d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1304:2004:x1805522257704832:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 59us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.292538:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914230 00010000:00010000:3.0:1721880422.292541:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727bd7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.292547:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.292548:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727bd7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.292551:0:9458:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f09d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011688320:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.292554:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727bd7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.292562:0:9458:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727bd96 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.292565:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727bd7a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.292568:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257704960 00000100:00100000:0.0:1721880422.292570:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257704960 00010000:00010000:3.0:1721880422.292571:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b6d00 already unused, calling callback (ffffffffa084e330) 00000100:00100000:1.0:1721880422.292574:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.292574:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727bd7a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.292576:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008cc1b180/0x8a60d30f5719abb4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ca65 expref: 1304 pid: 16100 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.292580:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727bd7a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.292586:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257705216 00000100:00100000:0.0:1721880422.292587:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257705216 00000100:00100000:2.0:1721880422.292589:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914231 00010000:00010000:3.0:1721880422.292589:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727bd7a lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.292591:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.292593:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1304:2007:x1805522257704960:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.292594:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d0bbcc0/0x8a60d30f571eca4a lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe326:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af64 expref: 286 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.292596:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727bd7a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.292598:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.292601:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008cc1b180/0x8a60d30f5719abb4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb45:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ca65 expref: 1304 pid: 16100 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.292602:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257705088 00000100:00100000:0.0:1721880422.292604:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914232 00000100:00100000:1.0:1721880422.292604:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257705088 00000100:00100000:0.0:1721880422.292607:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+287:2005:x1805522257705216:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.292607:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008cc1b180/0x8a60d30f5719abb4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb45:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ca65 expref: 1304 pid: 16100 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.292612:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.292613:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095e80fc0/0x8a60d30f571eca2e lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af48 expref: 287 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.292614:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d0bbcc0/0x8a60d30f571eca4a lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe326:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af64 expref: 287 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.292615:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008cc1b180/0x8a60d30f5719abb4 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb45:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ca65 expref: 1304 pid: 16100 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.292620:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d0bbcc0/0x8a60d30f571eca4a lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe326:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af64 expref: 287 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.292622:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1721880422.292624:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914233 00010000:00010000:2.0:1721880422.292624:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.292625:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727bd81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.292626:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.292627:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1721880422.292627:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+287:2005:x1805522257705088:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.292629:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009325cb40/0x8a60d30f5727bd8f lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe326:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.292631:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.292632:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325cb40/0x8a60d30f5727bd8f lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe326:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.292633:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095e80fc0/0x8a60d30f571eca2e lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af48 expref: 287 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.292633:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727bd81 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.292639:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.292639:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095e80fc0/0x8a60d30f571eca2e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af48 expref: 287 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.292641:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.292646:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095e80fc0/0x8a60d30f571eca2e lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe325:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af48 expref: 287 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.292647:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+287:2005:x1805522257705216:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 40us (72us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.292650:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1303:2007:x1805522257704960:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 57us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.292651:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914232 00010000:00010000:1.0:1721880422.292653:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.292653:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914231 00010000:00010000:1.0:1721880422.292654:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.292656:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136350480/0x8a60d30f5727bd88 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.292660:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136350480/0x8a60d30f5727bd88 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe325:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.292666:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727bd81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.292670:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.292671:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727bd81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.292676:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727bd81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.292679:0:16110:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d0bbcc0/0x8a60d30f571eca4a lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe326:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af64 expref: 285 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.292679:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727bd81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.292680:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+285:2005:x1805522257705088:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 52us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.292683:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914233 00010000:00010000:2.0:1721880422.292683:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727bd81 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.292686:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b6400 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.292688:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727bd81 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.292690:0:16110:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088615880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_094:lustre-OST0000_UUID:16110:1805522011688192:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.292695:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727bd81 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.292700:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727bd81 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.292701:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c40aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+1953:3686:x1805522011687040:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2840us (2891us total) trans 4296020015 rc 0/0 00010000:00010000:0.0:1721880422.292702:0:16110:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325cb40/0x8a60d30f5727bd8f lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.292704:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.292704:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727bd81 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.292707:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632038 00010000:00010000:0.0:1721880422.292709:0:16110:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325cb40/0x8a60d30f5727bd8f lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.292710:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257705344 00000100:00100000:1.0:1721880422.292712:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257705344 00010000:00010000:0.0:1721880422.292716:0:16110:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325cb40/0x8a60d30f5727bd8f lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.292718:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880123bfb3c0/0x8a60d30f5719ae38 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10cb29 expref: 1303 pid: 16016 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.292723:0:16110:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325cb40/0x8a60d30f5727bd8f lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.292741:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914234 00000100:00100000:1.0:1721880422.292744:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+1303:2007:x1805522257705344:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.292748:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00080000:3.0:1721880422.292748:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012f09f480/2, rc 0, transno 1052719 00010000:00010000:1.0:1721880422.292750:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880123bfb3c0/0x8a60d30f5719ae38 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb46:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10cb29 expref: 1303 pid: 16016 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.292755:0:16110:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325cb40/0x8a60d30f5727bd8f lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.292756:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880123bfb3c0/0x8a60d30f5719ae38 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb46:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10cb29 expref: 1303 pid: 16016 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.292762:0:16110:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325cb40/0x8a60d30f5727bd8f lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.292764:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123bfb3c0/0x8a60d30f5719ae38 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb46:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10cb29 expref: 1303 pid: 16016 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.292764:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f09f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011687040:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.292768:0:16110:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325cb40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.292771:0:16110:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325cb40/0x8a60d30f5727bd8f lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.292773:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.292775:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.292777:0:16110:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325cb40/0x8a60d30f5727bd8f lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.292777:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727bd96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.292780:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011689984:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1721880422.292784:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727bd96 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.292787:0:16110:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325cb40/0x8a60d30f5727bd8f lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.292794:0:16110:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325cb40/0x8a60d30f5727bd8f lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.292799:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.292800:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.292810:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+1302:2007:x1805522257705344:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 64us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.292815:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914234 00000100:00100000:3.0:1721880422.292817:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1721880422.292824:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011690112:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.292841:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.292856:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800952a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+1953:3686:x1805522011687424:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2885us (2917us total) trans 4296020016 rc 0/0 00000100:00100000:2.0:1721880422.292862:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632039 00000100:00100000:3.0:1721880422.292865:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011690240:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.292873:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011689984 00000100:00100000:2.0:1721880422.292875:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011689984 00000100:00100000:3.0:1721880422.292878:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.292888:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011690112 00000100:00100000:2.0:1721880422.292890:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011690112 00000100:00100000:2.0:1721880422.292897:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011690240 00000004:00080000:3.0:1721880422.292897:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008c40b480/2, rc 0, transno 1052720 00000100:00100000:2.0:1721880422.292898:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011690240 00000100:00100000:3.0:1721880422.292914:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008c40b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011687424:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.292935:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632048 00000100:00100000:3.0:1721880422.292940:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2768:3688:x1805522011689984:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.292943:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632049 00000100:00100000:2.0:1721880422.292945:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+1954:3688:x1805522011690112:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.292952:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000407:58154 count 1 00002000:00080000:2.0:1721880422.292954:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64330 count 1 00010000:00010000:2.0:1721880422.292962:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727bdce lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb4a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.292962:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727bdc7 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe32a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.292969:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ea35f80/0x8a60d30f5719b864 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10cda6 expref: 1301 pid: 16055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.292972:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b028240/0x8a60d30f571ecaba lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe32a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12afd4 expref: 283 pid: 16099 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.292974:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632050 00010000:00010000:2.0:1721880422.292977:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1721880422.292978:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+1954:3686:x1805522011690240:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.292978:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.292978:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.292980:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727bdce lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.292980:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.292982:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727bdc7 lrc: 4/0,1 mode: --/PW res: [0x280000407:0xe32a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.292990:0:16088:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64331 count 1 00010000:00010000:2.0:1721880422.292990:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ea35f80/0x8a60d30f5719b864 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10cda6 expref: 1301 pid: 16055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.292998:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ea35f80/0x8a60d30f5719b864 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10cda6 expref: 1301 pid: 16055 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.292998:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b028240/0x8a60d30f571ecaba lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe32a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12afd4 expref: 283 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.293000:0:16088:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106cd80/0x8a60d30f5727bdd5 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb4b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.293008:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076fdfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011690496:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.293008:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b028240/0x8a60d30f571ecaba lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe32a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12afd4 expref: 283 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.293010:0:16088:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fb76880/0x8a60d30f5719bb04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ce63 expref: 1301 pid: 16037 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.293029:0:16110:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800952a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_094:lustre-MDT0000-mdtlov_UUID+2769:3688:x1805522011687808:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2868us (2912us total) trans 4296061712 rc 0/0 00010000:00010000:1.0:1721880422.293030:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.293032:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1721880422.293033:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008854c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16125:1805522011690624:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.293034:0:16088:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106cd80/0x8a60d30f5727bdd5 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.293035:0:16110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632040 00000100:00100000:2.0:1721880422.293035:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde600 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.293048:0:9458:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727bd96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.293052:0:16088:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fb76880/0x8a60d30f5719bb04 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ce63 expref: 1301 pid: 16037 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.293054:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec9c0 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.293055:0:9458:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727bd96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.293061:0:9458:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727bd96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.293062:0:16088:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fb76880/0x8a60d30f5719bb04 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ce63 expref: 1301 pid: 16037 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.293066:0:9458:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727bd96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.293068:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1721880422.293072:0:16088:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba64e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011690752:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.293073:0:9458:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727bd96 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.293076:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800952a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011690368:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.293079:0:9458:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352d00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.293082:0:9458:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727bd96 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.293087:0:9458:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727bd96 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.293089:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.293092:0:16088:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522af00 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.293096:0:9458:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727bd96 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.293101:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727bd96 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.293101:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.293108:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257705472 00000100:00100000:0.0:1721880422.293110:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011690368 00000100:00100000:1.0:1721880422.293111:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257705472 00000100:00100000:0.0:1721880422.293112:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011690368 00010000:00010000:1.0:1721880422.293122:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801353473c0/0x8a60d30f571eca66 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe327:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af80 expref: 284 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.293126:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632051 00000100:00100000:0.0:1721880422.293128:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008854dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+1955:3686:x1805522011690368:12345-0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1721880422.293133:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012f09c380/2, rc 0, transno 1052718 00002000:00080000:0.0:1721880422.293138:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64332 count 1 00000100:00100000:1.0:1721880422.293138:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914235 00000100:00100000:1.0:1721880422.293142:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088efd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+284:2004:x1805522257705472:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.293142:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f09c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011686912:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.293148:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727bddc lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb4c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.293148:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.293152:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801353473c0/0x8a60d30f571eca66 lrc: 5/0,0 mode: PW/PW res: [0x280000407:0xe327:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af80 expref: 284 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.293159:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ec58000/0x8a60d30f5719be7d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10cf82 expref: 1301 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.293161:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801353473c0/0x8a60d30f571eca66 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe327:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af80 expref: 284 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.293165:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.293167:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.293169:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727bddc lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.293172:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.293173:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.293176:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136351680/0x8a60d30f5727bd9d lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe327:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.293182:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136351680/0x8a60d30f5727bd9d lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe327:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.293183:0:9458:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800952a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+1956:3688:x1805522011688064:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2935us (2976us total) trans 4296020017 rc 0/0 00010000:00010000:0.0:1721880422.293185:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ec58000/0x8a60d30f5719be7d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10cf82 expref: 1301 pid: 16113 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.293187:0:9458:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632041 00000100:00100000:3.0:1721880422.293191:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1721880422.293193:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.293195:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ec58000/0x8a60d30f5719be7d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10cf82 expref: 1301 pid: 16113 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.293197:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008854df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011690880:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.293205:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088efc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011691008:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.293205:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088efd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+284:2004:x1805522257705472:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 61us (115us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.293208:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801353473c0/0x8a60d30f571eca66 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe327:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af80 expref: 284 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.293211:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914235 00000100:00100000:2.0:1721880422.293218:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801362db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:15466:1805522011688576:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.293219:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.293222:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3ed80 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.293226:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136351680/0x8a60d30f5727bd9d lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.293231:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136351680/0x8a60d30f5727bd9d lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.293239:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136351680/0x8a60d30f5727bd9d lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.293243:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136351680/0x8a60d30f5727bd9d lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.293245:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800952a0a80/2, rc 0, transno 1052721 00010000:00010000:2.0:1721880422.293246:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136351680/0x8a60d30f5727bd9d lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.293250:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136351680/0x8a60d30f5727bd9d lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.293252:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800952a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011688064:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.293253:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136351680 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.293255:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136351680/0x8a60d30f5727bd9d lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.293258:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136351680/0x8a60d30f5727bd9d lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.293262:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800952a2680/2, rc 0, transno 1094416 00010000:00010000:2.0:1721880422.293264:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136351680/0x8a60d30f5727bd9d lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.293266:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800952a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011687808:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1721880422.293267:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136351680/0x8a60d30f5727bd9d lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.293273:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1721880422.293281:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801341d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011691136:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.293301:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.293318:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011690880 00000100:00100000:3.0:1721880422.293322:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011690880 00000100:00100000:3.0:1721880422.293337:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011691136 00000100:00100000:3.0:1721880422.293340:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011691136 00000100:00100000:2.0:1721880422.293341:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801362d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2769:3687:x1805522011688448:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2002us (2040us total) trans 4296061713 rc 0/0 00000100:00100000:2.0:1721880422.293346:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632042 00000100:00100000:3.0:1721880422.293352:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632052 00000100:00100000:3.0:1721880422.293356:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+1957:3689:x1805522011690880:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.293357:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632053 00000100:00100000:2.0:1721880422.293360:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088615880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1957:3688:x1805522011691136:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.293367:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64333 count 1 00002000:00080000:2.0:1721880422.293368:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64334 count 1 00010000:00010000:2.0:1721880422.293377:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727bde3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb4e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.293378:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727bdea lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb4d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.293384:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880120237180/0x8a60d30f5719c3a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d0e7 expref: 1301 pid: 16083 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.293388:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.293389:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.293389:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e969440/0x8a60d30f5719c155 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d038 expref: 1301 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.293391:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727bde3 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.293394:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.293396:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.293398:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727bdea lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.293401:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880120237180/0x8a60d30f5719c3a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d0e7 expref: 1301 pid: 16083 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.293405:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880120237180/0x8a60d30f5719c3a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d0e7 expref: 1301 pid: 16083 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.293411:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076fdd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011691264:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.293415:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e969440/0x8a60d30f5719c155 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d038 expref: 1301 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.293425:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e969440/0x8a60d30f5719c155 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d038 expref: 1301 pid: 15506 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.293434:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801341d0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011691392:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.293436:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde3c0 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.293448:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136350480/0x8a60d30f5727bd88 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.293456:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136350480/0x8a60d30f5727bd88 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.293456:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec0c0 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.293461:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136350480/0x8a60d30f5727bd88 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.293464:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136350480/0x8a60d30f5727bd88 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.293468:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136350480/0x8a60d30f5727bd88 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.293471:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350480 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.293472:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136350480/0x8a60d30f5727bd88 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.293476:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136350480/0x8a60d30f5727bd88 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.293482:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136350480/0x8a60d30f5727bd88 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.293485:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136350480/0x8a60d30f5727bd88 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.293571:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2769:3688:x1805522011686656:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3996us (4025us total) trans 4296061714 rc 0/0 00000100:00100000:2.0:1721880422.293575:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632035 00000004:00080000:0.0:1721880422.293585:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122c7f800/2, rc 0, transno 1094418 00000100:00100000:0.0:1721880422.293589:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011686656:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1721880422.293594:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012f09c000/2, rc 0, transno 1094417 00000100:00100000:2.0:1721880422.293597:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f09c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011688448:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.294284:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088616680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011689088:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.294297:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800952a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011688960:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.294298:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727bdab lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.294310:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727bda4 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.294313:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088614700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:15452:1805522011689344:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.294325:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088617b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011689856:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.294326:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008777ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0000_UUID:16017:1805522011689728:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.294330:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727bdb2 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe328:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.294336:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727bdc0 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.294336:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4b40/0x8a60d30f5727bdb9 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe329:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.294393:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.294412:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.294457:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257705728 00000100:00100000:2.0:1721880422.294458:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257705600 00000100:00100000:2.0:1721880422.294461:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257705600 00000100:00100000:1.0:1721880422.294462:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257705728 00000100:00100000:0.0:1721880422.294467:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.294472:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009202b840/0x8a60d30f5719b3fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10cc72 expref: 1303 pid: 16090 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.294476:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257705856 00010000:00010000:1.0:1721880422.294476:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011eb7db00/0x8a60d30f5719b0ed lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10cbc3 expref: 1303 pid: 16100 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.294478:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257705856 00010000:00010000:0.0:1721880422.294487:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e768000/0x8a60d30f571eca89 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe328:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12afa3 expref: 283 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.294493:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914236 00000100:00100000:2.0:1721880422.294496:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8067050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1303:2004:x1805522257705600:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.294500:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914237 00010000:00010000:2.0:1721880422.294503:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.294506:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088617b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+1303:2005:x1805522257705728:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.294506:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009202b840/0x8a60d30f5719b3fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb48:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10cc72 expref: 1303 pid: 16090 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.294508:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914238 00000100:00100000:0.0:1721880422.294512:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088615180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+283:2005:x1805522257705856:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.294512:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009202b840/0x8a60d30f5719b3fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb48:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10cc72 expref: 1303 pid: 16090 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.294514:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.294517:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.294518:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011eb7db00/0x8a60d30f5719b0ed lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb47:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10cbc3 expref: 1303 pid: 16100 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.294520:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e768000/0x8a60d30f571eca89 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe328:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12afa3 expref: 283 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.294524:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009202b840/0x8a60d30f5719b3fd lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb48:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10cc72 expref: 1303 pid: 16090 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.294528:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011eb7db00/0x8a60d30f5719b0ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb47:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10cbc3 expref: 1303 pid: 16100 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.294530:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e768000/0x8a60d30f571eca89 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe328:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12afa3 expref: 283 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.294535:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.294537:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.294539:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e768000/0x8a60d30f571eca89 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe328:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12afa3 expref: 283 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.294540:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727bdab lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.294542:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011eb7db00/0x8a60d30f5719b0ed lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb47:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10cbc3 expref: 1302 pid: 16100 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.294547:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.294547:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727bdab lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.294548:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.294550:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727bdb2 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe328:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.294550:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.294551:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.294553:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727bda4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.294555:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727bdb2 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe328:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.294557:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727bda4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.294564:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.294564:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.294569:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727bdab lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.294576:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727bdab lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.294577:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088615180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+282:2005:x1805522257705856:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 65us (110us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.294577:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.294580:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727bdab lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.294582:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914238 00000100:00100000:2.0:1721880422.294583:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8067050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1301:2004:x1805522257705600:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 84us (168us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.294585:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727bdab lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.294590:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914236 00000100:00100000:1.0:1721880422.294595:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088617b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+1301:2005:x1805522257705728:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 89us (202us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.294597:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727bdab lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.294600:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914237 00010000:00010000:3.0:1721880422.294603:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325cfc0 already unused, calling callback (ffffffffa084e330) 00000100:00100000:0.0:1721880422.294604:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.294606:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727bdab lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.294612:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727bdab lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.294622:0:15444:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257705984 00010000:00010000:3.0:1721880422.294622:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727bdab lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.294624:0:15444:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257705984 00000100:00100000:0.0:1721880422.294625:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.294628:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727bdab lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.294630:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257706112 00000100:00100000:1.0:1721880422.294633:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257706112 00010000:00010000:2.0:1721880422.294634:0:15444:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b02a400/0x8a60d30f571eca9e lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe329:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12afb8 expref: 282 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.294640:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099daf3c0/0x8a60d30f5719b5a1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10cd0c expref: 1300 pid: 16125 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.294658:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914239 00000100:00100000:1.0:1721880422.294662:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914240 00000100:00100000:2.0:1721880422.294663:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088614700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+282:2004:x1805522257705984:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.294664:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727bda4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.294665:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088616680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+1300:2005:x1805522257706112:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.294669:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.294670:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.294670:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727bda4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.294672:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099daf3c0/0x8a60d30f5719b5a1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb49:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10cd0c expref: 1300 pid: 16125 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.294672:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b02a400/0x8a60d30f571eca9e lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe329:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12afb8 expref: 282 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.294676:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727bda4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.294679:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099daf3c0/0x8a60d30f5719b5a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb49:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10cd0c expref: 1300 pid: 16125 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.294679:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b02a400/0x8a60d30f571eca9e lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe329:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12afb8 expref: 282 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.294682:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727bda4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.294686:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099daf3c0/0x8a60d30f5719b5a1 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb49:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10cd0c expref: 1300 pid: 16125 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.294688:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b02a400/0x8a60d30f571eca9e lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe329:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12afb8 expref: 282 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.294689:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727bda4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.294692:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.294693:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.294694:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4900 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.294695:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727bdc0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.294696:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727bda4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.294701:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727bda4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.294702:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727bdc0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.294703:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.294704:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.294706:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4b40/0x8a60d30f5727bdb9 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe329:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.294709:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727bda4 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.294711:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4b40/0x8a60d30f5727bdb9 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe329:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.294714:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727bda4 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.294718:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.294720:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.294746:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727bdc0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.294752:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088616680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+1299:2005:x1805522257706112:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 86us (127us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.294755:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727bdc0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.294756:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914240 00000100:00100000:2.0:1721880422.294756:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088614700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+281:2004:x1805522257705984:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 91us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.294762:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914239 00010000:00010000:0.0:1721880422.294767:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727bdc0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.294772:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727bdb2 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.294775:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727bdc0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.294777:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727bdb2 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.294781:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727bdb2 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.294785:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727bdb2 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.294789:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727bdb2 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.294790:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076fdfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011690496:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.294792:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325c6c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.294794:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727bdb2 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.294801:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727bdb2 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.294804:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727bdce lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.294807:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727bdb2 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.294810:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009325c6c0/0x8a60d30f5727bdb2 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.294820:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4b40/0x8a60d30f5727bdb9 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.294827:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4b40/0x8a60d30f5727bdb9 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.294834:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727bdc0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.294835:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4b40/0x8a60d30f5727bdb9 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.294838:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801362d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+1958:3687:x1805522011688704:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3298us (3345us total) trans 4296020018 rc 0/0 00010000:00010000:0.0:1721880422.294841:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325df80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.294843:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4b40/0x8a60d30f5727bdb9 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.294844:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727bdc0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.294844:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632043 00010000:00010000:2.0:1721880422.294850:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4b40/0x8a60d30f5727bdb9 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.294851:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727bdc0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.294855:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4b40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.294857:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4b40/0x8a60d30f5727bdb9 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.294861:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727bdc0 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.294861:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4b40/0x8a60d30f5727bdb9 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.294867:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4b40/0x8a60d30f5727bdb9 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.294869:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727bdc0 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.294870:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b4b40/0x8a60d30f5727bdb9 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.294876:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008854c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0000_UUID:16125:1805522011690624:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.294888:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727bdc7 lrc: 3/0,1 mode: --/PW res: [0x280000407:0xe32a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.294904:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2769:3688:x1805522011689216:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2930us (3008us total) trans 4296061715 rc 0/0 00000100:00100000:1.0:1721880422.294909:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632045 00000100:00100000:1.0:1721880422.294930:0:16088:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012ba64e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011690752:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.294941:0:16088:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106cd80/0x8a60d30f5727bdd5 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.294963:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012f09df80/2, rc 0, transno 1094419 00000100:00100000:1.0:1721880422.294967:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f09df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011689216:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.294974:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2769:3687:x1805522011689472:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2847us (2885us total) trans 4296061716 rc 0/0 00000100:00100000:2.0:1721880422.294978:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632046 00000004:00080000:2.0:1721880422.295001:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880135170000/2, rc 0, transno 1094420 00000100:00100000:2.0:1721880422.295004:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135170000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011689472:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1721880422.295026:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801362db480/2, rc 0, transno 1052722 00000100:00100000:2.0:1721880422.295037:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801362db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011688704:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.295042:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+1959:3687:x1805522011689600:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2855us (2890us total) trans 4296020019 rc 0/0 00000004:00080000:2.0:1721880422.295045:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800919c2680/2, rc 0, transno 1052723 00000100:00100000:0.0:1721880422.295046:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632047 00000100:00100000:2.0:1721880422.295048:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800919c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011689600:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.295072:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.295078:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801341d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011691520:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.295086:0:7116:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257706240 00000100:00100000:3.0:1721880422.295090:0:7116:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257706240 00000100:00100000:2.0:1721880422.295093:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.295096:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.295103:0:7116:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ea35f80/0x8a60d30f5719b864 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10cda6 expref: 1299 pid: 16055 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.295105:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011691520 00000100:00100000:2.0:1721880422.295108:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011691520 00000100:00100000:2.0:1721880422.295119:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632054 00000100:00100000:3.0:1721880422.295119:0:7116:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257706368 00000100:00100000:2.0:1721880422.295122:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+1959:3686:x1805522011691520:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.295122:0:7116:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257706368 00010000:00010000:3.0:1721880422.295130:0:7116:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b028240/0x8a60d30f571ecaba lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe32a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12afd4 expref: 281 pid: 16099 timeout: 887 lvb_type: 0 00002000:00080000:2.0:1721880422.295133:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64335 count 1 00000100:00100000:0.0:1721880422.295142:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.295142:0:7116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914241 00010000:00010000:2.0:1721880422.295144:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727bdf1 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb4f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.295147:0:7116:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088617b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1299:2005:x1805522257706240:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.295154:0:7116:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.295155:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098d74b40/0x8a60d30f5719c5c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d196 expref: 1299 pid: 16031 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.295158:0:7116:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ea35f80/0x8a60d30f5719b864 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb4a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10cda6 expref: 1299 pid: 16055 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.295159:0:8271:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257706496 00010000:00010000:2.0:1721880422.295161:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1721880422.295162:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.295162:0:8271:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257706496 00010000:00010000:2.0:1721880422.295163:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.295165:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727bdf1 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.295167:0:7116:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ea35f80/0x8a60d30f5719b864 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb4a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10cda6 expref: 1300 pid: 16055 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.295170:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257706624 00010000:00010000:1.0:1721880422.295171:0:8271:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fb76880/0x8a60d30f5719bb04 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ce63 expref: 1300 pid: 16037 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.295173:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257706624 00010000:00010000:3.0:1721880422.295177:0:7116:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ea35f80/0x8a60d30f5719b864 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb4a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10cda6 expref: 1301 pid: 16055 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.295181:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ec58000/0x8a60d30f5719be7d lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10cf82 expref: 1301 pid: 16113 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.295182:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098d74b40/0x8a60d30f5719c5c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d196 expref: 1301 pid: 16031 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.295185:0:8271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914242 00000100:00100000:1.0:1721880422.295188:0:8271:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092318e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+281:2005:x1805522257706368:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.295188:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.295190:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.295192:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098d74b40/0x8a60d30f5719c5c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d196 expref: 1300 pid: 16031 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.295193:0:8271:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.295193:0:7116:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727bdce lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.295195:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914243 00010000:00010000:1.0:1721880422.295196:0:8271:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b028240/0x8a60d30f571ecaba lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe32a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12afd4 expref: 281 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.295198:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092318000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1300:2006:x1805522257706496:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.295199:0:7116:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727bdce lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.295202:0:8271:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b028240/0x8a60d30f571ecaba lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe32a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12afd4 expref: 281 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.295202:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801362db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011691776:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.295204:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.295207:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fb76880/0x8a60d30f5719bb04 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb4b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ce63 expref: 1300 pid: 16037 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.295211:0:8271:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b028240/0x8a60d30f571ecaba lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe32a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12afd4 expref: 281 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.295213:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fb76880/0x8a60d30f5719bb04 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb4b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ce63 expref: 1300 pid: 16037 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.295219:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.295219:0:7116:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.295220:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.295222:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fb76880/0x8a60d30f5719bb04 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb4b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ce63 expref: 1300 pid: 16037 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.295222:0:8271:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727bdc7 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe32a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.295223:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde600 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.295226:0:8271:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727bdc7 lrc: 4/0,1 mode: PW/PW res: [0x280000407:0xe32a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.295230:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.295231:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.295233:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106cd80/0x8a60d30f5727bdd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.295235:0:8271:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.295237:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106cd80/0x8a60d30f5727bdd5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.295237:0:7116:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088617b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1299:2005:x1805522257706240:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 89us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.295238:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914244 00000100:00100000:3.0:1721880422.295244:0:7116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914241 00000100:00100000:2.0:1721880422.295245:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e194850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1299:2004:x1805522257706624:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.295247:0:8271:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880092318e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+280:2005:x1805522257706368:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 59us (150us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.295251:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.295251:0:8271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914242 00010000:00010000:2.0:1721880422.295253:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.295258:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ec58000/0x8a60d30f5719be7d lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10cf82 expref: 1298 pid: 16113 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.295264:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880092318000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1298:2006:x1805522257706496:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 65us (121us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.295265:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727bdce lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.295267:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ec58000/0x8a60d30f5719be7d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10cf82 expref: 1298 pid: 16113 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.295268:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914243 00010000:00010000:1.0:1721880422.295271:0:16088:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106cd80/0x8a60d30f5727bdd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.295271:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727bdce lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.295275:0:16088:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106cd80/0x8a60d30f5727bdd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.295278:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727bdce lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.295279:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.295281:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.295283:0:16088:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106cd80/0x8a60d30f5727bdd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.295283:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727bddc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.295284:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727bdce lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.295287:0:16088:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106cd80/0x8a60d30f5727bdd5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.295288:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076fdd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011691264:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.295290:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727bdce lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.295291:0:16088:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106cd80/0x8a60d30f5727bdd5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.295291:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727bddc lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.295294:0:16088:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106cd80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.295295:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353a80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.295296:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727bde3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.295296:0:16088:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106cd80/0x8a60d30f5727bdd5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.295297:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727bdce lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.295299:0:16088:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106cd80/0x8a60d30f5727bdd5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.295301:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.295303:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727bdce lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.295305:0:16088:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106cd80/0x8a60d30f5727bdd5 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.295308:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106cd80/0x8a60d30f5727bdd5 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.295315:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e194850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1297:2004:x1805522257706624:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 70us (152us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.295315:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727bdce lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.295321:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914244 00010000:00010000:3.0:1721880422.295321:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727bdce lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.295348:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.295354:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257706752 00000100:00100000:2.0:1721880422.295357:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257706752 00010000:00010000:2.0:1721880422.295368:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880120237180/0x8a60d30f5719c3a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d0e7 expref: 1297 pid: 16083 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.295392:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+1961:3686:x1805522011690240:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2413us (2512us total) trans 4296020021 rc 0/0 00000100:00100000:2.0:1721880422.295393:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914245 00000100:00100000:0.0:1721880422.295396:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.295397:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632050 00000100:00100000:2.0:1721880422.295398:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092319180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1297:2005:x1805522257706752:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.295407:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.295411:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880120237180/0x8a60d30f5719c3a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb4e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d0e7 expref: 1297 pid: 16083 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.295415:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257706880 00000100:00100000:3.0:1721880422.295416:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+1960:3688:x1805522011690112:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2469us (2574us total) trans 4296020022 rc 0/0 00000100:00100000:1.0:1721880422.295418:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257706880 00010000:00010000:2.0:1721880422.295419:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880120237180/0x8a60d30f5719c3a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb4e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d0e7 expref: 1297 pid: 16083 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.295421:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632049 00010000:00010000:1.0:1721880422.295426:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e969440/0x8a60d30f5719c155 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d038 expref: 1298 pid: 15506 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.295432:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880120237180/0x8a60d30f5719c3a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb4e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d0e7 expref: 1298 pid: 16083 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.295435:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727bdc7 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.295439:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727bdc7 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.295441:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.295443:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.295443:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727bdc7 lrc: 3/0,1 mode: PW/PW res: [0x280000407:0xe32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.295445:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727bde3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.295446:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914246 00010000:00010000:3.0:1721880422.295447:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727bdc7 lrc: 2/0,0 mode: PW/PW res: [0x280000407:0xe32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.295449:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092319f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1297:2005:x1805522257706880:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.295450:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727bdc7 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.295452:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727bde3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.295453:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b7cc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.295455:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.295455:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727bdc7 lrc: 3/0,0 mode: PW/PW res: [0x280000407:0xe32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.295457:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e969440/0x8a60d30f5719c155 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb4d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d038 expref: 1297 pid: 15506 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.295460:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727bdc7 lrc: 4/0,0 mode: PW/PW res: [0x280000407:0xe32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.295463:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e969440/0x8a60d30f5719c155 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb4d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d038 expref: 1297 pid: 15506 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.295465:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.295465:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727bdc7 lrc: 2/0,0 mode: --/PW res: [0x280000407:0xe32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.295468:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727bde3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.295469:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727bdc7 lrc: 0/0,0 mode: --/PW res: [0x280000407:0xe32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.295471:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.295471:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.295473:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727bde3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.295473:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727bdea lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb4d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.295477:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727bdea lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb4d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.295478:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727bde3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.295481:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727bde3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.295483:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880092319180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1297:2005:x1805522257706752:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 85us (135us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.295485:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727bde3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.295485:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.295488:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350b40 already unused, calling callback (ffffffffa084e330) 00000100:00100000:2.0:1721880422.295489:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914245 00010000:00010000:0.0:1721880422.295491:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727bde3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.295495:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727bde3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.295497:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880092319f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1297:2005:x1805522257706880:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 47us (101us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.295501:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727bde3 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.295501:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914246 00010000:00010000:0.0:1721880422.295505:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727bde3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.295517:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012f09d880/2, rc 0, transno 1052725 00010000:00010000:1.0:1721880422.295523:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ec58000/0x8a60d30f5719be7d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10cf82 expref: 1295 pid: 16113 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.295531:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f09d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011690240:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.295533:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088efc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011691008:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.295537:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1721880422.295541:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008854c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011691648:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.295544:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727bddc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.295549:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727bddc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.295552:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727bddc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.295556:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727bddc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.295558:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.295560:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727bddc lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.295564:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727bddc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.295567:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325c240 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.295569:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727bddc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.295572:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727bddc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.295576:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011691648 00000100:00100000:2.0:1721880422.295578:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011691648 00010000:00010000:1.0:1721880422.295581:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727bddc lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.295585:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727bddc lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.295595:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632055 00000100:00100000:2.0:1721880422.295600:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088615180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+1961:3686:x1805522011691648:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.295601:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088615880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1961:3688:x1805522011691136:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2238us (2298us total) trans 4296020023 rc 0/0 00000100:00100000:0.0:1721880422.295606:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632053 00002000:00080000:2.0:1721880422.295608:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64336 count 1 00000100:00100000:3.0:1721880422.295612:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2769:3688:x1805522011689984:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2671us (2811us total) trans 4296061717 rc 0/0 00010000:00010000:2.0:1721880422.295616:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727bdf8 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb50:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.295619:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632048 00010000:00010000:2.0:1721880422.295624:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800966a21c0/0x8a60d30f5719c7c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d237 expref: 1294 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.295628:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.295629:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.295630:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727bdf8 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.295640:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800966a21c0/0x8a60d30f5719c7c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d237 expref: 1294 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.295645:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800966a21c0/0x8a60d30f5719c7c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d237 expref: 1294 pid: 16110 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.295649:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+1961:3688:x1805522011688832:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4004us (4047us total) trans 4296020020 rc 0/0 00000100:00100000:2.0:1721880422.295652:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088616680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011692032:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.295655:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632044 00000100:00100000:2.0:1721880422.295671:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.295678:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008854dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+1960:3686:x1805522011690368:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2549us (2578us total) trans 4296020024 rc 0/0 00000100:00100000:1.0:1721880422.295683:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632051 00000004:00080000:0.0:1721880422.295686:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800952a0700/2, rc 0, transno 1052728 00000100:00100000:0.0:1721880422.295693:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800952a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011690368:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.295701:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008777ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011691904:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.295714:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1721880422.295754:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801341d0380/2, rc 0, transno 1052727 00000100:00100000:1.0:1721880422.295761:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801341d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011691136:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.295768:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880092318e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011692160:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1721880422.295769:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012f09c700/2, rc 0, transno 1052726 00000100:00100000:1.0:1721880422.295771:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f09c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011690112:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.295773:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011691904 00000004:00080000:1.0:1721880422.295777:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122c7f480/2, rc 0, transno 1094421 00000100:00100000:3.0:1721880422.295777:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011691904 00000100:00100000:1.0:1721880422.295779:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011689984:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1721880422.295783:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1721880422.295786:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012f09ed80/2, rc 0, transno 1052724 00000100:00100000:1.0:1721880422.295790:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f09ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011688832:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.295794:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011692160 00000100:00100000:3.0:1721880422.295795:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011692160 00000100:00100000:1.0:1721880422.295803:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632056 00000100:00100000:1.0:1721880422.295806:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+1961:3688:x1805522011691904:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.295808:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632057 00000100:00100000:3.0:1721880422.295812:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088614700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+1961:3689:x1805522011692160:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.295814:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e969440/0x8a60d30f5719c155 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d038 expref: 1294 pid: 15506 timeout: 887 lvb_type: 0 00002000:00080000:1.0:1721880422.295815:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64337 count 1 00010000:00010000:1.0:1721880422.295823:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727bdff lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb51:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.295823:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64338 count 1 00000100:00100000:2.0:1721880422.295825:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801341d0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011691392:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.295831:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800857fe640/0x8a60d30f5719ca0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d2df expref: 1293 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.295832:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727be06 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb52:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.295835:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.295835:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727bdea lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.295836:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.295837:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727bdff lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.295839:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727bdea lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.295841:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ef1f840/0x8a60d30f5719cc84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d38e expref: 1293 pid: 10431 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.295843:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727bdea lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.295847:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727bdea lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.295847:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.295848:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800857fe640/0x8a60d30f5719ca0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d2df expref: 1293 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.295849:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.295851:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727bdea lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.295851:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727be06 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.295854:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800857fe640/0x8a60d30f5719ca0e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d2df expref: 1293 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.295855:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727bdea lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.295858:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4000 already unused, calling callback (ffffffffa084e330) 00000100:00100000:1.0:1721880422.295860:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba65f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011692544:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.295860:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727bdea lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.295863:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727bdea lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.295865:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ef1f840/0x8a60d30f5719cc84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d38e expref: 1293 pid: 10431 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.295872:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ef1f840/0x8a60d30f5719cc84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d38e expref: 1293 pid: 10431 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.295873:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727bdea lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.295878:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727bdea lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.295879:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522af00 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.295880:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011692672:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.295891:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880092318000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011692288:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.295899:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.295908:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.295917:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011692288 00000100:00100000:0.0:1721880422.295920:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1721880422.295920:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011692288 00000100:00100000:0.0:1721880422.295923:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076fde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011692416:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.295935:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.295938:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632058 00000100:00100000:3.0:1721880422.295942:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076fdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+1963:3686:x1805522011692288:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.295952:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64339 count 1 00000100:00100000:1.0:1721880422.295953:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011692416 00000100:00100000:1.0:1721880422.295955:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011692416 00000100:00100000:2.0:1721880422.295955:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801362db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011691776:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.295961:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727be0d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb53:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.295968:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727bdf1 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.295969:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632059 00010000:00010000:3.0:1721880422.295971:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009594cb40/0x8a60d30f5719ce7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d436 expref: 1293 pid: 16108 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.295972:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076fde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1964:3686:x1805522011692416:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.295976:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.295977:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00002000:00080000:1.0:1721880422.295980:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64340 count 1 00010000:00010000:3.0:1721880422.295980:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727be0d lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.295981:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1721880422.295986:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727be14 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb54:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.295989:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076fdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011692800:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.295993:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fc8fcc0/0x8a60d30f5719d012 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d4f3 expref: 1293 pid: 16031 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.295993:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009594cb40/0x8a60d30f5719ce7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d436 expref: 1293 pid: 16108 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.296001:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.296001:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009594cb40/0x8a60d30f5719ce7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d436 expref: 1293 pid: 16108 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.296002:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.296003:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727be14 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.296009:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.296009:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011692928:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.296029:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fc8fcc0/0x8a60d30f5719d012 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d4f3 expref: 1293 pid: 16031 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.296035:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fc8fcc0/0x8a60d30f5719d012 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d4f3 expref: 1293 pid: 16031 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.296041:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba67b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011693056:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.296044:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011692800 00000100:00100000:3.0:1721880422.296046:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011692800 00000100:00100000:1.0:1721880422.296059:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a900 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.296062:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632060 00000100:00100000:3.0:1721880422.296065:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088617b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+1965:3689:x1805522011692800:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.296074:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64341 count 1 00010000:00010000:3.0:1721880422.296081:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727be1b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb55:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.296089:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bd02400/0x8a60d30f5719d1a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d571 expref: 1293 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.296094:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.296095:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.296097:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727be1b lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.296109:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bd02400/0x8a60d30f5719d1a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d571 expref: 1293 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.296111:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+1965:3689:x1805522011690880:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2752us (2890us total) trans 4296020025 rc 0/0 00000100:00100000:2.0:1721880422.296119:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632052 00010000:00010000:3.0:1721880422.296122:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bd02400/0x8a60d30f5719d1a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d571 expref: 1293 pid: 16089 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.296130:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011693184:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.296145:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdeccc0 going to sleep for 11 seconds 00000004:00080000:2.0:1721880422.296150:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008854df80/2, rc 0, transno 1052729 00000100:00100000:2.0:1721880422.296159:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008854df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011690880:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.296163:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdecb40 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.296181:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1721880422.296186:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011693312:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.296200:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.296212:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011693312 00000100:00100000:3.0:1721880422.296214:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011693312 00000100:00100000:1.0:1721880422.296220:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.296227:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632061 00000100:00100000:3.0:1721880422.296230:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1965:3688:x1805522011693312:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.296235:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257707008 00002000:00080000:3.0:1721880422.296237:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64342 count 1 00000100:00100000:0.0:1721880422.296238:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257707008 00010000:00010000:3.0:1721880422.296244:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727be22 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb56:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.296249:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098d74b40/0x8a60d30f5719c5c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d196 expref: 1294 pid: 16031 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.296250:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007b979f80/0x8a60d30f5719d425 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d60b expref: 1294 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.296254:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.296255:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.296257:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727be22 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.296261:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088616680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011692032:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.296266:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007b979f80/0x8a60d30f5719d425 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d60b expref: 1294 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.296271:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914247 00010000:00010000:3.0:1721880422.296271:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007b979f80/0x8a60d30f5719d425 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d60b expref: 1294 pid: 15466 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.296275:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1294:2004:x1805522257707008:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.296276:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727bdf8 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.296277:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011693440:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.296280:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.296283:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098d74b40/0x8a60d30f5719c5c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb4f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d196 expref: 1294 pid: 16031 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.296289:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098d74b40/0x8a60d30f5719c5c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb4f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d196 expref: 1294 pid: 16031 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.296294:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec000 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.296297:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098d74b40/0x8a60d30f5719c5c3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb4f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d196 expref: 1294 pid: 16031 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.296303:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.296304:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.296306:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727bdf1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.296311:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727bdf1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.296320:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.296325:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727bdf1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.296332:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727bdf1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.296333:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1293:2004:x1805522257707008:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 58us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.296336:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914247 00010000:00010000:2.0:1721880422.296337:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727bdf1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.296340:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727bdf1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.296344:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727bdf1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.296347:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801363521c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.296349:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727bdf1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.296352:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727bdf1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.296358:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727bdf1 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.296362:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727bdf1 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.296445:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.296453:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880076fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+1966:3686:x1805522011691520:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1329us (1358us total) trans 4296020026 rc 0/0 00000100:00100000:0.0:1721880422.296455:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257707136 00000100:00100000:0.0:1721880422.296457:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257707136 00000100:00100000:2.0:1721880422.296460:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632054 00010000:00010000:0.0:1721880422.296465:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800966a21c0/0x8a60d30f5719c7c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d237 expref: 1293 pid: 16110 timeout: 887 lvb_type: 0 00000004:00080000:1.0:1721880422.296470:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801341d2300/2, rc 0, transno 1052730 00000100:00100000:1.0:1721880422.296477:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801341d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011691520:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.296485:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914248 00000100:00100000:0.0:1721880422.296488:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076fdd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1293:2005:x1805522257707136:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.296493:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.296495:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800966a21c0/0x8a60d30f5719c7c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb50:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d237 expref: 1293 pid: 16110 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.296498:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011693568:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.296501:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800966a21c0/0x8a60d30f5719c7c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb50:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d237 expref: 1293 pid: 16110 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.296509:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800966a21c0/0x8a60d30f5719c7c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb50:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d237 expref: 1293 pid: 16110 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.296512:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.296515:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.296516:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.296517:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727bdf8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.296522:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727bdf8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.296523:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011693568 00000100:00100000:2.0:1721880422.296527:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011693568 00010000:00010000:0.0:1721880422.296531:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.296538:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727bdf8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.296539:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632062 00000100:00100000:2.0:1721880422.296541:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+1966:3686:x1805522011693568:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.296543:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880076fdd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1292:2005:x1805522257707136:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 55us (100us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.296543:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727bdf8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.296548:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727bdf8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.296550:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914248 00002000:00080000:2.0:1721880422.296550:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64343 count 1 00010000:00010000:3.0:1721880422.296552:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727bdf8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.296555:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727bdf8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.296558:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727be29 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb57:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.296558:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801363533c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.296560:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727bdf8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.296564:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727bdf8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.296566:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c534b40/0x8a60d30f5719d575 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d6a5 expref: 1291 pid: 16062 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.296570:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.296570:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727bdf8 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.296571:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.296573:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727be29 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.296574:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727bdf8 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.296583:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c534b40/0x8a60d30f5719d575 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d6a5 expref: 1291 pid: 16062 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.296588:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c534b40/0x8a60d30f5719d575 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d6a5 expref: 1291 pid: 16062 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.296594:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088616680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011693696:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.296612:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.296661:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088615180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+1967:3686:x1805522011691648:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1061us (1101us total) trans 4296020027 rc 0/0 00000100:00100000:3.0:1721880422.296665:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632055 00000004:00080000:1.0:1721880422.296667:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008854c380/2, rc 0, transno 1052731 00000100:00100000:1.0:1721880422.296676:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008854c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011691648:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.296792:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1721880422.296797:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076fdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011693824:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.296810:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.296835:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011693824 00000100:00100000:3.0:1721880422.296838:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011693824 00000100:00100000:3.0:1721880422.296849:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632063 00000100:00100000:3.0:1721880422.296852:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+1967:3686:x1805522011693824:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.296859:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64344 count 1 00010000:00010000:3.0:1721880422.296866:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727be30 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb58:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.296873:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009709ef40/0x8a60d30f5719d77b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d77e expref: 1291 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.296877:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.296878:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.296880:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727be30 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.296890:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009709ef40/0x8a60d30f5719d77b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d77e expref: 1291 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.296895:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009709ef40/0x8a60d30f5719d77b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d77e expref: 1291 pid: 15467 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.296901:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008c40aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011693952:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.296917:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec240 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.297028:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012ba65f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011692544:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.297041:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727bdff lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.297045:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f09ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011692672:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.297048:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.297055:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727be06 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.297061:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012ba67b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011693056:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.297071:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727be14 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.297106:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257707392 00000100:00100000:0.0:1721880422.297110:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257707392 00010000:00010000:0.0:1721880422.297123:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ef1f840/0x8a60d30f5719cc84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d38e expref: 1292 pid: 10431 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.297142:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914249 00000100:00100000:0.0:1721880422.297146:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cd23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1292:2006:x1805522257707392:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.297154:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.297157:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ef1f840/0x8a60d30f5719cc84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d38e expref: 1292 pid: 10431 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.297165:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ef1f840/0x8a60d30f5719cc84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d38e expref: 1292 pid: 10431 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.297177:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ef1f840/0x8a60d30f5719cc84 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d38e expref: 1292 pid: 10431 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.297188:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.297190:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.297193:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727be06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.297199:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727be06 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.297219:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.297226:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727be06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.297233:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727be06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.297238:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727be06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.297244:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727be06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.297247:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cd23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1291:2006:x1805522257707392:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 99us (198us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.297249:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727be06 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.297253:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914249 00010000:00010000:3.0:1721880422.297255:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b46c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.297257:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727be06 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.297268:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727be06 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.297276:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727be06 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.297282:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727be06 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.297316:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.297330:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257707520 00000100:00100000:1.0:1721880422.297331:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.297333:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257707520 00010000:00010000:0.0:1721880422.297342:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc8fcc0/0x8a60d30f5719d012 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d4f3 expref: 1291 pid: 16031 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.297353:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257707264 00000100:00100000:0.0:1721880422.297355:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257707264 00010000:00010000:0.0:1721880422.297360:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800857fe640/0x8a60d30f5719ca0e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d2df expref: 1292 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.297371:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.297379:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257707648 00000100:00100000:3.0:1721880422.297380:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f09dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011693184:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.297386:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914250 00000100:00100000:1.0:1721880422.297391:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914251 00000100:00100000:2.0:1721880422.297391:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1292:2004:x1805522257707520:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.297392:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727be1b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.297395:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e197c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+1292:2005:x1805522257707264:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.297398:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.297401:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fc8fcc0/0x8a60d30f5719d012 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d4f3 expref: 1292 pid: 16031 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.297402:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.297405:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800857fe640/0x8a60d30f5719ca0e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d2df expref: 1292 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.297408:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fc8fcc0/0x8a60d30f5719d012 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d4f3 expref: 1292 pid: 16031 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.297412:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800857fe640/0x8a60d30f5719ca0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d2df expref: 1292 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.297412:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f09f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011693440:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.297417:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fc8fcc0/0x8a60d30f5719d012 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d4f3 expref: 1292 pid: 16031 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.297421:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800857fe640/0x8a60d30f5719ca0e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d2df expref: 1292 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.297422:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727be22 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.297427:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.297428:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.297430:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727be14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.297434:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.297434:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727be14 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.297435:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.297437:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727bdff lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.297441:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727bdff lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.297446:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.297450:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.297451:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257707648 00000100:00100000:3.0:1721880422.297454:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088614700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+1968:3689:x1805522011692160:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1641us (1669us total) trans 4296020028 rc 0/0 00000100:00100000:3.0:1721880422.297460:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632057 00000100:00100000:2.0:1721880422.297464:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1291:2004:x1805522257707520:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 73us (149us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.297465:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bd02400/0x8a60d30f5719d1a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d571 expref: 1291 pid: 16089 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.297465:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e197c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+1291:2005:x1805522257707264:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 69us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.297468:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914250 00000100:00100000:1.0:1721880422.297471:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914251 00000100:00100000:2.0:1721880422.297480:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914252 00000100:00100000:2.0:1721880422.297484:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1289:2005:x1805522257707648:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.297484:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f09ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011692928:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.297488:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.297490:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bd02400/0x8a60d30f5719d1a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb55:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d571 expref: 1289 pid: 16089 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.297493:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727be0d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.297497:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bd02400/0x8a60d30f5719d1a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb55:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d571 expref: 1289 pid: 16089 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.297503:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727bdff lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.297504:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bd02400/0x8a60d30f5719d1a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb55:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d571 expref: 1289 pid: 16089 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.297507:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727bdff lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.297510:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.297511:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.297512:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727bdff lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.297513:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727be1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.297515:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727bdff lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.297517:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727be1b lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.297519:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727bdff lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.297524:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.297526:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106eac0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.297528:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727bdff lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.297532:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727bdff lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.297534:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1288:2005:x1805522257707648:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 51us (165us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.297534:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727be1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.297537:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727bdff lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.297538:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914252 00010000:00010000:1.0:1721880422.297541:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727bdff lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.297541:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727be1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.297548:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727be1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.297549:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727be14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.297554:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727be14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.297554:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727be1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.297559:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727be14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.297561:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727be1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.297566:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727be14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.297567:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b7840 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.297569:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727be1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.297571:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727be14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.297574:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106ed00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.297575:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727be1b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.297576:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727be14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.297580:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727be14 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.297584:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727be1b lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.297585:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727be14 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.297588:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727be14 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.297591:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727be1b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.297620:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+1968:3688:x1805522011691904:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1812us (1904us total) trans 4296020029 rc 0/0 00000100:00100000:1.0:1721880422.297626:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632056 00000004:00080000:0.0:1721880422.297641:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008777ce00/2, rc 0, transno 1052733 00000100:00100000:0.0:1721880422.297649:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008777ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011691904:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.297658:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.297672:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257707904 00000100:00100000:1.0:1721880422.297676:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257707904 00000100:00100000:0.0:1721880422.297678:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008cd23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011694080:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.297687:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009594cb40/0x8a60d30f5719ce7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d436 expref: 1288 pid: 16108 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.297687:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880076fde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1969:3686:x1805522011692416:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1713us (1750us total) trans 4296020030 rc 0/0 00000100:00100000:2.0:1721880422.297691:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632059 00000100:00100000:0.0:1721880422.297699:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.297709:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088617b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+1968:3689:x1805522011692800:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1641us (1698us total) trans 4296020031 rc 0/0 00000100:00100000:1.0:1721880422.297713:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914253 00000100:00100000:2.0:1721880422.297715:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011694080 00000100:00100000:3.0:1721880422.297715:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632060 00000100:00100000:1.0:1721880422.297718:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1288:2005:x1805522257707904:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.297719:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011694080 00010000:00010000:1.0:1721880422.297726:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.297758:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009594cb40/0x8a60d30f5719ce7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d436 expref: 1288 pid: 16108 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.297761:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632064 00010000:00010000:1.0:1721880422.297766:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009594cb40/0x8a60d30f5719ce7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d436 expref: 1288 pid: 16108 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.297767:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1968:3688:x1805522011694080:12345-0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1721880422.297775:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880076fde680/2, rc 0, transno 1052734 00010000:00010000:1.0:1721880422.297777:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009594cb40/0x8a60d30f5719ce7c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d436 expref: 1288 pid: 16108 timeout: 887 lvb_type: 0 00002000:00080000:2.0:1721880422.297779:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64345 count 1 00000100:00100000:0.0:1721880422.297780:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076fde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011692416:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.297788:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.297790:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.297790:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727be37 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb59:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.297792:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727be0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.297798:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727be0d lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.297800:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1721880422.297801:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801202f3180/0x8a60d30f5719d942 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d826 expref: 1287 pid: 16074 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.297804:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011694208:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.297807:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.297809:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.297811:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.297811:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727be37 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.297817:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.297828:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1287:2005:x1805522257707904:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 109us (170us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.297828:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801202f3180/0x8a60d30f5719d942 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d826 expref: 1287 pid: 16074 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.297830:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011694208 00000100:00100000:0.0:1721880422.297833:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011694208 00000100:00100000:1.0:1721880422.297834:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914253 00010000:00010000:2.0:1721880422.297838:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801202f3180/0x8a60d30f5719d942 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d826 expref: 1287 pid: 16074 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.297845:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632065 00000100:00100000:2.0:1721880422.297847:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801341d0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011694336:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.297848:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+1969:3688:x1805522011694208:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.297854:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727be0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1721880422.297856:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64346 count 1 00010000:00010000:3.0:1721880422.297862:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727be0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.297865:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727be3e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb5a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.297867:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde600 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.297869:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727be0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.297872:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008427ba80/0x8a60d30f5719db87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d8b9 expref: 1286 pid: 16074 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.297875:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727be0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.297877:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.297878:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.297879:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727be3e lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.297882:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727be0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.297888:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b5440 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.297889:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008427ba80/0x8a60d30f5719db87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d8b9 expref: 1286 pid: 16074 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.297889:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880076fdce00/2, rc 0, transno 1052735 00010000:00010000:3.0:1721880422.297891:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727be0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.297895:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008427ba80/0x8a60d30f5719db87 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d8b9 expref: 1286 pid: 16074 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.297897:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727be0d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.297900:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076fdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011692800:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.297902:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094634000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011694464:192.168.201.24@tcp:104: 00000004:00080000:2.0:1721880422.297907:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880092318e00/2, rc 0, transno 1052732 00010000:00010000:3.0:1721880422.297907:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727be0d lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.297910:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880092318e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011692160:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.297914:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727be0d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.297928:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880136398e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011694592:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.297932:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.297944:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.297948:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257707776 00000100:00100000:1.0:1721880422.297952:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257707776 00000100:00100000:0.0:1721880422.297961:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1721880422.297963:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007b979f80/0x8a60d30f5719d425 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d60b expref: 1287 pid: 15466 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.297964:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880136398a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011694720:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.297965:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011694592 00000100:00100000:3.0:1721880422.297969:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011694592 00000100:00100000:2.0:1721880422.297972:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088616680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011693696:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.297975:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.297980:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914254 00010000:00010000:2.0:1721880422.297981:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727be29 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.297985:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f020e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1287:2004:x1805522257707776:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.297988:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011694720 00000100:00100000:0.0:1721880422.297990:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632066 00000100:00100000:3.0:1721880422.297990:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011694720 00010000:00010000:1.0:1721880422.297992:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1721880422.297993:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136398380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+1971:3686:x1805522011694592:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.297995:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007b979f80/0x8a60d30f5719d425 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d60b expref: 1287 pid: 15466 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.298001:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007b979f80/0x8a60d30f5719d425 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d60b expref: 1287 pid: 15466 timeout: 887 lvb_type: 0 00002000:00080000:0.0:1721880422.298002:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64347 count 1 00000100:00100000:3.0:1721880422.298005:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632067 00010000:00010000:0.0:1721880422.298009:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727be45 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb5b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.298009:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007b979f80/0x8a60d30f5719d425 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d60b expref: 1287 pid: 15466 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.298010:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136399c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+1971:3686:x1805522011694720:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.298022:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.298032:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.298033:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.298034:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727be22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.298035:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091b0e400/0x8a60d30f5719dcc9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d93e expref: 1286 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.298039:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727be22 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.298040:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.298041:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00002000:00080000:3.0:1721880422.298041:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64348 count 1 00010000:00010000:0.0:1721880422.298043:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727be45 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.298049:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.298051:0:8271:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257708032 00010000:00010000:3.0:1721880422.298051:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727be4c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb5c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.298054:0:8271:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257708032 00010000:00010000:0.0:1721880422.298062:0:8271:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c534b40/0x8a60d30f5719d575 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d6a5 expref: 1287 pid: 16062 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.298062:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008425a400/0x8a60d30f5719ddfd lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d9ae expref: 1287 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.298068:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.298069:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1721880422.298070:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f020e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1287:2004:x1805522257707776:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 86us (138us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.298071:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727be4c lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.298073:0:8271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914255 00000100:00100000:1.0:1721880422.298076:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914254 00000100:00100000:0.0:1721880422.298077:0:8271:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f021500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+1287:2004:x1805522257708032:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.298083:0:8271:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.298085:0:8271:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c534b40/0x8a60d30f5719d575 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d6a5 expref: 1286 pid: 16062 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.298088:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008425a400/0x8a60d30f5719ddfd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d9ae expref: 1286 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.298095:0:8271:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c534b40/0x8a60d30f5719d575 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d6a5 expref: 1286 pid: 16062 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.298098:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008425a400/0x8a60d30f5719ddfd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d9ae expref: 1286 pid: 16090 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.298104:0:8271:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c534b40/0x8a60d30f5719d575 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d6a5 expref: 1286 pid: 16062 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.298111:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.298112:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.298113:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011694848:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.298114:0:8271:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727be29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.298118:0:8271:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727be29 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.298132:0:8271:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.298135:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.298138:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdecb40 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.298144:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257708160 00000100:00100000:0.0:1721880422.298145:0:8271:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f021500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+1285:2004:x1805522257708032:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 68us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.298146:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257708160 00010000:00010000:2.0:1721880422.298148:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727be29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.298149:0:8271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914255 00010000:00010000:2.0:1721880422.298153:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727be29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.298154:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009709ef40/0x8a60d30f5719d77b lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d77e expref: 1286 pid: 15467 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.298158:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727be29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.298160:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008c40aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011693952:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.298161:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727be29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.298165:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727be29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.298167:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914256 00010000:00010000:2.0:1721880422.298168:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352400 already unused, calling callback (ffffffffa084e330) 00000100:00100000:0.0:1721880422.298170:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f022a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1285:2005:x1805522257708160:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.298170:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727be29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.298172:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727be30 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.298174:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727be29 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.298175:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.298178:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009709ef40/0x8a60d30f5719d77b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb58:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d77e expref: 1285 pid: 15467 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.298183:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727be29 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.298184:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009709ef40/0x8a60d30f5719d77b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d77e expref: 1285 pid: 15467 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.298185:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727be22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.298188:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727be29 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.298191:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727be22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.298193:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009709ef40/0x8a60d30f5719d77b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d77e expref: 1285 pid: 15467 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.298199:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.298199:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727be22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.298200:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.298202:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727be30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.298205:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727be22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.298206:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727be30 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.298212:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727be22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.298214:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.298218:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4d80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.298221:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727be22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.298223:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f022a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1284:2005:x1805522257708160:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 52us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.298226:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914256 00010000:00010000:3.0:1721880422.298232:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727be22 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.298242:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091b0e400/0x8a60d30f5719dcc9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d93e expref: 1283 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.298242:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727be22 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.298248:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091b0e400/0x8a60d30f5719dcc9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d93e expref: 1283 pid: 16018 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.298249:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727be22 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.298253:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013639aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011694976:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.298264:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e480 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.298277:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e180 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.298278:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+1972:3686:x1805522011693568:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1734us (1763us total) trans 4296020032 rc 0/0 00000100:00100000:2.0:1721880422.298284:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632062 00000004:00080000:1.0:1721880422.298287:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012ba65500/2, rc 0, transno 1052736 00000100:00100000:1.0:1721880422.298293:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012ba65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011693568:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.298321:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013639b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011695104:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.298336:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1721880422.298350:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012ba66680/2, rc 0, transno 1052737 00000100:00100000:0.0:1721880422.298353:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011695104 00000100:00100000:3.0:1721880422.298353:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1972:3688:x1805522011693312:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2120us (2150us total) trans 4296020033 rc 0/0 00000100:00100000:0.0:1721880422.298359:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011695104 00000100:00100000:3.0:1721880422.298359:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632061 00000100:00100000:1.0:1721880422.298360:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012ba66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011693312:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.298377:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727be30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.298384:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727be30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.298390:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727be30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.298391:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013639a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011695232:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.298395:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727be30 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.298399:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632068 00010000:00010000:3.0:1721880422.298400:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727be30 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.298402:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+1972:3688:x1805522011695104:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.298408:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.298409:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4240 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.298412:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727be30 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.298418:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011695232 00010000:00010000:3.0:1721880422.298418:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727be30 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.298420:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011695232 00010000:00010000:3.0:1721880422.298425:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727be30 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.298431:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727be30 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.298435:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632069 00000100:00100000:1.0:1721880422.298438:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f020380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1973:3689:x1805522011695232:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.298446:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64350 count 1 00010000:00010000:1.0:1721880422.298454:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727be53 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb5e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.298461:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009473a400/0x8a60d30f5719f09c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10e98a expref: 1283 pid: 15452 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1721880422.298465:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64349 count 1 00010000:00010000:1.0:1721880422.298465:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.298465:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.298467:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727be53 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.298474:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727be5a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb5d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.298477:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009473a400/0x8a60d30f5719f09c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10e98a expref: 1283 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.298482:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880120392f40/0x8a60d30f5719eec0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10e8e9 expref: 1283 pid: 16058 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.298483:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009473a400/0x8a60d30f5719f09c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10e98a expref: 1283 pid: 15452 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.298493:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba64a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011695360:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.298510:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a900 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.298517:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+1974:3686:x1805522011693824:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1663us (1705us total) trans 4296020034 rc 0/0 00000100:00100000:3.0:1721880422.298521:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632063 00010000:00010000:0.0:1721880422.298523:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000004:00080000:1.0:1721880422.298523:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880076fdd880/2, rc 0, transno 1052738 00010000:00010000:0.0:1721880422.298524:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.298527:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727be5a lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.298534:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076fdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011693824:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.298571:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880120392f40/0x8a60d30f5719eec0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10e8e9 expref: 1283 pid: 16058 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.298576:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880076fdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+1974:3686:x1805522011692288:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2633us (2666us total) trans 4296020035 rc 0/0 00010000:00010000:0.0:1721880422.298580:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880120392f40/0x8a60d30f5719eec0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10e8e9 expref: 1283 pid: 16058 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.298580:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632058 00000100:00100000:0.0:1721880422.298589:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013639bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011695616:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.298590:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801341d0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011694336:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.298597:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013639b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011695488:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.298600:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727be37 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.298610:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.298620:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011695488 00000004:00080000:1.0:1721880422.298622:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880092318000/2, rc 0, transno 1052739 00000100:00100000:3.0:1721880422.298622:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011695488 00000100:00100000:1.0:1721880422.298627:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880092318000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011692288:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.298632:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632070 00000100:00100000:3.0:1721880422.298634:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092319180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+1974:3686:x1805522011695488:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.298642:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64351 count 1 00000100:00100000:1.0:1721880422.298647:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1721880422.298649:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727be61 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb5f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.298650:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880092319f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011695744:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.298656:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007ca8d440/0x8a60d30f5719f335 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ea39 expref: 1283 pid: 16109 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.298657:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e600 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.298660:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.298661:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1721880422.298662:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.298663:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727be61 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.298671:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.298673:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007ca8d440/0x8a60d30f5719f335 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ea39 expref: 1283 pid: 16109 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.298678:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007ca8d440/0x8a60d30f5719f335 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ea39 expref: 1283 pid: 16109 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.298684:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011695872:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.298689:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257708288 00000100:00100000:1.0:1721880422.298691:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257708288 00000100:00100000:2.0:1721880422.298695:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011695744 00000100:00100000:2.0:1721880422.298699:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011695744 00010000:00010000:1.0:1721880422.298700:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801202f3180/0x8a60d30f5719d942 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d826 expref: 1284 pid: 16074 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.298703:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec240 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.298710:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914257 00000100:00100000:1.0:1721880422.298713:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f022680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1284:2004:x1805522257708288:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.298717:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.298717:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632071 00010000:00010000:1.0:1721880422.298720:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801202f3180/0x8a60d30f5719d942 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb59:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d826 expref: 1284 pid: 16074 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.298722:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076fdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1975:3686:x1805522011695744:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.298725:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801202f3180/0x8a60d30f5719d942 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb59:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d826 expref: 1284 pid: 16074 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.298755:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801202f3180/0x8a60d30f5719d942 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb59:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d826 expref: 1284 pid: 16074 timeout: 887 lvb_type: 0 00002000:00080000:2.0:1721880422.298756:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64352 count 1 00010000:00010000:1.0:1721880422.298761:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.298762:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.298764:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727be37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.298768:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727be37 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.298768:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727be68 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb60:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.298778:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.298779:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013065c900/0x8a60d30f5719f5a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10eafd expref: 1283 pid: 16118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.298783:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727be37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.298787:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.298787:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727be37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.298788:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.298791:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727be68 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.298791:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727be37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.298793:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f022680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1283:2004:x1805522257708288:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 79us (124us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.298795:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727be37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.298796:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914257 00010000:00010000:3.0:1721880422.298800:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727be37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.298803:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350240 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.298805:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727be37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.298808:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013065c900/0x8a60d30f5719f5a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10eafd expref: 1282 pid: 16118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.298808:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727be37 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.298814:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727be37 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.298815:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013065c900/0x8a60d30f5719f5a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10eafd expref: 1282 pid: 16118 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.298817:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727be37 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.298822:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f020700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011696000:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.298844:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde600 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.298900:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1976:3688:x1805522011694080:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1132us (1199us total) trans 4296020036 rc 0/0 00000004:00080000:1.0:1721880422.298905:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008cd23800/2, rc 0, transno 1052740 00000100:00100000:3.0:1721880422.298906:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632064 00000100:00100000:1.0:1721880422.298910:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008cd23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011694080:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.298928:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011696128:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.298940:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.298952:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011696128 00000100:00100000:3.0:1721880422.298956:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011696128 00000100:00100000:3.0:1721880422.298972:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632072 00000100:00100000:3.0:1721880422.298976:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088efd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1976:3688:x1805522011696128:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.298988:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64353 count 1 00010000:00010000:3.0:1721880422.298997:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727be6f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb61:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.299027:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134f5e1c0/0x8a60d30f5719f756 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10eb6d expref: 1282 pid: 16046 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.299034:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.299035:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.299038:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727be6f lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.299048:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013639aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011694976:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.299055:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134f5e1c0/0x8a60d30f5719f756 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10eb6d expref: 1282 pid: 16046 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.299060:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.299064:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134f5e1c0/0x8a60d30f5719f756 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10eb6d expref: 1282 pid: 16046 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.299068:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257708416 00000100:00100000:1.0:1721880422.299070:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257708416 00000100:00100000:3.0:1721880422.299074:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011696256:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.299077:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008425a400/0x8a60d30f5719ddfd lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d9ae expref: 1283 pid: 16090 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.299095:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914258 00000100:00100000:3.0:1721880422.299098:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec000 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.299099:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a70ed850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1283:2005:x1805522257708416:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.299103:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.299106:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008425a400/0x8a60d30f5719ddfd lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb5c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d9ae expref: 1283 pid: 16090 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.299111:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008425a400/0x8a60d30f5719ddfd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb5c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d9ae expref: 1283 pid: 16090 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.299117:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.299118:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.299120:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727be4c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb5c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.299122:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008425a400/0x8a60d30f5719ddfd lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb5c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d9ae expref: 1283 pid: 16090 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.299124:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727be4c lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb5c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.299131:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.299131:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f09ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011694848:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.299141:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a70ed850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1282:2005:x1805522257708416:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 42us (82us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.299145:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727be45 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.299145:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727be4c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.299146:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914258 00010000:00010000:3.0:1721880422.299151:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727be4c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.299162:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727be4c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.299169:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727be4c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.299175:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727be4c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.299180:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.299182:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727be4c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.299188:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b58c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.299191:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727be4c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.299196:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257708544 00010000:00010000:3.0:1721880422.299198:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727be4c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.299199:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257708544 00010000:00010000:1.0:1721880422.299206:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008427ba80/0x8a60d30f5719db87 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d8b9 expref: 1282 pid: 16074 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.299208:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727be4c lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.299214:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727be4c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.299215:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914259 00000100:00100000:1.0:1721880422.299217:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013639aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1282:2005:x1805522257708544:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.299223:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.299225:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008427ba80/0x8a60d30f5719db87 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb5a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d8b9 expref: 1282 pid: 16074 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.299230:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008427ba80/0x8a60d30f5719db87 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb5a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d8b9 expref: 1282 pid: 16074 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.299236:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.299237:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.299239:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727be3e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb5a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.299242:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727be3e lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb5a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.299249:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.299549:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88013639aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1282:2005:x1805522257708544:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 331us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.299553:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914259 00000100:00100000:1.0:1721880422.299572:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012ba64a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011695360:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.299575:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880136399c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+1977:3686:x1805522011694720:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1563us (1597us total) trans 4296020037 rc 0/0 00010000:00010000:1.0:1721880422.299580:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727be53 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.299582:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632067 00000004:00080000:2.0:1721880422.299596:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880136398a80/2, rc 0, transno 1052741 00000100:00100000:2.0:1721880422.299603:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880136398a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011694720:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.299623:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1721880422.299627:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011696384:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.299644:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.299658:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011696384 00000100:00100000:3.0:1721880422.299661:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011696384 00000100:00100000:3.0:1721880422.299678:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632073 00000100:00100000:3.0:1721880422.299683:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c84b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+1977:3688:x1805522011696384:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.299692:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00002000:00080000:3.0:1721880422.299693:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64354 count 1 00000100:00100000:1.0:1721880422.299700:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257708672 00010000:00010000:0.0:1721880422.299702:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008427ba80/0x8a60d30f5719db87 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d8b9 expref: 1281 pid: 16074 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.299702:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257708672 00010000:00010000:3.0:1721880422.299704:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727be76 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb62:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.299709:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091b0e400/0x8a60d30f5719dcc9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d93e expref: 1282 pid: 16018 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.299713:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094634000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011694464:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.299714:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097198900/0x8a60d30f5719f8ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ebf2 expref: 1281 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.299719:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914260 00010000:00010000:3.0:1721880422.299721:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1721880422.299722:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1281:2005:x1805522257708672:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.299723:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.299725:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727be76 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.299742:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.299744:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091b0e400/0x8a60d30f5719dcc9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb5b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d93e expref: 1281 pid: 16018 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.299750:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091b0e400/0x8a60d30f5719dcc9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb5b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d93e expref: 1281 pid: 16018 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.299757:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091b0e400/0x8a60d30f5719dcc9 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb5b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10d93e expref: 1281 pid: 16018 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.299761:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097198900/0x8a60d30f5719f8ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ebf2 expref: 1281 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.299764:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.299765:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.299767:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727be45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.299770:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097198900/0x8a60d30f5719f8ec lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ebf2 expref: 1280 pid: 15506 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.299771:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727be45 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.299780:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.299780:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011696512:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.299785:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727be3e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.299794:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727be3e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.299795:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1280:2005:x1805522257708672:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 72us (102us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.299800:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727be3e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.299800:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdecb40 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.299801:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914260 00000100:00100000:2.0:1721880422.299802:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.299806:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727be3e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.299811:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727be3e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.299811:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257708928 00000100:00100000:1.0:1721880422.299813:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257708928 00010000:00010000:0.0:1721880422.299817:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727be3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.299818:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007ca8d440/0x8a60d30f5719f335 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ea39 expref: 1280 pid: 16109 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.299821:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f09f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011695872:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.299822:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325db00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.299825:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727be3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.299831:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727be3e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.299834:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727be61 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.299835:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914261 00000100:00100000:1.0:1721880422.299838:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f023100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1280:2005:x1805522257708928:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.299842:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727be3e lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.299842:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.299844:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007ca8d440/0x8a60d30f5719f335 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb5f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ea39 expref: 1280 pid: 16109 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.299848:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727be3e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.299849:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007ca8d440/0x8a60d30f5719f335 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb5f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ea39 expref: 1280 pid: 16109 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.299856:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007ca8d440/0x8a60d30f5719f335 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb5f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ea39 expref: 1280 pid: 16109 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.299857:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.299861:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.299862:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.299863:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727be61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.299867:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727be61 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.299873:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257708800 00000100:00100000:3.0:1721880422.299877:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257708800 00010000:00010000:1.0:1721880422.299878:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.299887:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009473a400/0x8a60d30f5719f09c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10e98a expref: 1280 pid: 15452 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.299889:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f023100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1280:2005:x1805522257708928:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 50us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.299892:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914261 00000100:00100000:1.0:1721880422.299900:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914262 00000100:00100000:1.0:1721880422.299902:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f020e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1279:2005:x1805522257708800:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.299906:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.299908:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.299909:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009473a400/0x8a60d30f5719f09c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb5e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10e98a expref: 1279 pid: 15452 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.299909:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727be61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.299913:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009473a400/0x8a60d30f5719f09c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb5e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10e98a expref: 1279 pid: 15452 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.299916:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727be61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.299920:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009473a400/0x8a60d30f5719f09c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb5e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10e98a expref: 1279 pid: 15452 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.299925:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.299926:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.299926:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727be61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.299927:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727be53 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.299931:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727be53 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.299932:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727be61 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.299938:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.299939:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727be61 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.299944:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b61c0 already unused, calling callback (ffffffffa084e330) 00000100:00100000:0.0:1721880422.299945:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+1978:3688:x1805522011694208:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2096us (2127us total) trans 4296020038 rc 0/0 00010000:00010000:3.0:1721880422.299947:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727be61 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.299948:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f020e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1278:2005:x1805522257708800:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 45us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.299951:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632065 00000100:00100000:1.0:1721880422.299952:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914262 00010000:00010000:3.0:1721880422.299954:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727be61 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.299958:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257709056 00000100:00100000:1.0:1721880422.299960:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257709056 00010000:00010000:3.0:1721880422.299964:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727be61 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.299965:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880120392f40/0x8a60d30f5719eec0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10e8e9 expref: 1278 pid: 16058 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.299970:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727be61 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.299971:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013639bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011695616:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.299973:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914263 00000100:00100000:1.0:1721880422.299975:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f021500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1278:2005:x1805522257709056:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.299979:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.299981:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727be5a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.299981:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880120392f40/0x8a60d30f5719eec0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb5d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10e8e9 expref: 1278 pid: 16058 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.299986:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880120392f40/0x8a60d30f5719eec0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb5d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10e8e9 expref: 1278 pid: 16058 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.299994:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880120392f40/0x8a60d30f5719eec0 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb5d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10e8e9 expref: 1278 pid: 16058 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.299995:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.299997:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727be45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.299999:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.300000:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.300002:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727be45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.300002:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727be5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.300005:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727be5a lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.300006:0:8271:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257709184 00010000:00010000:0.0:1721880422.300007:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727be45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.300008:0:8271:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257709184 00010000:00010000:0.0:1721880422.300010:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727be45 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.300031:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.300032:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727be45 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.300036:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f020700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011696000:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.300036:0:8271:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013065c900/0x8a60d30f5719f5a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10eafd expref: 1278 pid: 16118 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.300037:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325fa80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.300040:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727be45 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.300042:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f021500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1278:2005:x1805522257709056:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 65us (135us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.300044:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727be45 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.300046:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914263 00010000:00010000:0.0:1721880422.300050:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727be45 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.300050:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727be68 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.300054:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727be45 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.300054:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914264 00000100:00100000:1.0:1721880422.300056:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f022a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1277:2005:x1805522257709184:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.300061:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.300063:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013065c900/0x8a60d30f5719f5a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb60:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10eafd expref: 1277 pid: 16118 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.300068:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013065c900/0x8a60d30f5719f5a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb60:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10eafd expref: 1277 pid: 16118 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.300078:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013065c900/0x8a60d30f5719f5a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb60:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10eafd expref: 1277 pid: 16118 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.300088:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.300090:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.300092:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727be68 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.300098:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727be68 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.300112:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.300112:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f09dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011696256:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.300124:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727be6f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.300133:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f022a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1276:2005:x1805522257709184:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 75us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.300139:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914264 00000100:00100000:0.0:1721880422.300149:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880136398380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+1979:3686:x1805522011694592:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2152us (2202us total) trans 4296020039 rc 0/0 00000100:00100000:0.0:1721880422.300155:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632066 00010000:00010000:1.0:1721880422.300156:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727be53 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.300163:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727be53 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.300168:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.300171:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727be53 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.300174:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727be5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.300180:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727be53 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.300182:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727be5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.300187:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727be53 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.300190:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727be5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.300193:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106f840 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.300196:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727be5a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.300196:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727be53 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.300202:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727be53 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.300204:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727be5a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.300210:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325c000 already unused, calling callback (ffffffffa084e330) 00000100:00100000:3.0:1721880422.300211:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880092319180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+1978:3686:x1805522011695488:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1573us (1597us total) trans 4296020040 rc 0/0 00010000:00010000:0.0:1721880422.300212:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727be5a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.300212:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727be53 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.300217:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632070 00010000:00010000:0.0:1721880422.300219:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727be5a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.300223:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727be53 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.300228:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88013639b800/2, rc 0, transno 1052744 00010000:00010000:0.0:1721880422.300230:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727be5a lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.300237:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727be5a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.300238:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013639b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011695488:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.300244:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257709312 00000100:00100000:1.0:1721880422.300247:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257709312 00000004:00080000:2.0:1721880422.300247:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880136398e00/2, rc 0, transno 1052743 00000100:00100000:2.0:1721880422.300251:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880136398e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011694592:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.300256:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134f5e1c0/0x8a60d30f5719f756 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10eb6d expref: 1276 pid: 16046 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.300266:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727be68 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.300276:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727be68 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.300280:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914265 00000100:00100000:3.0:1721880422.300281:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011696768:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.300284:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129d23050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1276:2007:x1805522257709312:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.300284:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727be68 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.300291:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.300292:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727be68 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.300294:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134f5e1c0/0x8a60d30f5719f756 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb61:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10eb6d expref: 1276 pid: 16046 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.300299:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727be68 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.300302:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134f5e1c0/0x8a60d30f5719f756 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb61:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10eb6d expref: 1276 pid: 16046 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.300303:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.300305:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353600 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.300308:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727be68 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.300313:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134f5e1c0/0x8a60d30f5719f756 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb61:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10eb6d expref: 1276 pid: 16046 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.300315:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727be68 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.300315:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1721880422.300319:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011696640:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.300322:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.300323:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.300326:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727be6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.300326:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727be68 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.300333:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727be6f lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.300338:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727be68 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.300344:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.300346:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.300366:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727be6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.300368:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880129d23050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1275:2007:x1805522257709312:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 83us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.300374:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914265 00010000:00010000:3.0:1721880422.300378:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727be6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.300385:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727be6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.300390:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727be6f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.300397:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727be6f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.300402:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4fc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.300405:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727be6f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.300412:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727be6f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.300423:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727be6f lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.300429:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727be6f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.300479:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+1980:3688:x1805522011695104:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2074us (2140us total) trans 4296020041 rc 0/0 00000100:00100000:2.0:1721880422.300482:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880076fdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1980:3686:x1805522011695744:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1759us (1818us total) trans 4296020042 rc 0/0 00000100:00100000:0.0:1721880422.300483:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632068 00000100:00100000:2.0:1721880422.300487:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632071 00000100:00100000:0.0:1721880422.300493:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011696768 00000100:00100000:0.0:1721880422.300496:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011696768 00000100:00100000:2.0:1721880422.300497:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011696640 00000100:00100000:2.0:1721880422.300499:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011696640 00000100:00100000:0.0:1721880422.300507:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632074 00000100:00100000:0.0:1721880422.300511:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+1981:3687:x1805522011696768:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.300511:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632075 00000100:00100000:2.0:1721880422.300513:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c40aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1981:3687:x1805522011696640:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.300520:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64356 count 1 00002000:00080000:2.0:1721880422.300522:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64355 count 1 00010000:00010000:0.0:1721880422.300528:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727be7d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb64:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.300529:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727be84 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb63:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.300538:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099b058c0/0x8a60d30f5719fd3e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ed50 expref: 1274 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.300538:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013063b180/0x8a60d30f5719fae4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10eca8 expref: 1274 pid: 16121 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.300540:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088efd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1981:3688:x1805522011696128:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1562us (1597us total) trans 4296020043 rc 0/0 00010000:00010000:0.0:1721880422.300543:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.300543:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.300544:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.300544:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.300545:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727be84 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.300546:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727be7d lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.300547:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632072 00010000:00010000:0.0:1721880422.300556:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099b058c0/0x8a60d30f5719fd3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ed50 expref: 1274 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.300556:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013063b180/0x8a60d30f5719fae4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10eca8 expref: 1274 pid: 16121 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.300561:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099b058c0/0x8a60d30f5719fd3e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ed50 expref: 1274 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.300561:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f020380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+1980:3689:x1805522011695232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2120us (2150us total) trans 4296020044 rc 0/0 00010000:00010000:2.0:1721880422.300562:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013063b180/0x8a60d30f5719fae4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10eca8 expref: 1274 pid: 16121 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.300568:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632069 00000100:00100000:0.0:1721880422.300569:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013639bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011696896:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.300569:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f020700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011697024:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.300585:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e600 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.300588:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde600 going to sleep for 11 seconds 00000004:00080000:1.0:1721880422.300594:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088efc380/2, rc 0, transno 1052747 00000100:00100000:1.0:1721880422.300600:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011696128:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1721880422.300606:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88013639a680/2, rc 0, transno 1052748 00000004:00080000:1.0:1721880422.300609:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88013639b100/2, rc 0, transno 1052745 00000100:00100000:2.0:1721880422.300609:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013639a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011695232:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.300613:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013639b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011695104:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1721880422.300622:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880092319f80/2, rc 0, transno 1052746 00000100:00100000:2.0:1721880422.300624:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880092319f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011695744:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1721880422.300626:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880094635880/2, rc 0, transno 1052742 00000100:00100000:1.0:1721880422.300630:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011694208:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.300639:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011697152:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.300658:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.300673:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011697664:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.300674:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f09ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011696512:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.300685:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.300686:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727be76 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.300694:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.300695:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1721880422.300696:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011697152 00000100:00100000:0.0:1721880422.300698:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011697152 00000100:00100000:1.0:1721880422.300700:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011697280:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.300701:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011697536:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.300708:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011697664 00000100:00100000:0.0:1721880422.300710:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011697664 00000100:00100000:1.0:1721880422.300712:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257709440 00000100:00100000:1.0:1721880422.300715:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257709440 00000100:00100000:0.0:1721880422.300718:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632076 00000100:00100000:0.0:1721880422.300720:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+1981:3688:x1805522011697152:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.300723:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.300726:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097198900/0x8a60d30f5719f8ec lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ebf2 expref: 1275 pid: 15506 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.300747:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011697536 00000100:00100000:2.0:1721880422.300749:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011697536 00000100:00100000:3.0:1721880422.300756:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1721880422.300761:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011697408:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.300763:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632077 00000100:00100000:2.0:1721880422.300768:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+1982:3688:x1805522011697664:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.300774:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914266 00000100:00100000:3.0:1721880422.300778:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.300780:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f022680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1275:2005:x1805522257709440:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.300785:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011697408 00000100:00100000:2.0:1721880422.300786:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011697408 00010000:00010000:1.0:1721880422.300787:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.300791:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097198900/0x8a60d30f5719f8ec lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ebf2 expref: 1275 pid: 15506 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.300796:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632078 00010000:00010000:1.0:1721880422.300800:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097198900/0x8a60d30f5719f8ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ebf2 expref: 1275 pid: 15506 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.300800:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1983:3687:x1805522011697536:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.300803:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632079 00002000:00080000:2.0:1721880422.300807:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64360 count 1 00000100:00100000:3.0:1721880422.300808:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+1983:3687:x1805522011697408:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.300812:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097198900/0x8a60d30f5719f8ec lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ebf2 expref: 1275 pid: 15506 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.300815:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727be8b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb68:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.300821:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64359 count 1 00010000:00010000:2.0:1721880422.300822:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012edbdb00/0x8a60d30f571a0605 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10f052 expref: 1274 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.300824:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.300826:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.300827:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.300828:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727be76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.300828:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.300829:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727be8b lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.300831:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727be92 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb67:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.300835:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727be76 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.300840:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012edbdb00/0x8a60d30f571a0605 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10f052 expref: 1274 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.300841:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099978240/0x8a60d30f571a0468 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ef9c expref: 1274 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.300847:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012edbdb00/0x8a60d30f571a0605 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10f052 expref: 1274 pid: 16088 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.300847:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.300848:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.300853:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f023100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011697792:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.300853:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727be92 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.300855:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.300864:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727be76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.300867:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.300874:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f022680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1274:2005:x1805522257709440:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 94us (180us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.300875:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727be76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.300880:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914266 00010000:00010000:3.0:1721880422.300881:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727be76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.300887:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727be76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.300888:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64361 count 1 00010000:00010000:3.0:1721880422.300893:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727be76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.300894:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727be99 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb69:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.300899:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8b40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.300901:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727be76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.300902:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880123bf98c0/0x8a60d30f571a0804 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10f0fa expref: 1273 pid: 16037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.300907:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.300908:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.300908:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727be76 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.300909:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727be99 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.300917:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727be76 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.300918:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880123bf98c0/0x8a60d30f571a0804 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10f0fa expref: 1273 pid: 16037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.300923:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880123bf98c0/0x8a60d30f571a0804 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10f0fa expref: 1273 pid: 16037 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.300924:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727be76 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.300932:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f020e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011697920:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.300945:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde840 going to sleep for 11 seconds 00002000:00080000:0.0:1721880422.300970:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64357 count 1 00010000:00010000:0.0:1721880422.300982:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727bea0 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb65:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.300993:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8e1440/0x8a60d30f5719ff13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ee06 expref: 1273 pid: 15533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.301000:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.301002:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.301004:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727bea0 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.301031:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d8e1440/0x8a60d30f5719ff13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ee06 expref: 1273 pid: 15533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.301040:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d8e1440/0x8a60d30f5719ff13 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ee06 expref: 1273 pid: 15533 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.301043:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.301046:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c84b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+1984:3688:x1805522011696384:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1361us (1399us total) trans 4296020045 rc 0/0 00000100:00100000:0.0:1721880422.301050:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013639b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011698048:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.301053:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632073 00000004:00080000:1.0:1721880422.301059:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012ba64a80/2, rc 0, transno 1052749 00000100:00100000:1.0:1721880422.301071:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012ba64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011696384:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.301074:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e180 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.301086:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011697280 00000100:00100000:0.0:1721880422.301089:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011697280 00000100:00100000:1.0:1721880422.301120:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1721880422.301126:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f021500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011698176:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.301140:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.301150:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011698176 00000100:00100000:3.0:1721880422.301153:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011698176 00000100:00100000:2.0:1721880422.301155:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632080 00000100:00100000:2.0:1721880422.301159:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+1985:3688:x1805522011697280:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.301168:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64358 count 1 00000100:00100000:3.0:1721880422.301182:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632081 00000100:00100000:3.0:1721880422.301188:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+1985:3688:x1805522011698176:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.301191:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727bea7 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb66:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.301198:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098363a80/0x8a60d30f571a0151 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10eeae expref: 1273 pid: 16109 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.301199:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64362 count 1 00010000:00010000:2.0:1721880422.301202:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.301204:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.301205:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727bea7 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.301208:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727beae lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb6a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.301215:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098363a80/0x8a60d30f571a0151 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10eeae expref: 1273 pid: 16109 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.301218:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801363e4480/0x8a60d30f571a0b06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10f2d6 expref: 1273 pid: 16051 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.301221:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098363a80/0x8a60d30f571a0151 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10eeae expref: 1273 pid: 16109 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.301224:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.301225:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.301226:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f022a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011698304:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.301228:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727beae lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.301244:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde180 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.301244:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801363e4480/0x8a60d30f571a0b06 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10f2d6 expref: 1273 pid: 16051 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.301252:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801363e4480/0x8a60d30f571a0b06 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10f2d6 expref: 1273 pid: 16051 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.301262:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c7c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011698432:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.301282:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdecb40 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.301300:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099978240/0x8a60d30f571a0468 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ef9c expref: 1273 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.301313:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099978240/0x8a60d30f571a0468 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ef9c expref: 1273 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.301322:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c7fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011698560:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.301324:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013639bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011696896:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.301338:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727be7d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.301342:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec000 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.301359:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f020700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011697024:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.301369:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727be84 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.301441:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.301483:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257709568 00000100:00100000:1.0:1721880422.301486:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257709568 00000100:00100000:0.0:1721880422.301496:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.301496:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099b058c0/0x8a60d30f5719fd3e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ed50 expref: 1274 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.301514:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257709696 00000100:00100000:1.0:1721880422.301516:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257709696 00010000:00010000:1.0:1721880422.301521:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013063b180/0x8a60d30f5719fae4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10eca8 expref: 1275 pid: 16121 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.301531:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914267 00000100:00100000:1.0:1721880422.301536:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914268 00000100:00100000:2.0:1721880422.301538:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013639bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1275:2004:x1805522257709568:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.301539:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136398700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1275:2004:x1805522257709696:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.301544:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.301546:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013063b180/0x8a60d30f5719fae4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10eca8 expref: 1275 pid: 16121 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.301547:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.301552:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013063b180/0x8a60d30f5719fae4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10eca8 expref: 1275 pid: 16121 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.301552:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099b058c0/0x8a60d30f5719fd3e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ed50 expref: 1275 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.301560:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013063b180/0x8a60d30f5719fae4 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10eca8 expref: 1275 pid: 16121 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.301562:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099b058c0/0x8a60d30f5719fd3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ed50 expref: 1275 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.301571:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.301572:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.301574:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727be84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.301575:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099b058c0/0x8a60d30f5719fd3e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ed50 expref: 1274 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.301578:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727be84 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.301584:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.301585:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.301587:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727be7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.301588:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.301591:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727be7d lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.301601:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.301608:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880136398700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1273:2004:x1805522257709696:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 67us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.301609:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.301614:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914268 00000100:00100000:2.0:1721880422.301614:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88013639bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1273:2004:x1805522257709568:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 78us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.301619:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914267 00000100:00100000:3.0:1721880422.301625:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257709952 00000100:00100000:3.0:1721880422.301629:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257709952 00010000:00010000:1.0:1721880422.301636:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727be84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.301639:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880123bf98c0/0x8a60d30f571a0804 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10f0fa expref: 1272 pid: 16037 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.301640:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f023100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011697792:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.301642:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727be84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.301647:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727be8b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.301650:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727be84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.301651:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727be7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.301652:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914269 00000100:00100000:3.0:1721880422.301655:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013639a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1272:2005:x1805522257709952:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.301656:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727be7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.301656:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727be84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.301661:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727be84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.301661:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f020e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011697920:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.301661:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.301662:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727be7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.301663:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880123bf98c0/0x8a60d30f571a0804 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb69:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10f0fa expref: 1272 pid: 16037 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.301666:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727be7d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.301668:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353840 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.301668:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727be99 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb69:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.301669:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880123bf98c0/0x8a60d30f571a0804 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb69:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10f0fa expref: 1272 pid: 16037 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.301670:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727be7d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.301670:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727be84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.301673:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325d8c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.301674:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727be84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.301675:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727be7d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.301678:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123bf98c0/0x8a60d30f571a0804 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb69:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10f0fa expref: 1272 pid: 16037 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.301679:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727be7d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.301680:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727be84 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.301683:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727be84 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.301685:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727be7d lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.301686:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.301687:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.301689:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727be7d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.301689:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727be99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.301693:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727be99 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.301703:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.301709:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727be99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.301714:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727be99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.301718:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727be99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.301718:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88013639a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1271:2005:x1805522257709952:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 62us (110us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.301722:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727be99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.301722:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914269 00010000:00010000:2.0:1721880422.301726:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727be99 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.301746:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352f40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.301748:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727be99 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.301760:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727be99 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.301770:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727be99 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.301777:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727be99 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.301793:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c40aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1987:3687:x1805522011696640:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1278us (1448us total) trans 4296020046 rc 0/0 00000100:00100000:1.0:1721880422.301798:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632075 00000004:00080000:3.0:1721880422.301808:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012f09dc00/2, rc 0, transno 1052750 00000100:00100000:3.0:1721880422.301825:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f09dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011696640:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.301857:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f020e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011698688:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.301876:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.301886:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+1987:3687:x1805522011696768:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1374us (1582us total) trans 4296020047 rc 0/0 00000100:00100000:0.0:1721880422.301891:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632074 00000100:00100000:0.0:1721880422.301902:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011698688 00000100:00100000:0.0:1721880422.301904:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011698688 00000100:00100000:0.0:1721880422.301914:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632082 00000100:00100000:1.0:1721880422.301914:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.301916:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c7c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011698432:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.301917:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+1987:3686:x1805522011698688:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.301924:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727beae lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1721880422.301926:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64363 count 1 00000100:00100000:2.0:1721880422.301930:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+1987:3688:x1805522011697664:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1160us (1243us total) trans 4296020048 rc 0/0 00010000:00010000:0.0:1721880422.301934:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727beb5 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb6b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.301935:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.301935:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257710208 00000100:00100000:2.0:1721880422.301937:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632077 00000100:00100000:3.0:1721880422.301937:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257710208 00010000:00010000:0.0:1721880422.301942:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099c95200/0x8a60d30f571a0d13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10f3ee expref: 1271 pid: 16048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.301945:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098363a80/0x8a60d30f571a0151 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10eeae expref: 1271 pid: 16109 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.301946:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1721880422.301946:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.301948:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.301949:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727beb5 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.301955:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257709824 00000100:00100000:1.0:1721880422.301956:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257710336 00000100:00100000:3.0:1721880422.301956:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257709824 00000100:00100000:1.0:1721880422.301958:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257710336 00010000:00010000:0.0:1721880422.301961:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099c95200/0x8a60d30f571a0d13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10f3ee expref: 1273 pid: 16048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.301961:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012edbdb00/0x8a60d30f571a0605 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10f052 expref: 1273 pid: 16088 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.301965:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801363e4480/0x8a60d30f571a0b06 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10f2d6 expref: 1273 pid: 16051 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.301966:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099c95200/0x8a60d30f571a0d13 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10f3ee expref: 1273 pid: 16048 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.301968:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f022a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011698304:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.301973:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880136399500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011698816:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.301974:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914270 00000100:00100000:1.0:1721880422.301978:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914271 00000100:00100000:3.0:1721880422.301978:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1273:2007:x1805522257710208:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.301981:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1273:2004:x1805522257709824:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.301983:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727bea7 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.301983:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.301986:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.301986:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098363a80/0x8a60d30f571a0151 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb66:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10eeae expref: 1273 pid: 16109 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.301988:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012edbdb00/0x8a60d30f571a0605 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10f052 expref: 1273 pid: 16088 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.301991:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e600 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.301992:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098363a80/0x8a60d30f571a0151 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10eeae expref: 1273 pid: 16109 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.301994:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012edbdb00/0x8a60d30f571a0605 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10f052 expref: 1273 pid: 16088 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.302001:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098363a80/0x8a60d30f571a0151 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10eeae expref: 1273 pid: 16109 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.302002:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012edbdb00/0x8a60d30f571a0605 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10f052 expref: 1273 pid: 16088 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.302008:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.302008:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.302009:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.302009:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.302010:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727be8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.302011:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727bea7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.302029:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.302030:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727be8b lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.302033:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727bea7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.302041:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.302046:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.302050:0:15444:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257710080 00000100:00100000:2.0:1721880422.302053:0:15444:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257710080 00000100:00100000:1.0:1721880422.302054:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1271:2004:x1805522257709824:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 72us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.302058:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914271 00000100:00100000:3.0:1721880422.302060:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1272:2007:x1805522257710208:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 81us (146us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.302064:0:15444:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8e1440/0x8a60d30f5719ff13 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ee06 expref: 1271 pid: 15533 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.302065:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914270 00000100:00100000:1.0:1721880422.302068:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914272 00000100:00100000:1.0:1721880422.302071:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a70ee450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1270:2004:x1805522257710336:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.302074:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.302075:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914273 00010000:00010000:1.0:1721880422.302077:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801363e4480/0x8a60d30f571a0b06 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb6a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10f2d6 expref: 1270 pid: 16051 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.302078:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013639ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1270:2004:x1805522257710080:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.302083:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801363e4480/0x8a60d30f571a0b06 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb6a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10f2d6 expref: 1270 pid: 16051 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.302083:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.302084:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727be8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.302086:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d8e1440/0x8a60d30f5719ff13 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ee06 expref: 1270 pid: 15533 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.302089:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801363e4480/0x8a60d30f571a0b06 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb6a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10f2d6 expref: 1270 pid: 16051 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.302089:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727be8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.302091:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d8e1440/0x8a60d30f5719ff13 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ee06 expref: 1270 pid: 15533 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.302095:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.302096:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1721880422.302097:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.302097:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727beae lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.302098:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.302099:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727be8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.302099:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.302101:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727beae lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.302101:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727bea0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.302105:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727bea0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.302108:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.302108:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727be8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.302110:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.302114:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727be8b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.302118:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a70ee450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1269:2004:x1805522257710336:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 47us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.302119:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88013639ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1269:2004:x1805522257710080:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 40us (108us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.302120:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353cc0 already unused, calling callback (ffffffffa084e330) 00000100:00100000:1.0:1721880422.302122:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914272 00010000:00010000:2.0:1721880422.302123:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727be8b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.302124:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914273 00010000:00010000:2.0:1721880422.302129:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727be8b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.302133:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257710464 00000100:00100000:3.0:1721880422.302135:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257710464 00010000:00010000:2.0:1721880422.302139:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727be8b lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.302141:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099978240/0x8a60d30f571a0468 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ef9c expref: 1268 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.302146:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727be8b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.302151:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914274 00000100:00100000:3.0:1721880422.302153:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136399180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1268:2005:x1805522257710464:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.302157:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8e1440/0x8a60d30f5719ff13 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ee06 expref: 1268 pid: 15533 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.302159:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.302161:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099978240/0x8a60d30f571a0468 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ef9c expref: 1268 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.302166:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099978240/0x8a60d30f571a0468 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ef9c expref: 1268 pid: 16126 timeout: 887 lvb_type: 0 00000004:00080000:1.0:1721880422.302168:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122c7e300/2, rc 0, transno 1052752 00010000:00010000:3.0:1721880422.302171:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.302172:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1721880422.302173:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013639b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011698048:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.302173:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727be92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.302177:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727be92 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.302180:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011697664:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.302182:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.302185:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727bea0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.302193:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727bea0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.302194:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880136399180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1267:2005:x1805522257710464:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 40us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.302198:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914274 00010000:00010000:0.0:1721880422.302200:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727bea0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.302206:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727bea0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.302209:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727beae lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.302213:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727bea0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.302213:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727beae lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.302218:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727beae lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.302220:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727bea0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.302224:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727beae lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.302226:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325d440 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.302228:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727bea0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.302228:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727beae lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.302231:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa86c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.302232:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727bea0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.302233:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727beae lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.302237:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727beae lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.302242:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727bea0 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.302242:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727beae lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.302246:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727beae lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.302247:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727bea0 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.302264:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1987:3687:x1805522011697536:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1463us (1540us total) trans 4296020049 rc 0/0 00000100:00100000:2.0:1721880422.302268:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632078 00000100:00100000:2.0:1721880422.302284:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1721880422.302292:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f022a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011698944:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.302310:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.302329:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011698944 00000100:00100000:2.0:1721880422.302333:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011698944 00000100:00100000:3.0:1721880422.302350:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+1989:3688:x1805522011698176:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1162us (1209us total) trans 4296020050 rc 0/0 00000100:00100000:2.0:1721880422.302351:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632083 00000100:00100000:3.0:1721880422.302355:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632081 00000100:00100000:2.0:1721880422.302356:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f023100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1989:3686:x1805522011698944:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.302368:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64364 count 1 00000004:00080000:1.0:1721880422.302372:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012f021500/2, rc 0, transno 1052754 00000004:00080000:3.0:1721880422.302376:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012f09f100/2, rc 0, transno 1052751 00000100:00100000:1.0:1721880422.302378:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f021500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011698176:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.302379:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727bebc lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb6c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.302380:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f09f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011696768:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1721880422.302387:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122c7e680/2, rc 0, transno 1052753 00010000:00010000:2.0:1721880422.302389:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099ef2640/0x8a60d30f571a116c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10f6db expref: 1266 pid: 15497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.302389:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011697536:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.302396:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.302397:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1721880422.302397:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1721880422.302400:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727bebc lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.302404:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801312d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011699200:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1721880422.302411:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122c7d500/2, rc 0, transno 1052755 00000100:00100000:0.0:1721880422.302414:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+1988:3688:x1805522011697152:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1691us (1754us total) trans 4296020051 rc 0/0 00000100:00100000:1.0:1721880422.302415:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011697152:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.302415:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099ef2640/0x8a60d30f571a116c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10f6db expref: 1266 pid: 15497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.302418:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632076 00010000:00010000:2.0:1721880422.302424:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099ef2640/0x8a60d30f571a116c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10f6db expref: 1266 pid: 15497 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.302424:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.302433:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011699200 00000100:00100000:2.0:1721880422.302434:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f020700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011699456:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.302435:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011699200 00000100:00100000:3.0:1721880422.302442:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801312d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011699072:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.302447:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632084 00000100:00100000:0.0:1721880422.302449:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+1988:3689:x1805522011699200:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.302456:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.302457:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde180 going to sleep for 11 seconds 00002000:00080000:0.0:1721880422.302458:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64366 count 1 00010000:00010000:0.0:1721880422.302465:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727bec3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.302473:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011699072 00010000:00010000:2.0:1721880422.302473:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727bea7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.302476:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011699072 00010000:00010000:2.0:1721880422.302485:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727bea7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.302485:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011699584:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.302487:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632085 00000100:00100000:1.0:1721880422.302490:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+1989:3689:x1805522011699072:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.302493:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727bea7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.302498:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64365 count 1 00010000:00010000:2.0:1721880422.302499:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727bea7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.302502:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.302506:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727beca lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb6d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.302506:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727bea7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.302512:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801363518c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.302513:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880120769b00/0x8a60d30f571a24eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1109e3 expref: 1266 pid: 16061 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.302513:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1721880422.302515:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727bea7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.302517:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.302518:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1721880422.302518:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011699328:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.302520:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727beca lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.302523:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727bea7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.302524:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c57d440/0x8a60d30f571a39f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b111d07 expref: 1266 pid: 16056 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.302530:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.302530:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880120769b00/0x8a60d30f571a24eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1109e3 expref: 1266 pid: 16061 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.302531:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.302533:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727bec3 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.302533:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727bea7 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.302535:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880120769b00/0x8a60d30f571a24eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1109e3 expref: 1266 pid: 16061 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.302539:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727bea7 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.302539:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.302541:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011699712:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.302546:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c57d440/0x8a60d30f571a39f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b111d07 expref: 1266 pid: 16056 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.302558:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c57d440/0x8a60d30f571a39f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b111d07 expref: 1266 pid: 16056 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.302563:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.302568:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013639b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011699840:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.302571:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011699584 00000100:00100000:1.0:1721880422.302572:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011699584 00010000:00010000:3.0:1721880422.302580:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099978240/0x8a60d30f571a0468 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10ef9c expref: 1266 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.302581:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011699328 00000100:00100000:1.0:1721880422.302583:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011699328 00000100:00100000:0.0:1721880422.302589:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e180 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.302589:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c7fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011698560:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.302597:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632086 00010000:00010000:3.0:1721880422.302598:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727be92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.302600:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1992:3687:x1805522011699584:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.302603:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727be92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.302607:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632087 00002000:00080000:1.0:1721880422.302608:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64368 count 1 00010000:00010000:3.0:1721880422.302609:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727be92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.302613:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+1992:3687:x1805522011699328:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.302614:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106dd40/0x8a60d30f5727bed1 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.302616:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727be92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.302621:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099200480/0x8a60d30f571a3b5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b111ec0 expref: 1265 pid: 16016 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.302624:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64367 count 1 00010000:00010000:1.0:1721880422.302625:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.302626:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.302626:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727be92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.302627:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106dd40/0x8a60d30f5727bed1 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.302633:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727be92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.302634:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727bed8 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.302636:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099200480/0x8a60d30f571a3b5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b111ec0 expref: 1265 pid: 16016 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.302637:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa9680 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.302640:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727be92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.302642:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099200480/0x8a60d30f571a3b5e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b111ec0 expref: 1265 pid: 16016 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.302644:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c57e1c0/0x8a60d30f571a3aaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b111dfc expref: 1265 pid: 16053 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.302645:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727be92 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.302647:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011699968:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.302649:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.302650:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.302652:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727bed8 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.302654:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727be92 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.302659:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727be92 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.302662:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a3c0 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.302664:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c57e1c0/0x8a60d30f571a3aaf lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b111dfc expref: 1265 pid: 16053 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.302670:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c57e1c0/0x8a60d30f571a3aaf lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b111dfc expref: 1265 pid: 16053 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.302676:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f022680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011700096:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.302685:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.302693:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde840 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.302706:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257710592 00000100:00100000:3.0:1721880422.302709:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257710592 00010000:00010000:3.0:1721880422.302721:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099c95200/0x8a60d30f571a0d13 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10f3ee expref: 1266 pid: 16048 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.302723:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880136399500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011698816:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.302757:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727beb5 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.302759:0:8271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914275 00000100:00100000:3.0:1721880422.302763:0:8271:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136398000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+1266:2004:x1805522257710592:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.302770:0:8271:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.302774:0:8271:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099c95200/0x8a60d30f571a0d13 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb6b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10f3ee expref: 1266 pid: 16048 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.302781:0:8271:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099c95200/0x8a60d30f571a0d13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb6b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10f3ee expref: 1266 pid: 16048 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.302791:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+1992:3688:x1805522011697280:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1630us (1748us total) trans 4296020052 rc 0/0 00010000:00010000:3.0:1721880422.302793:0:8271:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099c95200/0x8a60d30f571a0d13 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb6b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10f3ee expref: 1266 pid: 16048 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.302798:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632080 00010000:00010000:3.0:1721880422.302804:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.302805:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.302808:0:8271:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727beb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.302815:0:8271:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727beb5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.302825:0:8271:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.302844:0:8271:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880136398000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+1265:2004:x1805522257710592:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 80us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.302849:0:8271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914275 00000004:00080000:1.0:1721880422.302869:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122c7c700/2, rc 0, transno 1052756 00000100:00100000:1.0:1721880422.302874:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011697280:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.302876:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727beb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.302881:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727beb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.302886:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727beb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.302889:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727beb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.302893:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727beb5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.302894:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011700224:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.302900:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325f600 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.302903:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727beb5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.302906:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727beb5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.302907:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.302912:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727beb5 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.302916:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727beb5 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.302923:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011700224 00000100:00100000:3.0:1721880422.302925:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+1992:3687:x1805522011697408:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2116us (2146us total) trans 4296020053 rc 0/0 00000100:00100000:2.0:1721880422.302926:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011700224 00000100:00100000:3.0:1721880422.302929:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632079 00000100:00100000:2.0:1721880422.302938:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632088 00000100:00100000:2.0:1721880422.302942:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+1992:3688:x1805522011700224:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.302950:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64369 count 1 00000004:00080000:3.0:1721880422.302952:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122c7ed80/2, rc 0, transno 1052757 00000100:00100000:3.0:1721880422.302956:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011697408:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.302958:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727bedf lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb71:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.302965:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008561b840/0x8a60d30f571a3c68 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb71:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b111fb5 expref: 1264 pid: 15440 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.302969:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.302970:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.302972:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727bedf lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb71:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.302983:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008561b840/0x8a60d30f571a3c68 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb71:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b111fb5 expref: 1264 pid: 15440 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.302986:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011700352:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.302988:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008561b840/0x8a60d30f571a3c68 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb71:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b111fb5 expref: 1264 pid: 15440 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.302994:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f020380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011700480:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.303003:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.303027:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+1993:3686:x1805522011698688:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1093us (1135us total) trans 4296020054 rc 0/0 00000100:00100000:3.0:1721880422.303030:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011700352 00000100:00100000:2.0:1721880422.303031:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.303032:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632082 00000100:00100000:3.0:1721880422.303033:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011700352 00000100:00100000:3.0:1721880422.303055:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632089 00000004:00080000:0.0:1721880422.303056:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012f020e00/2, rc 0, transno 1052758 00000100:00100000:3.0:1721880422.303060:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+1993:3689:x1805522011700352:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.303062:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f020e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011698688:0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.303072:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64370 count 1 00010000:00010000:3.0:1721880422.303082:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727bee6 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb72:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.303093:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ff63180/0x8a60d30f571a434c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb72:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1122b0 expref: 1264 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.303094:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1721880422.303099:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.303101:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011700608:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.303101:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.303103:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727bee6 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb72:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.303117:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.303119:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ff63180/0x8a60d30f571a434c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb72:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1122b0 expref: 1264 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.303129:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ff63180/0x8a60d30f571a434c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb72:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1122b0 expref: 1264 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.303130:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011700608 00000100:00100000:2.0:1721880422.303132:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011700608 00000100:00100000:3.0:1721880422.303139:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800919c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011700736:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.303143:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632090 00000100:00100000:2.0:1721880422.303145:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+1994:3687:x1805522011700608:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.303155:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64371 count 1 00010000:00010000:2.0:1721880422.303162:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727beed lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb73:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.303164:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec000 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.303170:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b6e8000/0x8a60d30f571a453d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb73:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11233c expref: 1264 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.303174:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.303175:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.303177:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727beed lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb73:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.303186:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b6e8000/0x8a60d30f571a453d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb73:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11233c expref: 1264 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.303192:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b6e8000/0x8a60d30f571a453d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb73:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11233c expref: 1264 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.303197:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801341d0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011700864:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.303217:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde600 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.303230:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f020700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011699456:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.303232:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d9ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011699712:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.303239:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727bebc lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.303307:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727beca lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.303328:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.303366:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257710720 00000100:00100000:3.0:1721880422.303370:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257710720 00010000:00010000:3.0:1721880422.303380:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099ef2640/0x8a60d30f571a116c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10f6db expref: 1265 pid: 15497 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.303382:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.303395:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d9e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011699968:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.303405:0:8271:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257710848 00010000:00010000:1.0:1721880422.303406:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106dd40/0x8a60d30f5727bed1 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.303407:0:8271:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257710848 00010000:00010000:3.0:1721880422.303416:0:8271:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880120769b00/0x8a60d30f571a24eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1109e3 expref: 1266 pid: 16061 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.303417:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f022680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011700096:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.303431:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727bed8 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.303432:0:8271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914276 00000100:00100000:3.0:1721880422.303436:0:8271:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f020700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+1266:2005:x1805522257710720:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.303441:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914277 00010000:00010000:3.0:1721880422.303443:0:8271:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1721880422.303446:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088615880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1266:2004:x1805522257710848:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.303448:0:8271:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099ef2640/0x8a60d30f571a116c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb6c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10f6db expref: 1266 pid: 15497 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.303454:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.303455:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.303456:0:8271:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099ef2640/0x8a60d30f571a116c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb6c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10f6db expref: 1266 pid: 15497 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.303459:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880120769b00/0x8a60d30f571a24eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb6d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1109e3 expref: 1266 pid: 16061 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.303464:0:7116:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257710976 00010000:00010000:3.0:1721880422.303464:0:8271:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099ef2640/0x8a60d30f571a116c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb6c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b10f6db expref: 1266 pid: 15497 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.303465:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880120769b00/0x8a60d30f571a24eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb6d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1109e3 expref: 1266 pid: 16061 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.303467:0:7116:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257710976 00010000:00010000:3.0:1721880422.303472:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.303473:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.303475:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880120769b00/0x8a60d30f571a24eb lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb6d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1109e3 expref: 1266 pid: 16061 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.303475:0:8271:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727bebc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.303476:0:7116:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099200480/0x8a60d30f571a3b5e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b111ec0 expref: 1266 pid: 16016 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.303480:0:8271:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727bebc lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.303485:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.303486:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.303487:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727beca lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.303489:0:7116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914278 00010000:00010000:3.0:1721880422.303490:0:8271:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.303492:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727beca lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.303492:0:7116:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088615180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1265:2007:x1805522257710976:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.303498:0:7116:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.303500:0:7116:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099200480/0x8a60d30f571a3b5e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b111ec0 expref: 1265 pid: 16016 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.303506:0:7116:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099200480/0x8a60d30f571a3b5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b111ec0 expref: 1265 pid: 16016 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.303506:0:8271:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f020700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+1265:2005:x1805522257710720:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 69us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.303510:0:8271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914276 00010000:00010000:2.0:1721880422.303515:0:7116:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099200480/0x8a60d30f571a3b5e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b111ec0 expref: 1265 pid: 16016 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.303525:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.303526:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.303528:0:7116:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106dd40/0x8a60d30f5727bed1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.303532:0:7116:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106dd40/0x8a60d30f5727bed1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.303536:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.303542:0:7116:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.303550:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088615880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1263:2004:x1805522257710848:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 104us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.303554:0:7116:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088615180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1263:2007:x1805522257710976:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 61us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.303555:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914277 00000100:00100000:2.0:1721880422.303559:0:7116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914278 00010000:00010000:0.0:1721880422.303570:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727beca lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.303573:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727bebc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.303575:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727beca lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.303578:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727bebc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.303582:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727bebc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.303583:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727beca lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.303586:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727bebc lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.303587:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727beca lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.303589:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727bebc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.303591:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727beca lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.303592:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.303593:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801363506c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.303594:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106e1c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.303595:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727bebc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.303596:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727beca lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.303598:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727bebc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.303599:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727beca lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.303603:0:7116:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257711104 00010000:00010000:0.0:1721880422.303604:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727beca lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.303605:0:7116:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257711104 00010000:00010000:2.0:1721880422.303607:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727bebc lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.303608:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727beca lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.303611:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727bebc lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.303613:0:7116:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c57d440/0x8a60d30f571a39f2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b111d07 expref: 1262 pid: 16056 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.303623:0:7116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914279 00000100:00100000:3.0:1721880422.303626:0:7116:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a70efc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1262:2005:x1805522257711104:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.303630:0:7116:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.303631:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106dd40/0x8a60d30f5727bed1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.303632:0:7116:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c57d440/0x8a60d30f571a39f2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b111d07 expref: 1262 pid: 16056 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.303636:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106dd40/0x8a60d30f5727bed1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.303638:0:7116:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c57d440/0x8a60d30f571a39f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b111d07 expref: 1262 pid: 16056 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.303641:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106dd40/0x8a60d30f5727bed1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.303644:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106dd40/0x8a60d30f5727bed1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.303645:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.303645:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.303647:0:7116:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727bec3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.303648:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106dd40/0x8a60d30f5727bed1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.303651:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106dd40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.303651:0:7116:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727bec3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.303653:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106dd40/0x8a60d30f5727bed1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.303657:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106dd40/0x8a60d30f5727bed1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.303657:0:7116:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.303663:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106dd40/0x8a60d30f5727bed1 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.303667:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106dd40/0x8a60d30f5727bed1 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.303670:0:7116:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a70efc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1262:2005:x1805522257711104:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 43us (80us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.303676:0:7116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914279 00000100:00100000:2.0:1721880422.303695:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f023100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+1995:3686:x1805522011698944:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1338us (1384us total) trans 4296020055 rc 0/0 00000100:00100000:2.0:1721880422.303699:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632083 00000004:00080000:2.0:1721880422.303722:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012f022a00/2, rc 0, transno 1052759 00000100:00100000:2.0:1721880422.303754:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f022a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011698944:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.303774:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011700992:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.303784:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.303788:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.303797:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1996:3687:x1805522011699584:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1195us (1294us total) trans 4296020056 rc 0/0 00000100:00100000:1.0:1721880422.303801:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632086 00000100:00100000:1.0:1721880422.303811:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011700992 00000100:00100000:1.0:1721880422.303812:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011700992 00000100:00100000:3.0:1721880422.303812:0:15444:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257711232 00000100:00100000:3.0:1721880422.303814:0:15444:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257711232 00010000:00010000:3.0:1721880422.303822:0:15444:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c57e1c0/0x8a60d30f571a3aaf lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b111dfc expref: 1262 pid: 16053 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.303831:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914280 00000100:00100000:1.0:1721880422.303833:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632091 00000100:00100000:3.0:1721880422.303834:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088614700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1262:2005:x1805522257711232:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.303836:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+1996:3687:x1805522011700992:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.303838:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.303840:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c57e1c0/0x8a60d30f571a3aaf lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b111dfc expref: 1262 pid: 16053 timeout: 887 lvb_type: 0 00002000:00080000:1.0:1721880422.303844:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64372 count 1 00010000:00010000:3.0:1721880422.303845:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c57e1c0/0x8a60d30f571a3aaf lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b111dfc expref: 1262 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.303851:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727bef4 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb74:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.303852:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c57e1c0/0x8a60d30f571a3aaf lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b111dfc expref: 1262 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.303859:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009797aac0/0x8a60d30f571a470b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb74:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1123f2 expref: 1261 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.303859:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.303860:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.303862:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727bed8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.303863:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.303864:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.303865:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727bef4 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb74:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.303866:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727bed8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.303869:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+1996:3689:x1805522011699072:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1376us (1410us total) trans 4296020057 rc 0/0 00010000:00010000:1.0:1721880422.303875:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009797aac0/0x8a60d30f571a470b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb74:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1123f2 expref: 1261 pid: 16100 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.303876:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632085 00010000:00010000:1.0:1721880422.303880:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009797aac0/0x8a60d30f571a470b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb74:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1123f2 expref: 1261 pid: 16100 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.303880:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.303885:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727bed8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.303887:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c1e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011701120:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.303891:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727bed8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.303892:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088614700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1261:2005:x1805522257711232:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 58us (109us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.303896:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727bed8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.303896:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914280 00010000:00010000:2.0:1721880422.303899:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727bed8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.303900:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a3c0 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.303904:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727bed8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.303908:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136351440 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.303909:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c57d440/0x8a60d30f571a39f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b111d07 expref: 1260 pid: 16056 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.303911:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727bed8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.303913:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009d9eaa00/2, rc 0, transno 1052760 00010000:00010000:2.0:1721880422.303915:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727bed8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.303916:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801312d1c00/2, rc 0, transno 1052761 00000100:00100000:3.0:1721880422.303917:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d9eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011699584:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.303919:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801312d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011699072:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.303921:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727bed8 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.303924:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727bed8 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.303964:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880092319180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011701376:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.303976:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.303987:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013639b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011699840:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.303991:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1721880422.303994:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008854dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011701248:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.304001:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727bec3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.304005:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.304011:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+1996:3687:x1805522011699328:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1397us (1471us total) trans 4296020058 rc 0/0 00000100:00100000:0.0:1721880422.304029:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011701376 00000100:00100000:2.0:1721880422.304032:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632087 00000100:00100000:0.0:1721880422.304033:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011701376 00000004:00080000:3.0:1721880422.304038:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009d9e8a80/2, rc 0, transno 1052762 00000100:00100000:2.0:1721880422.304041:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011701248 00000100:00100000:2.0:1721880422.304044:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011701248 00000100:00100000:3.0:1721880422.304045:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d9e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011699328:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.304053:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632092 00000100:00100000:2.0:1721880422.304056:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632093 00000100:00100000:0.0:1721880422.304058:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+1997:3689:x1805522011701376:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.304059:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+1997:3689:x1805522011701248:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.304068:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64374 count 1 00002000:00080000:2.0:1721880422.304068:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64373 count 1 00000100:00100000:3.0:1721880422.304070:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011701504:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.304076:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727befb lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb76:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.304076:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727bf02 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.304083:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007b427a80/0x8a60d30f571a4ad1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb76:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112542 expref: 1259 pid: 16050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.304084:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009122cb40/0x8a60d30f571a488c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112485 expref: 1259 pid: 16053 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.304088:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.304089:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1721880422.304089:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.304090:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727befb lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb76:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.304092:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.304093:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.304094:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727bf02 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.304098:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011701504 00000100:00100000:1.0:1721880422.304100:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011701504 00010000:00010000:0.0:1721880422.304101:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007b427a80/0x8a60d30f571a4ad1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb76:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112542 expref: 1259 pid: 16050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.304104:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009122cb40/0x8a60d30f571a488c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112485 expref: 1259 pid: 16053 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.304106:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007b427a80/0x8a60d30f571a4ad1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb76:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112542 expref: 1259 pid: 16050 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.304109:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009122cb40/0x8a60d30f571a488c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112485 expref: 1259 pid: 16053 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.304114:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632094 00000100:00100000:2.0:1721880422.304116:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088617b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011701760:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.304117:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+1998:3686:x1805522011701504:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.304118:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013639b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011701632:192.168.201.24@tcp:104: 00002000:00080000:1.0:1721880422.304125:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64375 count 1 00010000:00010000:1.0:1721880422.304132:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106c900/0x8a60d30f5727bf09 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.304134:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde840 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.304136:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e180 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.304140:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801360cbcc0/0x8a60d30f571a4d24 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1125ff expref: 1259 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.304144:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.304145:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.304146:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106c900/0x8a60d30f5727bf09 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.304160:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801360cbcc0/0x8a60d30f571a4d24 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1125ff expref: 1259 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.304166:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801360cbcc0/0x8a60d30f571a4d24 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1125ff expref: 1259 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.304172:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c1d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011701888:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.304173:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f020380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011700480:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.304185:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522ae40 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.304188:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727bedf lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb71:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.304209:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800919c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011700736:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.304219:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727bee6 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb72:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.304341:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727bec3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.304364:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.304374:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.304385:0:7116:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257711360 00000100:00100000:3.0:1721880422.304389:0:7116:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257711360 00010000:00010000:0.0:1721880422.304398:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727bec3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.304401:0:7116:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008561b840/0x8a60d30f571a3c68 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb71:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b111fb5 expref: 1260 pid: 15440 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.304406:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727bec3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.304413:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727bec3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.304416:0:7116:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257711488 00000100:00100000:3.0:1721880422.304419:0:7116:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257711488 00010000:00010000:0.0:1721880422.304420:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727bec3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.304424:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.304426:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325eac0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.304427:0:7116:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ff63180/0x8a60d30f571a434c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb72:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1122b0 expref: 1261 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.304429:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727bec3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.304435:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257711616 00010000:00010000:0.0:1721880422.304436:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727bec3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.304437:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257711616 00000100:00100000:3.0:1721880422.304441:0:7116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914281 00000100:00100000:3.0:1721880422.304445:0:7116:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088616680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1262:2005:x1805522257711360:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.304446:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727bec3 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.304446:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b6e8000/0x8a60d30f571a453d lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb73:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11233c expref: 1262 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.304450:0:7116:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.304452:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727bec3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.304453:0:7116:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008561b840/0x8a60d30f571a3c68 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb71:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b111fb5 expref: 1262 pid: 15440 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.304459:0:7116:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008561b840/0x8a60d30f571a3c68 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb71:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b111fb5 expref: 1262 pid: 15440 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.304466:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914282 00010000:00010000:3.0:1721880422.304467:0:7116:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008561b840/0x8a60d30f571a3c68 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb71:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b111fb5 expref: 1262 pid: 15440 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.304469:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088615880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1262:2005:x1805522257711488:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.304475:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.304477:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.304478:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.304479:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ff63180/0x8a60d30f571a434c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb72:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1122b0 expref: 1261 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.304480:0:7116:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727bedf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb71:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.304484:0:7116:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727bedf lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb71:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.304485:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ff63180/0x8a60d30f571a434c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb72:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1122b0 expref: 1261 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.304492:0:7116:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.304494:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ff63180/0x8a60d30f571a434c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb72:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1122b0 expref: 1261 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.304496:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914283 00000100:00100000:1.0:1721880422.304502:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088615180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+1260:2005:x1805522257711616:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.304502:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.304503:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.304505:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727bee6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb72:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.304508:0:7116:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088616680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1260:2005:x1805522257711360:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 62us (144us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.304510:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.304510:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727bee6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb72:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.304511:0:7116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914281 00010000:00010000:1.0:1721880422.304515:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b6e8000/0x8a60d30f571a453d lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb73:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11233c expref: 1260 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.304518:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.304524:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b6e8000/0x8a60d30f571a453d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb73:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11233c expref: 1259 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.304532:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088615880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1259:2005:x1805522257711488:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 62us (157us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.304535:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.304536:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914282 00010000:00010000:1.0:1721880422.304537:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.304540:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727beed lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb73:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.304540:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b6e8000/0x8a60d30f571a453d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb73:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11233c expref: 1259 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.304546:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727beed lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb73:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.304550:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801341d0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011700864:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.304561:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.304565:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727beed lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.304573:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727beed lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.304579:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088615180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+1257:2005:x1805522257711616:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 76us (153us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.304579:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727beed lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.304585:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914283 00010000:00010000:3.0:1721880422.304586:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727beed lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.304593:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727beed lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.304600:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727beed lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.304604:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136351f80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.304606:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727beed lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.304610:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727beed lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.304613:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c1e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011701120:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.304617:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727beed lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.304621:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727beed lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.304623:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088617b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011701760:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.304628:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727bef4 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb74:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.304633:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727bf02 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.304643:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727bee6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.304648:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727bee6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.304653:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727bee6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.304658:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727bee6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.304661:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727bee6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.304664:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aaa880 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.304666:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727bee6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.304670:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727bee6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.304676:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727bee6 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.304679:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727bee6 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.304684:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013639b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011701632:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.304685:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.304695:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257711872 00010000:00010000:0.0:1721880422.304697:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727befb lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb76:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.304698:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257711872 00010000:00010000:1.0:1721880422.304709:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007b427a80/0x8a60d30f571a4ad1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb76:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112542 expref: 1257 pid: 16050 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.304712:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2000:3687:x1805522011700608:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1565us (1593us total) trans 4296020060 rc 0/0 00000100:00100000:3.0:1721880422.304716:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632090 00000100:00100000:1.0:1721880422.304750:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914284 00000004:00080000:3.0:1721880422.304752:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122c1ce00/2, rc 0, transno 1052764 00000100:00100000:1.0:1721880422.304755:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+1257:2005:x1805522257711872:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.304757:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011700608:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.304761:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.304765:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007b427a80/0x8a60d30f571a4ad1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb76:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112542 expref: 1257 pid: 16050 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.304770:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007b427a80/0x8a60d30f571a4ad1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb76:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112542 expref: 1257 pid: 16050 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.304772:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1721880422.304777:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011702016:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.304778:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007b427a80/0x8a60d30f571a4ad1 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb76:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112542 expref: 1257 pid: 16050 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.304786:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2000:3689:x1805522011699200:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2334us (2362us total) trans 4296020059 rc 0/0 00010000:00010000:1.0:1721880422.304790:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.304791:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1721880422.304793:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632084 00010000:00010000:1.0:1721880422.304793:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727befb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb76:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.304796:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.304797:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727befb lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb76:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.304797:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.304807:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011702016 00000100:00100000:2.0:1721880422.304807:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257712000 00000100:00100000:2.0:1721880422.304809:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257712000 00000100:00100000:0.0:1721880422.304812:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011702016 00010000:00010000:1.0:1721880422.304814:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.304817:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009122cb40/0x8a60d30f571a488c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112485 expref: 1257 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.304820:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727bedf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.304823:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727befb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.304827:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+1257:2005:x1805522257711872:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 72us (143us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.304827:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727bedf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.304828:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727befb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.304831:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914284 00010000:00010000:0.0:1721880422.304832:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727befb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.304835:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914285 00010000:00010000:0.0:1721880422.304836:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727befb lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.304836:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727bedf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.304838:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088617b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1256:2005:x1805522257712000:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.304839:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727befb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.304843:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.304843:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727bedf lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.304845:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009122cb40/0x8a60d30f571a488c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112485 expref: 1256 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.304847:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325c240 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.304849:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727befb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.304850:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727bedf lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.304852:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009122cb40/0x8a60d30f571a488c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112485 expref: 1256 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.304853:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727befb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.304854:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136351b00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.304855:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727bedf lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.304858:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.304859:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727befb lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.304859:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009122cb40/0x8a60d30f571a488c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112485 expref: 1256 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.304859:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727bedf lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.304862:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727befb lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.304865:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257711744 00010000:00010000:3.0:1721880422.304865:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727bedf lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.304867:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257711744 00010000:00010000:2.0:1721880422.304868:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.304869:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.304869:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727bedf lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.304870:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727bf02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.304873:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009797aac0/0x8a60d30f571a470b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb74:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1123f2 expref: 1256 pid: 16100 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.304875:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727bf02 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.304883:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914286 00010000:00010000:2.0:1721880422.304883:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.304886:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ab4d5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+1256:2004:x1805522257711744:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.304890:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.304893:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009797aac0/0x8a60d30f571a470b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb74:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1123f2 expref: 1256 pid: 16100 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.304896:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088617b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1256:2005:x1805522257712000:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 57us (99us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.304898:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009797aac0/0x8a60d30f571a470b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb74:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1123f2 expref: 1256 pid: 16100 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.304900:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914285 00010000:00010000:1.0:1721880422.304906:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009797aac0/0x8a60d30f571a470b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb74:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1123f2 expref: 1255 pid: 16100 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.304911:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727bf02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.304913:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000004:00080000:0.0:1721880422.304914:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801312d3800/2, rc 0, transno 1052763 00010000:00010000:1.0:1721880422.304914:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.304916:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727bef4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb74:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.304916:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727bf02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.304920:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801312d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011699200:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.304920:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727bef4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb74:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.304920:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727bf02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.304923:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727bf02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.304927:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.304927:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727bf02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.304930:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350b40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.304932:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727bf02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.304936:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727bf02 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.304938:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ab4d5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+1254:2004:x1805522257711744:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 51us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.304939:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632095 00010000:00010000:2.0:1721880422.304940:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727bf02 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.304941:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914286 00000100:00100000:0.0:1721880422.304942:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2002:3686:x1805522011702016:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.304944:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727bf02 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.304950:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011702144:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.304964:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727bef4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.304964:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.304969:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727bef4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.304973:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727bef4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.304977:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727bef4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.304978:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011702144 00000100:00100000:3.0:1721880422.304980:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011702144 00010000:00010000:1.0:1721880422.304984:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727bef4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.304987:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106cb40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.304989:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727bef4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.304990:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632096 00010000:00010000:1.0:1721880422.304993:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727bef4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.304993:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2004:3688:x1805522011702144:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.304998:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727bef4 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.305001:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727bef4 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.305001:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64377 count 1 00010000:00010000:3.0:1721880422.305009:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727bf10 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.305034:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ea7dd40/0x8a60d30f571a50dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11273a expref: 1253 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.305039:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.305040:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.305041:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727bf10 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.305052:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ea7dd40/0x8a60d30f571a50dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11273a expref: 1253 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.305057:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ea7dd40/0x8a60d30f571a50dc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11273a expref: 1253 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.305063:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800919c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011702272:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.305080:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec000 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.305085:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2005:3689:x1805522011701376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1026us (1106us total) trans 4296020062 rc 0/0 00000100:00100000:2.0:1721880422.305088:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2005:3689:x1805522011700352:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2026us (2082us total) trans 4296020061 rc 0/0 00000100:00100000:0.0:1721880422.305089:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632092 00000100:00100000:2.0:1721880422.305096:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632089 00000004:00080000:0.0:1721880422.305108:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880092319180/2, rc 0, transno 1052766 00000100:00100000:1.0:1721880422.305111:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2003:3687:x1805522011700992:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1273us (1321us total) trans 4296020065 rc 0/0 00000100:00100000:1.0:1721880422.305115:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632091 00000100:00100000:0.0:1721880422.305120:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880092319180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011701376:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1721880422.305120:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122c1d880/2, rc 0, transno 1052769 00000100:00100000:3.0:1721880422.305123:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011700992:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1721880422.305127:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122c1c000/2, rc 0, transno 1052765 00000100:00100000:0.0:1721880422.305129:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011700352:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.305155:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076fde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011702528:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.305168:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.305179:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2002:3688:x1805522011700224:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2236us (2271us total) trans 4296020063 rc 0/0 00000100:00100000:3.0:1721880422.305179:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1721880422.305182:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011702656:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.305183:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632088 00000100:00100000:1.0:1721880422.305187:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011702528 00000100:00100000:1.0:1721880422.305189:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011702528 00000100:00100000:3.0:1721880422.305199:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.305211:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011702656 00000100:00100000:1.0:1721880422.305213:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011702656 00000100:00100000:1.0:1721880422.305221:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632097 00000100:00100000:3.0:1721880422.305221:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076fdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011702400:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.305224:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076fdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2003:3686:x1805522011702528:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.305226:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632098 00000100:00100000:3.0:1721880422.305230:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.305231:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088efd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2003:3686:x1805522011702656:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.305233:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64379 count 1 00000100:00100000:2.0:1721880422.305235:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.305240:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106f600/0x8a60d30f5727bf17 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.305248:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009d9e8380/2, rc 0, transno 1052767 00010000:00010000:1.0:1721880422.305249:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097026f40/0x8a60d30f571a544e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11289f expref: 1253 pid: 16040 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1721880422.305253:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64380 count 1 00010000:00010000:1.0:1721880422.305253:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1721880422.305253:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d9e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011700224:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.305254:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.305255:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011702400 00010000:00010000:1.0:1721880422.305256:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106f600/0x8a60d30f5727bf17 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.305258:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011702400 00010000:00010000:0.0:1721880422.305265:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727bf1e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb7c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.305267:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1721880422.305268:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257712128 00000100:00100000:2.0:1721880422.305269:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632099 00000100:00100000:3.0:1721880422.305270:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801362db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011702784:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.305271:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257712128 00000100:00100000:2.0:1721880422.305272:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2004:3689:x1805522011702400:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.305276:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880123aedb00/0x8a60d30f571a564d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb7c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112940 expref: 1254 pid: 16031 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.305280:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.305281:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801360cbcc0/0x8a60d30f571a4d24 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1125ff expref: 1254 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.305282:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00002000:00080000:2.0:1721880422.305282:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64378 count 1 00010000:00010000:0.0:1721880422.305283:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.305286:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727bf1e lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb7c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.305293:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727bf25 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.305297:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914287 00010000:00010000:0.0:1721880422.305302:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880123aedb00/0x8a60d30f571a564d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb7c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112940 expref: 1254 pid: 16031 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.305302:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088614700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+1254:2004:x1805522257712128:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.305304:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132c8cb40/0x8a60d30f571a52b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1127fe expref: 1254 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.305308:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.305310:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801360cbcc0/0x8a60d30f571a4d24 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1125ff expref: 1254 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.305310:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.305311:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.305312:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880123aedb00/0x8a60d30f571a564d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb7c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112940 expref: 1254 pid: 16031 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.305313:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727bf25 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.305316:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801360cbcc0/0x8a60d30f571a4d24 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1125ff expref: 1254 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.305321:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013639b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011702912:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.305323:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.305324:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.305326:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106c900/0x8a60d30f5727bf09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.305330:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132c8cb40/0x8a60d30f571a52b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1127fe expref: 1254 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.305333:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106c900/0x8a60d30f5727bf09 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.305339:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132c8cb40/0x8a60d30f571a52b8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1127fe expref: 1254 pid: 16081 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.305341:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e180 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.305341:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.305349:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088616680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011703040:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.305350:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011702784 00000100:00100000:0.0:1721880422.305352:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011702784 00000100:00100000:1.0:1721880422.305354:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088614700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+1254:2004:x1805522257712128:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 52us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.305358:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914287 00000100:00100000:0.0:1721880422.305365:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632100 00000100:00100000:0.0:1721880422.305368:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801362d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2005:3689:x1805522011702784:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.305370:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde840 going to sleep for 11 seconds 00002000:00080000:0.0:1721880422.305376:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64381 count 1 00010000:00010000:1.0:1721880422.305380:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801360cbcc0/0x8a60d30f571a4d24 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1125ff expref: 1253 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.305383:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727bf2c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb7d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.305388:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c1d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011701888:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.305390:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134f39d40/0x8a60d30f571a580d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb7d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1129be expref: 1252 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.305394:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.305395:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.305397:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727bf2c lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb7d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.305397:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106c900/0x8a60d30f5727bf09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.305402:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106c900/0x8a60d30f5727bf09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.305405:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106c900/0x8a60d30f5727bf09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.305409:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134f39d40/0x8a60d30f571a580d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb7d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1129be expref: 1252 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.305409:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106c900/0x8a60d30f5727bf09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.305413:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106c900/0x8a60d30f5727bf09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.305417:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134f39d40/0x8a60d30f571a580d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb7d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1129be expref: 1252 pid: 16100 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.305419:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106c900/0x8a60d30f5727bf09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.305423:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106c900 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.305424:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106c900/0x8a60d30f5727bf09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.305425:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880136399500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011703168:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.305428:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106c900/0x8a60d30f5727bf09 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.305433:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106c900/0x8a60d30f5727bf09 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.305436:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106c900/0x8a60d30f5727bf09 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.305508:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e600 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.305525:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2006:3686:x1805522011701504:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1406us (1436us total) trans 4296020066 rc 0/0 00000100:00100000:1.0:1721880422.305529:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632094 00000004:00080000:3.0:1721880422.305540:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012ba64e00/2, rc 0, transno 1052770 00010000:00010000:1.0:1721880422.305546:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097026f40/0x8a60d30f571a544e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11289f expref: 1252 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.305550:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012ba64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011701504:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.305552:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097026f40/0x8a60d30f571a544e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11289f expref: 1252 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.305559:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c1d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011703296:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.305575:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522ae40 going to sleep for 11 seconds 00002000:00080000:0.0:1721880422.305587:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64376 count 1 00010000:00010000:0.0:1721880422.305597:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727bf33 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.305602:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1721880422.305607:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099c24b40/0x8a60d30f571a4e82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1126a0 expref: 1252 pid: 16016 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.305608:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088615880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011703424:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.305617:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.305619:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.305621:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727bf33 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.305625:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.305637:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011703424 00000100:00100000:1.0:1721880422.305640:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011703424 00000100:00100000:3.0:1721880422.305643:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2006:3689:x1805522011701248:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1582us (1636us total) trans 4296020064 rc 0/0 00000100:00100000:3.0:1721880422.305647:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632093 00000100:00100000:1.0:1721880422.305654:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632101 00000100:00100000:1.0:1721880422.305657:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088615180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2005:3688:x1805522011703424:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.305665:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64382 count 1 00000004:00080000:3.0:1721880422.305669:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008854dc00/2, rc 0, transno 1052768 00010000:00010000:1.0:1721880422.305672:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727bf3a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb7e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.305674:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008854dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011701248:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.305679:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800971b7180/0x8a60d30f571a5a28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb7e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112a82 expref: 1252 pid: 16031 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.305683:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.305684:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.305685:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727bf3a lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb7e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.305694:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800971b7180/0x8a60d30f571a5a28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb7e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112a82 expref: 1252 pid: 16031 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.305698:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088617b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011703552:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.305699:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800971b7180/0x8a60d30f571a5a28 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb7e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112a82 expref: 1252 pid: 16031 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.305704:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c1e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011703680:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.305709:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099c24b40/0x8a60d30f571a4e82 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1126a0 expref: 1252 pid: 16016 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.305715:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.305716:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099c24b40/0x8a60d30f571a4e82 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1126a0 expref: 1252 pid: 16016 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.305722:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a840 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.305723:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880136399f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011703808:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.305740:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011703552 00000100:00100000:2.0:1721880422.305743:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011703552 00000100:00100000:2.0:1721880422.305755:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632102 00000100:00100000:2.0:1721880422.305758:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2006:3686:x1805522011703552:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.305766:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64383 count 1 00010000:00010000:2.0:1721880422.305774:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727bf41 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.305782:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b1aaf40/0x8a60d30f571a5bfd lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112b31 expref: 1252 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.305786:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.305787:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.305788:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727bf41 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.305798:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b1aaf40/0x8a60d30f571a5bfd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112b31 expref: 1252 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.305803:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b1aaf40/0x8a60d30f571a5bfd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112b31 expref: 1252 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.305809:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f020380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011703936:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.305819:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.305828:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde180 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.305858:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800919c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011702272:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.305868:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727bf10 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.305908:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257712256 00000100:00100000:1.0:1721880422.305911:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257712256 00010000:00010000:1.0:1721880422.305920:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ea7dd40/0x8a60d30f571a50dc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11273a expref: 1253 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.305930:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914288 00000100:00100000:1.0:1721880422.305932:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801362db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+1253:2005:x1805522257712256:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.305937:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.305939:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ea7dd40/0x8a60d30f571a50dc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11273a expref: 1253 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.305944:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ea7dd40/0x8a60d30f571a50dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11273a expref: 1253 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.305951:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ea7dd40/0x8a60d30f571a50dc lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11273a expref: 1253 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.305957:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e480 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.305957:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.305958:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.305959:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727bf10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.305963:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727bf10 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.305981:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.305993:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801362db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+1252:2005:x1805522257712256:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 60us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.305997:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914288 00010000:00010000:2.0:1721880422.306002:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727bf10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.306024:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727bf10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.306030:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727bf10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.306034:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727bf10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.306037:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727bf10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.306040:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa9440 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.306042:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727bf10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.306046:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727bf10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.306053:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727bf10 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.306057:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727bf10 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.306151:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2007:3688:x1805522011702144:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1156us (1185us total) trans 4296020067 rc 0/0 00000100:00100000:2.0:1721880422.306155:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632096 00000100:00100000:3.0:1721880422.306167:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088616680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011703040:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.306180:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727bf25 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.306184:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013639b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011702912:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.306195:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727bf1e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb7c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.306197:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012ba67b80/2, rc 0, transno 1052771 00000100:00100000:3.0:1721880422.306202:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012ba67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011702144:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.306234:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f020700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011704064:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.306311:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.306315:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.306322:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011704064 00000100:00100000:1.0:1721880422.306324:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257712384 00000100:00100000:2.0:1721880422.306324:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011704064 00000100:00100000:1.0:1721880422.306326:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257712384 00010000:00010000:1.0:1721880422.306332:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132c8cb40/0x8a60d30f571a52b8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1127fe expref: 1252 pid: 16081 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.306334:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632103 00000100:00100000:2.0:1721880422.306337:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013639b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2007:3687:x1805522011704064:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.306343:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914289 00002000:00080000:2.0:1721880422.306344:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64384 count 1 00000100:00100000:1.0:1721880422.306346:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+1252:2004:x1805522257712384:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.306350:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.306352:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132c8cb40/0x8a60d30f571a52b8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1127fe expref: 1252 pid: 16081 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.306352:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727bf48 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb80:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.306358:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132c8cb40/0x8a60d30f571a52b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1127fe expref: 1252 pid: 16081 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.306359:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009adc6880/0x8a60d30f571a5d93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb80:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112bb6 expref: 1252 pid: 16108 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.306364:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.306365:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132c8cb40/0x8a60d30f571a52b8 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1127fe expref: 1252 pid: 16081 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.306365:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.306366:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727bf48 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb80:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.306373:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.306374:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.306375:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727bf25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.306376:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009adc6880/0x8a60d30f571a5d93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb80:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112bb6 expref: 1251 pid: 16108 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.306382:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727bf25 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.306382:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009adc6880/0x8a60d30f571a5d93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb80:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112bb6 expref: 1251 pid: 16108 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.306387:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f022680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011704192:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.306391:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.306395:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727bf25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.306399:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727bf25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.306404:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+1251:2004:x1805522257712384:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 57us (89us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.306404:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727bf25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.306406:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde840 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.306408:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914289 00010000:00010000:3.0:1721880422.306408:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727bf25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.306412:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727bf25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.306415:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352ac0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.306416:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727bf25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.306420:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727bf25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.306427:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727bf25 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.306431:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727bf25 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.306443:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.306470:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257712512 00000100:00100000:0.0:1721880422.306474:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257712512 00010000:00010000:0.0:1721880422.306484:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880123aedb00/0x8a60d30f571a564d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb7c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112940 expref: 1251 pid: 16031 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.306498:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914290 00000100:00100000:0.0:1721880422.306501:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+1251:2005:x1805522257712512:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.306507:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.306509:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880123aedb00/0x8a60d30f571a564d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb7c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112940 expref: 1251 pid: 16031 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.306519:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880123aedb00/0x8a60d30f571a564d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb7c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112940 expref: 1251 pid: 16031 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.306521:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2008:3689:x1805522011702400:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1247us (1289us total) trans 4296020068 rc 0/0 00000100:00100000:3.0:1721880422.306525:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632099 00010000:00010000:0.0:1721880422.306528:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123aedb00/0x8a60d30f571a564d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb7c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112940 expref: 1251 pid: 16031 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.306534:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1721880422.306534:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.306536:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.306538:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727bf1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb7c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.306539:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f020380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011703936:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.306542:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727bf1e lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb7c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.306551:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.306553:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727bf41 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.306559:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.306561:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257712768 00010000:00010000:1.0:1721880422.306563:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727bf1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.306563:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257712640 00000100:00100000:3.0:1721880422.306563:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257712768 00000100:00100000:2.0:1721880422.306565:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257712640 00010000:00010000:1.0:1721880422.306568:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727bf1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.306571:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097026f40/0x8a60d30f571a544e lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11289f expref: 1252 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.306572:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727bf1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.306573:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134f39d40/0x8a60d30f571a580d lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb7d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1129be expref: 1252 pid: 16100 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.306576:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+1252:2005:x1805522257712512:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 74us (132us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.306576:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727bf1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.306579:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727bf1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.306581:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914290 00010000:00010000:1.0:1721880422.306583:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325c6c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.306585:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727bf1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.306587:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914291 00010000:00010000:1.0:1721880422.306589:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727bf1e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.306591:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1251:2005:x1805522257712768:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.306592:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914292 00010000:00010000:1.0:1721880422.306595:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727bf1e lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.306596:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.306596:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1251:2004:x1805522257712640:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.306599:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727bf1e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.306599:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097026f40/0x8a60d30f571a544e lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11289f expref: 1251 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.306601:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.306604:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134f39d40/0x8a60d30f571a580d lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb7d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1129be expref: 1251 pid: 16100 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.306605:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097026f40/0x8a60d30f571a544e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11289f expref: 1251 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.306611:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880136399500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011703168:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.306611:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134f39d40/0x8a60d30f571a580d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb7d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1129be expref: 1251 pid: 16100 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.306613:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.306614:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.306616:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106f600/0x8a60d30f5727bf17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.306619:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106f600/0x8a60d30f5727bf17 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.306619:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134f39d40/0x8a60d30f571a580d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb7d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1129be expref: 1251 pid: 16100 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.306623:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727bf2c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb7d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.306625:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.306626:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.306626:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.306629:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727bf2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb7d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.306633:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727bf2c lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb7d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.306643:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.306645:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727bf2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.306649:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727bf2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.306650:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1250:2005:x1805522257712768:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 57us (116us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.306655:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727bf2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.306655:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914291 00000100:00100000:3.0:1721880422.306657:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1250:2004:x1805522257712640:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 60us (105us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.306659:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727bf2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.306661:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914292 00010000:00010000:0.0:1721880422.306663:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727bf2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.306668:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325d680 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.306670:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727bf2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.306674:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880076fdfb80/2, rc 0, transno 1052772 00010000:00010000:0.0:1721880422.306676:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727bf2c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.306679:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076fdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011702400:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.306686:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727bf2c lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.306692:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727bf2c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.306705:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1721880422.306709:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088efd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2008:3686:x1805522011702656:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1477us (1507us total) trans 4296020069 rc 0/0 00000100:00100000:2.0:1721880422.306711:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801362d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011704320:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1721880422.306712:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880076fdc000/2, rc 0, transno 1052773 00000100:00100000:1.0:1721880422.306716:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632098 00000100:00100000:3.0:1721880422.306716:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011702656:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.306742:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.306752:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011704320 00000100:00100000:1.0:1721880422.306755:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011704320 00000100:00100000:2.0:1721880422.306758:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801362d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011704448:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.306766:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632104 00000100:00100000:1.0:1721880422.306768:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f020380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2009:3689:x1805522011704320:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.306770:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:1.0:1721880422.306777:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64385 count 1 00000100:00100000:3.0:1721880422.306781:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011704448 00000100:00100000:3.0:1721880422.306784:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011704448 00010000:00010000:1.0:1721880422.306785:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106fcc0/0x8a60d30f5727bf4f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.306792:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800982b7cc0/0x8a60d30f571a5f92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112c50 expref: 1248 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.306795:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632105 00010000:00010000:1.0:1721880422.306796:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1721880422.306797:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801366a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2010:3689:x1805522011704448:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.306798:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.306799:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106fcc0/0x8a60d30f5727bf4f lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.306806:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64386 count 1 00010000:00010000:1.0:1721880422.306812:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800982b7cc0/0x8a60d30f571a5f92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112c50 expref: 1248 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.306813:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727bf56 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.306818:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800982b7cc0/0x8a60d30f571a5f92 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112c50 expref: 1248 pid: 16120 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.306820:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094722400/0x8a60d30f571a6160 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112cff expref: 1248 pid: 15515 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.306824:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800994e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011704576:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.306824:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.306824:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.306826:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727bf56 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.306829:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801362d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2010:3689:x1805522011702784:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1457us (1545us total) trans 4296020070 rc 0/0 00000004:00080000:2.0:1721880422.306831:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801362db800/2, rc 0, transno 1052774 00010000:00010000:3.0:1721880422.306835:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094722400/0x8a60d30f571a6160 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112cff expref: 1248 pid: 15515 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.306836:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632100 00000100:00100000:1.0:1721880422.306838:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a180 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.306841:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801362db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011702784:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.306842:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094722400/0x8a60d30f571a6160 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112cff expref: 1248 pid: 15515 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.306849:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801362d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011704704:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.306852:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c1e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011703680:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.306861:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727bf3a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb7e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.306867:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.306871:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097026f40/0x8a60d30f571a544e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11289f expref: 1248 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.306872:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088616680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011704832:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.306879:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c1d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011703296:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.306883:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec000 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.306884:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106f600/0x8a60d30f5727bf17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.306885:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.306889:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106f600/0x8a60d30f5727bf17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.306891:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257713024 00010000:00010000:1.0:1721880422.306892:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106f600/0x8a60d30f5727bf17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.306893:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257713024 00010000:00010000:1.0:1721880422.306897:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106f600/0x8a60d30f5727bf17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.306900:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011704832 00010000:00010000:1.0:1721880422.306901:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106f600/0x8a60d30f5727bf17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.306901:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b1aaf40/0x8a60d30f571a5bfd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112b31 expref: 1248 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.306902:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011704832 00010000:00010000:1.0:1721880422.306905:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106f600/0x8a60d30f5727bf17 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.306908:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106f600 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.306910:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106f600/0x8a60d30f5727bf17 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.306912:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632106 00000100:00100000:3.0:1721880422.306913:0:8271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914293 00010000:00010000:1.0:1721880422.306914:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106f600/0x8a60d30f5727bf17 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.306915:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801366a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2010:3686:x1805522011704832:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.306916:0:8271:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e196c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+1248:2004:x1805522257713024:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.306919:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106f600/0x8a60d30f5727bf17 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.306920:0:8271:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.306922:0:8271:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b1aaf40/0x8a60d30f571a5bfd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112b31 expref: 1248 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.306923:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106f600/0x8a60d30f5727bf17 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.306923:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64387 count 1 00010000:00010000:3.0:1721880422.306927:0:8271:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b1aaf40/0x8a60d30f571a5bfd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112b31 expref: 1248 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.306930:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727bf5d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb83:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.306934:0:8271:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b1aaf40/0x8a60d30f571a5bfd lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112b31 expref: 1248 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.306938:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097989440/0x8a60d30f571a62cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112d76 expref: 1248 pid: 15465 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.306942:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.306942:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.306943:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.306943:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.306945:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727bf5d lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.306945:0:8271:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727bf41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.306949:0:8271:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727bf41 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.306956:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097989440/0x8a60d30f571a62cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112d76 expref: 1247 pid: 15465 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.306957:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.306964:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097989440/0x8a60d30f571a62cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112d76 expref: 1247 pid: 15465 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.306966:0:8271:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.306973:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801366a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011704960:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.306982:0:8271:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e196c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+1247:2004:x1805522257713024:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 65us (115us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.306985:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727bf41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.306986:0:8271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914293 00000100:00100000:0.0:1721880422.306989:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.306992:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727bf41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.306999:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727bf41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.307004:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880076fdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2011:3686:x1805522011702528:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1778us (1835us total) trans 4296020071 rc 0/0 00010000:00010000:2.0:1721880422.307006:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727bf41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.307008:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632097 00000100:00100000:3.0:1721880422.307010:0:8271:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257713152 00010000:00010000:2.0:1721880422.307027:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727bf41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.307029:0:8271:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257713152 00010000:00010000:2.0:1721880422.307033:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352640 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.307035:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727bf41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.307037:0:8271:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099c24b40/0x8a60d30f571a4e82 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1126a0 expref: 1247 pid: 16016 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.307040:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727bf41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.307044:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880076fde300/2, rc 0, transno 1052775 00010000:00010000:2.0:1721880422.307047:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727bf41 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.307050:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076fde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011702528:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.307051:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727bf41 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.307052:0:8271:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257712896 00000100:00100000:3.0:1721880422.307054:0:8271:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257712896 00010000:00010000:3.0:1721880422.307059:0:8271:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800971b7180/0x8a60d30f571a5a28 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb7e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112a82 expref: 1248 pid: 16031 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.307066:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1721880422.307067:0:8271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914294 00000100:00100000:1.0:1721880422.307070:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800994e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011705088:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.307070:0:8271:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136399500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+1248:2004:x1805522257713152:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.307074:0:8271:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.307076:0:8271:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099c24b40/0x8a60d30f571a4e82 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1126a0 expref: 1248 pid: 16016 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.307081:0:8271:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099c24b40/0x8a60d30f571a4e82 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1126a0 expref: 1248 pid: 16016 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.307084:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.307088:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.307089:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.307090:0:8271:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727bf33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.307091:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914295 00010000:00010000:3.0:1721880422.307095:0:8271:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727bf33 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.307097:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013639ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+1248:2005:x1805522257712896:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.307101:0:8271:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.307105:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.307110:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800971b7180/0x8a60d30f571a5a28 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb7e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112a82 expref: 1248 pid: 16031 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.307114:0:8271:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880136399500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+1248:2004:x1805522257713152:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 43us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.307117:0:8271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914294 00010000:00010000:0.0:1721880422.307119:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800971b7180/0x8a60d30f571a5a28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb7e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112a82 expref: 1248 pid: 16031 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.307131:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800971b7180/0x8a60d30f571a5a28 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb7e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112a82 expref: 1247 pid: 16031 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.307135:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2011:3686:x1805522011703552:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1375us (1419us total) trans 4296020072 rc 0/0 00000100:00100000:2.0:1721880422.307140:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632102 00010000:00010000:0.0:1721880422.307142:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.307143:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.307146:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727bf3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb7e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.307149:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011705088 00000100:00100000:2.0:1721880422.307151:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011705088 00010000:00010000:0.0:1721880422.307152:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727bf3a lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb7e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.307154:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088617b80/2, rc 0, transno 1052776 00000100:00100000:1.0:1721880422.307159:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088617b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011703552:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.307161:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632107 00000100:00100000:2.0:1721880422.307164:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800994eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2011:3686:x1805522011705088:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.307166:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00080000:2.0:1721880422.307171:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64388 count 1 00010000:00010000:2.0:1721880422.307179:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727bf64 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb84:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.307182:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727bf3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.307186:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c04a880/0x8a60d30f571a647e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112e10 expref: 1246 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.307187:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88013639ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+1246:2005:x1805522257712896:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 90us (197us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.307187:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727bf3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.307188:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800994e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011705216:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.307190:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.307191:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.307192:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727bf3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.307192:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727bf64 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.307193:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914295 00010000:00010000:1.0:1721880422.307195:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727bf3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.307199:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727bf3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.307202:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106c480 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.307203:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c04a880/0x8a60d30f571a647e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112e10 expref: 1245 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.307204:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727bf3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.307207:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727bf3a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.307209:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c04a880/0x8a60d30f571a647e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112e10 expref: 1245 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.307210:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.307215:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801366a2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011705344:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.307217:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727bf3a lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.307221:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727bf3a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.307226:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011705216 00000100:00100000:2.0:1721880422.307229:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde300 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.307229:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011705216 00000100:00100000:3.0:1721880422.307245:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632108 00000100:00100000:3.0:1721880422.307249:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088614700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2012:3688:x1805522011705216:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.307250:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f022680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011704192:192.168.201.24@tcp:104: 00002000:00080000:3.0:1721880422.307259:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64389 count 1 00010000:00010000:2.0:1721880422.307261:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727bf48 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb80:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.307269:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727bf6b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb85:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.307279:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a1b1b00/0x8a60d30f571a6668 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112e9c expref: 1245 pid: 9459 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.307282:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde180 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.307286:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.307287:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.307289:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727bf6b lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.307302:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.307302:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088615180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2013:3688:x1805522011703424:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1643us (1675us total) trans 4296020073 rc 0/0 00010000:00010000:3.0:1721880422.307305:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a1b1b00/0x8a60d30f571a6668 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112e9c expref: 1245 pid: 9459 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.307307:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632101 00010000:00010000:3.0:1721880422.307314:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a1b1b00/0x8a60d30f571a6668 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112e9c expref: 1245 pid: 9459 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.307317:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257713280 00000100:00100000:2.0:1721880422.307321:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257713280 00000100:00100000:3.0:1721880422.307322:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801362db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011705472:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.307333:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009adc6880/0x8a60d30f571a5d93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb80:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112bb6 expref: 1246 pid: 16108 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.307339:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdeccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.307348:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914296 00000100:00100000:2.0:1721880422.307352:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136399180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1246:2004:x1805522257713280:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000004:00080000:3.0:1721880422.307360:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088615880/2, rc 0, transno 1052777 00010000:00010000:2.0:1721880422.307363:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.307365:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088615880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011703424:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.307366:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009adc6880/0x8a60d30f571a5d93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb80:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112bb6 expref: 1246 pid: 16108 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.307376:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009adc6880/0x8a60d30f571a5d93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb80:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112bb6 expref: 1246 pid: 16108 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.307384:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009adc6880/0x8a60d30f571a5d93 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb80:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112bb6 expref: 1246 pid: 16108 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.307388:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1721880422.307391:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.307392:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.307392:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800994ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011705600:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.307394:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727bf48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb80:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.307399:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727bf48 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb80:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.307404:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.307407:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.307415:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011705600 00000100:00100000:3.0:1721880422.307417:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011705600 00000100:00100000:2.0:1721880422.307420:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880136399180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1245:2004:x1805522257713280:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 67us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.307424:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914296 00000100:00100000:3.0:1721880422.307427:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632109 00000100:00100000:3.0:1721880422.307430:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2013:3688:x1805522011705600:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.307436:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727bf48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.307437:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64390 count 1 00010000:00010000:2.0:1721880422.307441:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727bf48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.307444:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727bf72 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb86:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.307445:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727bf48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.307451:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ce1cfc0/0x8a60d30f571a692b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112f52 expref: 1244 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.307453:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727bf48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.307455:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.307456:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.307457:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727bf48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.307457:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727bf72 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.307460:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350d80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.307462:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727bf48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.307465:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727bf48 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.307470:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727bf48 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.307471:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ce1cfc0/0x8a60d30f571a692b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112f52 expref: 1244 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.307474:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727bf48 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.307476:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ce1cfc0/0x8a60d30f571a692b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112f52 expref: 1244 pid: 9458 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.307481:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099c24b40/0x8a60d30f571a4e82 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1126a0 expref: 1244 pid: 16016 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.307482:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800952a3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011705728:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.307495:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880136399f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011703808:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.307496:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec9c0 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.307509:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727bf33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.307516:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727bf33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.307555:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88013639b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2014:3687:x1805522011704064:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1216us (1244us total) trans 4296020074 rc 0/0 00000100:00100000:2.0:1721880422.307558:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632103 00000004:00080000:1.0:1721880422.307564:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012f020700/2, rc 0, transno 1052778 00000100:00100000:1.0:1721880422.307570:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f020700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011704064:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.307589:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800994e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011705856:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.307593:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727bf33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.307601:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.307623:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801362d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011704704:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.307632:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800994e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011704576:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.307634:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727bf56 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.307646:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106fcc0/0x8a60d30f5727bf4f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.307647:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727bf33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.307648:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011705856 00000100:00100000:2.0:1721880422.307650:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011705856 00010000:00010000:0.0:1721880422.307655:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727bf33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.307661:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632110 00010000:00010000:0.0:1721880422.307662:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727bf33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.307664:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800994ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2014:3686:x1805522011705856:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.307667:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.307668:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325d200 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.307671:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727bf33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.307671:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64391 count 1 00010000:00010000:0.0:1721880422.307678:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727bf33 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.307683:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257713536 00000100:00100000:2.0:1721880422.307685:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257713536 00010000:00010000:2.0:1721880422.307692:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800982b7cc0/0x8a60d30f571a5f92 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112c50 expref: 1244 pid: 16120 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.307692:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.307703:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257713408 00000100:00100000:2.0:1721880422.307704:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257713408 00000100:00100000:3.0:1721880422.307708:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914297 00010000:00010000:2.0:1721880422.307710:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094722400/0x8a60d30f571a6160 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112cff expref: 1245 pid: 15515 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.307712:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800952a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1245:2004:x1805522257713536:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.307718:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.307720:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914298 00010000:00010000:3.0:1721880422.307722:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800982b7cc0/0x8a60d30f571a5f92 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112c50 expref: 1245 pid: 16120 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.307723:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800952a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+1245:2004:x1805522257713408:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.307746:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.307746:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800982b7cc0/0x8a60d30f571a5f92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112c50 expref: 1245 pid: 16120 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.307751:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094722400/0x8a60d30f571a6160 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112cff expref: 1245 pid: 15515 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.307756:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800982b7cc0/0x8a60d30f571a5f92 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112c50 expref: 1245 pid: 16120 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.307759:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094722400/0x8a60d30f571a6160 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112cff expref: 1245 pid: 15515 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.307763:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.307764:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.307766:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106fcc0/0x8a60d30f5727bf4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.307770:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106fcc0/0x8a60d30f5727bf4f lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.307772:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094722400/0x8a60d30f571a6160 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112cff expref: 1244 pid: 15515 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.307779:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.307784:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.307786:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.307789:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727bf56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.307793:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800952a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1243:2004:x1805522257713536:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 81us (128us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.307796:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727bf56 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.307797:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914297 00010000:00010000:2.0:1721880422.307809:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.307812:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727bf33 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.307818:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727bf33 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.307829:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800952a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+1242:2004:x1805522257713408:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 103us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.307834:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914298 00010000:00010000:1.0:1721880422.307837:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106fcc0/0x8a60d30f5727bf4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.307845:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106fcc0/0x8a60d30f5727bf4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.307850:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727bf56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.307851:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106fcc0/0x8a60d30f5727bf4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.307856:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727bf56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.307858:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106fcc0/0x8a60d30f5727bf4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.307861:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727bf56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.307865:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106fcc0/0x8a60d30f5727bf4f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.307865:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727bf56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.307869:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727bf56 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.307870:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106fcc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.307873:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106fcc0/0x8a60d30f5727bf4f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.307876:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa9200 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.307878:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727bf56 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.307880:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106fcc0/0x8a60d30f5727bf4f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.307882:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727bf56 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.307888:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727bf56 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.307889:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106fcc0/0x8a60d30f5727bf4f lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.307891:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727bf56 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.307895:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106fcc0/0x8a60d30f5727bf4f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.307915:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801366a2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011705344:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.307922:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727bf64 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.308003:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801366a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011704960:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.308010:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f020380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2016:3689:x1805522011704320:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1238us (1281us total) trans 4296020075 rc 0/0 00000100:00100000:2.0:1721880422.308028:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801366a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2016:3689:x1805522011704448:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1228us (1255us total) trans 4296020076 rc 0/0 00010000:00010000:3.0:1721880422.308031:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727bf5d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.308033:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632104 00000100:00100000:2.0:1721880422.308036:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632105 00010000:00010000:2.0:1721880422.308054:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727bf79 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb87:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.308061:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0d7db00/0x8a60d30f571a6ac1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112fe5 expref: 1241 pid: 16130 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.308064:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801362d8700/2, rc 0, transno 1052780 00010000:00010000:2.0:1721880422.308069:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.308070:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1721880422.308071:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801362d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011704448:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.308072:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727bf79 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.308074:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801362db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011705472:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.308082:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0d7db00/0x8a60d30f571a6ac1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112fe5 expref: 1241 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.308082:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727bf6b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.308088:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0d7db00/0x8a60d30f571a6ac1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112fe5 expref: 1241 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.308089:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.308094:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801366a2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011705984:192.168.201.24@tcp:104: 00000004:00080000:1.0:1721880422.308095:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801362d9880/2, rc 0, transno 1052779 00000100:00100000:3.0:1721880422.308098:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800952a3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011705728:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.308101:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801362d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011704320:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.308103:0:15444:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257713664 00000100:00100000:2.0:1721880422.308105:0:15444:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257713664 00010000:00010000:3.0:1721880422.308105:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727bf72 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.308109:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.308112:0:15444:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c04a880/0x8a60d30f571a647e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112e10 expref: 1242 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.308119:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.308122:0:15444:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257713920 00000100:00100000:2.0:1721880422.308124:0:15444:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257713920 00010000:00010000:2.0:1721880422.308129:0:15444:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a1b1b00/0x8a60d30f571a6668 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112e9c expref: 1243 pid: 9459 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.308129:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257713792 00000100:00100000:1.0:1721880422.308130:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1721880422.308131:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257713792 00000100:00100000:1.0:1721880422.308136:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800994e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011706112:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.308140:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914299 00010000:00010000:3.0:1721880422.308141:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097989440/0x8a60d30f571a62cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112d76 expref: 1244 pid: 15465 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.308143:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136399f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1244:2005:x1805522257713664:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.308148:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.308152:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c04a880/0x8a60d30f571a647e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb84:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112e10 expref: 1244 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.308156:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.308156:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914300 00000100:00100000:3.0:1721880422.308159:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5276c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1244:2005:x1805522257713920:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.308160:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.308161:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c04a880/0x8a60d30f571a647e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb84:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112e10 expref: 1244 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.308165:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.308168:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a1b1b00/0x8a60d30f571a6668 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb85:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112e9c expref: 1244 pid: 9459 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.308173:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c04a880/0x8a60d30f571a647e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb84:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112e10 expref: 1244 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.308174:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a1b1b00/0x8a60d30f571a6668 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb85:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112e9c expref: 1244 pid: 9459 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.308177:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257714048 00000100:00100000:1.0:1721880422.308180:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257714048 00010000:00010000:3.0:1721880422.308182:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a1b1b00/0x8a60d30f571a6668 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb85:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112e9c expref: 1243 pid: 9459 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.308183:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.308184:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.308187:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727bf64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.308188:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.308189:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.308191:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727bf6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.308192:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ce1cfc0/0x8a60d30f571a692b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112f52 expref: 1243 pid: 9458 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.308194:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727bf64 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.308195:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727bf6b lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.308202:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.308208:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.308209:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914301 00000100:00100000:1.0:1721880422.308213:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136398000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1243:2005:x1805522257713792:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.308216:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5276c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1243:2005:x1805522257713920:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 56us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.308219:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914300 00010000:00010000:1.0:1721880422.308220:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.308224:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097989440/0x8a60d30f571a62cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb83:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112d76 expref: 1243 pid: 15465 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.308226:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880136399f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1242:2005:x1805522257713664:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 81us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.308228:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914302 00000100:00100000:3.0:1721880422.308231:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136398700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1242:2005:x1805522257714048:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.308233:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097989440/0x8a60d30f571a62cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb83:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112d76 expref: 1242 pid: 15465 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.308233:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914299 00010000:00010000:3.0:1721880422.308234:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.308237:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ce1cfc0/0x8a60d30f571a692b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112f52 expref: 1242 pid: 9458 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.308243:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ce1cfc0/0x8a60d30f571a692b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112f52 expref: 1241 pid: 9458 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.308244:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097989440/0x8a60d30f571a62cc lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb83:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112d76 expref: 1241 pid: 15465 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.308249:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ce1cfc0/0x8a60d30f571a692b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112f52 expref: 1241 pid: 9458 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.308255:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.308255:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.308256:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.308256:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.308258:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727bf72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.308259:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727bf5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.308260:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2015:3686:x1805522011702016:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3315us (3463us total) trans 4296020077 rc 0/0 00010000:00010000:3.0:1721880422.308262:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727bf72 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.308266:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727bf5d lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.308267:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632095 00010000:00010000:3.0:1721880422.308268:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.308270:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727bf64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.308275:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727bf64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.308276:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880136398700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1239:2005:x1805522257714048:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 44us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.308279:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914302 00010000:00010000:1.0:1721880422.308280:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.308280:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727bf64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.308284:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727bf64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.308288:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727bf64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.308292:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353180 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.308293:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727bf64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.308295:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727bf6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.308296:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880136398000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1238:2005:x1805522257713792:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 81us (175us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.308297:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727bf64 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.308299:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727bf6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.308301:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914301 00010000:00010000:2.0:1721880422.308303:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727bf64 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.308304:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727bf6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.308306:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727bf64 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.308308:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727bf6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.308312:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727bf6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.308315:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8240 already unused, calling callback (ffffffffa084e330) 00000100:00100000:1.0:1721880422.308317:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1721880422.308317:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727bf6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.308321:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727bf6b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.308322:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800994ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011706240:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.308326:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727bf6b lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.308329:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727bf6b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.308339:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.308356:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011706112 00000100:00100000:1.0:1721880422.308358:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011706112 00000100:00100000:0.0:1721880422.308368:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011706240 00000100:00100000:0.0:1721880422.308371:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011706240 00000100:00100000:1.0:1721880422.308373:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632111 00000100:00100000:1.0:1721880422.308377:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800994eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2018:3686:x1805522011706112:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.308385:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632112 00000100:00100000:2.0:1721880422.308386:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800994eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2018:3686:x1805522011705088:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1220us (1300us total) trans 4296020078 rc 0/0 00000100:00100000:0.0:1721880422.308388:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800994e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2018:3689:x1805522011706240:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.308388:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64392 count 1 00000100:00100000:2.0:1721880422.308391:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632107 00002000:00080000:0.0:1721880422.308397:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64393 count 1 00010000:00010000:1.0:1721880422.308398:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106df80/0x8a60d30f5727bf80 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb88:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.308405:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727bf87 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb89:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.308408:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a603180/0x8a60d30f571a6c49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113094 expref: 1237 pid: 16050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.308413:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009750a880/0x8a60d30f571a6da0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11310b expref: 1237 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.308413:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.308414:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.308417:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.308417:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106df80/0x8a60d30f5727bf80 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.308418:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1721880422.308420:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088614700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2017:3688:x1805522011705216:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1170us (1210us total) trans 4296020079 rc 0/0 00010000:00010000:0.0:1721880422.308421:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727bf87 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.308424:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632108 00000100:00100000:2.0:1721880422.308427:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde300 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.308431:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a603180/0x8a60d30f571a6c49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113094 expref: 1237 pid: 16050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.308432:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009750a880/0x8a60d30f571a6da0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11310b expref: 1237 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.308437:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727bf72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.308439:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009750a880/0x8a60d30f571a6da0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11310b expref: 1237 pid: 16090 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.308441:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727bf72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.308445:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013639bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011706496:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.308445:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a603180/0x8a60d30f571a6c49 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113094 expref: 1237 pid: 16050 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.308445:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727bf72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.308449:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727bf72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.308452:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727bf72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.308454:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800994eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011706368:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.308456:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8fc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.308457:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727bf72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.308459:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e480 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.308461:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727bf72 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.308466:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727bf72 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.308469:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727bf72 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.308473:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a180 going to sleep for 11 seconds 00000004:00080000:1.0:1721880422.308490:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800994e8700/2, rc 0, transno 1052782 00000100:00100000:1.0:1721880422.308498:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800994e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011705088:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1721880422.308508:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012ba66300/2, rc 0, transno 1052781 00000100:00100000:1.0:1721880422.308511:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012ba66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011702016:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.308524:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727bf5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.308531:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727bf5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.308532:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013639a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011706624:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.308538:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727bf5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.308540:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2017:3688:x1805522011705600:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1109us (1134us total) trans 4296020080 rc 0/0 00010000:00010000:1.0:1721880422.308545:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727bf5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.308545:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632109 00000100:00100000:0.0:1721880422.308548:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.308551:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727bf5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.308555:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011706624 00000100:00100000:3.0:1721880422.308557:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011706624 00010000:00010000:1.0:1721880422.308561:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350000 already unused, calling callback (ffffffffa084e330) 00000100:00100000:0.0:1721880422.308564:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880136399c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011706752:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.308564:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727bf5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.308568:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632113 00000100:00100000:3.0:1721880422.308570:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136398380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2017:3689:x1805522011706624:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.308571:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727bf5d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.308575:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1721880422.308578:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64394 count 1 00010000:00010000:1.0:1721880422.308580:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727bf5d lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.308584:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727bf8e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.308586:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727bf5d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.308591:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098bb2ac0/0x8a60d30f571a6f0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113190 expref: 1237 pid: 16079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.308595:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1721880422.308596:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011706752 00010000:00010000:3.0:1721880422.308596:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.308597:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727bf8e lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.308599:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011706752 00010000:00010000:3.0:1721880422.308607:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098bb2ac0/0x8a60d30f571a6f0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113190 expref: 1237 pid: 16079 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.308610:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632114 00010000:00010000:3.0:1721880422.308612:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098bb2ac0/0x8a60d30f571a6f0c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113190 expref: 1237 pid: 16079 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.308613:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013639aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2018:3686:x1805522011706752:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.308617:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800952a3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011706880:192.168.201.24@tcp:104: 00002000:00080000:0.0:1721880422.308621:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64395 count 1 00010000:00010000:0.0:1721880422.308629:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727bf95 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb8b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.308630:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec9c0 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.308637:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b773180/0x8a60d30f571a7127 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113231 expref: 1237 pid: 16031 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.308641:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.308642:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.308644:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727bf95 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.308645:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800994ebb80/2, rc 0, transno 1052784 00000100:00100000:3.0:1721880422.308659:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800994ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011705600:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1721880422.308665:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800994e8e00/2, rc 0, transno 1052783 00000100:00100000:3.0:1721880422.308668:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800994e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011705216:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.308682:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1721880422.308685:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801366a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2019:3686:x1805522011704832:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1767us (1797us total) trans 4296020081 rc 0/0 00000100:00100000:0.0:1721880422.308687:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880136399180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011707136:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.308692:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632106 00000100:00100000:0.0:1721880422.308700:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.308707:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011707136 00000100:00100000:1.0:1721880422.308710:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011707136 00000004:00080000:0.0:1721880422.308722:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088616680/2, rc 0, transno 1052785 00000100:00100000:1.0:1721880422.308725:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632115 00000100:00100000:0.0:1721880422.308726:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088616680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011704832:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.308745:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1721880422.308748:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136399f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2019:3689:x1805522011707136:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.308759:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64397 count 1 00000100:00100000:0.0:1721880422.308761:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008c40aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011707264:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.308768:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106db00/0x8a60d30f5727bf9c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.308772:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.308778:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa4a400/0x8a60d30f571a7429 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113326 expref: 1237 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.308780:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011707264 00000100:00100000:2.0:1721880422.308783:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011707264 00010000:00010000:0.0:1721880422.308786:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b773180/0x8a60d30f571a7127 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113231 expref: 1237 pid: 16031 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.308790:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.308791:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.308792:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b773180/0x8a60d30f571a7127 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113231 expref: 1237 pid: 16031 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.308794:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106db00/0x8a60d30f5727bf9c lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.308796:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632116 00000100:00100000:0.0:1721880422.308800:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880136399500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011707392:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.308800:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2020:3689:x1805522011707264:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.308808:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64398 count 1 00010000:00010000:1.0:1721880422.308809:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa4a400/0x8a60d30f571a7429 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113326 expref: 1237 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.308813:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e600 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.308816:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727bfa3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.308818:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa4a400/0x8a60d30f571a7429 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113326 expref: 1237 pid: 16111 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.308819:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013639ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011707008:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.308824:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096629200/0x8a60d30f571a75f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1133ce expref: 1237 pid: 15468 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.308828:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c1f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011707520:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.308828:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.308829:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.308831:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727bfa3 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.308834:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.308842:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096629200/0x8a60d30f571a75f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1133ce expref: 1237 pid: 15468 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.308847:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522ae40 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.308847:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096629200/0x8a60d30f571a75f7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1133ce expref: 1237 pid: 15468 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.308847:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011707008 00000100:00100000:3.0:1721880422.308849:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011707008 00000100:00100000:2.0:1721880422.308853:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801366a3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011707648:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.308862:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632117 00000100:00100000:3.0:1721880422.308865:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2021:3686:x1805522011707008:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.308868:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde600 going to sleep for 11 seconds 00002000:00080000:3.0:1721880422.308872:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64396 count 1 00010000:00010000:3.0:1721880422.308880:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727bfaa lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.308887:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d2098c0/0x8a60d30f571a7293 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11328c expref: 1237 pid: 16048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.308891:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.308892:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.308893:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727bfaa lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.308903:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d2098c0/0x8a60d30f571a7293 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11328c expref: 1237 pid: 16048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.308908:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d2098c0/0x8a60d30f571a7293 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11328c expref: 1237 pid: 16048 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.308914:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800952a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011707776:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.308931:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdeccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.309522:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801366a2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011705984:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.309531:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727bf79 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.309558:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800994eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011706368:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.309574:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106df80/0x8a60d30f5727bf80 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.309595:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013639bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011706496:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.309607:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727bf87 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.309759:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.309769:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800952a3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011706880:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.309781:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727bf8e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.309782:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.309790:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.309799:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257714304 00000100:00100000:1.0:1721880422.309803:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257714304 00000100:00100000:0.0:1721880422.309811:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.309815:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0d7db00/0x8a60d30f571a6ac1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112fe5 expref: 1238 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.309823:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.309832:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257714176 00000100:00100000:3.0:1721880422.309835:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257714176 00000100:00100000:0.0:1721880422.309843:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.309843:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257714432 00000100:00100000:3.0:1721880422.309844:0:8271:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257714560 00000100:00100000:1.0:1721880422.309845:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257714432 00000100:00100000:3.0:1721880422.309846:0:8271:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257714560 00000100:00100000:2.0:1721880422.309848:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c1f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011707520:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.309853:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a603180/0x8a60d30f571a6c49 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113094 expref: 1241 pid: 16050 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.309854:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257714688 00010000:00010000:3.0:1721880422.309856:0:8271:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098bb2ac0/0x8a60d30f571a6f0c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113190 expref: 1241 pid: 16079 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.309857:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257714688 00010000:00010000:2.0:1721880422.309865:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106db00/0x8a60d30f5727bf9c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.309867:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b773180/0x8a60d30f571a7127 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113231 expref: 1242 pid: 16031 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.309875:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257714816 00000100:00100000:1.0:1721880422.309878:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257714816 00000100:00100000:3.0:1721880422.309883:0:8271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914303 00010000:00010000:1.0:1721880422.309887:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa4a400/0x8a60d30f571a7429 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113326 expref: 1243 pid: 16111 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.309889:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914304 00000100:00100000:3.0:1721880422.309891:0:8271:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135172680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+1243:2004:x1805522257714304:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.309893:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1243:2004:x1805522257714432:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.309898:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914305 00010000:00010000:3.0:1721880422.309898:0:8271:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.309902:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.309903:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+1243:2004:x1805522257714560:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.309903:0:8271:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0d7db00/0x8a60d30f571a6ac1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112fe5 expref: 1243 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.309907:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a603180/0x8a60d30f571a6c49 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113094 expref: 1243 pid: 16050 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.309909:0:8271:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0d7db00/0x8a60d30f571a6ac1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112fe5 expref: 1243 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.309911:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914306 00010000:00010000:2.0:1721880422.309912:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.309917:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a603180/0x8a60d30f571a6c49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113094 expref: 1243 pid: 16050 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.309917:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e195850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1243:2004:x1805522257714688:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.309917:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098bb2ac0/0x8a60d30f571a6f0c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113190 expref: 1243 pid: 16079 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.309917:0:8271:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0d7db00/0x8a60d30f571a6ac1 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b112fe5 expref: 1243 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.309924:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.309925:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.309925:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.309927:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098bb2ac0/0x8a60d30f571a6f0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113190 expref: 1242 pid: 16079 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.309927:0:8271:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727bf79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.309929:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b773180/0x8a60d30f571a7127 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113231 expref: 1242 pid: 16031 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.309931:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a603180/0x8a60d30f571a6c49 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113094 expref: 1242 pid: 16050 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.309934:0:8271:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727bf79 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.309938:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b773180/0x8a60d30f571a7127 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113231 expref: 1241 pid: 16031 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.309939:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098bb2ac0/0x8a60d30f571a6f0c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113190 expref: 1241 pid: 16079 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.309943:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.309943:0:8271:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.309944:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.309947:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106df80/0x8a60d30f5727bf80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.309949:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.309950:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.309951:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.309952:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.309953:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727bf8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.309954:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106df80/0x8a60d30f5727bf80 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.309955:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727bf95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.309960:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727bf8e lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.309960:0:8271:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135172680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+1240:2004:x1805522257714304:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 72us (203us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.309961:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727bf95 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.309964:0:8271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914303 00010000:00010000:0.0:1721880422.309973:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.309973:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.309975:0:8271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914307 00010000:00010000:1.0:1721880422.309978:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.309978:0:8271:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+1239:2005:x1805522257714816:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.309982:0:8271:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.309984:0:8271:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa4a400/0x8a60d30f571a7429 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113326 expref: 1239 pid: 16111 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.309992:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+1239:2004:x1805522257714560:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 88us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.309997:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914305 00000100:00100000:0.0:1721880422.309998:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1239:2004:x1805522257714432:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 103us (206us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.310000:0:8271:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa4a400/0x8a60d30f571a7429 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113326 expref: 1239 pid: 16111 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.310003:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914304 00000100:00100000:1.0:1721880422.310003:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e195850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1239:2004:x1805522257714688:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 85us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.310010:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914306 00010000:00010000:3.0:1721880422.310010:0:8271:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa4a400/0x8a60d30f571a7429 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113326 expref: 1238 pid: 16111 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.310031:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.310031:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.310034:0:8271:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106db00/0x8a60d30f5727bf9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.310038:0:8271:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106db00/0x8a60d30f5727bf9c lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.310039:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b773180/0x8a60d30f571a7127 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113231 expref: 1235 pid: 16031 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.310047:0:8271:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.310048:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880136399500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011707392:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.310055:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106df80/0x8a60d30f5727bf80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.310055:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106db00/0x8a60d30f5727bf9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.310057:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727bf95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.310059:0:8271:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+1234:2005:x1805522257714816:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 80us (214us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.310060:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106db00/0x8a60d30f5727bf9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.310062:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727bf95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.310063:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106df80/0x8a60d30f5727bf80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.310063:0:8271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914307 00010000:00010000:2.0:1721880422.310065:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106db00/0x8a60d30f5727bf9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.310066:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727bf95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.310069:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106db00/0x8a60d30f5727bf9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.310070:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727bf95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.310070:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106df80/0x8a60d30f5727bf80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.310073:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106db00/0x8a60d30f5727bf9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.310074:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727bf95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.310077:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106df80/0x8a60d30f5727bf80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.310078:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727bf95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.310078:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106db00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.310079:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106db00/0x8a60d30f5727bf9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.310080:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009750a880/0x8a60d30f571a6da0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11310b expref: 1233 pid: 16090 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.310081:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325f3c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.310083:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727bf95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.310083:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106db00/0x8a60d30f5727bf9c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.310084:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106df80/0x8a60d30f5727bf80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.310089:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106df80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.310089:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106db00/0x8a60d30f5727bf9c lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.310091:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727bf95 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.310091:0:7116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914308 00010000:00010000:1.0:1721880422.310092:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106df80/0x8a60d30f5727bf80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.310093:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106db00/0x8a60d30f5727bf9c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.310094:0:7116:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1233:2004:x1805522257714176:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.310097:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727bf95 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.310098:0:7116:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.310099:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106df80/0x8a60d30f5727bf80 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.310100:0:7116:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009750a880/0x8a60d30f571a6da0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11310b expref: 1233 pid: 16090 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.310101:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727bf95 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.310105:0:7116:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009750a880/0x8a60d30f571a6da0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11310b expref: 1233 pid: 16090 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.310112:0:7116:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009750a880/0x8a60d30f571a6da0 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11310b expref: 1233 pid: 16090 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.310113:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106df80/0x8a60d30f5727bf80 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.310118:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.310119:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106df80/0x8a60d30f5727bf80 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.310119:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.310121:0:7116:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727bf87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.310125:0:7116:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727bf87 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.310132:0:7116:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.310140:0:7116:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1232:2004:x1805522257714176:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 45us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.310143:0:7116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914308 00010000:00010000:3.0:1721880422.310170:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727bf8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.310174:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727bf8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.310178:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727bf8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.310182:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727bf8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.310186:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727bf8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.310189:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880136399f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2024:3689:x1805522011707136:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1441us (1487us total) trans 4296020082 rc 0/0 00010000:00010000:3.0:1721880422.310189:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa9d40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.310190:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727bf8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.310193:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632115 00010000:00010000:3.0:1721880422.310194:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727bf8e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.310201:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88013639aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2023:3686:x1805522011706752:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1586us (1624us total) trans 4296020083 rc 0/0 00010000:00010000:3.0:1721880422.310202:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727bf8e lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.310206:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632114 00010000:00010000:3.0:1721880422.310206:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727bf8e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.310213:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880136399180/2, rc 0, transno 1052786 00000100:00100000:2.0:1721880422.310217:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880136399180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011707136:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1721880422.310225:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880136399c00/2, rc 0, transno 1052787 00000100:00100000:0.0:1721880422.310228:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880136399c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011706752:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1721880422.310236:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800994e8a80/2, rc 0, transno 1052788 00000100:00100000:0.0:1721880422.310239:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800994e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011706112:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.310241:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800994eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2023:3686:x1805522011706112:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1861us (2083us total) trans 4296020084 rc 0/0 00000100:00100000:0.0:1721880422.310246:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801366a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011707904:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.310248:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801366a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011708160:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.310249:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632111 00000100:00100000:0.0:1721880422.310259:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.310265:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011707904 00000100:00100000:0.0:1721880422.310269:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1721880422.310269:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011707904 00000100:00100000:0.0:1721880422.310272:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801366a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011708032:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.310277:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.310284:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011708160 00000100:00100000:0.0:1721880422.310287:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.310287:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011708160 00000100:00100000:2.0:1721880422.310295:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011708032 00000100:00100000:2.0:1721880422.310298:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011708032 00000100:00100000:1.0:1721880422.310302:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632118 00000100:00100000:3.0:1721880422.310302:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880136398380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2025:3689:x1805522011706624:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1728us (1752us total) trans 4296020085 rc 0/0 00000100:00100000:0.0:1721880422.310308:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632119 00000100:00100000:1.0:1721880422.310308:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2025:3686:x1805522011707904:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.310312:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801366a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2025:3688:x1805522011708160:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.310313:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632113 00000100:00100000:2.0:1721880422.310316:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632120 00002000:00080000:1.0:1721880422.310317:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64399 count 1 00000100:00100000:2.0:1721880422.310319:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2025:3686:x1805522011708032:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.310322:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64401 count 1 00010000:00010000:1.0:1721880422.310325:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106d200/0x8a60d30f5727bfb1 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.310327:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64400 count 1 00010000:00010000:0.0:1721880422.310330:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727bfb8 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb91:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.310332:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0fef600/0x8a60d30f571a7771 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113437 expref: 1231 pid: 16016 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.310335:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727bfbf lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb90:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.310336:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.310337:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.310338:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007b9006c0/0x8a60d30f571a7b22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113572 expref: 1231 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.310338:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106d200/0x8a60d30f5727bfb1 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.310342:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88013639a300/2, rc 0, transno 1052789 00010000:00010000:0.0:1721880422.310343:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.310343:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c8e7180/0x8a60d30f571a795b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1134ca expref: 1231 pid: 16016 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.310344:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.310346:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727bfb8 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.310347:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.310348:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.310350:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727bfbf lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.310350:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013639a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011706624:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.310352:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0fef600/0x8a60d30f571a7771 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113437 expref: 1231 pid: 16016 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.310356:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007b9006c0/0x8a60d30f571a7b22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113572 expref: 1231 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.310358:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0fef600/0x8a60d30f571a7771 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113437 expref: 1231 pid: 16016 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.310359:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c8e7180/0x8a60d30f571a795b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1134ca expref: 1231 pid: 16016 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.310362:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007b9006c0/0x8a60d30f571a7b22 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113572 expref: 1231 pid: 16111 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.310364:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c1ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011708288:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.310369:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c7fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011708416:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.310369:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c8e7180/0x8a60d30f571a795b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1134ca expref: 1231 pid: 16016 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.310374:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801366a0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011708544:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.310379:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a180 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.310379:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800952a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011708672:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.310384:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e600 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.310385:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde300 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.310395:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727bf87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.310396:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.310399:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727bf87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.310404:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727bf87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.310408:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727bf87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.310412:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727bf87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.310413:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011708672 00000100:00100000:2.0:1721880422.310415:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011708672 00010000:00010000:1.0:1721880422.310417:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325e1c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.310420:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727bf87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.310422:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727bf79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.310426:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727bf87 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.310426:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727bf79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.310427:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801366a3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011707648:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.310431:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727bf79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.310435:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727bf87 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.310435:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727bfa3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.310435:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727bf79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.310441:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727bf87 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.310442:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727bf79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.310445:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350fc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.310446:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727bf79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.310447:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.310450:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727bf79 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.310454:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632121 00000100:00100000:2.0:1721880422.310457:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800952a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2025:3689:x1805522011708672:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.310458:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727bf79 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.310462:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727bf79 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.310463:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64402 count 1 00010000:00010000:2.0:1721880422.310470:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727bfc6 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb92:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.310476:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e968b40/0x8a60d30f571a7ce2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1135f0 expref: 1231 pid: 16029 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.310479:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257714944 00010000:00010000:2.0:1721880422.310480:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.310481:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1721880422.310481:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257714944 00010000:00010000:2.0:1721880422.310483:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727bfc6 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.310489:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096629200/0x8a60d30f571a75f7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1133ce expref: 1232 pid: 15468 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.310494:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e968b40/0x8a60d30f571a7ce2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1135f0 expref: 1232 pid: 16029 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.310501:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.310501:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e968b40/0x8a60d30f571a7ce2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1135f0 expref: 1232 pid: 16029 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.310502:0:7116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914309 00000100:00100000:3.0:1721880422.310505:0:7116:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1232:2005:x1805522257714944:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.310506:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801366a3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011708800:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.310510:0:7116:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.310512:0:7116:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096629200/0x8a60d30f571a75f7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1133ce expref: 1232 pid: 15468 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.310518:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde600 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.310518:0:7116:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096629200/0x8a60d30f571a75f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1133ce expref: 1232 pid: 15468 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.310524:0:7116:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096629200/0x8a60d30f571a75f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1133ce expref: 1232 pid: 15468 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.310532:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.310533:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.310536:0:7116:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727bfa3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.310542:0:7116:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727bfa3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.310554:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800994e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2026:3689:x1805522011706240:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2164us (2213us total) trans 4296020086 rc 0/0 00010000:00010000:3.0:1721880422.310555:0:7116:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.310561:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632112 00010000:00010000:2.0:1721880422.310561:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727bfa3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.310566:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727bfa3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.310570:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727bfa3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.310574:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727bfa3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.310574:0:7116:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1231:2005:x1805522257714944:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 67us (125us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.310577:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727bfa3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.310580:0:7116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914309 00010000:00010000:2.0:1721880422.310581:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136351200 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.310582:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727bfa3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.310587:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727bfa3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.310588:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800994ea300/2, rc 0, transno 1052790 00000100:00100000:3.0:1721880422.310590:0:7116:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257715072 00000100:00100000:3.0:1721880422.310593:0:7116:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257715072 00000100:00100000:1.0:1721880422.310594:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800994ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011706240:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.310594:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727bfa3 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.310597:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727bfa3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.310600:0:7116:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d2098c0/0x8a60d30f571a7293 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11328c expref: 1231 pid: 16048 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.310613:0:7116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914310 00000100:00100000:3.0:1721880422.310617:0:7116:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1231:2004:x1805522257715072:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.310622:0:7116:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.310625:0:7116:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d2098c0/0x8a60d30f571a7293 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11328c expref: 1231 pid: 16048 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.310630:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011708928:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.310633:0:7116:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d2098c0/0x8a60d30f571a7293 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11328c expref: 1231 pid: 16048 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.310643:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.310644:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.310647:0:7116:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727bfaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.310651:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.310653:0:7116:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727bfaa lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.310663:0:7116:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.310665:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011708928 00000100:00100000:1.0:1721880422.310668:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011708928 00000100:00100000:3.0:1721880422.310678:0:7116:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1231:2004:x1805522257715072:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 61us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.310682:0:7116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914310 00000100:00100000:1.0:1721880422.310683:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632122 00000100:00100000:1.0:1721880422.310686:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2027:3686:x1805522011708928:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.310686:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2027:3689:x1805522011707264:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1885us (1912us total) trans 4296020087 rc 0/0 00000100:00100000:2.0:1721880422.310691:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632116 00002000:00080000:1.0:1721880422.310694:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64403 count 1 00010000:00010000:1.0:1721880422.310702:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727bfcd lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.310706:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d2098c0/0x8a60d30f571a7293 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11328c expref: 1230 pid: 16048 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.310709:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099097180/0x8a60d30f571a7ef6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113698 expref: 1230 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.310713:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.310714:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1721880422.310714:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800952a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011707776:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.310716:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727bfcd lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.310724:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727bfaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.310748:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727bfaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.310749:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099097180/0x8a60d30f571a7ef6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113698 expref: 1229 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.310755:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099097180/0x8a60d30f571a7ef6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113698 expref: 1229 pid: 16075 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.310755:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727bfaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.310759:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727bfaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.310762:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c1df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011709056:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.310763:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727bfaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.310766:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727bfaa lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.310769:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8480 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.310771:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727bfaa lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.310775:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727bfaa lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.310780:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727bfaa lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.310781:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a840 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.310784:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727bfaa lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.310856:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008c40aa00/2, rc 0, transno 1052791 00000100:00100000:1.0:1721880422.310860:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008c40aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011707264:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.310871:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2027:3686:x1805522011707008:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2005us (2037us total) trans 4296020088 rc 0/0 00000100:00100000:3.0:1721880422.310876:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632117 00000100:00100000:1.0:1721880422.310877:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011709184:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.310890:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.310926:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011709184 00000100:00100000:2.0:1721880422.310929:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011709184 00000100:00100000:2.0:1721880422.310943:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632123 00000100:00100000:3.0:1721880422.310943:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800994ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2028:3686:x1805522011705856:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3277us (3340us total) trans 4296020089 rc 0/0 00000100:00100000:2.0:1721880422.310945:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2028:3687:x1805522011709184:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.310947:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632110 00000004:00080000:0.0:1721880422.310949:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88013639ad80/2, rc 0, transno 1052792 00002000:00080000:2.0:1721880422.310954:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64404 count 1 00000100:00100000:0.0:1721880422.310957:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013639ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011707008:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.310961:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727bfd4 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.310969:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130655d40/0x8a60d30f571a80c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113739 expref: 1229 pid: 16099 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.310970:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800994e9500/2, rc 0, transno 1052793 00010000:00010000:2.0:1721880422.310973:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1721880422.310974:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1721880422.310974:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.310976:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727bfd4 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.310984:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800994e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011705856:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.310988:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130655d40/0x8a60d30f571a80c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113739 expref: 1229 pid: 16099 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.310993:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011709312:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.310995:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130655d40/0x8a60d30f571a80c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113739 expref: 1229 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.311001:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801366a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011709440:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.311005:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.311027:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011709312 00000100:00100000:3.0:1721880422.311029:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011709312 00000100:00100000:2.0:1721880422.311030:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.311034:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011709568:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.311045:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632124 00000100:00100000:1.0:1721880422.311049:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.311050:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2028:3689:x1805522011709312:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.311060:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011709568 00002000:00080000:2.0:1721880422.311061:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64405 count 1 00000100:00100000:3.0:1721880422.311062:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011709568 00010000:00010000:2.0:1721880422.311070:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727bfdb lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.311071:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632125 00000100:00100000:3.0:1721880422.311074:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2029:3689:x1805522011709568:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.311080:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009759cd80/0x8a60d30f571a82f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1137ef expref: 1229 pid: 16116 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.311082:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64406 count 1 00010000:00010000:2.0:1721880422.311086:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.311088:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.311090:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727bfdb lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.311090:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727bfe2 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.311097:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d33aac0/0x8a60d30f571a84fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1138ac expref: 1229 pid: 15533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.311101:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.311102:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.311103:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727bfe2 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.311107:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009759cd80/0x8a60d30f571a82f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1137ef expref: 1229 pid: 16116 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.311114:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d33aac0/0x8a60d30f571a84fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1138ac expref: 1229 pid: 15533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.311119:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d33aac0/0x8a60d30f571a84fa lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1138ac expref: 1229 pid: 15533 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.311123:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009759cd80/0x8a60d30f571a82f4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1137ef expref: 1229 pid: 16116 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.311129:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800952a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011709824:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.311133:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801366a3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011709696:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.311146:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdeccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.311153:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.311275:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c1ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011708288:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.311286:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106d200/0x8a60d30f5727bfb1 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.311297:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c7fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011708416:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.311307:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727bfb8 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.311346:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.311346:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801366a0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011708544:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.311358:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257715200 00010000:00010000:2.0:1721880422.311359:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727bfbf lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.311360:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257715200 00000100:00100000:1.0:1721880422.311361:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.311370:0:8271:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257715456 00000100:00100000:3.0:1721880422.311371:0:8271:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257715456 00010000:00010000:3.0:1721880422.311379:0:8271:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c8e7180/0x8a60d30f571a795b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1134ca expref: 1231 pid: 16016 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.311389:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.311390:0:8271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914311 00000100:00100000:3.0:1721880422.311392:0:8271:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136398700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+1231:2005:x1805522257715456:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.311397:0:8271:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.311399:0:8271:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c8e7180/0x8a60d30f571a795b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1134ca expref: 1231 pid: 16016 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.311400:0:7116:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257715328 00000100:00100000:2.0:1721880422.311404:0:7116:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257715328 00010000:00010000:3.0:1721880422.311404:0:8271:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c8e7180/0x8a60d30f571a795b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1134ca expref: 1231 pid: 16016 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.311412:0:8271:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c8e7180/0x8a60d30f571a795b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1134ca expref: 1232 pid: 16016 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.311418:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.311418:0:7116:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0fef600/0x8a60d30f571a7771 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113437 expref: 1231 pid: 16016 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.311419:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.311420:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.311422:0:8271:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727bfbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.311429:0:8271:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727bfbf lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.311435:0:7116:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257715584 00000100:00100000:2.0:1721880422.311438:0:7116:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257715584 00010000:00010000:3.0:1721880422.311438:0:8271:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.311440:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914312 00000100:00100000:0.0:1721880422.311444:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136398000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1232:2005:x1805522257715328:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.311447:0:7116:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e968b40/0x8a60d30f571a7ce2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1135f0 expref: 1232 pid: 16029 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.311453:0:8271:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880136398700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+1232:2005:x1805522257715456:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 59us (91us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.311456:0:8271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914311 00000100:00100000:3.0:1721880422.311465:0:8271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914313 00000100:00100000:3.0:1721880422.311468:0:8271:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129d20850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+1231:2005:x1805522257715584:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.311472:0:8271:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.311475:0:8271:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e968b40/0x8a60d30f571a7ce2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb92:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1135f0 expref: 1231 pid: 16029 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.311478:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727bfbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.311480:0:8271:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e968b40/0x8a60d30f571a7ce2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb92:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1135f0 expref: 1231 pid: 16029 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.311485:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727bfbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.311485:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.311486:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.311487:0:8271:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727bfc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb92:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.311491:0:8271:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727bfc6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb92:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.311493:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.311496:0:8271:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.311497:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727bfbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.311500:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0fef600/0x8a60d30f571a7771 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113437 expref: 1231 pid: 16016 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.311503:0:8271:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880129d20850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+1231:2005:x1805522257715584:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 34us (85us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.311504:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727bfbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.311507:0:8271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914313 00010000:00010000:0.0:1721880422.311511:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0fef600/0x8a60d30f571a7771 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113437 expref: 1231 pid: 16016 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.311511:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727bfbf lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.311516:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352880 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.311519:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727bfbf lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.311519:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007b9006c0/0x8a60d30f571a7b22 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113572 expref: 1230 pid: 16111 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.311526:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727bfbf lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.311529:0:8271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914314 00000100:00100000:3.0:1721880422.311531:0:8271:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+1230:2005:x1805522257715200:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.311534:0:8271:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.311536:0:8271:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007b9006c0/0x8a60d30f571a7b22 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb91:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113572 expref: 1230 pid: 16111 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.311537:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727bfbf lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.311542:0:8271:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007b9006c0/0x8a60d30f571a7b22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb91:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113572 expref: 1230 pid: 16111 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.311543:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727bfbf lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.311548:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c1df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011709056:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.311548:0:8271:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007b9006c0/0x8a60d30f571a7b22 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb91:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113572 expref: 1230 pid: 16111 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.311554:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.311555:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.311556:0:8271:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727bfb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.311560:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727bfcd lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.311560:0:8271:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727bfb8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.311568:0:8271:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.311577:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0fef600/0x8a60d30f571a7771 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113437 expref: 1229 pid: 16016 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.311578:0:8271:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+1229:2005:x1805522257715200:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 46us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.311582:0:8271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914314 00010000:00010000:0.0:1721880422.311585:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.311586:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.311588:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106d200/0x8a60d30f5727bfb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.311591:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.311593:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106d200/0x8a60d30f5727bfb1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.311608:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e968b40/0x8a60d30f571a7ce2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1135f0 expref: 1227 pid: 16029 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.311609:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.311614:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106d200/0x8a60d30f5727bfb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.311614:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801366a3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011708800:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.311618:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106d200/0x8a60d30f5727bfb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.311622:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106d200/0x8a60d30f5727bfb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.311624:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727bfc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.311625:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880136398000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1226:2005:x1805522257715328:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 180us (235us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.311626:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106d200/0x8a60d30f5727bfb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.311630:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106d200/0x8a60d30f5727bfb1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.311631:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914312 00000100:00100000:3.0:1721880422.311631:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257715840 00010000:00010000:1.0:1721880422.311633:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106d200 already unused, calling callback (ffffffffa084e330) 00000100:00100000:3.0:1721880422.311633:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257715840 00010000:00010000:1.0:1721880422.311635:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106d200/0x8a60d30f5727bfb1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.311639:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130655d40/0x8a60d30f571a80c4 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113739 expref: 1226 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.311642:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106d200/0x8a60d30f5727bfb1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.311648:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106d200/0x8a60d30f5727bfb1 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.311649:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2030:3686:x1805522011708032:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1328us (1360us total) trans 4296020090 rc 0/0 00000100:00100000:3.0:1721880422.311650:0:8271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914315 00010000:00010000:1.0:1721880422.311652:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106d200/0x8a60d30f5727bfb1 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.311653:0:8271:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136399500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+1226:2004:x1805522257715840:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.311654:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632120 00010000:00010000:3.0:1721880422.311657:0:8271:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.311660:0:8271:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130655d40/0x8a60d30f571a80c4 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113739 expref: 1226 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.311665:0:8271:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130655d40/0x8a60d30f571a80c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113739 expref: 1226 pid: 16099 timeout: 887 lvb_type: 0 00000004:00080000:0.0:1721880422.311669:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801366a3800/2, rc 0, transno 1052794 00010000:00010000:3.0:1721880422.311671:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.311672:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.311673:0:8271:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727bfd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.311675:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801366a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011708032:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.311681:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130655d40/0x8a60d30f571a80c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113739 expref: 1226 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.311681:0:8271:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727bfd4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.311689:0:8271:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.311694:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801366a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011709440:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.311704:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801341d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011709952:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.311705:0:8271:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880136399500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+1225:2004:x1805522257715840:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 50us (113us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.311707:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727bfd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.311710:0:8271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914315 00010000:00010000:2.0:1721880422.311715:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727bfd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.311721:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727bfd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.311726:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727bfc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.311748:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727bfd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.311749:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727bfc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.311755:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2030:3686:x1805522011707904:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1448us (1495us total) trans 4296020091 rc 0/0 00010000:00010000:2.0:1721880422.311756:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727bfd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.311756:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727bfc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.311760:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632118 00010000:00010000:3.0:1721880422.311762:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727bfc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.311763:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727bfd4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.311769:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353600 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.311769:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727bfc6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.311772:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727bfd4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.311774:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353840 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.311777:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727bfc6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.311779:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727bfd4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.311789:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727bfc6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.311791:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727bfd4 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.311795:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727bfd4 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.311799:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727bfc6 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.311801:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.311806:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727bfc6 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.311820:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011709952 00000100:00100000:1.0:1721880422.311823:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011709952 00000004:00080000:0.0:1721880422.311830:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801366a2a00/2, rc 0, transno 1052795 00000100:00100000:0.0:1721880422.311836:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801366a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011707904:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.311845:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632126 00000100:00100000:1.0:1721880422.311850:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2030:3686:x1805522011709952:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.311862:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64407 count 1 00010000:00010000:0.0:1721880422.311868:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727bfb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.311872:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727bfe9 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.311876:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727bfb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.311881:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130657600/0x8a60d30f571a86c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113962 expref: 1224 pid: 16097 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.311884:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727bfb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.311886:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.311888:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.311890:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727bfb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.311890:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727bfe9 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.311897:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727bfb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.311902:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325cd80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.311904:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130657600/0x8a60d30f571a86c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113962 expref: 1224 pid: 16097 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.311905:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727bfb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.311912:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130657600/0x8a60d30f571a86c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113962 expref: 1224 pid: 16097 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.311917:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727bfb8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.311917:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800952a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2032:3689:x1805522011708672:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1457us (1518us total) trans 4296020092 rc 0/0 00000100:00100000:1.0:1721880422.311920:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013639bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011710208:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.311922:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632121 00000100:00100000:2.0:1721880422.311925:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2032:3687:x1805522011709184:12345-0@lo:6:osp-syn-1-0.0 Request processed in 977us (1033us total) trans 4296020093 rc 0/0 00010000:00010000:0.0:1721880422.311926:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727bfb8 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.311929:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632123 00010000:00010000:0.0:1721880422.311931:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727bfb8 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.311938:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a840 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.311950:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011710080:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1721880422.311950:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800952a3b80/2, rc 0, transno 1052796 00000100:00100000:3.0:1721880422.311957:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800952a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011708672:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.311967:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.311980:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011710080 00000100:00100000:3.0:1721880422.311982:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011710080 00000100:00100000:2.0:1721880422.311985:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801366a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011710336:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1721880422.311987:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122c1f800/2, rc 0, transno 1052797 00000100:00100000:3.0:1721880422.311994:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632127 00000100:00100000:3.0:1721880422.311996:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136398700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2032:3687:x1805522011710080:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.312002:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011709184:0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.312005:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64408 count 1 00010000:00010000:3.0:1721880422.312028:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727bff0 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.312034:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.312039:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0873840/0x8a60d30f571a889d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1139fc expref: 1224 pid: 15468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.312045:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.312047:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.312048:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011710336 00010000:00010000:3.0:1721880422.312049:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727bff0 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.312050:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011710336 00000100:00100000:0.0:1721880422.312062:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801366a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2033:3688:x1805522011708160:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1748us (1782us total) trans 4296020094 rc 0/0 00000100:00100000:2.0:1721880422.312062:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632128 00000100:00100000:2.0:1721880422.312065:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801366a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2033:3688:x1805522011710336:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.312065:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0873840/0x8a60d30f571a889d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1139fc expref: 1224 pid: 15468 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.312069:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632119 00010000:00010000:3.0:1721880422.312071:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0873840/0x8a60d30f571a889d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1139fc expref: 1224 pid: 15468 timeout: 887 lvb_type: 0 00002000:00080000:2.0:1721880422.312073:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64409 count 1 00000100:00100000:3.0:1721880422.312077:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800952a1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011710592:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.312081:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727bff7 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.312091:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091293cc0/0x8a60d30f571a8aa3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113ace expref: 1224 pid: 16119 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.312096:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdecc00 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.312097:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.312099:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.312101:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727bff7 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.312108:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801366a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011710464:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.312120:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.312123:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091293cc0/0x8a60d30f571a8aa3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113ace expref: 1224 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.312133:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091293cc0/0x8a60d30f571a8aa3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113ace expref: 1224 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.312135:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011710464 00000100:00100000:0.0:1721880422.312139:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011710464 00000100:00100000:2.0:1721880422.312143:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801366a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011710720:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.312155:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632129 00000100:00100000:0.0:1721880422.312159:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2033:3689:x1805522011710464:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.312167:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdecc0 going to sleep for 11 seconds 00002000:00080000:0.0:1721880422.312168:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64410 count 1 00010000:00010000:0.0:1721880422.312175:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727bffe lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.312183:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0948480/0x8a60d30f571a8c6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113b84 expref: 1224 pid: 16054 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.312185:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801366a1180/2, rc 0, transno 1052798 00010000:00010000:0.0:1721880422.312187:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.312188:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.312189:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727bffe lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.312191:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801366a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011708160:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.312202:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0948480/0x8a60d30f571a8c6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113b84 expref: 1224 pid: 16054 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.312211:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0948480/0x8a60d30f571a8c6a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113b84 expref: 1224 pid: 16054 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.312219:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011710848:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.312221:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1721880422.312223:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.312229:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800919c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011710976:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.312234:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257715712 00000100:00100000:3.0:1721880422.312237:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257715712 00000100:00100000:0.0:1721880422.312244:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.312245:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.312245:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099097180/0x8a60d30f571a7ef6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113698 expref: 1225 pid: 16075 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.312257:0:8271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914316 00000100:00100000:3.0:1721880422.312260:0:8271:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801362d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+1225:2005:x1805522257715712:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.312263:0:8271:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.312266:0:8271:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099097180/0x8a60d30f571a7ef6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113698 expref: 1225 pid: 16075 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.312271:0:8271:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099097180/0x8a60d30f571a7ef6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113698 expref: 1225 pid: 16075 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.312282:0:8271:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099097180/0x8a60d30f571a7ef6 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113698 expref: 1225 pid: 16075 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.312285:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801366a3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011709696:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.312287:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.312289:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.312290:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.312292:0:8271:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727bfcd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.312296:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727bfdb lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.312296:0:8271:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727bfcd lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.312303:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257715968 00010000:00010000:3.0:1721880422.312304:0:8271:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.312305:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257715968 00010000:00010000:1.0:1721880422.312315:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009759cd80/0x8a60d30f571a82f4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1137ef expref: 1225 pid: 16116 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.312316:0:8271:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801362d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+1225:2005:x1805522257715712:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 55us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.312319:0:8271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914316 00000100:00100000:0.0:1721880422.312327:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.312328:0:8271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914317 00000100:00100000:3.0:1721880422.312331:0:8271:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+1224:2005:x1805522257715968:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.312334:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257716096 00010000:00010000:3.0:1721880422.312334:0:8271:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.312336:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257716096 00010000:00010000:3.0:1721880422.312337:0:8271:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009759cd80/0x8a60d30f571a82f4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1137ef expref: 1224 pid: 16116 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.312341:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d33aac0/0x8a60d30f571a84fa lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1138ac expref: 1225 pid: 15533 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.312342:0:8271:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009759cd80/0x8a60d30f571a82f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1137ef expref: 1225 pid: 16116 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.312347:0:8271:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009759cd80/0x8a60d30f571a82f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1137ef expref: 1225 pid: 16116 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.312355:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914318 00010000:00010000:3.0:1721880422.312355:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.312355:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.312357:0:8271:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727bfdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.312358:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1224:2005:x1805522257716096:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.312361:0:8271:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727bfdb lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.312364:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.312366:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d33aac0/0x8a60d30f571a84fa lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1138ac expref: 1224 pid: 15533 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.312368:0:8271:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.312371:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d33aac0/0x8a60d30f571a84fa lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1138ac expref: 1224 pid: 15533 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.312377:0:8271:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+1224:2005:x1805522257715968:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 45us (92us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.312379:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.312380:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.312380:0:8271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914317 00010000:00010000:1.0:1721880422.312382:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727bfe2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.312383:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727bfdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.312385:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727bfe2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.312391:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727bfdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.312393:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.312399:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727bfdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.312401:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d33aac0/0x8a60d30f571a84fa lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1138ac expref: 1223 pid: 15533 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.312407:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1222:2005:x1805522257716096:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 49us (81us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.312408:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800952a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011709824:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.312411:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914318 00010000:00010000:2.0:1721880422.312412:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727bfdb lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.312417:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727bfe2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.312419:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727bfdb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.312421:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727bfe2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.312423:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727bfcd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.312425:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352400 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.312425:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727bfe2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.312427:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727bfdb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.312428:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727bfcd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.312429:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727bfe2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.312433:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727bfcd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.312433:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727bfe2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.312434:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727bfdb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.312437:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727bfcd lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.312437:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727bfe2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.312440:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727bfcd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.312440:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aab840 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.312442:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727bfdb lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.312442:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727bfe2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.312443:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106f840 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.312445:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727bfcd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.312446:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727bfdb lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.312446:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727bfe2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.312449:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727bfcd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.312451:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727bfe2 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.312453:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727bfcd lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.312455:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727bfe2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.312457:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727bfcd lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.312513:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011710976 00000100:00100000:3.0:1721880422.312519:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011710976 00000100:00100000:2.0:1721880422.312540:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2037:3689:x1805522011709312:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1488us (1533us total) trans 4296020095 rc 0/0 00000100:00100000:2.0:1721880422.312546:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632124 00000100:00100000:1.0:1721880422.312557:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2036:3686:x1805522011708928:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1870us (1906us total) trans 4296020097 rc 0/0 00000100:00100000:1.0:1721880422.312562:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632122 00000100:00100000:3.0:1721880422.312571:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2035:3689:x1805522011709568:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1494us (1519us total) trans 4296020096 rc 0/0 00000004:00080000:2.0:1721880422.312577:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122c1d180/2, rc 0, transno 1052800 00000100:00100000:3.0:1721880422.312577:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632125 00000100:00100000:2.0:1721880422.312586:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011709568:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.312605:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632130 00000100:00100000:3.0:1721880422.312609:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136398000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2034:3687:x1805522011710976:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.312620:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64411 count 1 00000100:00100000:1.0:1721880422.312624:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801362db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011711104:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.312629:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727c005 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.312632:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122c1dc00/2, rc 0, transno 1052799 00000100:00100000:2.0:1721880422.312639:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011709312:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.312639:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880122cd5680/0x8a60d30f571a8e23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113c2c expref: 1221 pid: 16090 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.312641:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.312645:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.312647:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.312649:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727c005 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.312654:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011711104 00000100:00100000:1.0:1721880422.312656:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011711104 00010000:00010000:3.0:1721880422.312661:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880122cd5680/0x8a60d30f571a8e23 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113c2c expref: 1221 pid: 16090 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.312665:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801362d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011711232:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.312667:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632131 00010000:00010000:3.0:1721880422.312668:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880122cd5680/0x8a60d30f571a8e23 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113c2c expref: 1221 pid: 16090 timeout: 887 lvb_type: 0 00000004:00080000:0.0:1721880422.312669:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122c1e680/2, rc 0, transno 1052801 00000100:00100000:1.0:1721880422.312670:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096c9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2035:3687:x1805522011711104:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.312674:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800952a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011711360:192.168.201.24@tcp:104: 00002000:00080000:1.0:1721880422.312678:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64412 count 1 00010000:00010000:1.0:1721880422.312685:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727c00c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.312692:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdeccc0 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.312693:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5050900/0x8a60d30f571a9084 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113cf7 expref: 1221 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.312697:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.312698:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.312699:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727c00c lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.312708:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.312709:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5050900/0x8a60d30f571a9084 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113cf7 expref: 1221 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.312714:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5050900/0x8a60d30f571a9084 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113cf7 expref: 1221 pid: 16090 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.312720:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c1ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011711616:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.312720:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011711232 00000100:00100000:2.0:1721880422.312722:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1721880422.312722:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011711232 00000100:00100000:2.0:1721880422.312726:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801366a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011711488:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.312748:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632132 00000100:00100000:1.0:1721880422.312750:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a180 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.312751:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f023100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2036:3688:x1805522011711232:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.312758:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64413 count 1 00010000:00010000:3.0:1721880422.312764:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727c013 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb9d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.312772:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011708928:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.312773:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880072a0b180/0x8a60d30f571a911e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb9d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113d3d expref: 1221 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.312777:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.312778:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.312780:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.312780:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727c013 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb9d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.312790:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880072a0b180/0x8a60d30f571a911e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb9d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113d3d expref: 1221 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.312795:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880072a0b180/0x8a60d30f571a911e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb9d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113d3d expref: 1221 pid: 16017 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.312800:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bb44700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011711744:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.312814:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdece40 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.312822:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011711488 00000100:00100000:3.0:1721880422.312823:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011711488 00000100:00100000:3.0:1721880422.312833:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632133 00000100:00100000:3.0:1721880422.312835:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f022680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2037:3688:x1805522011711488:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.312841:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64414 count 1 00010000:00010000:3.0:1721880422.312846:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727c01a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.312852:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130bd1440/0x8a60d30f571a91aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113d6e expref: 1221 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.312859:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.312860:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.312862:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727c01a lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.312870:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130bd1440/0x8a60d30f571a91aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113d6e expref: 1221 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.312875:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130bd1440/0x8a60d30f571a91aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113d6e expref: 1221 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.312880:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bb47480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011711872:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.312890:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec000 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.312962:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013639bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011710208:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.312972:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727bfe9 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.312988:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800952a1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011710592:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.312999:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727bff0 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.313032:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.313046:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257716224 00000100:00100000:2.0:1721880422.313047:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801366a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011710720:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.313048:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257716224 00010000:00010000:1.0:1721880422.313058:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130657600/0x8a60d30f571a86c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113962 expref: 1222 pid: 16097 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.313061:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727bff7 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.313068:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914319 00000100:00100000:1.0:1721880422.313071:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1222:2005:x1805522257716224:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.313076:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1721880422.313078:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.313078:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130657600/0x8a60d30f571a86c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113962 expref: 1222 pid: 16097 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.313084:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130657600/0x8a60d30f571a86c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113962 expref: 1222 pid: 16097 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.313090:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257716352 00010000:00010000:1.0:1721880422.313091:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130657600/0x8a60d30f571a86c8 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113962 expref: 1222 pid: 16097 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.313093:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257716352 00010000:00010000:1.0:1721880422.313097:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1721880422.313098:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.313098:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.313100:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727bfe9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.313102:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0873840/0x8a60d30f571a889d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1139fc expref: 1222 pid: 15468 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.313104:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727bfe9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.313112:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.313113:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257716480 00000100:00100000:3.0:1721880422.313115:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257716480 00000100:00100000:0.0:1721880422.313120:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.313120:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091293cc0/0x8a60d30f571a8aa3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113ace expref: 1223 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.313123:0:7116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914320 00000100:00100000:1.0:1721880422.313127:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1223:2005:x1805522257716224:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 54us (96us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.313129:0:7116:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088efd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1223:2005:x1805522257716352:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.313131:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914319 00000100:00100000:3.0:1721880422.313136:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257716608 00000100:00100000:3.0:1721880422.313138:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257716608 00010000:00010000:2.0:1721880422.313139:0:7116:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1721880422.313140:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914321 00010000:00010000:2.0:1721880422.313144:0:7116:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0873840/0x8a60d30f571a889d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1139fc expref: 1223 pid: 15468 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.313145:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e197850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1223:2005:x1805522257716480:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.313145:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0948480/0x8a60d30f571a8c6a lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113b84 expref: 1223 pid: 16054 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.313147:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727bfe9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.313152:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.313152:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727bfe9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.313152:0:7116:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0873840/0x8a60d30f571a889d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1139fc expref: 1223 pid: 15468 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.313155:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091293cc0/0x8a60d30f571a8aa3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113ace expref: 1223 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.313158:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727bfe9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.313160:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914322 00010000:00010000:2.0:1721880422.313161:0:7116:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0873840/0x8a60d30f571a889d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1139fc expref: 1223 pid: 15468 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.313162:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091293cc0/0x8a60d30f571a8aa3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113ace expref: 1223 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.313162:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727bfe9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.313163:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076fdd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1223:2004:x1805522257716608:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.313166:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727bfe9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.313168:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.313169:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106ed00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.313169:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.313170:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.313170:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0948480/0x8a60d30f571a8c6a lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfb9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113b84 expref: 1222 pid: 16054 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.313171:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727bfe9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.313172:0:7116:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727bff0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.313174:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727bfe9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.313175:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091293cc0/0x8a60d30f571a8aa3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113ace expref: 1222 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.313176:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0948480/0x8a60d30f571a8c6a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113b84 expref: 1222 pid: 16054 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.313179:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727bfe9 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.313180:0:7116:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727bff0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.313184:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.313184:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.313184:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.313185:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.313186:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727bfe9 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.313186:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727bffe lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.313187:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727bff7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.313190:0:7116:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.313190:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727bffe lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.313192:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727bff7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.313197:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.313201:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.313204:0:7116:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088efd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1221:2005:x1805522257716352:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 76us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.313209:0:7116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914320 00000100:00100000:3.0:1721880422.313209:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880076fdd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1221:2004:x1805522257716608:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 45us (89us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.313213:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914322 00000100:00100000:0.0:1721880422.313214:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e197850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1221:2005:x1805522257716480:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 69us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.313218:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914321 00010000:00010000:2.0:1721880422.313226:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727bff7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.313229:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727bff0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.313231:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727bff7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.313233:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727bff0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.313235:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727bff7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.313237:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727bff0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.313239:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727bff7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.313241:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727bff0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.313243:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727bff7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.313245:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727bff0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.313246:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801363521c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.313248:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727bff7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.313248:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8d80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.313249:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727bff0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.313252:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0948480/0x8a60d30f571a8c6a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113b84 expref: 1218 pid: 16054 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.313253:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727bff0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.313255:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727bff7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.313258:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727bff0 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.313260:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011710848:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.313260:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727bff7 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.313262:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727bff0 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.313264:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727bff7 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.313265:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2038:3686:x1805522011709952:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1414us (1464us total) trans 4296020098 rc 0/0 00010000:00010000:0.0:1721880422.313267:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727bffe lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.313269:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632126 00010000:00010000:0.0:1721880422.313272:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727bffe lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.313276:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727bffe lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.313282:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727bffe lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.313286:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727bffe lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.313288:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801341d0e00/2, rc 0, transno 1052802 00010000:00010000:0.0:1721880422.313290:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727bffe lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.313293:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325c480 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.313295:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727bffe lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.313298:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727bffe lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.313301:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801341d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011709952:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.313304:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727bffe lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.313307:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727bffe lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.313325:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1721880422.313329:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801366a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011712000:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.313342:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880136398700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2039:3687:x1805522011710080:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1344us (1374us total) trans 4296020099 rc 0/0 00000100:00100000:1.0:1721880422.313345:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.313347:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632127 00000100:00100000:3.0:1721880422.313355:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011712000 00000004:00080000:1.0:1721880422.313356:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122c7dc00/2, rc 0, transno 1052803 00000100:00100000:3.0:1721880422.313357:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011712000 00000100:00100000:1.0:1721880422.313366:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011710080:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.313367:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632134 00000100:00100000:3.0:1721880422.313369:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2040:3687:x1805522011712000:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.313377:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64415 count 1 00010000:00010000:3.0:1721880422.313383:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c021 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.313390:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800920cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011712128:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.313390:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136443840/0x8a60d30f571a93f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113e47 expref: 1217 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.313393:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.313394:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.313396:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c021 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfb9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.313405:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136443840/0x8a60d30f571a93f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113e47 expref: 1217 pid: 16099 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.313407:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801366a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2040:3688:x1805522011710336:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1341us (1372us total) trans 4296020100 rc 0/0 00000100:00100000:1.0:1721880422.313409:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.313410:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136443840/0x8a60d30f571a93f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113e47 expref: 1217 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.313412:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632128 00000100:00100000:3.0:1721880422.313416:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bb44a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011712256:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.313422:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011712128 00000100:00100000:0.0:1721880422.313424:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2039:3689:x1805522011710464:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1262us (1300us total) trans 4296020101 rc 0/0 00000100:00100000:2.0:1721880422.313424:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011712128 00000100:00100000:3.0:1721880422.313430:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdecc00 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.313431:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632129 00000100:00100000:2.0:1721880422.313439:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632135 00000100:00100000:2.0:1721880422.313442:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136399500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2039:3687:x1805522011712128:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.313450:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64416 count 1 00010000:00010000:2.0:1721880422.313459:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c028 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfba0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.313469:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098362ac0/0x8a60d30f571a9554 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfba0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113eda expref: 1217 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.313475:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.313477:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.313479:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c028 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfba0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.313496:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098362ac0/0x8a60d30f571a9554 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfba0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113eda expref: 1217 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.313506:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098362ac0/0x8a60d30f571a9554 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfba0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113eda expref: 1217 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.313516:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800920c9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011712384:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.313536:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdecc0 going to sleep for 11 seconds 00000004:00080000:2.0:1721880422.313556:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801366a1f80/2, rc 0, transno 1052804 00000100:00100000:2.0:1721880422.313573:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801366a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011710336:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1721880422.313593:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801366a0a80/2, rc 0, transno 1052805 00000100:00100000:2.0:1721880422.313598:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801366a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011710464:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.313629:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bb47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011712512:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.313653:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.313665:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800952a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011711360:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.313669:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011712512 00000100:00100000:1.0:1721880422.313671:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011712512 00000100:00100000:2.0:1721880422.313673:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1721880422.313678:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bb46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011712640:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.313679:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727c005 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.313684:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632136 00000100:00100000:1.0:1721880422.313687:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2040:3688:x1805522011712512:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.313695:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64417 count 1 00010000:00010000:1.0:1721880422.313702:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727c02f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfba1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.313706:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bb44700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011711744:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.313707:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.313710:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009430eac0/0x8a60d30f571a96c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfba1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113f82 expref: 1217 pid: 16031 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.313717:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.313718:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.313718:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727c013 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb9d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.313720:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727c02f lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfba1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.313751:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009430eac0/0x8a60d30f571a96c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfba1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113f82 expref: 1217 pid: 16031 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.313753:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011712640 00010000:00010000:1.0:1721880422.313756:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009430eac0/0x8a60d30f571a96c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfba1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113f82 expref: 1217 pid: 16031 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.313756:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011712640 00000100:00100000:1.0:1721880422.313762:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013639bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011712768:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.313774:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632137 00000100:00100000:2.0:1721880422.313778:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2041:3688:x1805522011712640:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.313781:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a840 going to sleep for 11 seconds 00002000:00080000:2.0:1721880422.313789:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64418 count 1 00000100:00100000:3.0:1721880422.313792:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bb47480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011711872:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.313795:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c1ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011711616:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.313799:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c036 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfba2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.313802:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727c01a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.313805:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727c00c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.313815:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8f3600/0x8a60d30f571a989c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfba2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114031 expref: 1217 pid: 16119 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.313821:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.313822:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.313824:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.313826:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c036 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfba2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.313838:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257716864 00000100:00100000:0.0:1721880422.313839:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.313840:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257716864 00010000:00010000:2.0:1721880422.313843:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d8f3600/0x8a60d30f571a989c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfba2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114031 expref: 1218 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.313848:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5050900/0x8a60d30f571a9084 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113cf7 expref: 1218 pid: 16090 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.313851:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257717120 00010000:00010000:2.0:1721880422.313852:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d8f3600/0x8a60d30f571a989c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfba2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114031 expref: 1218 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.313853:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.313853:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257717120 00000100:00100000:2.0:1721880422.313861:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800920c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011712896:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.313862:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130bd1440/0x8a60d30f571a91aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113d6e expref: 1219 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.313863:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914323 00000100:00100000:1.0:1721880422.313865:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801362d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1219:2004:x1805522257716864:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.313872:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.313873:0:8271:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257716736 00010000:00010000:1.0:1721880422.313874:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5050900/0x8a60d30f571a9084 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113cf7 expref: 1219 pid: 16090 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.313875:0:8271:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257716736 00010000:00010000:1.0:1721880422.313879:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5050900/0x8a60d30f571a9084 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113cf7 expref: 1220 pid: 16090 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.313880:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914324 00000100:00100000:3.0:1721880422.313883:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1220:2004:x1805522257717120:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.313885:0:8271:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880122cd5680/0x8a60d30f571a8e23 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113c2c expref: 1220 pid: 16090 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.313887:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5050900/0x8a60d30f571a9084 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113cf7 expref: 1220 pid: 16090 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.313888:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.313890:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130bd1440/0x8a60d30f571a91aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113d6e expref: 1220 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.313895:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1721880422.313896:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.313896:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.313896:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130bd1440/0x8a60d30f571a91aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113d6e expref: 1219 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.313897:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727c00c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.313898:0:8271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914325 00000100:00100000:2.0:1721880422.313901:0:8271:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+1219:2005:x1805522257716736:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.313902:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727c00c lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.313905:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130bd1440/0x8a60d30f571a91aa lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113d6e expref: 1219 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.313906:0:8271:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.313908:0:8271:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880122cd5680/0x8a60d30f571a8e23 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113c2c expref: 1219 pid: 16090 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.313910:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.313911:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.313912:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.313914:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727c01a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.313918:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727c01a lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.313921:0:8271:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880122cd5680/0x8a60d30f571a8e23 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113c2c expref: 1218 pid: 16090 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.313925:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801362d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1218:2004:x1805522257716864:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 59us (107us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.313926:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.313929:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914323 00010000:00010000:2.0:1721880422.313934:0:8271:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880122cd5680/0x8a60d30f571a8e23 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113c2c expref: 1218 pid: 16090 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.313938:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257716992 00000100:00100000:3.0:1721880422.313938:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1217:2004:x1805522257717120:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 54us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.313939:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257716992 00000100:00100000:3.0:1721880422.313941:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914324 00010000:00010000:2.0:1721880422.313944:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.313945:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880072a0b180/0x8a60d30f571a911e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb9d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113d3d expref: 1217 pid: 16017 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.313946:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.313948:0:8271:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727c005 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.313952:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914326 00010000:00010000:2.0:1721880422.313955:0:8271:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727c005 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.313956:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1216:2004:x1805522257716992:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.313963:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.313964:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727c00c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.313966:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880072a0b180/0x8a60d30f571a911e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb9d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113d3d expref: 1216 pid: 16017 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.313969:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727c00c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.313971:0:8271:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.313971:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880072a0b180/0x8a60d30f571a911e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb9d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113d3d expref: 1216 pid: 16017 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.313973:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727c00c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.313977:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727c00c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.313978:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880072a0b180/0x8a60d30f571a911e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb9d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113d3d expref: 1216 pid: 16017 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.313981:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727c00c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.313984:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106eac0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.313984:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.313985:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.313986:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727c00c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.313987:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727c013 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb9d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.313988:0:8271:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+1215:2005:x1805522257716736:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 86us (134us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.313989:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727c00c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.313991:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727c013 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb9d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.313993:0:8271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914325 00010000:00010000:1.0:1721880422.313995:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727c00c lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.313998:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727c00c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.313998:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.314008:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1214:2004:x1805522257716992:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 52us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.314027:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914326 00000100:00100000:2.0:1721880422.314038:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde3c0 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.314042:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727c005 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.314046:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727c005 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.314050:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727c005 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.314054:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727c005 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.314057:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727c005 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.314064:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8900 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.314066:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727c005 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.314069:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727c005 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.314075:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727c005 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.314078:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727c005 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.314094:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880096c9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2042:3687:x1805522011711104:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1423us (1452us total) trans 4296020102 rc 0/0 00000100:00100000:1.0:1721880422.314099:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632131 00000004:00080000:1.0:1721880422.314117:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801362db100/2, rc 0, transno 1052806 00000100:00100000:1.0:1721880422.314121:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801362db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011711104:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.314137:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1721880422.314141:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011713024:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.314155:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880136398000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2042:3687:x1805522011710976:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1545us (1908us total) trans 4296020103 rc 0/0 00000100:00100000:3.0:1721880422.314159:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632130 00000100:00100000:1.0:1721880422.314160:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1721880422.314170:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800919c1180/2, rc 0, transno 1052807 00000100:00100000:1.0:1721880422.314173:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800919c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011710976:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.314186:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880125a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011713152:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.314195:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.314206:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011713024 00000100:00100000:1.0:1721880422.314208:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011713024 00000100:00100000:1.0:1721880422.314215:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011713152 00000100:00100000:1.0:1721880422.314216:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011713152 00000100:00100000:1.0:1721880422.314223:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632138 00000100:00100000:1.0:1721880422.314225:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800994eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2043:3687:x1805522011713024:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.314236:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bb44a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011712256:192.168.201.24@tcp:104: 00002000:00080000:1.0:1721880422.314240:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64419 count 1 00010000:00010000:1.0:1721880422.314247:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106cd80/0x8a60d30f5727c03d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfba3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.314252:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c021 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfb9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.314255:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bfa0fc0/0x8a60d30f571a9aef lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfba3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1140e0 expref: 1213 pid: 16074 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.314255:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632139 00010000:00010000:1.0:1721880422.314259:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1721880422.314259:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880125a17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2043:3687:x1805522011713152:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.314260:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.314261:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106cd80/0x8a60d30f5727c03d lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfba3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.314267:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800920c9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011712384:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.314269:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00002000:00080000:3.0:1721880422.314270:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64420 count 1 00010000:00010000:1.0:1721880422.314272:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bfa0fc0/0x8a60d30f571a9aef lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfba3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1140e0 expref: 1213 pid: 16074 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.314275:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c028 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfba0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.314278:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bfa0fc0/0x8a60d30f571a9aef lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfba3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1140e0 expref: 1213 pid: 16074 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.314279:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727c044 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfba4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.314284:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257717248 00000100:00100000:1.0:1721880422.314284:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880125a15180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011713280:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.314288:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257717248 00010000:00010000:3.0:1721880422.314288:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800971e6d00/0x8a60d30f571a9caf lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfba4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114181 expref: 1213 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.314293:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.314294:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.314296:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727c044 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfba4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.314300:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098362ac0/0x8a60d30f571a9554 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfba0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113eda expref: 1214 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.314302:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a180 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.314310:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800971e6d00/0x8a60d30f571a9caf lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfba4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114181 expref: 1214 pid: 16119 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.314317:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914327 00010000:00010000:3.0:1721880422.314318:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800971e6d00/0x8a60d30f571a9caf lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfba4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114181 expref: 1214 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.314319:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013639bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011712768:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.314321:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1214:2005:x1805522257717248:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.314326:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bb47480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011713408:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.314328:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.314329:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727c02f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfba1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.314332:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098362ac0/0x8a60d30f571a9554 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfba0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113eda expref: 1214 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.314345:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec000 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.314362:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727c01a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.314368:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727c01a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.314374:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727c01a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.314380:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727c01a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.314386:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727c01a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.314391:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aaaac0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.314394:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727c01a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.314396:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098362ac0/0x8a60d30f571a9554 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfba0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113eda expref: 1214 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.314401:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727c01a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.314409:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098362ac0/0x8a60d30f571a9554 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfba0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113eda expref: 1214 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.314410:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727c01a lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.314414:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727c01a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.314420:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.314422:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.314424:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c028 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfba0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.314432:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c028 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfba0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.314499:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f022680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2044:3688:x1805522011711488:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1662us (1719us total) trans 4296020104 rc 0/0 00000100:00100000:3.0:1721880422.314504:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632133 00010000:00010000:0.0:1721880422.314512:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.314515:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727c013 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.314520:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c028 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfba0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.314520:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727c013 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.314524:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727c013 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.314527:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727c013 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.314529:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1213:2005:x1805522257717248:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 207us (261us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.314529:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c028 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfba0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.314531:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727c013 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.314535:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914327 00010000:00010000:3.0:1721880422.314535:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aab3c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.314537:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c028 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfba0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.314537:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727c013 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.314540:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727c013 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.314542:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c028 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfba0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.314546:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c028 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfba0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.314546:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727c013 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.314549:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350240 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.314549:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727c013 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.314551:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c028 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfba0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.314555:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c028 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfba0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.314561:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c028 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfba0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.314565:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c028 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfba0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.314607:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.314611:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f023100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2044:3688:x1805522011711232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1858us (1902us total) trans 4296020105 rc 0/0 00000100:00100000:3.0:1721880422.314616:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632132 00000100:00100000:1.0:1721880422.314638:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257717376 00000100:00100000:1.0:1721880422.314640:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257717376 00000100:00100000:0.0:1721880422.314641:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.314650:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136443840/0x8a60d30f571a93f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113e47 expref: 1213 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.314657:0:7116:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257717504 00000100:00100000:3.0:1721880422.314661:0:7116:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257717504 00000100:00100000:1.0:1721880422.314668:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914328 00000100:00100000:1.0:1721880422.314671:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ab4d7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1214:2004:x1805522257717376:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.314673:0:7116:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009430eac0/0x8a60d30f571a96c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfba1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113f82 expref: 1214 pid: 16031 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.314675:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.314678:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136443840/0x8a60d30f571a93f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113e47 expref: 1214 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.314684:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136443840/0x8a60d30f571a93f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113e47 expref: 1214 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.314690:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880136399500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2044:3687:x1805522011712128:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1244us (1277us total) trans 4296020106 rc 0/0 00000100:00100000:3.0:1721880422.314691:0:7116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914329 00010000:00010000:1.0:1721880422.314693:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136443840/0x8a60d30f571a93f6 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113e47 expref: 1214 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.314695:0:7116:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088efd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1214:2005:x1805522257717504:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.314697:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632135 00010000:00010000:1.0:1721880422.314699:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.314700:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.314701:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c021 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.314702:0:7116:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1721880422.314704:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.314705:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c021 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfb9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.314706:0:7116:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009430eac0/0x8a60d30f571a96c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfba1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113f82 expref: 1213 pid: 16031 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.314713:0:7116:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009430eac0/0x8a60d30f571a96c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfba1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113f82 expref: 1213 pid: 16031 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.314715:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.314721:0:7116:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009430eac0/0x8a60d30f571a96c7 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfba1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b113f82 expref: 1213 pid: 16031 timeout: 887 lvb_type: 0 00000004:00080000:2.0:1721880422.314723:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801366a3480/2, rc 0, transno 1052808 00010000:00010000:3.0:1721880422.314744:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.314745:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1721880422.314747:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ab4d7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1212:2004:x1805522257717376:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 74us (182us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.314747:0:7116:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727c02f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfba1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.314751:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914328 00000100:00100000:2.0:1721880422.314751:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801366a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011711488:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.314751:0:7116:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727c02f lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfba1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.314760:0:7116:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.314773:0:7116:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088efd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1211:2005:x1805522257717504:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 78us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.314777:0:7116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914329 00000100:00100000:1.0:1721880422.314780:0:15444:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257717632 00010000:00010000:2.0:1721880422.314780:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c021 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.314782:0:15444:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257717632 00010000:00010000:1.0:1721880422.314788:0:15444:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8f3600/0x8a60d30f571a989c lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfba2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114031 expref: 1211 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.314788:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c021 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.314791:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727c02f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfba1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.314795:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c021 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfb9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.314796:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727c02f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfba1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.314801:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727c02f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfba1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.314802:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c021 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfb9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.314803:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914330 00000100:00100000:1.0:1721880422.314806:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088614700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1211:2004:x1805522257717632:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.314808:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c021 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.314808:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727c02f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfba1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.314810:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.314812:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d8f3600/0x8a60d30f571a989c lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfba2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114031 expref: 1211 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.314812:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727c02f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfba1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.314814:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8000 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.314815:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106e1c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.314817:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c021 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfb9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.314817:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727c02f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfba1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.314820:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727c02f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfba1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.314821:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d8f3600/0x8a60d30f571a989c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfba2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114031 expref: 1211 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.314824:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c021 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfb9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.314825:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727c02f lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfba1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.314828:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.314829:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.314829:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727c02f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfba1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.314830:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c036 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfba2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.314834:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c036 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfba2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.314835:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c021 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfb9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.314841:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.314841:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c021 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfb9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.314855:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088614700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1211:2004:x1805522257717632:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 47us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.314861:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914330 00000004:00080000:1.0:1721880422.314891:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800920cb480/2, rc 0, transno 1052810 00000100:00100000:1.0:1721880422.314899:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800920cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011712128:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.314908:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2045:3688:x1805522011712512:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1220us (1254us total) trans 4296020107 rc 0/0 00000100:00100000:3.0:1721880422.314912:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632136 00000100:00100000:2.0:1721880422.314955:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2044:3687:x1805522011712000:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1582us (1607us total) trans 4296020108 rc 0/0 00000004:00080000:1.0:1721880422.314961:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801366a0700/2, rc 0, transno 1052812 00000100:00100000:2.0:1721880422.314961:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632134 00000100:00100000:1.0:1721880422.314968:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801366a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011712000:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.314982:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088615180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011713664:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.314998:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1721880422.315001:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.315004:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011713792:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.315032:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011713664 00000100:00100000:2.0:1721880422.315033:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1721880422.315035:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011713664 00000100:00100000:2.0:1721880422.315039:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800920c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011713536:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.315040:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.315058:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011713792 00000100:00100000:2.0:1721880422.315060:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.315060:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011713792 00000100:00100000:3.0:1721880422.315071:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011713536 00000100:00100000:3.0:1721880422.315073:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011713536 00000100:00100000:3.0:1721880422.315084:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632140 00000004:00080000:2.0:1721880422.315089:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801362d9500/2, rc 0, transno 1052809 00000100:00100000:3.0:1721880422.315089:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2046:3689:x1805522011713664:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.315091:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632141 00000100:00100000:2.0:1721880422.315096:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801362d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011711232:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.315098:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880125a17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2046:3687:x1805522011713792:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.315100:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64422 count 1 00000004:00080000:2.0:1721880422.315105:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007bb47100/2, rc 0, transno 1052811 00000100:00100000:2.0:1721880422.315107:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bb47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011712512:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.315109:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c04b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfba6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1721880422.315112:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64423 count 1 00010000:00010000:2.0:1721880422.315119:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8f3600/0x8a60d30f571a989c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfba2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114031 expref: 1210 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.315119:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e2a73c0/0x8a60d30f571a9ef4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfba6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114299 expref: 1210 pid: 16087 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.315123:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c052 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfba7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.315124:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.315126:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.315127:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c04b lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfba6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.315128:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800920c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011712896:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.315133:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880125a15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011713920:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.315137:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c036 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfba2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.315142:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e2a73c0/0x8a60d30f571a9ef4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfba6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114299 expref: 1209 pid: 16087 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.315145:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c036 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfba2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.315149:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c036 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfba2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.315150:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e2a73c0/0x8a60d30f571a9ef4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfba6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114299 expref: 1209 pid: 16087 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.315151:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.315153:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c036 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfba2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.315157:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c036 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfba2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.315158:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bb44700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011714176:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.315161:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c036 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfba2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.315164:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350480 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.315166:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c036 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfba2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.315169:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c036 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfba2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.315175:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c036 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfba2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.315179:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c036 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfba2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.315181:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdece40 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.315193:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011713920 00000100:00100000:3.0:1721880422.315196:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011713920 00010000:00010000:0.0:1721880422.315206:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5a56400/0x8a60d30f571aa098 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfba7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11433a expref: 1209 pid: 15440 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.315211:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632142 00010000:00010000:0.0:1721880422.315213:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.315214:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1721880422.315215:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2048:3689:x1805522011713536:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.315217:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c052 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfba7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.315226:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64421 count 1 00010000:00010000:3.0:1721880422.315234:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c059 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfba5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.315236:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5a56400/0x8a60d30f571aa098 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfba7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11433a expref: 1209 pid: 15440 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.315241:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d6de400/0x8a60d30f571a9de3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfba5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114229 expref: 1209 pid: 16016 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.315245:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.315246:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5a56400/0x8a60d30f571aa098 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfba7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11433a expref: 1209 pid: 15440 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.315246:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.315247:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c059 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfba5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.315257:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d6de400/0x8a60d30f571a9de3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfba5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114229 expref: 1209 pid: 16016 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.315261:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2048:3688:x1805522011712640:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1480us (1552us total) trans 4296020109 rc 0/0 00000100:00100000:0.0:1721880422.315262:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba65f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011714304:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.315263:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d6de400/0x8a60d30f571a9de3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfba5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114229 expref: 1209 pid: 16016 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.315267:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632137 00000100:00100000:3.0:1721880422.315269:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bb44000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011714432:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.315281:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632143 00000100:00100000:2.0:1721880422.315286:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880125a15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2047:3687:x1805522011713920:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.315291:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.315291:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdeccc0 going to sleep for 11 seconds 00002000:00080000:2.0:1721880422.315300:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64424 count 1 00000100:00100000:3.0:1721880422.315306:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bb47480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011713408:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.315310:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c060 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfba8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.315314:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727c044 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfba4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.315320:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a43c240/0x8a60d30f571aa297 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfba8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1143f7 expref: 1209 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.315321:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880125a15180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011713280:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.315323:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.315326:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.315328:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.315330:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c060 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfba8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.315335:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106cd80/0x8a60d30f5727c03d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfba3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.315344:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257717760 00010000:00010000:2.0:1721880422.315344:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a43c240/0x8a60d30f571aa297 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfba8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1143f7 expref: 1209 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.315346:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257717760 00010000:00010000:2.0:1721880422.315351:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a43c240/0x8a60d30f571aa297 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfba8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1143f7 expref: 1210 pid: 15506 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.315354:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bfa0fc0/0x8a60d30f571a9aef lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfba3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1140e0 expref: 1210 pid: 16074 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.315357:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.315361:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800920c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011714560:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.315369:0:15444:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257717888 00000100:00100000:1.0:1721880422.315371:0:15444:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257717888 00010000:00010000:1.0:1721880422.315376:0:15444:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800971e6d00/0x8a60d30f571a9caf lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfba4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114181 expref: 1211 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.315378:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.315384:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914331 00000100:00100000:1.0:1721880422.315387:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1211:2004:x1805522257717760:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.315388:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1721880422.315392:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.315394:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bfa0fc0/0x8a60d30f571a9aef lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfba3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1140e0 expref: 1211 pid: 16074 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.315394:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880125a15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011714048:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.315395:0:8271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914332 00010000:00010000:1.0:1721880422.315400:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bfa0fc0/0x8a60d30f571a9aef lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfba3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1140e0 expref: 1211 pid: 16074 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.315400:0:8271:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+1211:2005:x1805522257717888:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.315407:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bfa0fc0/0x8a60d30f571a9aef lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfba3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1140e0 expref: 1211 pid: 16074 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.315408:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.315410:0:8271:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.315414:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.315415:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.315415:0:8271:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800971e6d00/0x8a60d30f571a9caf lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfba4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114181 expref: 1210 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.315417:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106cd80/0x8a60d30f5727c03d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfba3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.315421:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106cd80/0x8a60d30f5727c03d lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfba3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.315423:0:8271:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800971e6d00/0x8a60d30f571a9caf lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfba4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114181 expref: 1210 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.315428:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.315435:0:8271:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800971e6d00/0x8a60d30f571a9caf lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfba4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114181 expref: 1210 pid: 16119 timeout: 887 lvb_type: 0 00000004:00080000:2.0:1721880422.315437:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007bb46300/2, rc 0, transno 1052813 00000100:00100000:1.0:1721880422.315439:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1210:2004:x1805522257717760:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 51us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.315443:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914331 00000100:00100000:2.0:1721880422.315445:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bb46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011712640:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.315445:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.315446:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.315449:0:8271:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727c044 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfba4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.315455:0:8271:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727c044 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfba4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.315456:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106cd80/0x8a60d30f5727c03d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfba3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.315460:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106cd80/0x8a60d30f5727c03d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfba3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.315464:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106cd80/0x8a60d30f5727c03d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfba3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.315467:0:8271:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.315468:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106cd80/0x8a60d30f5727c03d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfba3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.315472:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106cd80/0x8a60d30f5727c03d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfba3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.315475:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106cd80 already unused, calling callback (ffffffffa084e330) 00000100:00100000:2.0:1721880422.315475:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800920c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011714688:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.315477:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106cd80/0x8a60d30f5727c03d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfba3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.315481:0:8271:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+1208:2005:x1805522257717888:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 81us (123us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.315484:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106cd80/0x8a60d30f5727c03d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfba3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.315486:0:8271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914332 00010000:00010000:1.0:1721880422.315489:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106cd80/0x8a60d30f5727c03d lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfba3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.315493:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106cd80/0x8a60d30f5727c03d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfba3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.315494:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.315507:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727c044 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfba4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.315513:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727c044 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfba4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.315524:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727c044 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfba4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.315530:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727c044 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfba4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.315537:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727c044 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfba4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.315542:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aaaf40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.315545:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727c044 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfba4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.315551:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727c044 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfba4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.315561:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727c044 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfba4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.315566:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727c044 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfba4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.315577:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800994eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2048:3687:x1805522011713024:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1349us (1415us total) trans 4296020110 rc 0/0 00000100:00100000:1.0:1721880422.315583:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632138 00000100:00100000:1.0:1721880422.315595:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011714048 00000100:00100000:1.0:1721880422.315598:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011714048 00000100:00100000:1.0:1721880422.315610:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011714688 00000100:00100000:1.0:1721880422.315612:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011714688 00000100:00100000:1.0:1721880422.315622:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632144 00000100:00100000:1.0:1721880422.315626:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2050:3689:x1805522011714048:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.315637:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64425 count 1 00010000:00010000:1.0:1721880422.315646:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106e640/0x8a60d30f5727c067 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfba9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.315649:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122c1ca80/2, rc 0, transno 1052814 00000100:00100000:3.0:1721880422.315654:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880125a17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2050:3687:x1805522011713152:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1393us (1457us total) trans 4296020111 rc 0/0 00010000:00010000:1.0:1721880422.315656:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a538fa80/0x8a60d30f571aa4b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfba9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11449f expref: 1207 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.315658:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632139 00000100:00100000:0.0:1721880422.315661:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011713024:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.315662:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.315664:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.315666:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106e640/0x8a60d30f5727c067 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfba9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.315668:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632145 00000100:00100000:3.0:1721880422.315671:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2049:3689:x1805522011714688:12345-0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1721880422.315672:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880125a17100/2, rc 0, transno 1052815 00000100:00100000:0.0:1721880422.315676:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880125a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011713152:0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.315679:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64426 count 1 00010000:00010000:1.0:1721880422.315681:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a538fa80/0x8a60d30f571aa4b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfba9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11449f expref: 1207 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.315687:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c06e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbaa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.315689:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a538fa80/0x8a60d30f571aa4b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfba9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11449f expref: 1207 pid: 9458 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.315694:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880122d43180/0x8a60d30f571aa6f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbaa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114563 expref: 1207 pid: 15468 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.315696:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800920ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011714944:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.315698:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1721880422.315699:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880125a15180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011714816:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.315699:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.315701:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c06e lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbaa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.315713:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.315713:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880122d43180/0x8a60d30f571aa6f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbaa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114563 expref: 1207 pid: 15468 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.315718:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800920cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011715072:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.315720:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880122d43180/0x8a60d30f571aa6f7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbaa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114563 expref: 1207 pid: 15468 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.315721:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a180 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.315748:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bb47480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011715200:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.315752:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011714944 00000100:00100000:1.0:1721880422.315754:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011714944 00000100:00100000:3.0:1721880422.315767:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec000 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.315791:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bb44700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011714176:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.315803:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c04b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfba6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.315852:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632146 00000100:00100000:1.0:1721880422.315856:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2050:3686:x1805522011714944:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.315866:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64427 count 1 00010000:00010000:1.0:1721880422.315876:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106c240/0x8a60d30f5727c075 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbab:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.315884:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.315886:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132d15440/0x8a60d30f571aa90b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114612 expref: 1207 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.315892:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.315893:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1721880422.315895:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.315895:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106c240/0x8a60d30f5727c075 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.315896:0:8271:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257718016 00000100:00100000:3.0:1721880422.315899:0:8271:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257718016 00010000:00010000:3.0:1721880422.315908:0:8271:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e2a73c0/0x8a60d30f571a9ef4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfba6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114299 expref: 1208 pid: 16087 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.315909:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132d15440/0x8a60d30f571aa90b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114612 expref: 1208 pid: 16126 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.315912:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011715072 00000100:00100000:2.0:1721880422.315916:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011715072 00010000:00010000:1.0:1721880422.315917:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132d15440/0x8a60d30f571aa90b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114612 expref: 1208 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.315920:0:8271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914333 00000100:00100000:3.0:1721880422.315923:0:8271:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+1208:2005:x1805522257718016:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.315926:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880125a16300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011715328:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.315928:0:8271:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.315931:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632147 00010000:00010000:3.0:1721880422.315931:0:8271:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e2a73c0/0x8a60d30f571a9ef4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfba6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114299 expref: 1208 pid: 16087 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.315935:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2051:3687:x1805522011715072:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.315936:0:8271:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e2a73c0/0x8a60d30f571a9ef4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfba6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114299 expref: 1208 pid: 16087 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.315944:0:8271:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e2a73c0/0x8a60d30f571a9ef4 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfba6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114299 expref: 1208 pid: 16087 timeout: 887 lvb_type: 0 00002000:00080000:2.0:1721880422.315946:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64428 count 1 00010000:00010000:3.0:1721880422.315950:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.315951:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.315952:0:8271:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c04b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfba6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.315956:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c07c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbac:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.315957:0:8271:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c04b lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfba6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.315965:0:8271:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.315966:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007cb59f80/0x8a60d30f571aaa15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114690 expref: 1207 pid: 16056 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.315972:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.315974:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.315976:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c07c lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.315991:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007cb59f80/0x8a60d30f571aaa15 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114690 expref: 1207 pid: 16056 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.315994:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a540 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.315996:0:8271:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+1207:2005:x1805522257718016:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 72us (113us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.316000:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007cb59f80/0x8a60d30f571aaa15 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114690 expref: 1207 pid: 16056 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.316000:0:8271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914333 00000100:00100000:2.0:1721880422.316009:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b16ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011715456:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.316026:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c04b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfba6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.316033:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c04b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfba6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.316038:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c04b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfba6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.316043:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c04b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfba6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.316046:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c04b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfba6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.316048:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdecc0 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.316049:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aaa400 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.316051:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c04b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfba6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.316055:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c04b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfba6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.316060:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c04b lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfba6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.316064:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c04b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfba6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.316120:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012ba65f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011714304:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.316139:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c052 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfba7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.316145:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2052:3689:x1805522011713664:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1055us (1143us total) trans 4296020112 rc 0/0 00000100:00100000:3.0:1721880422.316149:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632140 00000004:00080000:2.0:1721880422.316157:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088615180/2, rc 0, transno 1052816 00000100:00100000:2.0:1721880422.316163:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088615180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011713664:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.316169:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.316184:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257718144 00000100:00100000:2.0:1721880422.316187:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257718144 00010000:00010000:2.0:1721880422.316195:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5a56400/0x8a60d30f571aa098 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfba7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11433a expref: 1207 pid: 15440 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.316199:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1721880422.316206:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bb44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011715584:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.316208:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914334 00000100:00100000:2.0:1721880422.316211:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1207:2005:x1805522257718144:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.316216:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.316218:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5a56400/0x8a60d30f571aa098 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfba7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11433a expref: 1207 pid: 15440 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.316221:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.316224:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5a56400/0x8a60d30f571aa098 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfba7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11433a expref: 1207 pid: 15440 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.316231:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011715584 00010000:00010000:2.0:1721880422.316232:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5a56400/0x8a60d30f571aa098 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfba7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11433a expref: 1207 pid: 15440 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.316233:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011715584 00010000:00010000:2.0:1721880422.316244:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.316244:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632148 00010000:00010000:2.0:1721880422.316245:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.316247:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c052 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfba7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.316247:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2052:3689:x1805522011715584:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.316251:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c052 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfba7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.316254:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64429 count 1 00010000:00010000:2.0:1721880422.316259:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.316261:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c083 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbad:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.316263:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c052 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfba7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.316268:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fc2f180/0x8a60d30f571aac99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114793 expref: 1206 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.316269:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c052 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfba7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.316271:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.316272:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.316273:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1206:2005:x1805522257718144:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 61us (104us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.316274:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c083 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.316277:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914334 00010000:00010000:0.0:1721880422.316278:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c052 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfba7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.316282:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c052 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfba7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.316283:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fc2f180/0x8a60d30f571aac99 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114793 expref: 1205 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.316286:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c052 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfba7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.316289:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325c6c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.316289:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fc2f180/0x8a60d30f571aac99 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114793 expref: 1205 pid: 15506 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.316291:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c052 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfba7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.316294:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bb47b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011715712:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.316295:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c052 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfba7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.316301:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c052 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfba7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.316304:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c052 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfba7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.316309:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdece40 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.316417:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880125a17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2053:3687:x1805522011713792:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1318us (1376us total) trans 4296020113 rc 0/0 00000100:00100000:0.0:1721880422.316424:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632141 00000004:00080000:2.0:1721880422.316431:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012ba67800/2, rc 0, transno 1052817 00000100:00100000:2.0:1721880422.316447:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012ba67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011713792:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.316499:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bb44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011715840:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.316529:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.316546:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011715840 00000100:00100000:2.0:1721880422.316550:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011715840 00000100:00100000:2.0:1721880422.316574:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632149 00000100:00100000:2.0:1721880422.316578:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2053:3689:x1805522011715840:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.316590:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64430 count 1 00010000:00010000:2.0:1721880422.316600:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c08a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbae:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.316610:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801391d2400/0x8a60d30f571aae98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11483b expref: 1205 pid: 15440 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.316616:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.316619:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.316621:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c08a lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.316637:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801391d2400/0x8a60d30f571aae98 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11483b expref: 1205 pid: 15440 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.316647:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801391d2400/0x8a60d30f571aae98 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11483b expref: 1205 pid: 15440 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.316656:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b16c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011715968:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.316681:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde300 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.317104:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bb44000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011714432:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.317117:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c059 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfba5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.317131:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bb47480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011715200:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.317144:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c06e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbaa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.317161:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800920c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011714560:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.317176:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c060 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfba8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.317188:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880125a15180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011714816:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.317200:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106e640/0x8a60d30f5727c067 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfba9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.317220:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.317222:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880125a16300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011715328:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.317231:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.317234:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106c240/0x8a60d30f5727c075 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.317246:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257718400 00000100:00100000:0.0:1721880422.317248:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.317249:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257718400 00000100:00100000:0.0:1721880422.317257:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.317263:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257718528 00000100:00100000:3.0:1721880422.317263:0:8271:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257718784 00000100:00100000:1.0:1721880422.317265:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257718528 00000100:00100000:3.0:1721880422.317266:0:8271:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257718784 00010000:00010000:1.0:1721880422.317274:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a43c240/0x8a60d30f571aa297 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfba8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1143f7 expref: 1208 pid: 15506 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.317275:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.317277:0:8271:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132d15440/0x8a60d30f571aa90b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114612 expref: 1208 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.317278:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b16ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011715456:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.317285:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.317286:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257718272 00010000:00010000:2.0:1721880422.317287:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c07c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.317288:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257718272 00000100:00100000:3.0:1721880422.317292:0:8271:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257718656 00010000:00010000:1.0:1721880422.317294:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d6de400/0x8a60d30f571a9de3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfba5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114229 expref: 1209 pid: 16016 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.317294:0:8271:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257718656 00000100:00100000:0.0:1721880422.317298:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257718912 00000100:00100000:0.0:1721880422.317301:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257718912 00010000:00010000:3.0:1721880422.317301:0:8271:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a538fa80/0x8a60d30f571aa4b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfba9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11449f expref: 1210 pid: 9458 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.317304:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914335 00000100:00100000:1.0:1721880422.317307:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094636a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1211:2005:x1805522257718528:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.317311:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007cb59f80/0x8a60d30f571aaa15 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114690 expref: 1211 pid: 16056 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.317312:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.317315:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a43c240/0x8a60d30f571aa297 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfba8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1143f7 expref: 1211 pid: 15506 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.317315:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914336 00000100:00100000:2.0:1721880422.317320:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094637800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+1211:2005:x1805522257718784:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.317320:0:8271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914337 00010000:00010000:1.0:1721880422.317324:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a43c240/0x8a60d30f571aa297 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfba8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1143f7 expref: 1211 pid: 15506 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.317325:0:8271:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094634000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+1211:2006:x1805522257718272:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.317327:0:7118:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.317331:0:7118:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132d15440/0x8a60d30f571aa90b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114612 expref: 1211 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.317332:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914338 00010000:00010000:1.0:1721880422.317333:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a43c240/0x8a60d30f571aa297 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfba8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1143f7 expref: 1211 pid: 15506 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.317333:0:8271:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1721880422.317336:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1211:2006:x1805522257718656:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.317337:0:8271:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d6de400/0x8a60d30f571a9de3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfba5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114229 expref: 1211 pid: 16016 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.317338:0:7118:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132d15440/0x8a60d30f571aa90b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114612 expref: 1210 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.317341:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.317342:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.317342:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.317344:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c060 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfba8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.317345:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a538fa80/0x8a60d30f571aa4b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfba9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11449f expref: 1210 pid: 9458 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.317347:0:7118:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132d15440/0x8a60d30f571aa90b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114612 expref: 1210 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.317348:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c060 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfba8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.317351:0:8271:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d6de400/0x8a60d30f571a9de3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfba5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114229 expref: 1210 pid: 16016 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.317352:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a538fa80/0x8a60d30f571aa4b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfba9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11449f expref: 1209 pid: 9458 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.317354:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.317355:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.317357:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.317357:0:7118:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106c240/0x8a60d30f5727c075 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.317361:0:7118:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106c240/0x8a60d30f5727c075 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.317362:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a538fa80/0x8a60d30f571aa4b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfba9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11449f expref: 1209 pid: 9458 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.317363:0:8271:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d6de400/0x8a60d30f571a9de3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfba5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114229 expref: 1209 pid: 16016 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.317371:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.317371:0:7118:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.317373:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1721880422.317373:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094636a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1207:2005:x1805522257718528:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 65us (124us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.317374:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.317375:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106e640/0x8a60d30f5727c067 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfba9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.317375:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1721880422.317377:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914335 00010000:00010000:3.0:1721880422.317378:0:8271:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c059 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfba5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.317380:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106e640/0x8a60d30f5727c067 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfba9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.317384:0:8271:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c059 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfba5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.317386:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914339 00000100:00100000:2.0:1721880422.317386:0:7118:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094637800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+1206:2005:x1805522257718784:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 66us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.317389:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1206:2004:x1805522257718912:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.317390:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.317390:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914336 00010000:00010000:1.0:1721880422.317393:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.317397:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007cb59f80/0x8a60d30f571aaa15 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114690 expref: 1205 pid: 16056 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.317398:0:8271:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.317401:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1205:2006:x1805522257718656:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 65us (126us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.317402:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007cb59f80/0x8a60d30f571aaa15 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114690 expref: 1205 pid: 16056 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.317405:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914338 00010000:00010000:2.0:1721880422.317407:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106c240/0x8a60d30f5727c075 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.317410:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007cb59f80/0x8a60d30f571aaa15 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114690 expref: 1205 pid: 16056 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.317411:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106c240/0x8a60d30f5727c075 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.317415:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.317416:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.317417:0:8271:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094634000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+1203:2006:x1805522257718272:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 91us (157us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.317418:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c07c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.317419:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106c240/0x8a60d30f5727c075 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.317421:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c07c lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.317423:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106c240/0x8a60d30f5727c075 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.317423:0:8271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914337 00010000:00010000:2.0:1721880422.317427:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106c240/0x8a60d30f5727c075 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.317429:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.317430:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106c240 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.317432:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106c240/0x8a60d30f5727c075 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.317436:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106c240/0x8a60d30f5727c075 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.317440:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1202:2004:x1805522257718912:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 50us (154us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.317441:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106c240/0x8a60d30f5727c075 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.317443:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914339 00010000:00010000:2.0:1721880422.317445:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106c240/0x8a60d30f5727c075 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.317451:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880122d43180/0x8a60d30f571aa6f7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbaa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114563 expref: 1202 pid: 15468 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.317465:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.317465:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914340 00000100:00100000:1.0:1721880422.317469:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a70ef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1201:2005:x1805522257718400:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.317470:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257719040 00010000:00010000:1.0:1721880422.317473:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.317473:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257719040 00010000:00010000:1.0:1721880422.317475:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880122d43180/0x8a60d30f571aa6f7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbaa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114563 expref: 1202 pid: 15468 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.317480:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880122d43180/0x8a60d30f571aa6f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbaa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114563 expref: 1202 pid: 15468 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.317483:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fc2f180/0x8a60d30f571aac99 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfbad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114793 expref: 1202 pid: 15506 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.317486:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880122d43180/0x8a60d30f571aa6f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbaa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114563 expref: 1202 pid: 15468 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.317493:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.317494:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.317496:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c06e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbaa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.317500:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c06e lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbaa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.317504:0:7116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914341 00010000:00010000:1.0:1721880422.317508:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.317508:0:7116:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d3d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1201:2005:x1805522257719040:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.317515:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.317515:0:7116:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.317517:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a70ef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1201:2005:x1805522257718400:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 48us (298us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.317519:0:7116:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fc2f180/0x8a60d30f571aac99 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfbad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114793 expref: 1201 pid: 15506 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.317520:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914340 00010000:00010000:3.0:1721880422.317528:0:7116:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fc2f180/0x8a60d30f571aac99 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114793 expref: 1200 pid: 15506 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.317535:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2054:3686:x1805522011714944:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1678us (1821us total) trans 4296020114 rc 0/0 00010000:00010000:3.0:1721880422.317538:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.317540:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632146 00010000:00010000:3.0:1721880422.317540:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.317542:0:7116:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c083 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.317549:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257719168 00010000:00010000:3.0:1721880422.317549:0:7116:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c083 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.317551:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257719168 00010000:00010000:0.0:1721880422.317554:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106e640/0x8a60d30f5727c067 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfba9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.317555:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c06e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.317557:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801391d2400/0x8a60d30f571aae98 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfbae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11483b expref: 1201 pid: 15440 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.317559:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106e640/0x8a60d30f5727c067 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfba9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.317559:0:7116:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.317560:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c06e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.317564:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106e640/0x8a60d30f5727c067 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfba9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.317565:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c06e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.317568:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c06e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.317570:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106e640/0x8a60d30f5727c067 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfba9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.317572:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c06e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.317574:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106e640/0x8a60d30f5727c067 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfba9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.317575:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914342 00010000:00010000:2.0:1721880422.317575:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa9f80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.317577:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106e640 already unused, calling callback (ffffffffa084e330) 00000100:00100000:1.0:1721880422.317577:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e195050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1201:2004:x1805522257719168:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.317577:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c06e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.317579:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106e640/0x8a60d30f5727c067 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfba9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.317580:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c06e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.317581:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.317581:0:7116:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d3d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1201:2005:x1805522257719040:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 71us (115us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.317583:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801391d2400/0x8a60d30f571aae98 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfbae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11483b expref: 1201 pid: 15440 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.317584:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106e640/0x8a60d30f5727c067 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfba9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.317586:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c06e lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.317587:0:7116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914341 00010000:00010000:1.0:1721880422.317589:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801391d2400/0x8a60d30f571aae98 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11483b expref: 1201 pid: 15440 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.317590:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106e640/0x8a60d30f5727c067 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfba9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.317590:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c06e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.317594:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106e640/0x8a60d30f5727c067 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfba9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.317599:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.317600:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.317601:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c08a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.317605:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c08a lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.317611:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.317622:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e195050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1200:2004:x1805522257719168:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 44us (107us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.317624:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fc2f180/0x8a60d30f571aac99 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114793 expref: 1200 pid: 15506 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.317626:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914342 00000100:00100000:3.0:1721880422.317636:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bb47b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011715712:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.317647:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c083 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.317655:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c083 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.317661:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c083 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.317668:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2055:3689:x1805522011714688:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1994us (2173us total) trans 4296020115 rc 0/0 00010000:00010000:3.0:1721880422.317669:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c083 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.317672:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632145 00010000:00010000:3.0:1721880422.317675:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c083 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.317682:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2054:3689:x1805522011714048:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2056us (2273us total) trans 4296020116 rc 0/0 00010000:00010000:3.0:1721880422.317682:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c083 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.317687:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632144 00010000:00010000:3.0:1721880422.317688:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aaba80 already unused, calling callback (ffffffffa084e330) 00000004:00080000:2.0:1721880422.317691:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800920ca300/2, rc 0, transno 1052818 00010000:00010000:3.0:1721880422.317691:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c083 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.317698:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c083 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.317703:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800920ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011714944:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.317709:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c083 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.317710:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800920c9c00/2, rc 0, transno 1052819 00000100:00100000:0.0:1721880422.317713:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800920c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011714688:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.317715:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c07c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.317718:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880125a15f80/2, rc 0, transno 1052820 00010000:00010000:2.0:1721880422.317719:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c07c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.317720:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880125a15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011714048:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.317721:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c083 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.317724:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c07c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.317746:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c07c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.317750:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c07c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.317753:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136351680 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.317756:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c07c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.317760:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c07c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.317765:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c07c lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.317770:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c07c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.317796:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bb47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011716096:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.317818:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.317833:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1721880422.317834:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1721880422.317840:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bb47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011716352:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.317840:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2054:3687:x1805522011715072:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1904us (1946us total) trans 4296020117 rc 0/0 00000100:00100000:0.0:1721880422.317841:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007bb44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011716224:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.317844:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632147 00000100:00100000:2.0:1721880422.317852:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011716096 00000100:00100000:2.0:1721880422.317855:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011716096 00000100:00100000:1.0:1721880422.317864:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.317865:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632150 00000100:00100000:2.0:1721880422.317868:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2055:3686:x1805522011716096:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.317871:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011716352 00000100:00100000:0.0:1721880422.317875:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011716352 00002000:00080000:2.0:1721880422.317877:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64431 count 1 00010000:00010000:2.0:1721880422.317885:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c091 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbaf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.317892:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632151 00010000:00010000:2.0:1721880422.317892:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801341ccfc0/0x8a60d30f571ab04a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1148c7 expref: 1198 pid: 16108 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.317897:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.317897:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.317899:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c091 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.317909:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801341ccfc0/0x8a60d30f571ab04a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1148c7 expref: 1198 pid: 16108 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.317915:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801341ccfc0/0x8a60d30f571ab04a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1148c7 expref: 1198 pid: 16108 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.317915:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2056:3689:x1805522011715584:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1665us (1691us total) trans 4296020118 rc 0/0 00000100:00100000:2.0:1721880422.317923:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b16ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011716480:192.168.201.24@tcp:104: 00000004:00080000:1.0:1721880422.317928:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007bb44700/2, rc 0, transno 1052822 00000100:00100000:1.0:1721880422.317934:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bb44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011715584:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.317940:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.317952:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632148 00000100:00100000:0.0:1721880422.317953:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880125a15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2056:3689:x1805522011716352:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.317954:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880125a14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011716608:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1721880422.317958:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800920cb800/2, rc 0, transno 1052821 00002000:00080000:0.0:1721880422.317965:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64433 count 1 00000100:00100000:2.0:1721880422.317971:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800920cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011715072:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.317971:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c059 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfba5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.317974:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c098 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbb1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.317978:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c059 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfba5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.317981:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ba80240/0x8a60d30f571ab456 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114a64 expref: 1198 pid: 15533 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.317985:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.317986:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.317986:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c059 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfba5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.317988:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c098 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.317988:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801391d2400/0x8a60d30f571aae98 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11483b expref: 1198 pid: 15440 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.317992:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.317992:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c059 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfba5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.317995:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b16c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011715968:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.317999:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ba80240/0x8a60d30f571ab456 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114a64 expref: 1197 pid: 15533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.317999:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c059 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfba5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.318004:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ba80240/0x8a60d30f571ab456 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114a64 expref: 1197 pid: 15533 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.318005:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aab600 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.318006:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c08a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.318008:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c059 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfba5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.318010:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d3d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011716864:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.318026:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c08a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.318029:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c059 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfba5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.318031:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c08a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.318036:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c08a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.318040:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c08a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.318040:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c059 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfba5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.318042:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3ec00 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.318043:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c08a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.318047:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c059 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfba5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.318048:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353a80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.318050:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c08a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.318053:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.318054:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c08a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.318060:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c08a lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.318063:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c08a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.318068:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880125a14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011716736:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.318079:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.318091:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011716608 00000100:00100000:1.0:1721880422.318093:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011716608 00000100:00100000:1.0:1721880422.318103:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011716224 00000100:00100000:1.0:1721880422.318105:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011716224 00000100:00100000:1.0:1721880422.318110:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011716736 00000100:00100000:1.0:1721880422.318112:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011716736 00000100:00100000:1.0:1721880422.318120:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632152 00000100:00100000:1.0:1721880422.318122:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880125a14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2060:3689:x1805522011716608:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.318127:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632153 00002000:00080000:1.0:1721880422.318131:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64434 count 1 00000100:00100000:3.0:1721880422.318133:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d3d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2060:3686:x1805522011716224:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.318139:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727c09f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbb2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.318146:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801232a9b00/0x8a60d30f571ab6cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114b44 expref: 1197 pid: 15533 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.318146:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64432 count 1 00010000:00010000:1.0:1721880422.318150:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.318151:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.318153:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727c09f lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.318155:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c0a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbb0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.318164:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801232a9b00/0x8a60d30f571ab6cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114b44 expref: 1197 pid: 15533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.318165:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5054fc0/0x8a60d30f571ab1f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11496f expref: 1197 pid: 16119 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.318167:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2060:3689:x1805522011715840:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1586us (1636us total) trans 4296020120 rc 0/0 00010000:00010000:1.0:1721880422.318169:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801232a9b00/0x8a60d30f571ab6cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114b44 expref: 1197 pid: 15533 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.318171:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000004:00080000:0.0:1721880422.318172:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007bb44a80/2, rc 0, transno 1052824 00010000:00010000:3.0:1721880422.318172:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.318173:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632149 00010000:00010000:3.0:1721880422.318175:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c0a6 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.318176:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880125a16300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011716992:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.318178:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bb44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011715840:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.318188:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632154 00010000:00010000:3.0:1721880422.318191:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5054fc0/0x8a60d30f571ab1f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11496f expref: 1197 pid: 16119 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.318193:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.318193:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d3d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2059:3686:x1805522011716736:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.318199:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1721880422.318200:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5054fc0/0x8a60d30f571ab1f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11496f expref: 1197 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.318205:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d3d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011717248:0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.318205:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64435 count 1 00010000:00010000:2.0:1721880422.318215:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727c0ad lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbb3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.318215:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800920c9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011717120:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.318225:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e9d0000/0x8a60d30f571ab870 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114bde expref: 1197 pid: 16018 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.318226:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.318232:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.318234:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.318236:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727c0ad lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.318238:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011717248 00000100:00100000:1.0:1721880422.318241:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011717248 00000100:00100000:3.0:1721880422.318241:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdece40 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.318252:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e9d0000/0x8a60d30f571ab870 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114bde expref: 1197 pid: 16018 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.318254:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632155 00000100:00100000:1.0:1721880422.318256:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d3d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2060:3686:x1805522011717248:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.318261:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e9d0000/0x8a60d30f571ab870 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114bde expref: 1197 pid: 16018 timeout: 887 lvb_type: 0 00002000:00080000:1.0:1721880422.318263:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64436 count 1 00010000:00010000:1.0:1721880422.318270:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727c0b4 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbb4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.318270:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b16c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011717376:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.318281:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fb98b40/0x8a60d30f571aba0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114c6a expref: 1197 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.318286:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.318286:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde300 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.318288:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.318290:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727c0b4 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.318304:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2060:3689:x1805522011713536:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3086us (3242us total) trans 4296020119 rc 0/0 00010000:00010000:1.0:1721880422.318305:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fb98b40/0x8a60d30f571aba0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114c6a expref: 1197 pid: 16018 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.318310:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632142 00000004:00080000:0.0:1721880422.318313:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800920c9500/2, rc 0, transno 1052823 00010000:00010000:1.0:1721880422.318313:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fb98b40/0x8a60d30f571aba0d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114c6a expref: 1197 pid: 16018 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.318318:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800920c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011713536:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.318322:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094636a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011717504:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.318334:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1721880422.318339:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d3d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011717632:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.318341:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.318359:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.318368:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011717632 00000100:00100000:2.0:1721880422.318371:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011717632 00000100:00100000:2.0:1721880422.318383:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632156 00000100:00100000:2.0:1721880422.318386:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2060:3689:x1805522011717632:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.318396:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c060 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfba8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.318400:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64437 count 1 00010000:00010000:3.0:1721880422.318403:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c060 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfba8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.318408:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c0bb lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbb5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.318410:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c060 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfba8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.318416:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c060 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfba8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.318418:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008420f3c0/0x8a60d30f571abc75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114d3c expref: 1197 pid: 16085 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.318423:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c060 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfba8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.318425:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.318426:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.318428:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c0bb lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.318428:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801363533c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.318431:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c060 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfba8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.318437:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c060 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfba8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.318444:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008420f3c0/0x8a60d30f571abc75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114d3c expref: 1197 pid: 16085 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.318447:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c060 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfba8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.318454:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008420f3c0/0x8a60d30f571abc75 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114d3c expref: 1197 pid: 16085 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.318454:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c060 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfba8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.318464:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b16ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011717760:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.318488:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.318565:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880125a15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2061:3687:x1805522011713920:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3277us (3412us total) trans 4296020121 rc 0/0 00000100:00100000:3.0:1721880422.318571:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632143 00000004:00080000:2.0:1721880422.318578:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880125a15500/2, rc 0, transno 1052825 00000100:00100000:2.0:1721880422.318585:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880125a15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011713920:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.318686:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d3d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011717888:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.318710:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.318718:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d3d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011716864:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.318741:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011717888 00000100:00100000:3.0:1721880422.318746:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011717888 00010000:00010000:0.0:1721880422.318747:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c098 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.318764:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632157 00000100:00100000:3.0:1721880422.318768:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b16df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2061:3689:x1805522011717888:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.318777:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b16ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011716480:192.168.201.24@tcp:104: 00002000:00080000:3.0:1721880422.318779:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64438 count 1 00010000:00010000:2.0:1721880422.318788:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c091 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.318788:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c0c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbb6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.318798:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880123aed440/0x8a60d30f571abda9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114db3 expref: 1197 pid: 16124 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.318804:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.318805:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.318807:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c0c2 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.318822:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880123aed440/0x8a60d30f571abda9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114db3 expref: 1197 pid: 16124 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.318836:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880123aed440/0x8a60d30f571abda9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114db3 expref: 1197 pid: 16124 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.318845:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800920c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011718016:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.318877:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdeccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.318980:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.318991:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880125a16300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011716992:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.318995:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.319006:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727c09f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.319008:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257719424 00000100:00100000:1.0:1721880422.319025:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257719424 00010000:00010000:1.0:1721880422.319038:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ba80240/0x8a60d30f571ab456 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114a64 expref: 1198 pid: 15533 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.319054:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257719296 00000100:00100000:1.0:1721880422.319056:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914343 00000100:00100000:0.0:1721880422.319057:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257719296 00000100:00100000:1.0:1721880422.319061:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094637800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1199:2004:x1805522257719424:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.319069:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801341ccfc0/0x8a60d30f571ab04a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1148c7 expref: 1199 pid: 16108 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.319070:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.319074:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ba80240/0x8a60d30f571ab456 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbb1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114a64 expref: 1199 pid: 15533 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.319082:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ba80240/0x8a60d30f571ab456 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbb1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114a64 expref: 1199 pid: 15533 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.319083:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914344 00000100:00100000:0.0:1721880422.319086:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094634000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1199:2004:x1805522257719296:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.319092:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.319094:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ba80240/0x8a60d30f571ab456 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbb1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114a64 expref: 1199 pid: 15533 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.319095:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801341ccfc0/0x8a60d30f571ab04a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbaf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1148c7 expref: 1199 pid: 16108 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.319102:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801341ccfc0/0x8a60d30f571ab04a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbaf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1148c7 expref: 1198 pid: 16108 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.319104:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.319106:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.319109:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c098 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.319110:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801341ccfc0/0x8a60d30f571ab04a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbaf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1148c7 expref: 1198 pid: 16108 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.319115:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c098 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.319121:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.319122:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.319124:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c091 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.319129:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c091 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.319131:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.319136:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c098 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.319141:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c098 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.319145:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.319150:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094637800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1197:2004:x1805522257719424:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 88us (171us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.319150:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c098 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.319154:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c098 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.319157:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914343 00010000:00010000:2.0:1721880422.319158:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c098 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.319159:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094634000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1197:2004:x1805522257719296:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 72us (164us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.319161:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325e880 already unused, calling callback (ffffffffa084e330) 00000100:00100000:0.0:1721880422.319163:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914344 00010000:00010000:2.0:1721880422.319163:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c098 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.319167:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c098 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.319173:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c098 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.319175:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c091 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.319176:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c098 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.319183:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c091 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.319192:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c091 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.319199:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c091 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.319205:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c091 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.319211:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352d00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.319214:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c091 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.319219:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.319220:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c091 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.319230:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c091 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.319235:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257719552 00010000:00010000:3.0:1721880422.319236:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c091 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.319239:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257719552 00010000:00010000:0.0:1721880422.319250:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801232a9b00/0x8a60d30f571ab6cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114b44 expref: 1196 pid: 15533 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.319266:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880125a15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2062:3689:x1805522011716352:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1314us (1401us total) trans 4296020122 rc 0/0 00000100:00100000:2.0:1721880422.319271:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632151 00000100:00100000:3.0:1721880422.319276:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800920c9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011717120:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.319286:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.319289:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c0a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.319292:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007bb47480/2, rc 0, transno 1052826 00000100:00100000:2.0:1721880422.319299:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bb47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011716352:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.319308:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.319309:0:15444:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257719680 00000100:00100000:2.0:1721880422.319311:0:15444:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257719680 00000100:00100000:1.0:1721880422.319320:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257719808 00010000:00010000:2.0:1721880422.319321:0:15444:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5054fc0/0x8a60d30f571ab1f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11496f expref: 1197 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.319324:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257719808 00000100:00100000:0.0:1721880422.319334:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914345 00010000:00010000:1.0:1721880422.319337:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e9d0000/0x8a60d30f571ab870 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfbb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114bde expref: 1198 pid: 16018 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.319338:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914346 00000100:00100000:0.0:1721880422.319339:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088efd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1198:2004:x1805522257719552:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.319341:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088614700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1198:2005:x1805522257719680:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.319346:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.319346:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.319348:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5054fc0/0x8a60d30f571ab1f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbb0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11496f expref: 1198 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.319350:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801232a9b00/0x8a60d30f571ab6cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbb2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114b44 expref: 1198 pid: 15533 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.319354:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5054fc0/0x8a60d30f571ab1f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbb0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11496f expref: 1198 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.319359:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801232a9b00/0x8a60d30f571ab6cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbb2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114b44 expref: 1198 pid: 15533 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.319360:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914347 00010000:00010000:2.0:1721880422.319362:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5054fc0/0x8a60d30f571ab1f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbb0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11496f expref: 1198 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.319365:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1198:2004:x1805522257719808:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.319370:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.319371:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.319372:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.319373:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c0a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.319375:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801232a9b00/0x8a60d30f571ab6cc lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbb2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114b44 expref: 1197 pid: 15533 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.319377:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e9d0000/0x8a60d30f571ab870 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfbb3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114bde expref: 1197 pid: 16018 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.319377:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c0a6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.319385:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e9d0000/0x8a60d30f571ab870 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbb3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114bde expref: 1196 pid: 16018 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.319386:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.319388:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.319390:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727c09f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.319394:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.319396:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727c09f lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.319397:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.319399:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.319399:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c0a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.319402:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727c0ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbb3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.319407:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c0a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.319408:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727c0ad lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbb3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.319409:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.319410:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088614700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1196:2005:x1805522257719680:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 68us (125us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.319414:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c0a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.319415:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914346 00010000:00010000:1.0:1721880422.319419:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.319421:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c0a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.319422:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088efd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1195:2004:x1805522257719552:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 83us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.319427:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914345 00010000:00010000:2.0:1721880422.319427:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727c09f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.319427:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c0a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.319432:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727c09f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.319432:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aabcc0 already unused, calling callback (ffffffffa084e330) 00000100:00100000:1.0:1721880422.319435:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1195:2004:x1805522257719808:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 69us (126us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.319435:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c0a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.319437:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727c09f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.319441:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914347 00010000:00010000:2.0:1721880422.319441:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727c09f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.319441:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c0a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.319444:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727c09f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.319448:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106fa80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.319449:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727c09f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.319450:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c0a6 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.319453:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727c09f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.319456:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c0a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.319458:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727c09f lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.319460:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1721880422.319465:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727c09f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.319508:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d3d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011718144:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.319522:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.319529:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b16ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011717760:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.319530:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.319533:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257719936 00000100:00100000:1.0:1721880422.319536:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257719936 00010000:00010000:2.0:1721880422.319540:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c0bb lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.319546:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fb98b40/0x8a60d30f571aba0d lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfbb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114c6a expref: 1194 pid: 16018 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.319561:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914348 00000100:00100000:3.0:1721880422.319564:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d3d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2064:3686:x1805522011716224:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1430us (1508us total) trans 4296020124 rc 0/0 00000100:00100000:2.0:1721880422.319565:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.319566:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1194:2004:x1805522257719936:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.319571:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632153 00010000:00010000:1.0:1721880422.319572:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.319576:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fb98b40/0x8a60d30f571aba0d lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfbb4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114c6a expref: 1194 pid: 16018 timeout: 887 lvb_type: 0 00000004:00080000:0.0:1721880422.319578:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007bb44000/2, rc 0, transno 1052828 00000100:00100000:0.0:1721880422.319583:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bb44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011716224:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.319584:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fb98b40/0x8a60d30f571aba0d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbb4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114c6a expref: 1194 pid: 16018 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.319584:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011718144 00000100:00100000:3.0:1721880422.319587:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011718144 00000100:00100000:0.0:1721880422.319588:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257720064 00000100:00100000:0.0:1721880422.319590:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257720064 00010000:00010000:1.0:1721880422.319594:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.319596:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.319599:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008420f3c0/0x8a60d30f571abc75 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114d3c expref: 1195 pid: 16085 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.319599:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727c0b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbb4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.319602:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632158 00010000:00010000:1.0:1721880422.319605:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727c0b4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbb4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.319607:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d3d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2064:3687:x1805522011718144:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.319610:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914349 00000100:00100000:0.0:1721880422.319613:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129d21c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1195:2005:x1805522257720064:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.319615:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00080000:3.0:1721880422.319617:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64439 count 1 00010000:00010000:0.0:1721880422.319618:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.319620:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008420f3c0/0x8a60d30f571abc75 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbb5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114d3c expref: 1195 pid: 16085 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.319626:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008420f3c0/0x8a60d30f571abc75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbb5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114d3c expref: 1195 pid: 16085 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.319627:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c0c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbb7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.319632:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1195:2004:x1805522257719936:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 65us (110us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.319634:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008420f3c0/0x8a60d30f571abc75 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbb5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114d3c expref: 1195 pid: 16085 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.319637:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096369b00/0x8a60d30f571abedd lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114e31 expref: 1195 pid: 16025 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.319638:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914348 00010000:00010000:0.0:1721880422.319640:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.319641:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.319642:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.319643:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c0bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.319643:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.319645:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.319647:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c0bb lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.319647:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c0c9 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.319651:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257720192 00000100:00100000:1.0:1721880422.319654:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257720192 00010000:00010000:0.0:1721880422.319656:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.319659:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c0bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.319663:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880123aed440/0x8a60d30f571abda9 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfbb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114db3 expref: 1194 pid: 16124 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.319663:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096369b00/0x8a60d30f571abedd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114e31 expref: 1194 pid: 16025 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.319664:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c0bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.319668:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880129d21c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1194:2005:x1805522257720064:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 54us (103us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.319669:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c0bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.319672:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914349 00010000:00010000:2.0:1721880422.319672:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c0bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.319672:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096369b00/0x8a60d30f571abedd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114e31 expref: 1194 pid: 16025 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.319676:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c0bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.319679:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353180 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.319682:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c0bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.319682:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800920c9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011718272:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.319688:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c0bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.319692:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914350 00010000:00010000:2.0:1721880422.319694:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c0bb lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.319697:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b16ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1193:2004:x1805522257720192:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.319699:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c0bb lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.319703:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdece40 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.319704:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.319708:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880123aed440/0x8a60d30f571abda9 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfbb6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114db3 expref: 1193 pid: 16124 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.319717:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011718400:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.319717:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880123aed440/0x8a60d30f571abda9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbb6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114db3 expref: 1193 pid: 16124 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.319746:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.319746:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.319747:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.319750:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c0c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbb6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.319757:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c0c2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbb6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.319763:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011718400 00000100:00100000:0.0:1721880422.319766:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011718400 00010000:00010000:1.0:1721880422.319767:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.319776:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632159 00000100:00100000:0.0:1721880422.319779:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2066:3687:x1805522011718400:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.319784:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b16ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1193:2004:x1805522257720192:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 86us (141us total) trans 0 rc 0/0 00002000:00080000:0.0:1721880422.319788:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64440 count 1 00000100:00100000:1.0:1721880422.319790:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914350 00000100:00100000:3.0:1721880422.319792:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880125a14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2066:3689:x1805522011716608:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1668us (1799us total) trans 4296020125 rc 0/0 00010000:00010000:0.0:1721880422.319796:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727c0d0 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbb8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.319797:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632152 00010000:00010000:0.0:1721880422.319804:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0cc3600/0x8a60d30f571ac050 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114ec4 expref: 1192 pid: 16022 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.319809:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.319810:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.319810:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2065:3689:x1805522011717632:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1421us (1448us total) trans 4296020126 rc 0/0 00010000:00010000:0.0:1721880422.319811:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727c0d0 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.319817:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632156 00010000:00010000:1.0:1721880422.319818:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fb98b40/0x8a60d30f571aba0d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114c6a expref: 1192 pid: 16018 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.319821:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0cc3600/0x8a60d30f571ac050 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114ec4 expref: 1192 pid: 16022 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.319827:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0cc3600/0x8a60d30f571ac050 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114ec4 expref: 1191 pid: 16022 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.319828:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123aed440/0x8a60d30f571abda9 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114db3 expref: 1191 pid: 16124 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.319830:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094636a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011717504:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.319834:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088614700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011718528:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.319840:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800920c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011718016:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.319843:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727c0b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.319843:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d3d4a80/2, rc 0, transno 1052830 00000100:00100000:0.0:1721880422.319848:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e840 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.319850:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727c0b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.319854:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c0c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.319856:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727c0b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.319859:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d3d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011717632:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.319861:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c0c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.319864:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727c0b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.319866:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c0c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.319870:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727c0b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.319872:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880125a14380/2, rc 0, transno 1052829 00000100:00100000:2.0:1721880422.319876:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880125a14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011716608:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.319877:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727c0b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.319878:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c0c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.319880:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1721880422.319882:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106f180 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.319884:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c0c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.319885:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727c0b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.319887:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009bdc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011718784:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.319890:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c0c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.319892:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727c0b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.319896:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aaad00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.319898:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c0c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.319901:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727c0b4 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.319904:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c0c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.319909:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.319912:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106f180/0x8a60d30f5727c0b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.319912:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c0c2 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.319917:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c0c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.319922:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011718656:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.319927:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011718784 00000100:00100000:0.0:1721880422.319930:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011718784 00000100:00100000:2.0:1721880422.319938:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.319946:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011718656 00000100:00100000:0.0:1721880422.319948:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011718656 00000100:00100000:0.0:1721880422.319961:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632160 00000100:00100000:0.0:1721880422.319966:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2068:3689:x1805522011718784:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.319966:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632161 00000100:00100000:2.0:1721880422.319971:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b16ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2068:3689:x1805522011718656:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.319978:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64442 count 1 00002000:00080000:2.0:1721880422.319983:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64441 count 1 00010000:00010000:0.0:1721880422.319988:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c0d7 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbba:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.319993:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727c0de lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbb9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.319996:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a9dd40/0x8a60d30f571ac589 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11506f expref: 1190 pid: 16053 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.320000:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013065d200/0x8a60d30f571ac287 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114f88 expref: 1190 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.320001:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.320001:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.320003:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c0d7 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.320004:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.320005:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.320007:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727c0de lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.320030:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130a9dd40/0x8a60d30f571ac589 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11506f expref: 1190 pid: 16053 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.320031:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2068:3686:x1805522011716096:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2159us (2211us total) trans 4296020123 rc 0/0 00010000:00010000:2.0:1721880422.320035:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013065d200/0x8a60d30f571ac287 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114f88 expref: 1190 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.320036:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130a9dd40/0x8a60d30f571ac589 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11506f expref: 1190 pid: 16053 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.320038:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632150 00000100:00100000:0.0:1721880422.320042:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009bdc6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011718912:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.320042:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d3d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2068:3686:x1805522011717248:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1782us (1813us total) trans 4296020127 rc 0/0 00010000:00010000:2.0:1721880422.320043:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013065d200/0x8a60d30f571ac287 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114f88 expref: 1190 pid: 16018 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.320048:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632155 00000100:00100000:2.0:1721880422.320053:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b16d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011719040:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.320057:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3ee40 going to sleep for 11 seconds 00000004:00080000:3.0:1721880422.320071:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d3d4000/2, rc 0, transno 1052831 00000100:00100000:2.0:1721880422.320075:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.320080:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d3d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011717248:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1721880422.320090:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007bb47b80/2, rc 0, transno 1052827 00000100:00100000:3.0:1721880422.320093:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007bb47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011716096:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.320098:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e9d0000/0x8a60d30f571ab870 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114bde expref: 1190 pid: 16018 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.320104:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009bdc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011719168:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.320105:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009bdc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011719296:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.320108:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b16c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011717376:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.320121:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727c0ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.320125:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.320133:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727c0ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.320133:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.320140:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727c0ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.320144:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011719296 00000100:00100000:0.0:1721880422.320146:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011719296 00010000:00010000:2.0:1721880422.320147:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727c0ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.320153:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727c0ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.320156:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011719168 00000100:00100000:0.0:1721880422.320158:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011719168 00010000:00010000:2.0:1721880422.320159:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727c0ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.320164:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136351200 already unused, calling callback (ffffffffa084e330) 00000100:00100000:1.0:1721880422.320167:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632162 00010000:00010000:2.0:1721880422.320167:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727c0ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.320172:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632163 00000100:00100000:1.0:1721880422.320173:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bdc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2068:3687:x1805522011719296:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.320173:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727c0ad lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.320175:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2068:3686:x1805522011719168:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.320182:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727c0ad lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1721880422.320184:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64443 count 1 00002000:00080000:1.0:1721880422.320187:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64444 count 1 00010000:00010000:2.0:1721880422.320188:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727c0ad lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.320191:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c0e5 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbbb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.320197:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106c6c0/0x8a60d30f5727c0ec lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbbc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.320198:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096f88480/0x8a60d30f571ac773 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11513a expref: 1189 pid: 16057 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.320202:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.320203:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1721880422.320204:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b16df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2068:3689:x1805522011717888:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1433us (1491us total) trans 4296020128 rc 0/0 00010000:00010000:0.0:1721880422.320205:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c0e5 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.320207:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013130eac0/0x8a60d30f571ac972 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1151db expref: 1189 pid: 16121 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.320210:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632157 00010000:00010000:1.0:1721880422.320213:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.320214:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.320215:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096f88480/0x8a60d30f571ac773 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11513a expref: 1189 pid: 16057 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.320216:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106c6c0/0x8a60d30f5727c0ec lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.320219:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096f88480/0x8a60d30f571ac773 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11513a expref: 1189 pid: 16057 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.320225:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009bdc4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011719424:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.320234:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013130eac0/0x8a60d30f571ac972 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1151db expref: 1189 pid: 16121 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.320242:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e3c0 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.320243:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013130eac0/0x8a60d30f571ac972 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1151db expref: 1189 pid: 16121 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.320258:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba64000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011719552:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.320281:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d3d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2068:3686:x1805522011716736:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2088us (2200us total) trans 4296020129 rc 0/0 00000100:00100000:1.0:1721880422.320282:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.320286:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632154 00000004:00080000:2.0:1721880422.320308:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d3d5f80/2, rc 0, transno 1052832 00000100:00100000:2.0:1721880422.320312:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d3d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011717888:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1721880422.320327:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880125a14700/2, rc 0, transno 1052833 00000100:00100000:3.0:1721880422.320335:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880125a14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011716736:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.320341:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009bdc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011719680:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.320360:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.320375:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011719680 00000100:00100000:2.0:1721880422.320375:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1721880422.320378:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011719680 00000100:00100000:2.0:1721880422.320380:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009bdc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011719808:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.320395:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632164 00000100:00100000:2.0:1721880422.320397:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.320399:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b16c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2068:3688:x1805522011719680:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.320410:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64445 count 1 00000100:00100000:1.0:1721880422.320411:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011719808 00000100:00100000:1.0:1721880422.320415:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011719808 00010000:00010000:0.0:1721880422.320420:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c0f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbbd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.320434:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632165 00010000:00010000:0.0:1721880422.320435:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c56d680/0x8a60d30f571acb6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115291 expref: 1189 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.320437:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b16ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2069:3688:x1805522011719808:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.320441:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.320442:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.320444:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c0f3 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.320446:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64446 count 1 00010000:00010000:1.0:1721880422.320453:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106e400/0x8a60d30f5727c0fa lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbbe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.320460:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fbd6f40/0x8a60d30f571acec0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1153e8 expref: 1189 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.320464:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.320465:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.320466:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106e400/0x8a60d30f5727c0fa lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.320477:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fbd6f40/0x8a60d30f571acec0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1153e8 expref: 1189 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.320482:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fbd6f40/0x8a60d30f571acec0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1153e8 expref: 1189 pid: 15514 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.320488:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba66d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011719936:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.320520:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a9c0 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.320527:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c56d680/0x8a60d30f571acb6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115291 expref: 1189 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.320538:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c56d680/0x8a60d30f571acb6a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115291 expref: 1189 pid: 15514 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.320548:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009bdc6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011720064:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.320569:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.320925:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009bdc6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011718912:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.320937:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c0d7 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.320992:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088614700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011718528:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.321035:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727c0d0 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.321103:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800920c9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011718272:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.321116:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c0c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.321121:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009bdc4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011719424:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.321122:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.321124:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b16d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011719040:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.321138:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.321138:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727c0de lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.321139:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c0e5 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.321148:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.321154:0:15444:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257720448 00000100:00100000:1.0:1721880422.321156:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257720576 00000100:00100000:3.0:1721880422.321157:0:15444:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257720448 00000100:00100000:0.0:1721880422.321158:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.321159:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257720576 00000100:00100000:0.0:1721880422.321167:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257720704 00010000:00010000:3.0:1721880422.321167:0:15444:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096369b00/0x8a60d30f571abedd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114e31 expref: 1191 pid: 16025 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.321169:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257720704 00010000:00010000:1.0:1721880422.321172:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130a9dd40/0x8a60d30f571ac589 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11506f expref: 1191 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.321180:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096f88480/0x8a60d30f571ac773 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11513a expref: 1192 pid: 16057 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.321181:0:15444:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257720320 00000100:00100000:3.0:1721880422.321182:0:15444:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257720320 00010000:00010000:3.0:1721880422.321189:0:15444:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0cc3600/0x8a60d30f571ac050 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114ec4 expref: 1193 pid: 16022 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.321192:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914351 00000100:00100000:1.0:1721880422.321197:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bdc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1193:2005:x1805522257720448:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.321199:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914352 00000100:00100000:0.0:1721880422.321205:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914353 00010000:00010000:1.0:1721880422.321205:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.321205:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bdc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1193:2005:x1805522257720576:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.321210:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096369b00/0x8a60d30f571abedd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbb7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114e31 expref: 1193 pid: 16025 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.321211:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bdc4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1193:2007:x1805522257720704:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.321215:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.321215:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914354 00010000:00010000:1.0:1721880422.321218:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096369b00/0x8a60d30f571abedd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbb7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114e31 expref: 1193 pid: 16025 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.321218:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bdc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1193:2007:x1805522257720320:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.321219:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.321220:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130a9dd40/0x8a60d30f571ac589 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11506f expref: 1193 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.321223:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096f88480/0x8a60d30f571ac773 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbbb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11513a expref: 1193 pid: 16057 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.321224:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.321227:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0cc3600/0x8a60d30f571ac050 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbb8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114ec4 expref: 1193 pid: 16022 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.321230:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096369b00/0x8a60d30f571abedd lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbb7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114e31 expref: 1193 pid: 16025 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.321232:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096f88480/0x8a60d30f571ac773 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbbb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11513a expref: 1193 pid: 16057 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.321233:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0cc3600/0x8a60d30f571ac050 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbb8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114ec4 expref: 1193 pid: 16022 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.321236:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130a9dd40/0x8a60d30f571ac589 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11506f expref: 1193 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.321245:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.321246:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096f88480/0x8a60d30f571ac773 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbbb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11513a expref: 1192 pid: 16057 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.321247:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.321248:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0cc3600/0x8a60d30f571ac050 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbb8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114ec4 expref: 1192 pid: 16022 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.321250:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c0c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.321250:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130a9dd40/0x8a60d30f571ac589 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11506f expref: 1192 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.321254:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.321255:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.321256:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c0c9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.321257:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.321257:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727c0d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.321259:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.321260:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.321261:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c0e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.321261:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.321262:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727c0d0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.321264:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c0d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.321268:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c0e5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.321270:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.321271:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c0d7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.321271:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.321280:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.321285:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.321289:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bdc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1189:2007:x1805522257720320:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 70us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.321290:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bdc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1189:2005:x1805522257720448:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 93us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.321293:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914354 00000100:00100000:0.0:1721880422.321297:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bdc4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1189:2007:x1805522257720704:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 86us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.321297:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914351 00000100:00100000:0.0:1721880422.321303:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914353 00000100:00100000:2.0:1721880422.321303:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bdc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1188:2005:x1805522257720576:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 97us (162us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.321309:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c0c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.321310:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914352 00010000:00010000:1.0:1721880422.321312:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c0e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.321314:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c0c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.321318:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c0e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.321322:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c0c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.321325:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c0e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.321326:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c0c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.321330:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c0d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.321330:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c0c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.321331:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c0e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.321333:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa9b00 already unused, calling callback (ffffffffa084e330) 00000100:00100000:0.0:1721880422.321334:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.321335:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c0c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.321337:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c0e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.321337:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c0d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.321339:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c0c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.321344:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c0c9 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.321347:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325dd40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.321347:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c0d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.321348:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c0c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.321350:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c0e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.321356:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c0e5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.321358:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c0d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.321365:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c0e5 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.321365:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c0d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.321369:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.321371:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c0e5 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.321371:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325e640 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.321375:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c0d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.321376:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257720960 00000100:00100000:0.0:1721880422.321379:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257720960 00010000:00010000:2.0:1721880422.321382:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c0d7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.321387:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013130eac0/0x8a60d30f571ac972 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfbbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1151db expref: 1186 pid: 16121 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.321391:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c0d7 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.321396:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257720832 00000100:00100000:0.0:1721880422.321397:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257720832 00010000:00010000:2.0:1721880422.321398:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c0d7 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.321401:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013065d200/0x8a60d30f571ac287 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114f88 expref: 1187 pid: 16018 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.321415:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914355 00000100:00100000:0.0:1721880422.321418:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bdc6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1187:2007:x1805522257720960:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.321423:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.321425:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914356 00010000:00010000:0.0:1721880422.321426:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013130eac0/0x8a60d30f571ac972 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfbbc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1151db expref: 1187 pid: 16121 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.321431:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8064050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1187:2005:x1805522257720832:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.321432:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013130eac0/0x8a60d30f571ac972 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbbc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1151db expref: 1187 pid: 16121 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.321439:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.321440:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.321442:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.321443:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106c6c0/0x8a60d30f5727c0ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbbc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.321444:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013065d200/0x8a60d30f571ac287 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbb9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114f88 expref: 1187 pid: 16018 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.321444:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d3d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2070:3687:x1805522011718144:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1836us (1913us total) trans 4296020130 rc 0/0 00010000:00010000:0.0:1721880422.321448:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106c6c0/0x8a60d30f5727c0ec lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbbc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.321449:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632158 00010000:00010000:1.0:1721880422.321453:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013065d200/0x8a60d30f571ac287 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbb9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114f88 expref: 1187 pid: 16018 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.321454:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.321464:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bdc6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1187:2007:x1805522257720960:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 45us (130us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.321465:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013065d200/0x8a60d30f571ac287 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbb9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b114f88 expref: 1187 pid: 16018 timeout: 887 lvb_type: 0 00000004:00080000:3.0:1721880422.321469:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d3d5500/2, rc 0, transno 1052834 00000100:00100000:0.0:1721880422.321470:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914355 00000100:00100000:3.0:1721880422.321475:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d3d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011718144:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.321481:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.321482:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.321485:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727c0de lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.321492:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727c0de lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.321498:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1721880422.321503:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800920c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011720192:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.321507:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.321508:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2070:3689:x1805522011718784:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1541us (1597us total) trans 4296020131 rc 0/0 00000100:00100000:2.0:1721880422.321513:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632160 00000100:00100000:3.0:1721880422.321518:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.321523:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011720192 00000100:00100000:1.0:1721880422.321525:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8064050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1185:2005:x1805522257720832:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 94us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.321525:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011720192 00000100:00100000:0.0:1721880422.321532:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.321532:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914356 00000100:00100000:0.0:1721880422.321539:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257721216 00000100:00100000:0.0:1721880422.321541:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257721216 00000100:00100000:2.0:1721880422.321544:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632166 00010000:00010000:0.0:1721880422.321548:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c56d680/0x8a60d30f571acb6a lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfbbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115291 expref: 1185 pid: 15514 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.321548:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f020380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2070:3687:x1805522011720192:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.321557:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914357 00002000:00080000:2.0:1721880422.321557:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64447 count 1 00000100:00100000:0.0:1721880422.321559:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ea15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1185:2005:x1805522257721216:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.321564:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.321565:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c101 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbbf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.321566:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c56d680/0x8a60d30f571acb6a lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfbbd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115291 expref: 1185 pid: 15514 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.321572:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c56d680/0x8a60d30f571acb6a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbbd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115291 expref: 1185 pid: 15514 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.321572:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096208900/0x8a60d30f571ad160 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1154dd expref: 1185 pid: 16073 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.321576:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.321577:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.321578:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.321579:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.321579:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c101 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.321581:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c0f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbbd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.321585:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c0f3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbbd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.321589:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096208900/0x8a60d30f571ad160 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1154dd expref: 1185 pid: 16073 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.321590:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.321591:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.321595:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096208900/0x8a60d30f571ad160 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1154dd expref: 1185 pid: 16073 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.321601:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b16d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011720320:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.321602:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ea15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1185:2005:x1805522257721216:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 42us (71us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.321607:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257721088 00000100:00100000:0.0:1721880422.321608:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914357 00000100:00100000:1.0:1721880422.321611:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257721088 00000100:00100000:2.0:1721880422.321622:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde6c0 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.321623:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fbd6f40/0x8a60d30f571acec0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfbbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1153e8 expref: 1185 pid: 15514 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.321627:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c56d680/0x8a60d30f571acb6a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115291 expref: 1185 pid: 15514 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.321636:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009bdc6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011720064:192.168.201.24@tcp:104: 00000004:00080000:2.0:1721880422.321642:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009bdc4700/2, rc 0, transno 1052835 00010000:00010000:0.0:1721880422.321649:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c0f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.321652:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914358 00010000:00010000:0.0:1721880422.321658:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c0f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.321658:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800919c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1184:2004:x1805522257721088:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.321658:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009bdc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011718784:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.321662:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c0f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.321665:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.321667:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c0f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.321669:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fbd6f40/0x8a60d30f571acec0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfbbe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1153e8 expref: 1184 pid: 15514 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.321670:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c0f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.321671:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727c0de lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.321674:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c0f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.321677:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325e400 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.321678:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fbd6f40/0x8a60d30f571acec0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbbe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1153e8 expref: 1184 pid: 15514 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.321679:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c0f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.321679:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727c0de lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.321681:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801312d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011720448:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.321687:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c0f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.321692:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727c0de lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.321693:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c0f3 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.321693:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.321694:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.321696:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c0f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.321697:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106e400/0x8a60d30f5727c0fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbbe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.321698:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727c0de lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.321700:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.321703:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106e400/0x8a60d30f5727c0fa lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbbe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.321705:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727c0de lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.321711:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350d80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.321714:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727c0de lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.321715:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.321720:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011720448 00010000:00010000:2.0:1721880422.321721:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727c0de lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.321723:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011720448 00010000:00010000:2.0:1721880422.321753:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727c0de lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.321757:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632167 00000100:00100000:1.0:1721880422.321758:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800919c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1184:2004:x1805522257721088:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 100us (167us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.321761:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727c0de lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.321762:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2072:3687:x1805522011720448:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.321765:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914358 00002000:00080000:3.0:1721880422.321773:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64448 count 1 00010000:00010000:3.0:1721880422.321782:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727c108 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbc0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.321790:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b6de640/0x8a60d30f571ad2a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11554d expref: 1183 pid: 16085 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.321794:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.321795:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.321797:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727c108 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.321807:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b6de640/0x8a60d30f571ad2a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11554d expref: 1183 pid: 16085 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.321813:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b6de640/0x8a60d30f571ad2a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11554d expref: 1183 pid: 16085 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.321819:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800994eb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011720576:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.321834:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdece40 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.321880:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b16c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2074:3688:x1805522011719680:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1480us (1519us total) trans 4296020133 rc 0/0 00000100:00100000:0.0:1721880422.321884:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632164 00000004:00080000:3.0:1721880422.321889:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009bdc7800/2, rc 0, transno 1052837 00000100:00100000:3.0:1721880422.321895:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009bdc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011719680:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.321914:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800994eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011720704:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.321931:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.321941:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b16ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2073:3689:x1805522011718656:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1968us (2001us total) trans 4296020134 rc 0/0 00000100:00100000:0.0:1721880422.321947:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011720704 00000100:00100000:2.0:1721880422.321948:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632161 00000100:00100000:0.0:1721880422.321951:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011720704 00000100:00100000:2.0:1721880422.321967:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632168 00000100:00100000:2.0:1721880422.321971:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800994e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2073:3688:x1805522011720704:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.321983:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64449 count 1 00000100:00100000:1.0:1721880422.321987:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2073:3686:x1805522011719168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1809us (1852us total) trans 4296020132 rc 0/0 00010000:00010000:2.0:1721880422.321992:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c10f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbc1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.321993:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632163 00000004:00080000:3.0:1721880422.321997:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009bdc7100/2, rc 0, transno 1052836 00010000:00010000:2.0:1721880422.322002:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8cb840/0x8a60d30f571ad446 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1155e7 expref: 1183 pid: 16085 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.322005:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009bdc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011719168:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.322008:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.322009:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.322024:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c10f lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.322031:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727c0d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.322038:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727c0d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.322039:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d8cb840/0x8a60d30f571ad446 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1155e7 expref: 1183 pid: 16085 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.322042:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1721880422.322046:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727c0d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.322046:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800994ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011720832:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.322048:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d8cb840/0x8a60d30f571ad446 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1155e7 expref: 1183 pid: 16085 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.322052:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727c0d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.322058:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b16c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011720960:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.322060:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.322063:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727c0d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.322069:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325e1c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.322072:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727c0d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.322072:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011720832 00000100:00100000:3.0:1721880422.322074:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011720832 00010000:00010000:1.0:1721880422.322078:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727c0d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.322080:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde300 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.322085:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632169 00010000:00010000:1.0:1721880422.322088:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727c0d0 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.322088:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801341d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2073:3688:x1805522011720832:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.322093:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727c0d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.322095:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088efd880/2, rc 0, transno 1052838 00002000:00080000:3.0:1721880422.322096:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64450 count 1 00000100:00100000:2.0:1721880422.322100:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011718656:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.322103:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727c116 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbc2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.322110:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b6ddf80/0x8a60d30f571ad6ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1156dc expref: 1183 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.322114:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.322115:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.322117:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727c116 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.322128:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b6ddf80/0x8a60d30f571ad6ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1156dc expref: 1183 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.322134:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b6ddf80/0x8a60d30f571ad6ae lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1156dc expref: 1183 pid: 16110 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.322135:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b16e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011721088:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.322140:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c1c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011721216:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.322155:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdeccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.322161:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.322205:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2074:3687:x1805522011718400:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2423us (2457us total) trans 4296020135 rc 0/0 00000100:00100000:1.0:1721880422.322212:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632159 00000100:00100000:0.0:1721880422.322217:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011721088 00000100:00100000:0.0:1721880422.322220:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011721088 00000004:00080000:2.0:1721880422.322221:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880094637800/2, rc 0, transno 1052839 00000100:00100000:2.0:1721880422.322229:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011718400:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.322233:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632170 00000100:00100000:0.0:1721880422.322236:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b16d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2074:3686:x1805522011721088:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.322245:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64451 count 1 00010000:00010000:0.0:1721880422.322253:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c11d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbc3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.322260:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a35c000/0x8a60d30f571ad821 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115784 expref: 1183 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.322264:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.322264:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011721344:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.322266:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.322267:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c11d lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.322279:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a35c000/0x8a60d30f571ad821 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115784 expref: 1183 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.322286:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.322319:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011721344 00000100:00100000:1.0:1721880422.322323:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011721344 00010000:00010000:0.0:1721880422.322329:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a35c000/0x8a60d30f571ad821 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115784 expref: 1183 pid: 9458 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.322337:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007ea15f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011721472:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.322338:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632171 00000100:00100000:1.0:1721880422.322342:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b16fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2075:3687:x1805522011721344:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.322353:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64452 count 1 00000100:00100000:0.0:1721880422.322356:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e6c0 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.322363:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727c124 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbc4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.322368:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b16d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011720320:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.322378:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0c7b840/0x8a60d30f571ad8ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1157df expref: 1183 pid: 15505 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.322381:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c101 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.322384:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.322385:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.322388:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727c124 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.322402:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0c7b840/0x8a60d30f571ad8ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1157df expref: 1183 pid: 15505 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.322410:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0c7b840/0x8a60d30f571ad8ec lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1157df expref: 1183 pid: 15505 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.322419:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba65f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011721600:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.322445:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522ae40 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.322465:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fbd6f40/0x8a60d30f571acec0 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1153e8 expref: 1183 pid: 15514 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.322476:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012ba66d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011719936:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.322483:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800994eb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011720576:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.322489:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106e400/0x8a60d30f5727c0fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.322497:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106e400/0x8a60d30f5727c0fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.322497:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727c108 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.322503:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.322506:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106e400/0x8a60d30f5727c0fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.322513:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106e400/0x8a60d30f5727c0fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.322519:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257721472 00010000:00010000:1.0:1721880422.322519:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106e400/0x8a60d30f5727c0fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.322522:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257721472 00010000:00010000:1.0:1721880422.322525:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106e400/0x8a60d30f5727c0fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.322527:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.322531:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106e400 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.322533:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106e400/0x8a60d30f5727c0fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.322536:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b6de640/0x8a60d30f571ad2a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11554d expref: 1183 pid: 16085 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.322540:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106e400/0x8a60d30f5727c0fa lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.322547:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257721344 00010000:00010000:1.0:1721880422.322548:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106e400/0x8a60d30f5727c0fa lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.322549:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257721344 00010000:00010000:0.0:1721880422.322554:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096208900/0x8a60d30f571ad160 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1154dd expref: 1184 pid: 16073 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.322554:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106e400/0x8a60d30f5727c0fa lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.322554:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914359 00000100:00100000:2.0:1721880422.322558:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b16d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1184:2006:x1805522257721472:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.322565:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.322568:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b6de640/0x8a60d30f571ad2a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbc0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11554d expref: 1184 pid: 16085 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.322575:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b6de640/0x8a60d30f571ad2a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbc0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11554d expref: 1184 pid: 16085 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.322577:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914360 00000100:00100000:3.0:1721880422.322581:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b16f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1184:2006:x1805522257721344:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.322585:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b6de640/0x8a60d30f571ad2a2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbc0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11554d expref: 1184 pid: 16085 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.322589:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.322594:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.322594:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096208900/0x8a60d30f571ad160 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbbf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1154dd expref: 1183 pid: 16073 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.322595:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.322597:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727c108 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.322602:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727c108 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.322608:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096208900/0x8a60d30f571ad160 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbbf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1154dd expref: 1183 pid: 16073 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.322612:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.322620:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096208900/0x8a60d30f571ad160 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbbf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1154dd expref: 1183 pid: 16073 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.322625:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b16d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1183:2006:x1805522257721472:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 66us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.322629:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914359 00010000:00010000:3.0:1721880422.322630:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.322631:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.322634:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c101 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.322641:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c101 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.322656:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.322661:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b16ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2076:3688:x1805522011719808:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2222us (2262us total) trans 4296020136 rc 0/0 00000100:00100000:1.0:1721880422.322667:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632165 00000100:00100000:3.0:1721880422.322670:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b16f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1181:2006:x1805522257721344:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 89us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.322674:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914360 00010000:00010000:3.0:1721880422.322690:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727c108 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.322694:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013130eac0/0x8a60d30f571ac972 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1151db expref: 1180 pid: 16121 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.322695:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727c108 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.322699:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727c108 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.322705:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012ba64000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011719552:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.322707:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727c108 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.322710:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727c108 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.322714:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa9200 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.322715:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727c108 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.322719:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106c6c0/0x8a60d30f5727c0ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.322719:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727c108 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.322724:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727c108 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.322726:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106c6c0/0x8a60d30f5727c0ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.322748:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727c108 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.322750:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106c6c0/0x8a60d30f5727c0ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.322757:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106c6c0/0x8a60d30f5727c0ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.322763:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106c6c0/0x8a60d30f5727c0ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.322768:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106c6c0/0x8a60d30f5727c0ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.322768:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b16c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011720960:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.322773:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106c6c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.322775:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106c6c0/0x8a60d30f5727c0ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.322778:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c10f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.322786:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106c6c0/0x8a60d30f5727c0ec lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.322794:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106c6c0/0x8a60d30f5727c0ec lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.322800:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106c6c0/0x8a60d30f5727c0ec lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.322855:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2077:3687:x1805522011720448:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1091us (1153us total) trans 4296020137 rc 0/0 00000004:00080000:2.0:1721880422.322861:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801312d2300/2, rc 0, transno 1052841 00000100:00100000:3.0:1721880422.322861:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632167 00000100:00100000:2.0:1721880422.322867:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801312d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011720448:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.322886:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bdc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2076:3687:x1805522011719296:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2713us (2759us total) trans 4296020138 rc 0/0 00000100:00100000:3.0:1721880422.322889:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c1c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011721216:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.322890:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632162 00000004:00080000:2.0:1721880422.322897:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009bdc6a00/2, rc 0, transno 1052842 00010000:00010000:3.0:1721880422.322901:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727c116 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.322903:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009bdc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011719296:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.322918:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c101 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.322924:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012ba65f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011721600:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.322925:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c101 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.322929:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b16d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011721856:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.322932:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c101 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.322933:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727c124 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.322938:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c101 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.322944:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c101 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.322948:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007ea15f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011721472:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.322948:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350fc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.322949:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c101 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.322952:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.322953:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c101 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.322954:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.322958:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c11d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.322959:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c101 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.322963:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c101 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.322968:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011721856 00000100:00100000:2.0:1721880422.322969:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1721880422.322970:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257721728 00000100:00100000:1.0:1721880422.322970:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011721856 00000100:00100000:2.0:1721880422.322975:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b16c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011721728:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.322983:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632172 00000100:00100000:1.0:1721880422.322986:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b16df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2076:3689:x1805522011721856:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.322991:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:1.0:1721880422.322994:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64454 count 1 00010000:00010000:1.0:1721880422.323001:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727c12b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbc6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.323008:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800981f9d40/0x8a60d30f571adb7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1158e9 expref: 1179 pid: 16122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.323023:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.323024:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.323026:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727c12b lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.323036:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800981f9d40/0x8a60d30f571adb7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1158e9 expref: 1179 pid: 16122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.323042:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800981f9d40/0x8a60d30f571adb7e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1158e9 expref: 1179 pid: 16122 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.323044:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257721728 00000100:00100000:1.0:1721880422.323048:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba65f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011721984:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.323056:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b6ddf80/0x8a60d30f571ad6ae lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1156dc expref: 1180 pid: 16110 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.323065:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f020380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2077:3687:x1805522011720192:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1515us (1545us total) trans 4296020139 rc 0/0 00000100:00100000:1.0:1721880422.323066:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.323068:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914361 00000100:00100000:2.0:1721880422.323068:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.323070:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632166 00000100:00100000:0.0:1721880422.323072:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ea16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1180:2007:x1805522257721728:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.323077:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.323078:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011721728 00010000:00010000:0.0:1721880422.323080:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b6ddf80/0x8a60d30f571ad6ae lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1156dc expref: 1180 pid: 16110 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.323081:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011721728 00010000:00010000:0.0:1721880422.323086:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b6ddf80/0x8a60d30f571ad6ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1156dc expref: 1180 pid: 16110 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.323087:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257721600 00000100:00100000:3.0:1721880422.323089:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257721600 00010000:00010000:0.0:1721880422.323094:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b6ddf80/0x8a60d30f571ad6ae lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1156dc expref: 1181 pid: 16110 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.323094:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632173 00000100:00100000:1.0:1721880422.323098:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b16ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2077:3689:x1805522011721728:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.323098:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8cb840/0x8a60d30f571ad446 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1155e7 expref: 1181 pid: 16085 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.323102:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.323103:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.323105:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727c116 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.323107:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64453 count 1 00010000:00010000:0.0:1721880422.323110:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727c116 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.323116:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106d200/0x8a60d30f5727c132 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbc5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.323116:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914362 00000100:00100000:3.0:1721880422.323119:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880125a17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1180:2004:x1805522257721600:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.323120:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.323124:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d809f80/0x8a60d30f571ada20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115872 expref: 1180 pid: 16079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.323125:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.323128:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d8cb840/0x8a60d30f571ad446 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbc1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1155e7 expref: 1180 pid: 16085 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.323131:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.323132:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1721880422.323134:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ea16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1180:2007:x1805522257721728:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 61us (183us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.323134:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d8cb840/0x8a60d30f571ad446 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbc1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1155e7 expref: 1180 pid: 16085 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.323135:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106d200/0x8a60d30f5727c132 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.323138:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914361 00010000:00010000:3.0:1721880422.323143:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8cb840/0x8a60d30f571ad446 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbc1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1155e7 expref: 1180 pid: 16085 timeout: 887 lvb_type: 0 00000004:00080000:2.0:1721880422.323148:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800920c9880/2, rc 0, transno 1052843 00010000:00010000:1.0:1721880422.323149:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d809f80/0x8a60d30f571ada20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115872 expref: 1179 pid: 16079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.323153:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.323154:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.323156:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800920c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011720192:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.323157:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c10f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.323158:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d809f80/0x8a60d30f571ada20 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115872 expref: 1178 pid: 16079 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.323162:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.323163:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c10f lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.323167:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba64000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011722112:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.323170:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257721984 00000100:00100000:0.0:1721880422.323172:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257721984 00010000:00010000:0.0:1721880422.323179:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0c7b840/0x8a60d30f571ad8ec lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1157df expref: 1179 pid: 15505 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.323179:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.323183:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1721880422.323188:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.323190:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880125a17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011722240:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.323191:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914363 00000100:00100000:0.0:1721880422.323194:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5275450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1179:2004:x1805522257721984:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.323197:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880125a17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1179:2004:x1805522257721600:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 75us (129us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.323199:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.323201:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0c7b840/0x8a60d30f571ad8ec lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1157df expref: 1179 pid: 15505 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.323203:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914362 00010000:00010000:0.0:1721880422.323207:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0c7b840/0x8a60d30f571ad8ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1157df expref: 1179 pid: 15505 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.323210:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.323215:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0c7b840/0x8a60d30f571ad8ec lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1157df expref: 1178 pid: 15505 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.323222:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.323222:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727c116 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.323223:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.323225:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727c124 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.323225:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011722240 00000100:00100000:1.0:1721880422.323227:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011722240 00010000:00010000:0.0:1721880422.323229:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727c124 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.323229:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727c116 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.323239:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.323241:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632174 00000100:00100000:1.0:1721880422.323243:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880125a15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2078:3687:x1805522011722240:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.323248:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5275450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1177:2004:x1805522257721984:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 53us (86us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.323248:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727c116 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.323250:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64455 count 1 00000100:00100000:0.0:1721880422.323252:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914363 00010000:00010000:3.0:1721880422.323254:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727c116 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.323256:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.323257:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106df80/0x8a60d30f5727c139 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbc7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.323258:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727c116 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.323263:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8480 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.323264:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a094b3c0/0x8a60d30f571adcc0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11596e expref: 1176 pid: 15533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.323265:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727c116 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.323268:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.323269:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.323271:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106df80/0x8a60d30f5727c139 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.323271:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727c116 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.323275:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257721856 00000100:00100000:0.0:1721880422.323277:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257721856 00010000:00010000:1.0:1721880422.323280:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a094b3c0/0x8a60d30f571adcc0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11596e expref: 1177 pid: 15533 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.323280:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727c116 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.323283:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a35c000/0x8a60d30f571ad821 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115784 expref: 1177 pid: 9458 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.323284:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727c116 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.323286:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a094b3c0/0x8a60d30f571adcc0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11596e expref: 1177 pid: 15533 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.323286:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c10f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.323291:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba66d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011722368:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.323299:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914364 00010000:00010000:2.0:1721880422.323300:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c10f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.323302:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880125a15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1177:2004:x1805522257721856:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.323305:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a9c0 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.323307:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.323308:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c10f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.323309:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a35c000/0x8a60d30f571ad821 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115784 expref: 1177 pid: 9458 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.323314:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a35c000/0x8a60d30f571ad821 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115784 expref: 1177 pid: 9458 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.323314:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727c124 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.323315:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c10f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.323319:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727c124 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.323321:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a35c000/0x8a60d30f571ad821 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115784 expref: 1177 pid: 9458 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.323322:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c10f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.323323:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727c124 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.323327:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.323327:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.323327:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727c124 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.323328:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352ac0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.323329:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c11d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.323330:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727c124 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.323331:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c10f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.323334:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c11d lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.323334:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106e1c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.323335:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727c124 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.323339:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c10f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.323340:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727c124 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.323342:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.323346:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727c124 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.323350:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106e1c0/0x8a60d30f5727c124 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.323350:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c10f lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.323353:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880125a15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1176:2004:x1805522257721856:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 50us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.323356:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914364 00010000:00010000:2.0:1721880422.323356:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c10f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.323367:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801341d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2079:3688:x1805522011720832:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1277us (1306us total) trans 4296020140 rc 0/0 00000100:00100000:3.0:1721880422.323371:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632169 00000004:00080000:3.0:1721880422.323396:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800994ead80/2, rc 0, transno 1052844 00000100:00100000:3.0:1721880422.323414:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800994ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011720832:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1721880422.323428:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009bdc5500/2, rc 0, transno 1052840 00000100:00100000:3.0:1721880422.323432:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009bdc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011719808:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.323438:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b16fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2080:3687:x1805522011721344:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1094us (1151us total) trans 4296020141 rc 0/0 00000100:00100000:1.0:1721880422.323444:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632171 00000100:00100000:2.0:1721880422.323456:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880125a14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011722496:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.323461:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880125a16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011722624:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.323464:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c11d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.323471:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c11d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.323477:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c11d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.323482:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.323483:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c11d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.323491:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c11d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.323501:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325ed00 already unused, calling callback (ffffffffa084e330) 00000100:00100000:3.0:1721880422.323502:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.323504:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c11d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.323509:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122c1e300/2, rc 0, transno 1052845 00010000:00010000:1.0:1721880422.323513:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c11d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.323515:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011721344:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.323524:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c11d lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.323527:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011722496 00010000:00010000:1.0:1721880422.323528:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c11d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.323530:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011722496 00000100:00100000:3.0:1721880422.323544:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011722624 00000100:00100000:2.0:1721880422.323545:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d040a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011722752:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.323546:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011722624 00000100:00100000:3.0:1721880422.323555:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632175 00000100:00100000:1.0:1721880422.323556:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012ba65f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011721984:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.323560:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.323560:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880125a17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2081:3687:x1805522011722496:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.323565:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727c12b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.323571:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64456 count 1 00000100:00100000:1.0:1721880422.323575:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011722752 00000100:00100000:1.0:1721880422.323577:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011722752 00000100:00100000:2.0:1721880422.323578:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632176 00000100:00100000:2.0:1721880422.323581:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2082:3688:x1805522011722624:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.323583:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727c140 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbc8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.323589:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632177 00000100:00100000:1.0:1721880422.323591:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2082:3689:x1805522011722752:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.323592:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64457 count 1 00010000:00010000:3.0:1721880422.323597:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095dd2d00/0x8a60d30f571addf4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1159de expref: 1175 pid: 16037 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.323600:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64458 count 1 00010000:00010000:3.0:1721880422.323603:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.323604:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c147 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbc9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.323605:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106db00/0x8a60d30f5727c14e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbca:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.323605:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.323607:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727c140 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.323612:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095dd33c0/0x8a60d30f571ae166 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115b51 expref: 1175 pid: 16127 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.323613:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.323615:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096fa8d80/0x8a60d30f571adf9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115a8d expref: 1175 pid: 15533 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.323616:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.323617:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.323618:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106db00/0x8a60d30f5727c14e lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.323623:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.323623:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095dd2d00/0x8a60d30f571addf4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1159de expref: 1175 pid: 16037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.323625:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.323627:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095dd33c0/0x8a60d30f571ae166 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115b51 expref: 1175 pid: 16127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.323627:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c147 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.323632:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095dd33c0/0x8a60d30f571ae166 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115b51 expref: 1175 pid: 16127 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.323632:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095dd2d00/0x8a60d30f571addf4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1159de expref: 1175 pid: 16037 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.323638:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba65f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011723008:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.323639:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257722112 00000100:00100000:2.0:1721880422.323642:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257722112 00000100:00100000:3.0:1721880422.323642:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c1f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011722880:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.323653:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800981f9d40/0x8a60d30f571adb7e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1158e9 expref: 1176 pid: 16122 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.323655:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.323661:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdeccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.323679:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914365 00000100:00100000:2.0:1721880422.323682:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ea15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1176:2005:x1805522257722112:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.323691:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.323693:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800981f9d40/0x8a60d30f571adb7e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1158e9 expref: 1176 pid: 16122 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.323699:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800981f9d40/0x8a60d30f571adb7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1158e9 expref: 1176 pid: 16122 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.323708:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800981f9d40/0x8a60d30f571adb7e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1158e9 expref: 1176 pid: 16122 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.323715:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.323716:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.323718:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727c12b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.323722:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727c12b lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.323753:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b16d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2083:3686:x1805522011721088:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1515us (1591us total) trans 4296020143 rc 0/0 00010000:00010000:2.0:1721880422.323756:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.323760:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632170 00010000:00010000:0.0:1721880422.323768:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727c12b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.323774:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727c12b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.323777:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ea15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1175:2005:x1805522257722112:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 93us (164us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.323780:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727c12b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.323783:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914365 00010000:00010000:0.0:1721880422.323786:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727c12b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.323792:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727c12b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.323792:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009b16e300/2, rc 0, transno 1052847 00010000:00010000:0.0:1721880422.323797:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106f840 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.323800:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727c12b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.323801:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b16e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011721088:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.323807:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727c12b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.323818:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727c12b lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.323824:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106f840/0x8a60d30f5727c12b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.323837:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f022680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011723136:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.323854:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.323868:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800994e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2082:3688:x1805522011720704:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1896us (1935us total) trans 4296020142 rc 0/0 00000100:00100000:1.0:1721880422.323870:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011723136 00000100:00100000:1.0:1721880422.323872:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011723136 00000100:00100000:2.0:1721880422.323873:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632168 00000004:00080000:3.0:1721880422.323881:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800994eb480/2, rc 0, transno 1052846 00000100:00100000:1.0:1721880422.323884:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632178 00000100:00100000:1.0:1721880422.323887:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f023100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2083:3686:x1805522011723136:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.323896:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800994eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011720704:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.323898:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096fa8d80/0x8a60d30f571adf9f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115a8d expref: 1174 pid: 15533 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.323906:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1721880422.323908:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096fa8d80/0x8a60d30f571adf9f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115a8d expref: 1174 pid: 15533 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.323910:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800994eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011723392:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.323914:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d040380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011723264:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.323921:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.323928:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde300 going to sleep for 11 seconds 00002000:00080000:1.0:1721880422.323934:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64459 count 1 00000100:00100000:3.0:1721880422.323934:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011723392 00000100:00100000:3.0:1721880422.323937:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011723392 00010000:00010000:1.0:1721880422.323941:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106fcc0/0x8a60d30f5727c155 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbcb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.323948:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800991f0480/0x8a60d30f571ae31f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115c07 expref: 1174 pid: 16077 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.323952:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.323953:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.323955:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106fcc0/0x8a60d30f5727c155 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.323955:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632179 00000100:00100000:3.0:1721880422.323959:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800994eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2084:3686:x1805522011723392:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.323964:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800991f0480/0x8a60d30f571ae31f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115c07 expref: 1174 pid: 16077 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.323970:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64460 count 1 00010000:00010000:1.0:1721880422.323972:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800991f0480/0x8a60d30f571ae31f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115c07 expref: 1174 pid: 16077 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.323980:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800920cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011723520:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.323980:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727c15c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbcc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.323995:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c930b40/0x8a60d30f571ae4d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115caf expref: 1174 pid: 16073 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.323997:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522ac00 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.324001:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.324002:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.324004:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727c15c lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.324030:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b16df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2084:3689:x1805522011721856:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1040us (1075us total) trans 4296020144 rc 0/0 00000100:00100000:0.0:1721880422.324038:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632172 00000004:00080000:2.0:1721880422.324038:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009b16d180/2, rc 0, transno 1052848 00010000:00010000:3.0:1721880422.324038:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c930b40/0x8a60d30f571ae4d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115caf expref: 1174 pid: 16073 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.324046:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b16d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011721856:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.324047:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c930b40/0x8a60d30f571ae4d1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115caf expref: 1174 pid: 16073 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.324057:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c1df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011723648:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.324079:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdece40 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.324097:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800920caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011723776:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.324103:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012ba64000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011722112:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.324113:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106d200/0x8a60d30f5727c132 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.324168:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.324187:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011723776 00000100:00100000:3.0:1721880422.324190:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011723776 00000100:00100000:1.0:1721880422.324192:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012ba66d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011722368:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.324194:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.324202:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106df80/0x8a60d30f5727c139 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.324203:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257722240 00000100:00100000:2.0:1721880422.324205:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257722240 00000100:00100000:3.0:1721880422.324209:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632180 00000100:00100000:3.0:1721880422.324213:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d042300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2084:3688:x1805522011723776:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.324214:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d809f80/0x8a60d30f571ada20 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115872 expref: 1175 pid: 16079 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.324217:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00002000:00080000:3.0:1721880422.324223:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64461 count 1 00010000:00010000:3.0:1721880422.324232:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727c163 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbcd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.324234:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257722368 00000100:00100000:2.0:1721880422.324236:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257722368 00000100:00100000:1.0:1721880422.324240:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914366 00010000:00010000:2.0:1721880422.324242:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a094b3c0/0x8a60d30f571adcc0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11596e expref: 1176 pid: 15533 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.324242:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c3df3c0/0x8a60d30f571ae740 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115d57 expref: 1176 pid: 16112 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.324244:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ea16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1176:2007:x1805522257722240:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.324251:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.324254:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.324255:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d809f80/0x8a60d30f571ada20 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115872 expref: 1176 pid: 16079 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.324255:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914367 00010000:00010000:3.0:1721880422.324255:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.324257:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727c163 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.324259:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ea17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1176:2005:x1805522257722368:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.324261:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d809f80/0x8a60d30f571ada20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115872 expref: 1176 pid: 16079 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.324265:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.324267:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a094b3c0/0x8a60d30f571adcc0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbc7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11596e expref: 1176 pid: 15533 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.324270:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d809f80/0x8a60d30f571ada20 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115872 expref: 1176 pid: 16079 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.324273:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c3df3c0/0x8a60d30f571ae740 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115d57 expref: 1176 pid: 16112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.324277:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.324277:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a094b3c0/0x8a60d30f571adcc0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbc7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11596e expref: 1175 pid: 15533 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.324278:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.324279:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106d200/0x8a60d30f5727c132 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.324282:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c3df3c0/0x8a60d30f571ae740 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115d57 expref: 1175 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.324284:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106d200/0x8a60d30f5727c132 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.324286:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a094b3c0/0x8a60d30f571adcc0 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbc7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11596e expref: 1175 pid: 15533 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.324291:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011723904:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.324292:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.324293:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.324294:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.324296:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106df80/0x8a60d30f5727c139 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.324300:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106df80/0x8a60d30f5727c139 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.324309:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.324311:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ea16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1174:2007:x1805522257722240:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 67us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.324314:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.324316:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914366 00000100:00100000:2.0:1721880422.324321:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ea17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1174:2005:x1805522257722368:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 62us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.324323:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.324325:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914367 00000100:00100000:1.0:1721880422.324329:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257722496 00000100:00100000:1.0:1721880422.324331:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257722496 00000100:00100000:3.0:1721880422.324335:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c1f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011722880:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.324338:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095dd2d00/0x8a60d30f571addf4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1159de expref: 1173 pid: 16037 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.324340:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106df80/0x8a60d30f5727c139 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.324344:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106df80/0x8a60d30f5727c139 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.324348:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727c140 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.324349:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106df80/0x8a60d30f5727c139 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.324356:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914368 00010000:00010000:2.0:1721880422.324358:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106df80/0x8a60d30f5727c139 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.324359:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ea15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1173:2004:x1805522257722496:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.324362:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106df80/0x8a60d30f5727c139 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.324363:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.324365:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095dd2d00/0x8a60d30f571addf4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1159de expref: 1173 pid: 16037 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.324365:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106df80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.324367:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106df80/0x8a60d30f5727c139 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.324369:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.324370:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095dd2d00/0x8a60d30f571addf4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1159de expref: 1173 pid: 16037 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.324371:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106df80/0x8a60d30f5727c139 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.324375:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106df80/0x8a60d30f5727c139 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.324377:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095dd2d00/0x8a60d30f571addf4 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1159de expref: 1173 pid: 16037 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.324379:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257722624 00010000:00010000:2.0:1721880422.324379:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106df80/0x8a60d30f5727c139 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.324382:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257722624 00010000:00010000:1.0:1721880422.324383:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.324384:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.324386:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727c140 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.324390:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727c140 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.324393:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095dd33c0/0x8a60d30f571ae166 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfbca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115b51 expref: 1173 pid: 16127 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.324401:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.324409:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727c140 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.324412:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ea15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1173:2004:x1805522257722496:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 53us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.324415:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914369 00010000:00010000:3.0:1721880422.324416:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727c140 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.324419:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914368 00000100:00100000:0.0:1721880422.324420:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ea15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1173:2004:x1805522257722624:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.324423:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727c140 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.324426:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.324430:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095dd33c0/0x8a60d30f571ae166 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfbca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115b51 expref: 1172 pid: 16127 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.324432:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106d200/0x8a60d30f5727c132 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.324434:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727c140 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.324436:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106d200/0x8a60d30f5727c132 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.324439:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095dd33c0/0x8a60d30f571ae166 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115b51 expref: 1172 pid: 16127 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.324440:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106d200/0x8a60d30f5727c132 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.324441:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727c140 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.324444:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106d200/0x8a60d30f5727c132 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.324447:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106d200/0x8a60d30f5727c132 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.324447:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa9d40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.324449:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727c140 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.324450:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.324451:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106d200 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.324452:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.324452:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106d200/0x8a60d30f5727c132 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.324453:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106db00/0x8a60d30f5727c14e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.324456:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106d200/0x8a60d30f5727c132 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.324456:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727c140 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.324461:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106db00/0x8a60d30f5727c14e lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.324464:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106d200/0x8a60d30f5727c132 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.324466:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727c140 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.324468:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106d200/0x8a60d30f5727c132 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.324469:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.324472:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727c140 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.324483:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ea15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1172:2004:x1805522257722624:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 63us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.324487:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914369 00000100:00100000:2.0:1721880422.324487:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880125a15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2085:3687:x1805522011722240:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1242us (1276us total) trans 4296020145 rc 0/0 00000100:00100000:2.0:1721880422.324491:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632174 00000100:00100000:1.0:1721880422.324556:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b16ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2086:3689:x1805522011721728:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1457us (1564us total) trans 4296020146 rc 0/0 00000100:00100000:1.0:1721880422.324561:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632173 00000004:00080000:2.0:1721880422.324567:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009b16c700/2, rc 0, transno 1052850 00000100:00100000:2.0:1721880422.324575:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b16c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011721728:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.324578:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880125a17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2085:3687:x1805522011722496:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1017us (1095us total) trans 4296020147 rc 0/0 00010000:00010000:1.0:1721880422.324581:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095dd33c0/0x8a60d30f571ae166 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115b51 expref: 1171 pid: 16127 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.324585:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632175 00000100:00100000:1.0:1721880422.324589:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012ba65f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011723008:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.324598:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106db00/0x8a60d30f5727c14e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.324602:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106db00/0x8a60d30f5727c14e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.324606:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106db00/0x8a60d30f5727c14e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.324607:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007ea14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011724032:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1721880422.324609:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880125a14000/2, rc 0, transno 1052851 00010000:00010000:1.0:1721880422.324610:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106db00/0x8a60d30f5727c14e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.324616:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106db00/0x8a60d30f5727c14e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.324617:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880125a14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011722496:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.324620:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106db00/0x8a60d30f5727c14e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.324623:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106db00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.324625:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106db00/0x8a60d30f5727c14e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.324627:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880125a17800/2, rc 0, transno 1052849 00010000:00010000:1.0:1721880422.324628:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106db00/0x8a60d30f5727c14e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.324629:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.324631:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880125a17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011722240:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.324634:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106db00/0x8a60d30f5727c14e lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.324638:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106db00/0x8a60d30f5727c14e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.324639:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1721880422.324645:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007ea14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011724160:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.324664:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.324680:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007ea15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011724288:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.324693:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.324705:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011724032 00000100:00100000:2.0:1721880422.324707:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011724032 00000100:00100000:3.0:1721880422.324712:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011724160 00000100:00100000:3.0:1721880422.324715:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011724160 00000100:00100000:2.0:1721880422.324718:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011724288 00000100:00100000:2.0:1721880422.324721:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011724288 00000100:00100000:1.0:1721880422.324747:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2088:3689:x1805522011722752:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1135us (1167us total) trans 4296020148 rc 0/0 00000100:00100000:3.0:1721880422.324750:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632181 00000100:00100000:1.0:1721880422.324754:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632177 00000100:00100000:3.0:1721880422.324755:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d042680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2088:3689:x1805522011724032:12345-0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1721880422.324762:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009d040a80/2, rc 0, transno 1052852 00000100:00100000:1.0:1721880422.324765:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632182 00000100:00100000:1.0:1721880422.324768:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2087:3687:x1805522011724160:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.324768:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64462 count 1 00000100:00100000:2.0:1721880422.324772:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d040a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011722752:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.324773:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632183 00002000:00080000:1.0:1721880422.324776:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64463 count 1 00010000:00010000:3.0:1721880422.324778:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727c16a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbce:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.324779:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2087:3687:x1805522011724288:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.324784:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727c171 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbcf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.324788:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800967a4b40/0x8a60d30f571ae970 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115e61 expref: 1170 pid: 16124 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.324790:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801363cb3c0/0x8a60d30f571aeb84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115f17 expref: 1170 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.324794:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.324795:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.324795:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.324796:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.324797:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727c171 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.324798:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727c16a lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.324806:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801363cb3c0/0x8a60d30f571aeb84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115f17 expref: 1170 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.324811:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801363cb3c0/0x8a60d30f571aeb84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115f17 expref: 1170 pid: 9458 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.324811:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800919c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011724416:0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.324815:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64464 count 1 00010000:00010000:3.0:1721880422.324815:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800967a4b40/0x8a60d30f571ae970 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115e61 expref: 1170 pid: 16124 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.324817:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800920cad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011724544:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.324824:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800967a4b40/0x8a60d30f571ae970 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115e61 expref: 1170 pid: 16124 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.324826:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.324827:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c178 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbd0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.324835:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.324838:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011724672:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.324839:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cae1200/0x8a60d30f571aed4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115fc6 expref: 1170 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.324843:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011724416 00010000:00010000:0.0:1721880422.324845:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.324845:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011724416 00010000:00010000:0.0:1721880422.324847:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.324849:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c178 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.324856:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632184 00000100:00100000:3.0:1721880422.324857:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdeccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.324859:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d041180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2088:3688:x1805522011724416:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.324865:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cae1200/0x8a60d30f571aed4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115fc6 expref: 1170 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.324874:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cae1200/0x8a60d30f571aed4b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115fc6 expref: 1170 pid: 16111 timeout: 887 lvb_type: 0 00002000:00080000:2.0:1721880422.324874:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64465 count 1 00010000:00010000:2.0:1721880422.324883:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727c17f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbd1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.324888:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b16d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011724800:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.324891:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095c14240/0x8a60d30f571aef89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11606e expref: 1170 pid: 16073 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.324895:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.324896:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.324898:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727c17f lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.324907:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e000 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.324908:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095c14240/0x8a60d30f571aef89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11606e expref: 1170 pid: 16073 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.324918:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095c14240/0x8a60d30f571aef89 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11606e expref: 1170 pid: 16073 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.324923:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d041c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011724928:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.324937:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.324957:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800920cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011723520:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.324970:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106fcc0/0x8a60d30f5727c155 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.325044:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d040380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011723264:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.325052:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.325054:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c147 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.325071:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257722752 00000100:00100000:1.0:1721880422.325075:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257722752 00010000:00010000:1.0:1721880422.325088:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800991f0480/0x8a60d30f571ae31f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115c07 expref: 1171 pid: 16077 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.325109:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914370 00000100:00100000:1.0:1721880422.325113:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e196850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1171:2004:x1805522257722752:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.325118:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.325121:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.325124:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800991f0480/0x8a60d30f571ae31f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbcb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115c07 expref: 1171 pid: 16077 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.325129:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257722880 00000100:00100000:2.0:1721880422.325131:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257722880 00010000:00010000:1.0:1721880422.325132:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800991f0480/0x8a60d30f571ae31f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbcb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115c07 expref: 1171 pid: 16077 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.325134:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.325139:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096fa8d80/0x8a60d30f571adf9f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115a8d expref: 1172 pid: 15533 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.325144:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800991f0480/0x8a60d30f571ae31f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbcb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115c07 expref: 1172 pid: 16077 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.325144:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c1df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011723648:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.325149:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257723008 00000100:00100000:2.0:1721880422.325150:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257723008 00010000:00010000:1.0:1721880422.325154:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.325156:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.325156:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c930b40/0x8a60d30f571ae4d1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115caf expref: 1172 pid: 16073 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.325158:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106fcc0/0x8a60d30f5727c155 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.325160:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727c15c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbcc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.325164:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914371 00010000:00010000:1.0:1721880422.325165:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106fcc0/0x8a60d30f5727c155 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbcb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.325167:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b16f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1172:2004:x1805522257722880:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.325171:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.325172:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.325174:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096fa8d80/0x8a60d30f571adf9f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115a8d expref: 1172 pid: 15533 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.325178:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.325183:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096fa8d80/0x8a60d30f571adf9f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115a8d expref: 1172 pid: 15533 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.325186:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257723136 00000100:00100000:3.0:1721880422.325190:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257723136 00010000:00010000:2.0:1721880422.325191:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096fa8d80/0x8a60d30f571adf9f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115a8d expref: 1172 pid: 15533 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.325197:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.325198:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1721880422.325199:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e196850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1172:2004:x1805522257722752:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 85us (147us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.325200:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c147 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.325204:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c3df3c0/0x8a60d30f571ae740 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfbcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115d57 expref: 1172 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.325205:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c147 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.325206:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914370 00010000:00010000:2.0:1721880422.325212:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.325223:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b16f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1171:2004:x1805522257722880:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 55us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.325224:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914372 00000100:00100000:2.0:1721880422.325228:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914371 00000100:00100000:3.0:1721880422.325231:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800888f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1171:2005:x1805522257723008:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.325239:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914373 00010000:00010000:3.0:1721880422.325240:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.325243:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800888f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1170:2005:x1805522257723136:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.325245:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c930b40/0x8a60d30f571ae4d1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbcc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115caf expref: 1170 pid: 16073 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.325247:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.325250:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c3df3c0/0x8a60d30f571ae740 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfbcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115d57 expref: 1170 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.325251:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106fcc0/0x8a60d30f5727c155 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.325255:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c930b40/0x8a60d30f571ae4d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbcc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115caf expref: 1170 pid: 16073 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.325256:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c3df3c0/0x8a60d30f571ae740 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115d57 expref: 1170 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.325258:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106fcc0/0x8a60d30f5727c155 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.325263:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.325264:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106fcc0/0x8a60d30f5727c155 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.325264:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.325266:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727c163 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.325269:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c930b40/0x8a60d30f571ae4d1 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbcc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115caf expref: 1170 pid: 16073 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.325270:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106fcc0/0x8a60d30f5727c155 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.325270:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727c163 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.325275:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.325276:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106fcc0/0x8a60d30f5727c155 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.325278:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.325280:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.325281:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106fcc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.325283:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727c15c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.325284:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106fcc0/0x8a60d30f5727c155 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.325285:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800888f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1169:2005:x1805522257723136:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 41us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.325288:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914373 00010000:00010000:3.0:1721880422.325289:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727c15c lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbcc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.325290:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106fcc0/0x8a60d30f5727c155 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.325299:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106fcc0/0x8a60d30f5727c155 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.325301:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.325302:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c147 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.325304:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106fcc0/0x8a60d30f5727c155 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.325306:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c147 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.325311:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c147 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.325317:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c147 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.325324:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c147 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.325326:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800888f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1168:2005:x1805522257723008:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 94us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.325332:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914372 00010000:00010000:2.0:1721880422.325334:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352640 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.325338:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c147 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.325344:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c147 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.325355:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c147 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.325362:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c147 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.325370:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c3df3c0/0x8a60d30f571ae740 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115d57 expref: 1167 pid: 16112 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.325381:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011723904:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.325394:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727c163 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.325401:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727c163 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.325405:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f023100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2089:3686:x1805522011723136:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1515us (1549us total) trans 4296020149 rc 0/0 00010000:00010000:3.0:1721880422.325408:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727c163 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.325411:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632178 00000004:00080000:0.0:1721880422.325413:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012f022680/2, rc 0, transno 1052853 00010000:00010000:3.0:1721880422.325414:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727c163 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.325419:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f022680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011723136:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.325421:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727c163 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.325428:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727c163 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.325434:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8240 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.325437:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727c163 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.325444:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727c163 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.325453:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727c163 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.325460:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2089:3688:x1805522011722624:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1877us (1958us total) trans 4296020150 rc 0/0 00010000:00010000:3.0:1721880422.325460:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727c163 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.325465:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632176 00000100:00100000:2.0:1721880422.325479:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800888f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011725056:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.325490:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.325505:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011725056 00000100:00100000:0.0:1721880422.325509:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011725056 00000004:00080000:2.0:1721880422.325514:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880125a16300/2, rc 0, transno 1052854 00000100:00100000:2.0:1721880422.325521:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880125a16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011722624:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.325527:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632185 00000100:00100000:0.0:1721880422.325531:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2090:3689:x1805522011725056:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.325542:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64466 count 1 00010000:00010000:0.0:1721880422.325553:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727c186 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbd2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.325564:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800992c6ac0/0x8a60d30f571af173 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116116 expref: 1166 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.325565:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1721880422.325570:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.325572:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.325573:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800920cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011725184:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.325574:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727c186 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.325591:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800992c6ac0/0x8a60d30f571af173 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116116 expref: 1166 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.325594:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d042300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2090:3688:x1805522011723776:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1378us (1424us total) trans 4296020151 rc 0/0 00000100:00100000:2.0:1721880422.325596:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.325601:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800992c6ac0/0x8a60d30f571af173 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116116 expref: 1166 pid: 16111 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.325601:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632180 00000100:00100000:1.0:1721880422.325613:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011725184 00000100:00100000:1.0:1721880422.325617:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011725184 00000004:00080000:2.0:1721880422.325619:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800920caa00/2, rc 0, transno 1052855 00010000:00010000:3.0:1721880422.325621:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727c15c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.325629:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727c15c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.325631:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800920caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011723776:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.325636:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727c15c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.325644:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727c15c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.325650:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727c15c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.325655:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8fc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.325658:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727c15c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.325659:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632186 00000100:00100000:2.0:1721880422.325659:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800920c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011725440:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.325664:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d043480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2090:3687:x1805522011725184:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.325664:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727c15c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.325672:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.325673:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727c15c lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.325674:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64467 count 1 00010000:00010000:3.0:1721880422.325680:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727c15c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.325682:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800888fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011725312:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.325683:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106f600/0x8a60d30f5727c18d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbd3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.325693:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097507a80/0x8a60d30f571af348 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1161c5 expref: 1166 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.325699:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.325700:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.325702:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106f600/0x8a60d30f5727c18d lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.325717:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097507a80/0x8a60d30f571af348 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1161c5 expref: 1166 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.325747:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097507a80/0x8a60d30f571af348 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1161c5 expref: 1166 pid: 16111 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.325757:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800920c8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011725568:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.325781:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.325795:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.325799:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800994eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2091:3686:x1805522011723392:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1838us (1876us total) trans 4296020152 rc 0/0 00000100:00100000:3.0:1721880422.325805:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632179 00000004:00080000:0.0:1721880422.325815:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800994eb800/2, rc 0, transno 1052856 00000100:00100000:3.0:1721880422.325815:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011725440 00000100:00100000:3.0:1721880422.325818:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011725440 00000100:00100000:0.0:1721880422.325824:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800994eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011723392:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.325833:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632187 00000100:00100000:3.0:1721880422.325836:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d040e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2091:3687:x1805522011725440:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.325860:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64468 count 1 00010000:00010000:3.0:1721880422.325870:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727c194 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbd4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.325876:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800920c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011725696:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.325885:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fccb180/0x8a60d30f571af501 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116266 expref: 1166 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.325891:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.325892:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.325894:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727c194 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.325900:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.325902:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800920cad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011724544:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.325910:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fccb180/0x8a60d30f571af501 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116266 expref: 1166 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.325917:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fccb180/0x8a60d30f571af501 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116266 expref: 1166 pid: 16111 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.325918:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727c171 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.325926:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.325927:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011725824:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.325938:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d041c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011724928:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.325943:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b16d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011724800:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.325947:0:15444:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257723392 00010000:00010000:2.0:1721880422.325949:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727c17f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.325950:0:15444:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257723392 00000100:00100000:1.0:1721880422.325953:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.325955:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c178 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.325960:0:15444:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801363cb3c0/0x8a60d30f571aeb84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115f17 expref: 1167 pid: 9458 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.325969:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.325977:0:15444:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257723648 00000100:00100000:2.0:1721880422.325979:0:7116:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257723264 00000100:00100000:3.0:1721880422.325979:0:15444:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257723648 00000100:00100000:2.0:1721880422.325982:0:7116:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257723264 00010000:00010000:3.0:1721880422.325988:0:15444:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095c14240/0x8a60d30f571aef89 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11606e expref: 1169 pid: 16073 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.325991:0:7116:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800967a4b40/0x8a60d30f571ae970 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfbce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115e61 expref: 1169 pid: 16124 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.326005:0:7116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914374 00000100:00100000:2.0:1721880422.326009:0:7116:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1169:2004:x1805522257723392:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.326010:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914375 00000100:00100000:1.0:1721880422.326023:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.326025:0:7116:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.326029:0:7116:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801363cb3c0/0x8a60d30f571aeb84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115f17 expref: 1169 pid: 9458 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.326033:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880125a15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1169:2005:x1805522257723264:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.326036:0:7116:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801363cb3c0/0x8a60d30f571aeb84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115f17 expref: 1169 pid: 9458 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.326041:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.326044:0:7116:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801363cb3c0/0x8a60d30f571aeb84 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115f17 expref: 1169 pid: 9458 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.326046:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800967a4b40/0x8a60d30f571ae970 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfbce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115e61 expref: 1169 pid: 16124 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.326049:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011724672:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.326055:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.326055:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800967a4b40/0x8a60d30f571ae970 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115e61 expref: 1168 pid: 16124 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.326056:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.326058:0:7116:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727c171 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.326062:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727c16a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.326062:0:7116:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727c171 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.326067:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800967a4b40/0x8a60d30f571ae970 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbce:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115e61 expref: 1168 pid: 16124 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.326070:0:7116:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.326075:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011725696 00010000:00010000:3.0:1721880422.326076:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1721880422.326078:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011725696 00010000:00010000:3.0:1721880422.326078:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.326080:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727c171 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.326080:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727c16a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.326085:0:7116:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1167:2004:x1805522257723392:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 76us (160us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.326087:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727c16a lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.326088:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727c171 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.326089:0:7116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914374 00010000:00010000:0.0:1721880422.326095:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727c171 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.326095:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632188 00000100:00100000:2.0:1721880422.326096:0:7116:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257723520 00000100:00100000:2.0:1721880422.326098:0:7116:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257723520 00000100:00100000:1.0:1721880422.326099:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d042a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2092:3688:x1805522011725696:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.326101:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.326103:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727c171 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.326104:0:7116:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cae1200/0x8a60d30f571aed4b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115fc6 expref: 1167 pid: 16111 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.326107:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727c171 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.326109:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64469 count 1 00010000:00010000:0.0:1721880422.326110:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106c480 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.326112:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727c171 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.326116:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727c171 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.326120:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880125a15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1167:2005:x1805522257723264:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 88us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.326121:0:7116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914376 00010000:00010000:0.0:1721880422.326122:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727c171 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.326124:0:7116:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1167:2004:x1805522257723648:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.326126:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106c480/0x8a60d30f5727c171 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.326127:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914375 00010000:00010000:2.0:1721880422.326128:0:7116:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.326131:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914377 00010000:00010000:2.0:1721880422.326131:0:7116:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095c14240/0x8a60d30f571aef89 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbd1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11606e expref: 1167 pid: 16073 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.326136:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ab4d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1166:2005:x1805522257723520:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.326138:0:7116:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095c14240/0x8a60d30f571aef89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbd1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11606e expref: 1166 pid: 16073 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.326142:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.326147:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cae1200/0x8a60d30f571aed4b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbd0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115fc6 expref: 1166 pid: 16111 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.326149:0:7116:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095c14240/0x8a60d30f571aef89 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbd1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11606e expref: 1166 pid: 16073 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.326155:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cae1200/0x8a60d30f571aed4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbd0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115fc6 expref: 1165 pid: 16111 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.326158:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.326159:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.326160:0:7116:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727c17f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.326162:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec0c0 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.326165:0:7116:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727c17f lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.326166:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cae1200/0x8a60d30f571aed4b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbd0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b115fc6 expref: 1165 pid: 16111 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.326173:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.326173:0:7116:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.326174:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.326176:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c178 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.326180:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c178 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.326183:0:7116:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1164:2004:x1805522257723648:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 58us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.326187:0:7116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914376 00010000:00010000:3.0:1721880422.326188:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727c17f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.326191:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.326195:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727c17f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.326202:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727c17f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.326204:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ab4d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1163:2005:x1805522257723520:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 69us (194us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.326208:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727c17f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.326209:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914377 00010000:00010000:3.0:1721880422.326214:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727c17f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.326220:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350b40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.326223:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727c17f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.326231:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727c17f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.326239:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727c16a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.326240:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727c17f lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.326243:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727c16a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.326245:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727c17f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.326248:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727c16a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.326251:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727c16a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.326251:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007ea14000/2, rc 0, transno 1052857 00010000:00010000:1.0:1721880422.326255:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727c16a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.326257:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007ea14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011724160:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.326258:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa9440 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.326260:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727c16a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.326267:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727c16a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.326273:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727c16a lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.326276:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727c16a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.326278:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d041c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011725952:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.326295:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.326307:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2093:3687:x1805522011724160:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1475us (1580us total) trans 4296020153 rc 0/0 00000100:00100000:0.0:1721880422.326315:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632182 00010000:00010000:1.0:1721880422.326322:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106e640/0x8a60d30f5727c19b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbd5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.326327:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011725952 00000100:00100000:0.0:1721880422.326329:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011725952 00010000:00010000:1.0:1721880422.326329:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097341f80/0x8a60d30f571af6a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11630e expref: 1162 pid: 16079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.326333:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.326334:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.326336:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106e640/0x8a60d30f5727c19b lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.326345:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632189 00010000:00010000:1.0:1721880422.326346:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097341f80/0x8a60d30f571af6a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11630e expref: 1162 pid: 16079 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.326349:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c848c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2095:3689:x1805522011725952:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.326352:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097341f80/0x8a60d30f571af6a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11630e expref: 1162 pid: 16079 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.326358:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880125a15180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011726080:192.168.201.24@tcp:104: 00002000:00080000:0.0:1721880422.326361:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64470 count 1 00000100:00100000:3.0:1721880422.326364:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d041180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2095:3688:x1805522011724416:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1502us (1535us total) trans 4296020154 rc 0/0 00000004:00080000:2.0:1721880422.326368:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800919c1c00/2, rc 0, transno 1052858 00000100:00100000:3.0:1721880422.326371:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632184 00010000:00010000:0.0:1721880422.326372:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727c1a2 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbd6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.326373:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.326373:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800919c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011724416:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.326382:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099e37840/0x8a60d30f571af873 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1163c4 expref: 1162 pid: 9460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.326387:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.326387:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1721880422.326388:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.326390:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727c1a2 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.326391:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d043100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011726208:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.326402:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099e37840/0x8a60d30f571af873 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1163c4 expref: 1162 pid: 9460 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.326406:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.326417:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d042680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2094:3689:x1805522011724032:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1662us (1788us total) trans 4296020155 rc 0/0 00000100:00100000:3.0:1721880422.326420:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011726208 00000100:00100000:1.0:1721880422.326421:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632181 00000100:00100000:3.0:1721880422.326424:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011726208 00000100:00100000:3.0:1721880422.326440:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632190 00000004:00080000:1.0:1721880422.326442:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007ea14380/2, rc 0, transno 1052859 00000100:00100000:3.0:1721880422.326445:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2094:3687:x1805522011726208:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.326451:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099e37840/0x8a60d30f571af873 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1163c4 expref: 1162 pid: 9460 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.326456:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007ea14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011724032:0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.326456:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64471 count 1 00000100:00100000:0.0:1721880422.326459:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800888f8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011726336:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.326463:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c1a9 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbd7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.326470:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800983c46c0/0x8a60d30f571afa80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11647a expref: 1162 pid: 10431 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.326471:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800920aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011726464:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.326474:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1721880422.326475:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e000 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.326475:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.326477:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c1a9 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.326482:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.326484:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c178 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.326488:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800983c46c0/0x8a60d30f571afa80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11647a expref: 1162 pid: 10431 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.326489:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c178 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.326494:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c178 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.326494:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800983c46c0/0x8a60d30f571afa80 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11647a expref: 1162 pid: 10431 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.326495:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011726464 00000100:00100000:1.0:1721880422.326498:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011726464 00010000:00010000:0.0:1721880422.326499:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c178 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.326502:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c7ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011726592:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.326503:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c178 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.326506:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325cd80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.326508:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c178 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.326509:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632191 00010000:00010000:0.0:1721880422.326511:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c178 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.326512:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2095:3687:x1805522011726464:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.326517:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c178 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.326519:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64472 count 1 00010000:00010000:0.0:1721880422.326521:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c178 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.326524:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdece40 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.326526:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106c900/0x8a60d30f5727c1b0 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbd8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.326533:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800973461c0/0x8a60d30f571afd7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbd8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11655a expref: 1162 pid: 16022 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.326537:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.326538:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.326539:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106c900/0x8a60d30f5727c1b0 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbd8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.326548:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800973461c0/0x8a60d30f571afd7b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbd8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11655a expref: 1162 pid: 16022 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.326553:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800973461c0/0x8a60d30f571afd7b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbd8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11655a expref: 1162 pid: 16022 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.326562:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800920c9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011726720:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.326572:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb000 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.326605:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2096:3687:x1805522011724288:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1826us (1911us total) trans 4296020156 rc 0/0 00000100:00100000:0.0:1721880422.326609:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632183 00000004:00080000:2.0:1721880422.326626:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007ea15f80/2, rc 0, transno 1052860 00000100:00100000:2.0:1721880422.326633:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007ea15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011724288:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.326645:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800920c8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011725568:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.326654:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106f600/0x8a60d30f5727c18d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.326668:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1721880422.326671:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.326674:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011726848:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.326688:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257723904 00000100:00100000:1.0:1721880422.326690:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257723904 00010000:00010000:1.0:1721880422.326696:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097507a80/0x8a60d30f571af348 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1161c5 expref: 1163 pid: 16111 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.326707:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914378 00000100:00100000:1.0:1721880422.326710:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800888f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1163:2004:x1805522257723904:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.326714:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.326716:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097507a80/0x8a60d30f571af348 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbd3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1161c5 expref: 1163 pid: 16111 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.326720:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.326721:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097507a80/0x8a60d30f571af348 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbd3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1161c5 expref: 1163 pid: 16111 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.326747:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257723776 00010000:00010000:1.0:1721880422.326748:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097507a80/0x8a60d30f571af348 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbd3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1161c5 expref: 1163 pid: 16111 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.326751:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257723776 00010000:00010000:1.0:1721880422.326764:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.326765:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800992c6ac0/0x8a60d30f571af173 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfbd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116116 expref: 1163 pid: 16111 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.326766:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.326768:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106f600/0x8a60d30f5727c18d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.326775:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106f600/0x8a60d30f5727c18d lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.326784:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914379 00010000:00010000:1.0:1721880422.326788:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.326788:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800888f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1163:2005:x1805522257723776:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.326795:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.326799:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800992c6ac0/0x8a60d30f571af173 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfbd2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116116 expref: 1163 pid: 16111 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.326801:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800888fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011725312:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.326808:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800992c6ac0/0x8a60d30f571af173 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbd2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116116 expref: 1163 pid: 16111 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.326811:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800888f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1163:2004:x1805522257723904:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 98us (138us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.326816:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727c186 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbd2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.326817:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914378 00010000:00010000:2.0:1721880422.326821:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800992c6ac0/0x8a60d30f571af173 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbd2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116116 expref: 1163 pid: 16111 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.326832:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.326833:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.326836:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727c186 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.326842:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727c186 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.326846:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.326859:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011726848 00000100:00100000:0.0:1721880422.326861:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011726848 00010000:00010000:2.0:1721880422.326863:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.326874:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632192 00000100:00100000:0.0:1721880422.326877:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2096:3689:x1805522011726848:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.326881:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800888f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1161:2005:x1805522257723776:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 91us (160us total) trans 0 rc 0/0 00002000:00080000:0.0:1721880422.326885:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64473 count 1 00000100:00100000:2.0:1721880422.326887:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914379 00010000:00010000:0.0:1721880422.326892:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727c1b7 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbd9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.326900:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097970900/0x8a60d30f571afecb lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbd9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1165df expref: 1160 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.326905:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.326906:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.326907:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727c1b7 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbd9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.326916:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097970900/0x8a60d30f571afecb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbd9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1165df expref: 1160 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.326921:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097970900/0x8a60d30f571afecb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbd9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1165df expref: 1160 pid: 15514 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.326927:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800888fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011726976:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.326942:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106f600/0x8a60d30f5727c18d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.326948:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3ef00 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.326949:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106f600/0x8a60d30f5727c18d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.326957:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106f600/0x8a60d30f5727c18d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.326963:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727c186 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.326963:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106f600/0x8a60d30f5727c18d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.326969:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106f600/0x8a60d30f5727c18d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.326970:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727c186 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.326978:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727c186 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.326979:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106f600 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.326981:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106f600/0x8a60d30f5727c18d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.326985:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727c186 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.326988:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106f600/0x8a60d30f5727c18d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.326992:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727c186 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.326997:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106f600/0x8a60d30f5727c18d lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.326998:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325f3c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.327001:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727c186 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.327003:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106f600/0x8a60d30f5727c18d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.327008:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727c186 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.327030:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727c186 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.327037:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727c186 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.327127:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d043480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2098:3687:x1805522011725184:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1462us (1528us total) trans 4296020157 rc 0/0 00000100:00100000:1.0:1721880422.327133:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632186 00000004:00080000:2.0:1721880422.327135:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800920cbb80/2, rc 0, transno 1052861 00000100:00100000:2.0:1721880422.327146:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800920cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011725184:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.327152:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2097:3689:x1805522011725056:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1618us (1659us total) trans 4296020158 rc 0/0 00000100:00100000:0.0:1721880422.327158:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632185 00000004:00080000:1.0:1721880422.327164:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800888f8a80/2, rc 0, transno 1052862 00000100:00100000:1.0:1721880422.327169:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800888f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011725056:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.327200:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011727104:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.327213:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011727232:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.327230:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.327246:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.327260:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011727104 00000100:00100000:1.0:1721880422.327263:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011727104 00000100:00100000:1.0:1721880422.327276:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011727232 00000100:00100000:1.0:1721880422.327278:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011727232 00000100:00100000:3.0:1721880422.327288:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632193 00000100:00100000:1.0:1721880422.327292:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632194 00000100:00100000:3.0:1721880422.327293:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2098:3689:x1805522011727104:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.327297:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2098:3686:x1805522011727232:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.327306:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64474 count 1 00002000:00080000:1.0:1721880422.327308:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64475 count 1 00010000:00010000:3.0:1721880422.327316:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727c1be lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbda:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.327318:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727c1c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbdb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.327326:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095954000/0x8a60d30f571b0029 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbda:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116672 expref: 1160 pid: 16025 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.327327:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097973cc0/0x8a60d30f571b021a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbdb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11670c expref: 1160 pid: 16016 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.327332:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.327333:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.327334:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.327334:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.327336:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727c1be lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbda:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.327337:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727c1c5 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbdb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.327339:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011725824:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.327347:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727c194 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.327353:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097973cc0/0x8a60d30f571b021a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbdb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11670c expref: 1160 pid: 16016 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.327353:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095954000/0x8a60d30f571b0029 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbda:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116672 expref: 1160 pid: 16025 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.327362:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097973cc0/0x8a60d30f571b021a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbdb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11670c expref: 1160 pid: 16016 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.327362:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095954000/0x8a60d30f571b0029 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbda:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116672 expref: 1160 pid: 16025 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.327371:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007ea15c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011727488:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.327373:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801366a0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011727360:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.327376:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800888f8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011726336:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.327390:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727c1a2 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.327396:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb240 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.327396:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec480 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.327415:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880125a15180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011726080:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.327428:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106e640/0x8a60d30f5727c19b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.327541:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c7ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011726592:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.327554:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c1a9 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.327624:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.327636:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800888fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011726976:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.327636:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.327641:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800920c9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011726720:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.327645:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727c1b7 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbd9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.327646:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257724032 00000100:00100000:3.0:1721880422.327650:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257724032 00010000:00010000:1.0:1721880422.327656:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106c900/0x8a60d30f5727c1b0 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbd8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.327656:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.327664:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fccb180/0x8a60d30f571af501 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116266 expref: 1161 pid: 16111 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.327670:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257724288 00000100:00100000:2.0:1721880422.327672:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.327673:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257724288 00010000:00010000:1.0:1721880422.327683:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099e37840/0x8a60d30f571af873 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1163c4 expref: 1162 pid: 9460 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.327689:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257724544 00000100:00100000:3.0:1721880422.327692:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257724544 00000100:00100000:1.0:1721880422.327699:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257724160 00000100:00100000:1.0:1721880422.327702:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257724160 00010000:00010000:3.0:1721880422.327702:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097970900/0x8a60d30f571afecb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbd9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1165df expref: 1163 pid: 15514 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.327706:0:8271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914380 00010000:00010000:1.0:1721880422.327711:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097341f80/0x8a60d30f571af6a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11630e expref: 1164 pid: 16079 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.327712:0:8271:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+1164:2005:x1805522257724032:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.327721:0:8271:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.327722:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914381 00010000:00010000:2.0:1721880422.327745:0:8271:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fccb180/0x8a60d30f571af501 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116266 expref: 1164 pid: 16111 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.327747:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914382 00000100:00100000:3.0:1721880422.327748:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1164:2005:x1805522257724288:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.327752:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1164:2005:x1805522257724544:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.327754:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914383 00010000:00010000:2.0:1721880422.327756:0:8271:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fccb180/0x8a60d30f571af501 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116266 expref: 1164 pid: 16111 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.327756:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1721880422.327760:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1164:2005:x1805522257724160:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.327760:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.327760:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099e37840/0x8a60d30f571af873 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1163c4 expref: 1164 pid: 9460 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.327764:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097970900/0x8a60d30f571afecb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbd9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1165df expref: 1164 pid: 15514 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.327769:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.327770:0:8271:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fccb180/0x8a60d30f571af501 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116266 expref: 1164 pid: 16111 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.327770:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099e37840/0x8a60d30f571af873 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1163c4 expref: 1164 pid: 9460 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.327773:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097970900/0x8a60d30f571afecb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbd9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1165df expref: 1164 pid: 15514 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.327775:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097341f80/0x8a60d30f571af6a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11630e expref: 1164 pid: 16079 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.327782:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.327783:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099e37840/0x8a60d30f571af873 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1163c4 expref: 1163 pid: 9460 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.327784:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097970900/0x8a60d30f571afecb lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbd9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1165df expref: 1163 pid: 15514 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.327784:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.327785:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097341f80/0x8a60d30f571af6a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11630e expref: 1163 pid: 16079 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.327787:0:8271:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727c194 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.327794:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.327794:0:8271:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727c194 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.327794:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.327795:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.327796:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.327798:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097341f80/0x8a60d30f571af6a5 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11630e expref: 1161 pid: 16079 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.327798:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727c1b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbd9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.327798:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727c1a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.327808:0:8271:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.327809:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727c1b7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbd9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.327810:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727c1a2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.327816:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.327818:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.327821:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106e640/0x8a60d30f5727c19b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.327824:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.327826:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.327828:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106e640/0x8a60d30f5727c19b lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.327829:0:8271:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+1160:2005:x1805522257724032:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 116us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.327835:0:8271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914380 00010000:00010000:0.0:1721880422.327844:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.327844:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1159:2005:x1805522257724544:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 89us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.327846:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1159:2005:x1805522257724288:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 118us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.327852:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914382 00010000:00010000:2.0:1721880422.327855:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727c194 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.327855:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914381 00010000:00010000:2.0:1721880422.327862:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727c194 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.327863:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1158:2005:x1805522257724160:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 102us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.327869:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914383 00010000:00010000:2.0:1721880422.327870:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727c194 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.327872:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106e640/0x8a60d30f5727c19b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.327875:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727c194 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.327880:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106e640/0x8a60d30f5727c19b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.327883:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727c194 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.327886:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106e640/0x8a60d30f5727c19b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.327886:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aaa880 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.327888:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727c194 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.327892:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727c194 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.327893:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106e640/0x8a60d30f5727c19b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.327898:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727c194 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.327900:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106e640/0x8a60d30f5727c19b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.327901:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727c194 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.327906:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106e640 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.327909:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106e640/0x8a60d30f5727c19b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.327920:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106e640/0x8a60d30f5727c19b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.327928:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106e640/0x8a60d30f5727c19b lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.327934:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106e640/0x8a60d30f5727c19b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.327944:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727c1b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.327952:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727c1b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.327958:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727c1b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.327964:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727c1b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.327970:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727c1b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.327980:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325d680 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.327983:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727c1b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.327989:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727c1b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.327990:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d040e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2100:3687:x1805522011725440:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2153us (2317us total) trans 4296020159 rc 0/0 00000100:00100000:2.0:1721880422.327994:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632187 00000004:00080000:3.0:1721880422.328027:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800920c9180/2, rc 0, transno 1052863 00000100:00100000:2.0:1721880422.328036:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.328037:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800920c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011725440:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.328047:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d042a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2099:3688:x1805522011725696:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1946us (2146us total) trans 4296020160 rc 0/0 00010000:00010000:0.0:1721880422.328051:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727c1b7 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.328051:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632188 00010000:00010000:0.0:1721880422.328055:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727c1b7 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.328067:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801366a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011727616:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.328068:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.328079:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257724416 00000100:00100000:0.0:1721880422.328082:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257724416 00000100:00100000:3.0:1721880422.328085:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257724672 00000100:00100000:3.0:1721880422.328088:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257724672 00010000:00010000:0.0:1721880422.328091:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800983c46c0/0x8a60d30f571afa80 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11647a expref: 1158 pid: 10431 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.328100:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800973461c0/0x8a60d30f571afd7b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbd8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11655a expref: 1158 pid: 16022 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.328106:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914384 00000100:00100000:0.0:1721880422.328109:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8066450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1158:2005:x1805522257724416:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000004:00080000:2.0:1721880422.328113:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800920c8380/2, rc 0, transno 1052864 00010000:00010000:0.0:1721880422.328114:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.328116:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800983c46c0/0x8a60d30f571afa80 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbd7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11647a expref: 1158 pid: 10431 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.328118:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914385 00000100:00100000:2.0:1721880422.328119:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800920c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011725696:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.328123:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800983c46c0/0x8a60d30f571afa80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbd7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11647a expref: 1158 pid: 10431 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.328124:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1158:2005:x1805522257724672:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.328130:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.328132:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800983c46c0/0x8a60d30f571afa80 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbd7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11647a expref: 1158 pid: 10431 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.328134:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800973461c0/0x8a60d30f571afd7b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbd8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11655a expref: 1158 pid: 16022 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.328139:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.328140:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.328141:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c1a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.328142:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800920ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011727744:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.328143:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007ea15c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011727488:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.328144:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800973461c0/0x8a60d30f571afd7b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbd8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11655a expref: 1157 pid: 16022 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.328146:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c1a9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.328152:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727c1c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbdb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.328155:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.328155:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.328163:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800973461c0/0x8a60d30f571afd7b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbd8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11655a expref: 1157 pid: 16022 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.328169:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011727744 00000100:00100000:0.0:1721880422.328170:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8066450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1156:2005:x1805522257724416:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 60us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.328170:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011727744 00000100:00100000:0.0:1721880422.328173:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914384 00010000:00010000:3.0:1721880422.328175:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.328176:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.328179:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106c900/0x8a60d30f5727c1b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbd8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.328182:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632195 00000100:00100000:1.0:1721880422.328184:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2099:3688:x1805522011727744:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.328186:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106c900/0x8a60d30f5727c1b0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbd8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.328192:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64477 count 1 00010000:00010000:1.0:1721880422.328199:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106dd40/0x8a60d30f5727c1cc lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbdd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.328200:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.328206:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800842d2ac0/0x8a60d30f571b059a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbdd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11684e expref: 1155 pid: 16117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.328210:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c1a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.328210:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.328211:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.328212:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106dd40/0x8a60d30f5727c1cc lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbdd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.328215:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c1a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.328219:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c1a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.328221:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800842d2ac0/0x8a60d30f571b059a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbdd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11684e expref: 1155 pid: 16117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.328223:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c1a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.328225:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1155:2005:x1805522257724672:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 101us (155us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.328227:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800842d2ac0/0x8a60d30f571b059a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbdd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11684e expref: 1155 pid: 16117 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.328228:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.328230:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c1a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.328231:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914385 00000100:00100000:1.0:1721880422.328233:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007ea15c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011727872:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.328235:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa9680 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.328237:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c1a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.328241:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c1a9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.328244:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257724800 00010000:00010000:0.0:1721880422.328247:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c1a9 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.328247:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb240 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.328247:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257724800 00010000:00010000:0.0:1721880422.328251:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c1a9 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.328256:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097973cc0/0x8a60d30f571b021a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbdb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11670c expref: 1155 pid: 16016 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.328257:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106c900/0x8a60d30f5727c1b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.328261:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106c900/0x8a60d30f5727c1b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.328265:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106c900/0x8a60d30f5727c1b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.328269:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106c900/0x8a60d30f5727c1b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.328271:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914386 00010000:00010000:1.0:1721880422.328272:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106c900/0x8a60d30f5727c1b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.328275:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1155:2005:x1805522257724800:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.328276:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106c900 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.328278:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.328278:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106c900/0x8a60d30f5727c1b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.328281:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097973cc0/0x8a60d30f571b021a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbdb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11670c expref: 1155 pid: 16016 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.328282:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106c900/0x8a60d30f5727c1b0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.328283:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.328287:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097973cc0/0x8a60d30f571b021a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbdb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11670c expref: 1155 pid: 16016 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.328288:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106c900/0x8a60d30f5727c1b0 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.328291:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106c900/0x8a60d30f5727c1b0 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.328297:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257724928 00000100:00100000:3.0:1721880422.328297:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801366a0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011727360:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.328298:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097973cc0/0x8a60d30f571b021a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbdb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11670c expref: 1155 pid: 16016 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.328299:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257724928 00010000:00010000:0.0:1721880422.328305:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.328306:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.328308:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727c1c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbdb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.328309:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095954000/0x8a60d30f571b0029 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbda:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116672 expref: 1155 pid: 16025 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.328310:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727c1be lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbda:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.328312:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727c1c5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbdb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.328321:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.328326:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914387 00000100:00100000:2.0:1721880422.328330:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1155:2004:x1805522257724928:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.328332:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1155:2005:x1805522257724800:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 56us (105us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.328334:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.328337:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095954000/0x8a60d30f571b0029 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbda:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116672 expref: 1155 pid: 16025 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.328338:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914386 00010000:00010000:2.0:1721880422.328343:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095954000/0x8a60d30f571b0029 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbda:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116672 expref: 1155 pid: 16025 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.328350:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.328352:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095954000/0x8a60d30f571b0029 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbda:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116672 expref: 1154 pid: 16025 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.328359:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.328360:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.328362:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727c1be lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbda:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.328367:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2100:3687:x1805522011726464:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1854us (1883us total) trans 4296020161 rc 0/0 00010000:00010000:2.0:1721880422.328367:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727c1be lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbda:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.328371:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632191 00000004:00080000:3.0:1721880422.328373:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800920aa680/2, rc 0, transno 1052865 00010000:00010000:2.0:1721880422.328376:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.328379:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011727616 00000100:00100000:1.0:1721880422.328381:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011727616 00000100:00100000:3.0:1721880422.328391:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800920aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011726464:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.328392:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632196 00000100:00100000:1.0:1721880422.328394:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801366a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2101:3687:x1805522011727616:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.328401:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64476 count 1 00010000:00010000:1.0:1721880422.328408:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106cd80/0x8a60d30f5727c1d3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbdc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.328409:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727c1be lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.328414:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1153:2004:x1805522257724928:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 83us (131us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.328415:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a51346c0/0x8a60d30f571b03be lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbdc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1167b4 expref: 1153 pid: 16016 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.328417:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727c1be lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.328418:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914387 00010000:00010000:1.0:1721880422.328422:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.328423:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.328424:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727c1be lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.328425:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106cd80/0x8a60d30f5727c1d3 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbdc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.328429:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1721880422.328431:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727c1be lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.328432:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800920ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011728000:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.328434:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a51346c0/0x8a60d30f571b03be lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbdc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1167b4 expref: 1152 pid: 16016 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.328438:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727c1be lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.328439:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a51346c0/0x8a60d30f571b03be lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbdc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1167b4 expref: 1152 pid: 16016 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.328443:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa86c0 already unused, calling callback (ffffffffa084e330) 00000100:00100000:1.0:1721880422.328445:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007ea16680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011728128:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.328447:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727c1be lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.328453:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727c1be lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.328457:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2101:3687:x1805522011726208:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2010us (2048us total) trans 4296020162 rc 0/0 00000100:00100000:1.0:1721880422.328459:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb000 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.328460:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.328462:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727c1be lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.328463:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632190 00010000:00010000:3.0:1721880422.328468:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727c1be lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.328478:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727c1c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.328482:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727c1c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.328486:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727c1c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.328490:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727c1c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.328493:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727c1c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.328497:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106cb40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.328499:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727c1c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.328503:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727c1c5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.328508:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727c1c5 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.328512:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106cb40/0x8a60d30f5727c1c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.328520:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011728000 00000100:00100000:0.0:1721880422.328523:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011728000 00000100:00100000:0.0:1721880422.328540:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632197 00000100:00100000:0.0:1721880422.328543:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2103:3688:x1805522011728000:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.328552:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64478 count 1 00010000:00010000:0.0:1721880422.328560:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727c1da lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbde:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.328568:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131b5b180/0x8a60d30f571b06ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbde:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1168e1 expref: 1152 pid: 10431 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.328572:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.328573:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.328575:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727c1da lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbde:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.328584:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2103:3686:x1805522011727232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1287us (1337us total) trans 4296020164 rc 0/0 00000100:00100000:3.0:1721880422.328584:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2103:3689:x1805522011727104:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1289us (1352us total) trans 4296020163 rc 0/0 00010000:00010000:0.0:1721880422.328585:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131b5b180/0x8a60d30f571b06ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbde:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1168e1 expref: 1152 pid: 10431 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.328589:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632194 00010000:00010000:0.0:1721880422.328591:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131b5b180/0x8a60d30f571b06ff lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbde:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1168e1 expref: 1152 pid: 10431 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.328592:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632193 00000004:00080000:2.0:1721880422.328595:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122c1f100/2, rc 0, transno 1052868 00000100:00100000:0.0:1721880422.328597:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800888f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011728256:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.328603:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011727232:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1721880422.328609:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122c1df80/2, rc 0, transno 1052867 00000100:00100000:1.0:1721880422.328612:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011727104:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.328617:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e000 going to sleep for 11 seconds 00000004:00080000:3.0:1721880422.328621:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009d043100/2, rc 0, transno 1052866 00000100:00100000:3.0:1721880422.328626:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d043100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011726208:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.328630:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1721880422.328637:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800920a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011728384:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.328654:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1721880422.328655:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.328657:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1721880422.328660:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800920a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011728512:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.328662:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011728640:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.328673:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011728384 00000100:00100000:1.0:1721880422.328676:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.328676:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011728384 00000100:00100000:3.0:1721880422.328689:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011728640 00000100:00100000:3.0:1721880422.328691:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011728640 00000004:00080000:1.0:1721880422.328695:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122c7df80/2, rc 0, transno 1052869 00000100:00100000:0.0:1721880422.328696:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2104:3689:x1805522011726848:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1818us (1850us total) trans 4296020165 rc 0/0 00000100:00100000:2.0:1721880422.328696:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.328701:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632192 00000100:00100000:1.0:1721880422.328707:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011726848:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.328707:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011728512 00000100:00100000:3.0:1721880422.328709:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011728512 00000100:00100000:0.0:1721880422.328712:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632198 00000100:00100000:0.0:1721880422.328717:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801366a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2104:3687:x1805522011728384:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.328717:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632199 00000100:00100000:1.0:1721880422.328720:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ea17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2104:3689:x1805522011728640:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.328743:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632200 00000100:00100000:1.0:1721880422.328746:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2104:3686:x1805522011728512:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.328748:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64479 count 1 00002000:00080000:1.0:1721880422.328754:0:16088:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64480 count 1 00010000:00010000:0.0:1721880422.328759:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c1e1 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbdf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.328761:0:16088:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727c1e8 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbe0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.328769:0:16088:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801203e06c0/0x8a60d30f571b0d73 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbe0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116a38 expref: 1152 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.328770:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0997a80/0x8a60d30f571b08e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbdf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116997 expref: 1152 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.328773:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.328774:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.328776:0:16088:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727c1e8 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbe0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.328776:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1721880422.328782:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.328783:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1721880422.328783:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008c610a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011728768:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.328787:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c1e1 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbdf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.328802:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.328840:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011728768 00000100:00100000:2.0:1721880422.328844:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011728768 00000100:00100000:2.0:1721880422.328862:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632201 00000100:00100000:2.0:1721880422.328867:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801366a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2105:3688:x1805522011728768:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.328880:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64482 count 1 00010000:00010000:1.0:1721880422.328889:0:16088:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801203e06c0/0x8a60d30f571b0d73 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbe0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116a38 expref: 1152 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.328891:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727c1ef lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbe2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.328898:0:16088:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801203e06c0/0x8a60d30f571b0d73 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbe0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116a38 expref: 1152 pid: 15466 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.328903:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c80b180/0x8a60d30f571b1370 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbe2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116b81 expref: 1152 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.328908:0:16088:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007ea15880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011728896:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.328909:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.328910:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.328913:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727c1ef lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbe2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.328930:0:16088:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb840 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.328930:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c80b180/0x8a60d30f571b1370 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbe2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116b81 expref: 1152 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.328940:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c80b180/0x8a60d30f571b1370 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbe2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116b81 expref: 1152 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.328949:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008c611500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011729152:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.328952:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0997a80/0x8a60d30f571b08e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbdf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116997 expref: 1152 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.328963:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0997a80/0x8a60d30f571b08e9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbdf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116997 expref: 1152 pid: 16018 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.328970:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.328973:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800888f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011729024:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.328988:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e540 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.329000:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727c1a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.329005:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727c1a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.329010:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727c1a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.329029:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727c1a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.329035:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727c1a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.329039:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325d200 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.329041:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727c1a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.329045:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727c1a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.329051:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727c1a2 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.329055:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727c1a2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.329065:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64481 count 1 00010000:00010000:1.0:1721880422.329075:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727c1f6 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbe1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.329086:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d71f840/0x8a60d30f571b11be lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbe1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116ad2 expref: 1152 pid: 16052 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.329092:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.329093:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.329095:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727c1f6 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbe1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.329110:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d71f840/0x8a60d30f571b11be lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbe1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116ad2 expref: 1152 pid: 16052 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.329119:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d71f840/0x8a60d30f571b11be lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbe1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116ad2 expref: 1152 pid: 16052 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.329127:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007ea15500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011729280:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.329152:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb900 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.329153:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.329171:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007ea15c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011727872:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.329183:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106dd40/0x8a60d30f5727c1cc lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbdd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.329198:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257725056 00000100:00100000:1.0:1721880422.329201:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007ea16680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011728128:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.329202:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257725056 00000100:00100000:2.0:1721880422.329206:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.329210:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106cd80/0x8a60d30f5727c1d3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbdc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.329217:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800842d2ac0/0x8a60d30f571b059a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbdd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11684e expref: 1153 pid: 16117 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.329234:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257725184 00000100:00100000:3.0:1721880422.329236:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257725184 00000100:00100000:2.0:1721880422.329241:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914388 00010000:00010000:3.0:1721880422.329244:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a51346c0/0x8a60d30f571b03be lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbdc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1167b4 expref: 1154 pid: 16016 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.329245:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c610e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1154:2005:x1805522257725056:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.329252:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.329256:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800842d2ac0/0x8a60d30f571b059a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbdd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11684e expref: 1154 pid: 16117 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.329262:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800842d2ac0/0x8a60d30f571b059a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbdd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11684e expref: 1154 pid: 16117 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.329265:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914389 00010000:00010000:2.0:1721880422.329270:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800842d2ac0/0x8a60d30f571b059a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbdd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11684e expref: 1154 pid: 16117 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.329270:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c611180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1154:2004:x1805522257725184:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.329277:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.329277:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.329278:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.329280:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106dd40/0x8a60d30f5727c1cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbdd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.329281:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a51346c0/0x8a60d30f571b03be lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbdc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1167b4 expref: 1153 pid: 16016 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.329284:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106dd40/0x8a60d30f5727c1cc lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbdd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.329290:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a51346c0/0x8a60d30f571b03be lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbdc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1167b4 expref: 1153 pid: 16016 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.329294:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.329298:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c848c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2106:3689:x1805522011725952:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2947us (3000us total) trans 4296020166 rc 0/0 00010000:00010000:1.0:1721880422.329301:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106dd40/0x8a60d30f5727c1cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.329302:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a51346c0/0x8a60d30f571b03be lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbdc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1167b4 expref: 1153 pid: 16016 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.329304:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632189 00000100:00100000:2.0:1721880422.329307:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c610e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1153:2005:x1805522257725056:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 62us (156us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.329308:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106dd40/0x8a60d30f5727c1cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.329311:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914388 00010000:00010000:3.0:1721880422.329313:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.329314:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.329315:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106dd40/0x8a60d30f5727c1cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.329317:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106cd80/0x8a60d30f5727c1d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbdc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.329321:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106dd40/0x8a60d30f5727c1cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.329324:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106cd80/0x8a60d30f5727c1d3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbdc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.329327:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106dd40/0x8a60d30f5727c1cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.329333:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106dd40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.329336:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106dd40/0x8a60d30f5727c1cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.329338:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.329342:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106dd40/0x8a60d30f5727c1cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.329351:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106dd40/0x8a60d30f5727c1cc lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.329357:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106dd40/0x8a60d30f5727c1cc lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.329358:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c611180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1151:2004:x1805522257725184:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 87us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.329365:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914389 00000100:00100000:1.0:1721880422.329451:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2106:3688:x1805522011727744:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1265us (1294us total) trans 4296020167 rc 0/0 00000100:00100000:1.0:1721880422.329455:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632195 00000100:00100000:2.0:1721880422.329465:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000004:00080000:3.0:1721880422.329469:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800920ab800/2, rc 0, transno 1052871 00000004:00080000:1.0:1721880422.329478:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009d041c00/2, rc 0, transno 1052870 00000100:00100000:0.0:1721880422.329487:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800888f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011728256:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.329487:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d041c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011725952:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.329489:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800920ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011727744:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.329495:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106cd80/0x8a60d30f5727c1d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.329498:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727c1da lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbde:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.329499:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106cd80/0x8a60d30f5727c1d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.329502:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257725312 00010000:00010000:1.0:1721880422.329503:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106cd80/0x8a60d30f5727c1d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.329505:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257725312 00010000:00010000:1.0:1721880422.329507:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106cd80/0x8a60d30f5727c1d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.329510:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106cd80/0x8a60d30f5727c1d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.329513:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106cd80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.329515:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106cd80/0x8a60d30f5727c1d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.329516:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131b5b180/0x8a60d30f571b06ff lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbde:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1168e1 expref: 1151 pid: 10431 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.329519:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106cd80/0x8a60d30f5727c1d3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.329524:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106cd80/0x8a60d30f5727c1d3 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.329524:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008c611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011729408:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.329527:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106cd80/0x8a60d30f5727c1d3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.329533:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914390 00000100:00100000:3.0:1721880422.329538:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c612a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1151:2005:x1805522257725312:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.329544:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.329546:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.329548:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131b5b180/0x8a60d30f571b06ff lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbde:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1168e1 expref: 1151 pid: 10431 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.329557:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131b5b180/0x8a60d30f571b06ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbde:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1168e1 expref: 1151 pid: 10431 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.329558:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011729408 00000100:00100000:0.0:1721880422.329561:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011729408 00000100:00100000:2.0:1721880422.329561:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1721880422.329566:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008c612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011729536:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.329570:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131b5b180/0x8a60d30f571b06ff lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbde:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1168e1 expref: 1151 pid: 10431 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.329573:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632202 00000100:00100000:0.0:1721880422.329576:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c613100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2107:3686:x1805522011729408:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.329581:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.329583:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00002000:00080000:0.0:1721880422.329584:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64483 count 1 00000100:00100000:2.0:1721880422.329584:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.329586:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727c1da lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbde:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.329592:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c1fd lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbe3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.329593:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727c1da lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbde:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.329599:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800990a8fc0/0x8a60d30f571b1679 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116c14 expref: 1150 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.329602:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801366a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2107:3687:x1805522011727616:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1205us (1252us total) trans 4296020168 rc 0/0 00010000:00010000:0.0:1721880422.329604:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.329605:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1721880422.329606:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632196 00010000:00010000:0.0:1721880422.329607:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c1fd lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.329608:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.329614:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011729536 00000100:00100000:1.0:1721880422.329616:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011729536 00000100:00100000:1.0:1721880422.329627:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632203 00000100:00100000:1.0:1721880422.329629:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096f17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2107:3686:x1805522011729536:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.329630:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c612a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1150:2005:x1805522257725312:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 90us (164us total) trans 0 rc 0/0 00002000:00080000:1.0:1721880422.329637:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64484 count 1 00000100:00100000:3.0:1721880422.329637:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914390 00010000:00010000:1.0:1721880422.329644:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727c204 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbe4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.329651:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009612df80/0x8a60d30f571b2c91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbe4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116c76 expref: 1149 pid: 15497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.329655:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.329656:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.329657:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800990a8fc0/0x8a60d30f571b1679 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116c14 expref: 1149 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.329657:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727c204 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbe4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.329663:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800990a8fc0/0x8a60d30f571b1679 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116c14 expref: 1149 pid: 16017 timeout: 887 lvb_type: 0 00000004:00080000:3.0:1721880422.329665:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801366a2300/2, rc 0, transno 1052872 00010000:00010000:1.0:1721880422.329667:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009612df80/0x8a60d30f571b2c91 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbe4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116c76 expref: 1149 pid: 15497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.329671:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800888f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011729664:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.329672:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009612df80/0x8a60d30f571b2c91 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbe4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116c76 expref: 1149 pid: 15497 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.329679:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007ea16680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011729792:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.329683:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801366a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011727616:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.329691:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e000 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.329696:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb000 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.329700:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727c1da lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.329705:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727c1da lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.329709:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727c1da lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.329714:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880096f17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011729920:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.329716:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727c1da lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.329721:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727c1da lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.329724:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325c240 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.329725:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727c1da lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.329744:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727c1da lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.329750:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727c1da lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.329753:0:16088:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007ea15880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011728896:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.329756:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.329763:0:16088:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727c1e8 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbe0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.329772:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011729920 00000100:00100000:1.0:1721880422.329774:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011729920 00000100:00100000:1.0:1721880422.329785:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632204 00000100:00100000:1.0:1721880422.329787:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2108:3688:x1805522011729920:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.329794:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64485 count 1 00010000:00010000:0.0:1721880422.329798:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727c1da lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.329801:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106c240/0x8a60d30f5727c20b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbe5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.329804:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.329807:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094007a80/0x8a60d30f571b3375 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbe5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116d25 expref: 1149 pid: 15468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.329810:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.329811:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.329812:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106c240/0x8a60d30f5727c20b lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbe5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.329818:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257725568 00000100:00100000:3.0:1721880422.329821:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257725568 00010000:00010000:1.0:1721880422.329822:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094007a80/0x8a60d30f571b3375 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbe5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116d25 expref: 1149 pid: 15468 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.329822:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.329827:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094007a80/0x8a60d30f571b3375 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbe5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116d25 expref: 1150 pid: 15468 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.329831:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.329834:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0997a80/0x8a60d30f571b08e9 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfbdf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116997 expref: 1150 pid: 16018 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.329836:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007ea15880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011730048:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.329839:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257725440 00000100:00100000:2.0:1721880422.329841:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257725440 00000100:00100000:1.0:1721880422.329851:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb840 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.329851:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801203e06c0/0x8a60d30f571b0d73 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbe0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116a38 expref: 1151 pid: 15466 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.329853:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257725696 00000100:00100000:3.0:1721880422.329855:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257725696 00000100:00100000:2.0:1721880422.329863:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914391 00000100:00100000:1.0:1721880422.329865:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007ea15500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011729280:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.329866:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c80b180/0x8a60d30f571b1370 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfbe2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116b81 expref: 1152 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.329867:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8065450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1152:2004:x1805522257725568:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.329872:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.329875:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727c1f6 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbe1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.329875:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0997a80/0x8a60d30f571b08e9 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfbdf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116997 expref: 1152 pid: 16018 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.329881:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0997a80/0x8a60d30f571b08e9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbdf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116997 expref: 1152 pid: 16018 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.329888:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2109:3688:x1805522011728000:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1344us (1428us total) trans 4296020169 rc 0/0 00010000:00010000:2.0:1721880422.329890:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.329890:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914392 00010000:00010000:2.0:1721880422.329892:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1721880422.329893:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632197 00010000:00010000:2.0:1721880422.329893:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c1e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbdf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.329894:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914393 00000100:00100000:3.0:1721880422.329896:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096f14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1152:2007:x1805522257725440:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.329898:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096f17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1152:2007:x1805522257725696:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.329898:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c1e1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbdf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.329902:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.329904:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.329905:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c80b180/0x8a60d30f571b1370 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfbe2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116b81 expref: 1152 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.329905:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.329909:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801203e06c0/0x8a60d30f571b0d73 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbe0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116a38 expref: 1152 pid: 15466 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.329910:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c80b180/0x8a60d30f571b1370 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbe2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116b81 expref: 1152 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.329914:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0997a80/0x8a60d30f571b08e9 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbdf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116997 expref: 1152 pid: 16018 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.329917:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8065450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1152:2004:x1805522257725568:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 49us (114us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.329918:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.329918:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801203e06c0/0x8a60d30f571b0d73 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbe0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116a38 expref: 1152 pid: 15466 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.329919:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1721880422.329921:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800888f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011729024:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.329921:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727c1ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbe2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.329921:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914391 00010000:00010000:1.0:1721880422.329925:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727c1ef lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbe2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.329930:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c1e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.329931:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.329931:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801203e06c0/0x8a60d30f571b0d73 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbe0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116a38 expref: 1150 pid: 15466 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.329935:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c1e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.329938:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c1e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.329941:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880096f17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1149:2007:x1805522257725696:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 43us (109us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.329941:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.329942:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c1e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.329942:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1721880422.329945:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914393 00010000:00010000:3.0:1721880422.329945:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727c1e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbe0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.329946:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c1e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.329949:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c1e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.329952:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325eac0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.329952:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727c1e8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbe0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.329954:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c1e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.329957:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c1e1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.329963:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c1e1 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.329963:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c80b180/0x8a60d30f571b1370 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbe2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116b81 expref: 1148 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.329965:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.329968:0:16088:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727c1e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.329970:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008c611500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011729152:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.329971:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c1e1 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.329973:0:16088:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727c1e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.329977:0:16088:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727c1e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.329978:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727c1ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.329981:0:16088:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727c1e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.329982:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880096f14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1147:2007:x1805522257725440:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 85us (159us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.329983:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727c1ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.329984:0:16088:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727c1e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.329987:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727c1ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.329988:0:16088:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106eac0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.329989:0:16088:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727c1e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.329989:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914392 00010000:00010000:2.0:1721880422.329991:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727c1ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.329993:0:16088:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727c1e8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.329996:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727c1ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.329998:0:16088:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727c1e8 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.330001:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727c1ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.330004:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136351b00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.330005:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106eac0/0x8a60d30f5727c1e8 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbe0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.330006:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727c1ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.330009:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727c1ef lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.330029:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727c1ef lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.330032:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727c1ef lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbe2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.330102:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2111:3686:x1805522011728512:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1354us (1406us total) trans 4296020171 rc 0/0 00000100:00100000:1.0:1721880422.330106:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632200 00000100:00100000:2.0:1721880422.330122:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801366a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2110:3688:x1805522011728768:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1254us (1319us total) trans 4296020172 rc 0/0 00000004:00080000:1.0:1721880422.330125:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800920a9500/2, rc 0, transno 1052875 00000100:00100000:2.0:1721880422.330126:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632201 00000100:00100000:1.0:1721880422.330130:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800920a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011728512:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.330150:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007ea15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011730176:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.330150:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.330158:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801366a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2109:3687:x1805522011728384:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1440us (1500us total) trans 4296020170 rc 0/0 00000100:00100000:3.0:1721880422.330161:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257725824 00000100:00100000:1.0:1721880422.330162:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.330165:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632198 00000100:00100000:3.0:1721880422.330165:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257725824 00000100:00100000:0.0:1721880422.330177:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011730176 00010000:00010000:3.0:1721880422.330177:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d71f840/0x8a60d30f571b11be lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbe1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116ad2 expref: 1147 pid: 16052 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.330180:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011730176 00000100:00100000:3.0:1721880422.330192:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914394 00000100:00100000:0.0:1721880422.330195:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632205 00000100:00100000:3.0:1721880422.330197:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096f14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1147:2004:x1805522257725824:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.330200:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ea15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2109:3689:x1805522011730176:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.330203:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.330207:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d71f840/0x8a60d30f571b11be lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbe1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116ad2 expref: 1147 pid: 16052 timeout: 887 lvb_type: 0 00002000:00080000:0.0:1721880422.330212:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64486 count 1 00010000:00010000:3.0:1721880422.330215:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d71f840/0x8a60d30f571b11be lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbe1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116ad2 expref: 1147 pid: 16052 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.330223:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c212 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbe6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.330231:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d71f840/0x8a60d30f571b11be lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbe1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116ad2 expref: 1147 pid: 16052 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.330236:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007ea16680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011729792:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.330241:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.330243:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.330245:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727c204 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbe4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.330245:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727c1f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbe1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.330251:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727c1f6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbe1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.330264:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.330267:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727c1f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.330271:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727c1f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.330275:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727c1f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.330279:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727c1f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.330283:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727c1f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.330287:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106ed00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.330289:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727c1f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.330289:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880096f14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1146:2004:x1805522257725824:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 91us (137us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.330292:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727c1f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.330295:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914394 00010000:00010000:0.0:1721880422.330298:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009612cfc0/0x8a60d30f571b3669 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbe6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116daa expref: 1146 pid: 16079 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.330298:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727c1f6 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.330301:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106ed00/0x8a60d30f5727c1f6 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbe1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.330304:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.330305:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.330306:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.330308:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c212 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbe6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.330318:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257726080 00000100:00100000:3.0:1721880422.330321:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257726080 00010000:00010000:0.0:1721880422.330325:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009612cfc0/0x8a60d30f571b3669 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbe6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116daa expref: 1146 pid: 16079 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.330331:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009612cfc0/0x8a60d30f571b3669 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbe6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116daa expref: 1146 pid: 16079 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.330331:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009612df80/0x8a60d30f571b2c91 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbe4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116c76 expref: 1146 pid: 15497 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.330339:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800888f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011730304:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.330347:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914395 00000100:00100000:3.0:1721880422.330351:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096f16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1146:2005:x1805522257726080:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.330358:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e540 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.330358:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.330362:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009612df80/0x8a60d30f571b2c91 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbe4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116c76 expref: 1146 pid: 15497 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.330373:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ea17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2110:3689:x1805522011728640:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1652us (1695us total) trans 4296020173 rc 0/0 00000100:00100000:1.0:1721880422.330377:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632199 00010000:00010000:3.0:1721880422.330377:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009612df80/0x8a60d30f571b2c91 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbe4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116c76 expref: 1146 pid: 15497 timeout: 887 lvb_type: 0 00000004:00080000:0.0:1721880422.330378:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008c610a80/2, rc 0, transno 1052876 00000100:00100000:2.0:1721880422.330378:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.330388:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009612df80/0x8a60d30f571b2c91 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbe4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116c76 expref: 1146 pid: 15497 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.330391:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008c610a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011728768:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.330395:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257725952 00010000:00010000:3.0:1721880422.330398:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000004:00080000:0.0:1721880422.330399:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800920ab100/2, rc 0, transno 1052873 00000100:00100000:2.0:1721880422.330399:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257725952 00010000:00010000:3.0:1721880422.330400:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1721880422.330402:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800920ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011728000:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.330402:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727c204 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbe4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.330409:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727c204 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbe4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.330411:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800990a8fc0/0x8a60d30f571b1679 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfbe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116c14 expref: 1146 pid: 16017 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.330415:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800888f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011729664:192.168.201.24@tcp:104: 00000004:00080000:1.0:1721880422.330420:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122c7ea00/2, rc 0, transno 1052877 00010000:00010000:0.0:1721880422.330422:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c1fd lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.330423:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.330435:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011728640:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.330439:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914396 00000100:00100000:3.0:1721880422.330442:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880096f16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1146:2005:x1805522257726080:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 89us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.330445:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096f15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1146:2005:x1805522257725952:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.330448:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914395 00000100:00100000:1.0:1721880422.330452:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1721880422.330452:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.330456:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800920c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011730688:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.330457:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800990a8fc0/0x8a60d30f571b1679 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbe3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116c14 expref: 1145 pid: 16017 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.330467:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800990a8fc0/0x8a60d30f571b1679 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbe3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116c14 expref: 1145 pid: 16017 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.330468:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.330471:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800920c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011730560:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.330479:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800990a8fc0/0x8a60d30f571b1679 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbe3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116c14 expref: 1145 pid: 16017 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.330480:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007ea16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011730432:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.330482:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011730688 00000100:00100000:0.0:1721880422.330485:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011730688 00010000:00010000:2.0:1721880422.330490:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.330491:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.330492:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727c204 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.330493:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.330494:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c1fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.330497:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727c204 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.330501:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727c204 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.330501:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c1fd lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbe3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.330504:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011730560 00010000:00010000:1.0:1721880422.330504:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727c204 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.330507:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011730560 00010000:00010000:1.0:1721880422.330508:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727c204 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.330511:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106fa80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.330512:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727c204 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.330516:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727c204 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.330516:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.330521:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632206 00010000:00010000:1.0:1721880422.330522:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727c204 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.330525:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880125a15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2111:3689:x1805522011730688:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.330525:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106fa80/0x8a60d30f5727c204 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbe4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.330526:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632207 00000100:00100000:3.0:1721880422.330531:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136399500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2111:3687:x1805522011730560:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.330534:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880096f15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1144:2005:x1805522257725952:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 88us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.330541:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914396 00002000:00080000:3.0:1721880422.330545:0:16088:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64488 count 1 00010000:00010000:3.0:1721880422.330556:0:16088:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727c219 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbe8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.330570:0:16088:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007b9c2640/0x8a60d30f571b3bbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116ed0 expref: 1143 pid: 16097 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.330576:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.330577:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.330579:0:16088:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727c219 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.330595:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880096f17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2112:3686:x1805522011729536:12345-0@lo:6:osp-syn-1-0.0 Request processed in 964us (1011us total) trans 4296020174 rc 0/0 00010000:00010000:3.0:1721880422.330595:0:16088:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007b9c2640/0x8a60d30f571b3bbe lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116ed0 expref: 1143 pid: 16097 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.330600:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632203 00010000:00010000:3.0:1721880422.330605:0:16088:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007b9c2640/0x8a60d30f571b3bbe lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116ed0 expref: 1143 pid: 16097 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.330612:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.330615:0:16088:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013639bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011730816:192.168.201.24@tcp:104: 00002000:00080000:0.0:1721880422.330621:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64489 count 1 00000004:00080000:1.0:1721880422.330625:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008c612680/2, rc 0, transno 1052878 00000100:00100000:1.0:1721880422.330628:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008c612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011729536:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.330630:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c220 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbe9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.330637:0:16088:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec480 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.330640:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098236ac0/0x8a60d30f571b3dcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbe9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116f4e expref: 1143 pid: 16077 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.330647:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.330648:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1721880422.330648:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880125a15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011730944:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.330651:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c220 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbe9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.330657:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800920a8000/2, rc 0, transno 1052874 00000100:00100000:1.0:1721880422.330659:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.330664:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800920a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011728384:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.330669:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011730432 00000100:00100000:1.0:1721880422.330671:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011730432 00000100:00100000:1.0:1721880422.330679:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011730944 00000100:00100000:1.0:1721880422.330680:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011730944 00000100:00100000:1.0:1721880422.330687:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632208 00000100:00100000:3.0:1721880422.330688:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1721880422.330689:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880125a17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2113:3686:x1805522011730432:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.330693:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013639b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011731072:0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.330696:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64487 count 1 00000100:00100000:2.0:1721880422.330701:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632209 00000100:00100000:2.0:1721880422.330705:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2113:3689:x1805522011730944:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.330706:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727c227 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbe7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.330715:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.330716:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098236ac0/0x8a60d30f571b3dcb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbe9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116f4e expref: 1143 pid: 16077 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.330716:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0bd7600/0x8a60d30f571b3876 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbe7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116e3d expref: 1143 pid: 16062 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.330716:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64490 count 1 00010000:00010000:1.0:1721880422.330721:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.330722:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098236ac0/0x8a60d30f571b3dcb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbe9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116f4e expref: 1143 pid: 16077 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.330723:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.330723:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727c22e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.330725:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727c227 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbe7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.330744:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800888f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011731200:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.330747:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092038240/0x8a60d30f571b4033 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116fc5 expref: 1143 pid: 16051 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.330751:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.330753:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1721880422.330754:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011731072 00010000:00010000:2.0:1721880422.330755:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727c22e lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.330757:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011731072 00000100:00100000:0.0:1721880422.330764:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e000 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.330776:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632210 00000100:00100000:3.0:1721880422.330782:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136399f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2114:3687:x1805522011731072:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.330794:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c1fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.330796:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64491 count 1 00010000:00010000:0.0:1721880422.330800:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c1fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.330806:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c235 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbeb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.330808:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c1fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.330815:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c1fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.330816:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c4986c0/0x8a60d30f571b43f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbeb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117058 expref: 1143 pid: 16078 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.330822:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.330823:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c1fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.330824:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.330826:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c235 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbeb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.330827:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0bd7600/0x8a60d30f571b3876 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbe7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116e3d expref: 1143 pid: 16062 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.330829:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325e640 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.330832:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c1fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.330833:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0bd7600/0x8a60d30f571b3876 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbe7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116e3d expref: 1143 pid: 16062 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.330839:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c1fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.330840:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba66d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011731328:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.330841:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c4986c0/0x8a60d30f571b43f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbeb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117058 expref: 1143 pid: 16078 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.330849:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c1fd lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.330850:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c4986c0/0x8a60d30f571b43f9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbeb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117058 expref: 1143 pid: 16078 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.330855:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb000 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.330856:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c1fd lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbe3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.330859:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013639aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011731456:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.330876:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007ea15880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011730048:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.330878:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdece40 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.330885:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009106c240/0x8a60d30f5727c20b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbe5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.330897:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092038240/0x8a60d30f571b4033 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116fc5 expref: 1143 pid: 16051 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.330903:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092038240/0x8a60d30f571b4033 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116fc5 expref: 1143 pid: 16051 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.330909:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800920abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011731584:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.330924:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.330945:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.330964:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257726208 00000100:00100000:3.0:1721880422.330968:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257726208 00010000:00010000:3.0:1721880422.330981:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094007a80/0x8a60d30f571b3375 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbe5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116d25 expref: 1144 pid: 15468 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.330997:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914397 00000100:00100000:3.0:1721880422.331000:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1144:2004:x1805522257726208:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.331008:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800888f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011730304:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.331008:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.331027:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094007a80/0x8a60d30f571b3375 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbe5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116d25 expref: 1144 pid: 15468 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.331030:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c212 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbe6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.331036:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094007a80/0x8a60d30f571b3375 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbe5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116d25 expref: 1144 pid: 15468 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.331048:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094007a80/0x8a60d30f571b3375 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbe5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116d25 expref: 1144 pid: 15468 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.331058:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.331059:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.331061:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106c240/0x8a60d30f5727c20b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbe5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.331068:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009106c240/0x8a60d30f5727c20b lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbe5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.331082:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.331085:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009106c240/0x8a60d30f5727c20b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.331089:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106c240/0x8a60d30f5727c20b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.331094:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009106c240/0x8a60d30f5727c20b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.331101:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009106c240/0x8a60d30f5727c20b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.331103:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c613100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2115:3686:x1805522011729408:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1524us (1556us total) trans 4296020175 rc 0/0 00010000:00010000:1.0:1721880422.331105:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009106c240/0x8a60d30f5727c20b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.331106:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.331106:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1143:2004:x1805522257726208:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 103us (159us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.331108:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009106c240 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.331110:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106c240/0x8a60d30f5727c20b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.331113:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009106c240/0x8a60d30f5727c20b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.331113:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914397 00010000:00010000:1.0:1721880422.331119:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009106c240/0x8a60d30f5727c20b lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.331122:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106c240/0x8a60d30f5727c20b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbe5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.331123:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257726336 00000100:00100000:3.0:1721880422.331126:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257726336 00010000:00010000:3.0:1721880422.331134:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009612cfc0/0x8a60d30f571b3669 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbe6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116daa expref: 1143 pid: 16079 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.331158:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914398 00000100:00100000:0.0:1721880422.331160:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632202 00000100:00100000:3.0:1721880422.331163:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a70ef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1143:2004:x1805522257726336:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.331170:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.331173:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009612cfc0/0x8a60d30f571b3669 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbe6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116daa expref: 1143 pid: 16079 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.331181:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.331181:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009612cfc0/0x8a60d30f571b3669 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbe6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116daa expref: 1143 pid: 16079 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.331189:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257726464 00000100:00100000:2.0:1721880422.331192:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257726464 00010000:00010000:3.0:1721880422.331192:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009612cfc0/0x8a60d30f571b3669 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbe6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116daa expref: 1143 pid: 16079 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.331200:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2115:3688:x1805522011729920:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1412us (1444us total) trans 4296020176 rc 0/0 00010000:00010000:2.0:1721880422.331201:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007b9c2640/0x8a60d30f571b3bbe lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfbe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116ed0 expref: 1143 pid: 16097 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.331202:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.331204:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1721880422.331205:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632204 00010000:00010000:3.0:1721880422.331206:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c212 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbe6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.331212:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c212 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbe6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.331215:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880096f17480/2, rc 0, transno 1052880 00000100:00100000:2.0:1721880422.331220:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914399 00000100:00100000:0.0:1721880422.331223:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880096f17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011729920:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.331223:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1143:2004:x1805522257726464:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.331225:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.331228:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c212 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.331229:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.331231:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007b9c2640/0x8a60d30f571b3bbe lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfbe8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116ed0 expref: 1143 pid: 16097 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.331232:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c212 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.331236:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c212 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.331237:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007b9c2640/0x8a60d30f571b3bbe lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbe8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116ed0 expref: 1143 pid: 16097 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.331240:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c212 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.331244:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c212 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.331245:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.331245:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a70ef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1143:2004:x1805522257726336:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 81us (138us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.331246:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.331247:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325e880 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.331248:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c212 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.331248:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727c219 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbe8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.331251:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914398 00010000:00010000:1.0:1721880422.331252:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c212 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.331252:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727c219 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbe8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.331253:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800888fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011731712:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.331257:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c212 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.331259:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.331261:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c212 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbe6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.331272:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1142:2004:x1805522257726464:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 48us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.331276:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.331276:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914399 00000100:00100000:0.0:1721880422.331295:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011731712 00000100:00100000:0.0:1721880422.331297:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011731712 00010000:00010000:3.0:1721880422.331310:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007b9c2640/0x8a60d30f571b3bbe lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbe8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116ed0 expref: 1141 pid: 16097 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.331314:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632211 00000100:00100000:0.0:1721880422.331319:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800888f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2116:3687:x1805522011731712:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.331320:0:16088:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013639bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011730816:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.331328:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ea15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2116:3689:x1805522011730176:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1127us (1164us total) trans 4296020177 rc 0/0 00002000:00080000:0.0:1721880422.331330:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64492 count 1 00000100:00100000:1.0:1721880422.331331:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632205 00010000:00010000:3.0:1721880422.331332:0:16088:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727c219 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.331339:0:16088:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727c219 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.331341:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727c23c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.331344:0:16088:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727c219 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.331350:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007ea15500/2, rc 0, transno 1052881 00010000:00010000:3.0:1721880422.331350:0:16088:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727c219 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.331356:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801202fa400/0x8a60d30f571b48d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117107 expref: 1140 pid: 16117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.331356:0:16088:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727c219 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.331361:0:16088:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727c219 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.331363:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007ea15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011730176:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.331365:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.331366:0:16088:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8b40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.331367:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.331369:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727c23c lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.331369:0:16088:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727c219 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.331374:0:16088:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727c219 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.331375:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008c611f80/2, rc 0, transno 1052879 00000100:00100000:1.0:1721880422.331377:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008c611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011729408:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.331383:0:16088:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727c219 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.331393:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727c219 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbe8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.331404:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1721880422.331412:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800888f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011731968:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.331432:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.331445:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800888f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011731840:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.331458:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.331478:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011731968 00000100:00100000:1.0:1721880422.331481:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011731968 00000100:00100000:1.0:1721880422.331494:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011731840 00000100:00100000:3.0:1721880422.331494:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880136399500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2117:3687:x1805522011730560:12345-0@lo:6:osp-syn-1-0.0 Request processed in 961us (1000us total) trans 4296020178 rc 0/0 00000100:00100000:1.0:1721880422.331495:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011731840 00000100:00100000:3.0:1721880422.331500:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632207 00000100:00100000:1.0:1721880422.331511:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632212 00000100:00100000:3.0:1721880422.331514:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632213 00000100:00100000:1.0:1721880422.331515:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2117:3689:x1805522011731968:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.331518:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ea15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2117:3689:x1805522011731840:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.331525:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64494 count 1 00002000:00080000:3.0:1721880422.331528:0:16088:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64493 count 1 00010000:00010000:1.0:1721880422.331535:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c243 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.331537:0:16088:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c24a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.331544:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a538d680/0x8a60d30f571b513c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117249 expref: 1140 pid: 16026 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.331546:0:16088:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012335fa80/0x8a60d30f571b4d22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1171d2 expref: 1140 pid: 16118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.331550:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.331552:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.331552:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.331554:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c243 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.331554:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.331555:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801202fa400/0x8a60d30f571b48d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117107 expref: 1140 pid: 16117 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.331556:0:16088:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c24a lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.331566:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801202fa400/0x8a60d30f571b48d7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117107 expref: 1140 pid: 16117 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.331571:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a538d680/0x8a60d30f571b513c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117249 expref: 1140 pid: 16026 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.331571:0:16088:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012335fa80/0x8a60d30f571b4d22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1171d2 expref: 1140 pid: 16118 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.331576:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800888f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011732096:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.331579:0:16088:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012335fa80/0x8a60d30f571b4d22 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1171d2 expref: 1140 pid: 16118 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.331580:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a538d680/0x8a60d30f571b513c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117249 expref: 1140 pid: 16026 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.331582:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800920abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011731584:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.331590:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d3d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011732352:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.331592:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727c22e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.331594:0:16088:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013639bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011732224:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.331597:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.331610:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb840 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.331612:0:16088:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec480 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.331632:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013639aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011731456:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.331636:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012ba66d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011731328:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.331644:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c235 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbeb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.331650:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727c227 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbe7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.331663:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800920c8e00/2, rc 0, transno 1052882 00000100:00100000:0.0:1721880422.331667:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800888f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011731200:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.331671:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800920c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011730560:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.331675:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.331678:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c220 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbe9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.331686:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257726592 00000100:00100000:2.0:1721880422.331688:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257726592 00010000:00010000:2.0:1721880422.331697:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098236ac0/0x8a60d30f571b3dcb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbe9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116f4e expref: 1141 pid: 16077 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.331698:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d3d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011732480:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.331709:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914400 00000100:00100000:2.0:1721880422.331711:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1141:2005:x1805522257726592:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.331717:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.331717:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.331719:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098236ac0/0x8a60d30f571b3dcb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbe9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116f4e expref: 1141 pid: 16077 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.331725:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098236ac0/0x8a60d30f571b3dcb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbe9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116f4e expref: 1141 pid: 16077 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.331747:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098236ac0/0x8a60d30f571b3dcb lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbe9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116f4e expref: 1141 pid: 16077 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.331749:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011732480 00000100:00100000:0.0:1721880422.331752:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011732480 00010000:00010000:2.0:1721880422.331754:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.331756:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.331757:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c220 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbe9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.331762:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c220 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbe9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.331767:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632214 00000100:00100000:0.0:1721880422.331770:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2118:3686:x1805522011732480:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.331775:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00080000:0.0:1721880422.331779:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64495 count 1 00010000:00010000:0.0:1721880422.331786:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c251 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.331787:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c220 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.331787:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1140:2005:x1805522257726592:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 75us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.331791:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914400 00010000:00010000:0.0:1721880422.331794:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800932ccb40/0x8a60d30f571b53a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1172dc expref: 1140 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.331794:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c220 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.331798:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.331799:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.331801:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c251 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.331801:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c220 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.331807:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c220 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.331810:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800932ccb40/0x8a60d30f571b53a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1172dc expref: 1139 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.331813:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c220 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.331816:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800932ccb40/0x8a60d30f571b53a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1172dc expref: 1139 pid: 15452 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.331816:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.331818:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325f600 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.331821:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c220 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.331823:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800888f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011732608:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.331827:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c220 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.331836:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c220 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.331839:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e000 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.331842:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c220 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbe9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.331846:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257726720 00000100:00100000:2.0:1721880422.331849:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257726720 00000100:00100000:3.0:1721880422.331855:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.331856:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0bd7600/0x8a60d30f571b3876 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbe7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116e3d expref: 1140 pid: 16062 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.331866:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257726848 00000100:00100000:2.0:1721880422.331868:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257726848 00000100:00100000:3.0:1721880422.331872:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914401 00010000:00010000:2.0:1721880422.331874:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c4986c0/0x8a60d30f571b43f9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbeb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117058 expref: 1141 pid: 16078 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.331878:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013639aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1141:2004:x1805522257726720:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.331885:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914402 00010000:00010000:3.0:1721880422.331887:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.331888:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136398380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1141:2005:x1805522257726848:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.331892:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0bd7600/0x8a60d30f571b3876 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbe7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116e3d expref: 1141 pid: 16062 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.331893:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.331896:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c4986c0/0x8a60d30f571b43f9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbeb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117058 expref: 1141 pid: 16078 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.331901:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0bd7600/0x8a60d30f571b3876 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbe7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116e3d expref: 1141 pid: 16062 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.331902:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c4986c0/0x8a60d30f571b43f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbeb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117058 expref: 1141 pid: 16078 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.331909:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c4986c0/0x8a60d30f571b43f9 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbeb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117058 expref: 1141 pid: 16078 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.331913:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0bd7600/0x8a60d30f571b3876 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbe7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116e3d expref: 1141 pid: 16062 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.331922:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.331923:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.331924:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.331925:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.331927:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c235 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbeb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.331928:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727c227 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbe7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.331934:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c235 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbeb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.331935:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727c227 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbe7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.331945:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880125a15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2119:3689:x1805522011730688:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1418us (1475us total) trans 4296020179 rc 0/0 00010000:00010000:2.0:1721880422.331948:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.331948:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.331952:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632206 00000100:00100000:3.0:1721880422.331960:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88013639aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1139:2004:x1805522257726720:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 82us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.331966:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880136398380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1139:2005:x1805522257726848:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 76us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.331966:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914401 00010000:00010000:1.0:1721880422.331971:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727c227 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.331973:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914402 00010000:00010000:1.0:1721880422.331978:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727c227 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.331985:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727c227 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.331988:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c235 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.331991:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800920c9f80/2, rc 0, transno 1052883 00010000:00010000:1.0:1721880422.331991:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727c227 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.331995:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c235 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.331998:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727c227 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.332001:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c235 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.332006:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800920c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011730688:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.332006:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4fc0 already unused, calling callback (ffffffffa084e330) 00000100:00100000:2.0:1721880422.332007:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.332008:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727c227 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.332008:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c235 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.332025:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727c227 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.332030:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c235 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.332031:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727c227 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.332034:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257726976 00010000:00010000:1.0:1721880422.332035:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727c227 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbe7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.332035:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa9b00 already unused, calling callback (ffffffffa084e330) 00000100:00100000:2.0:1721880422.332037:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257726976 00010000:00010000:3.0:1721880422.332038:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c235 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.332044:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092038240/0x8a60d30f571b4033 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116fc5 expref: 1138 pid: 16051 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.332045:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c235 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.332054:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c235 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.332055:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914403 00000100:00100000:2.0:1721880422.332058:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1138:2004:x1805522257726976:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.332060:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c235 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbeb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.332064:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.332066:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092038240/0x8a60d30f571b4033 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116fc5 expref: 1138 pid: 16051 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.332072:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092038240/0x8a60d30f571b4033 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116fc5 expref: 1138 pid: 16051 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.332080:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092038240/0x8a60d30f571b4033 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b116fc5 expref: 1138 pid: 16051 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.332088:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.332089:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.332091:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727c22e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.332095:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727c22e lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.332103:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.332112:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1137:2004:x1805522257726976:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 54us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.332115:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914403 00000100:00100000:1.0:1721880422.332123:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880125a17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2120:3686:x1805522011730432:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1432us (1509us total) trans 4296020180 rc 0/0 00010000:00010000:2.0:1721880422.332126:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727c22e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.332127:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632208 00010000:00010000:2.0:1721880422.332131:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727c22e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.332136:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727c22e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.332139:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727c22e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.332144:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007ea16680/2, rc 0, transno 1052884 00010000:00010000:2.0:1721880422.332147:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727c22e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.332149:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007ea16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011730432:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.332150:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880136399f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2119:3687:x1805522011731072:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1367us (1434us total) trans 4296020181 rc 0/0 00010000:00010000:2.0:1721880422.332151:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136351440 already unused, calling callback (ffffffffa084e330) 00000100:00100000:1.0:1721880422.332152:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1721880422.332153:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727c22e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.332155:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d3d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011732736:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.332156:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727c22e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.332157:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632210 00010000:00010000:2.0:1721880422.332161:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727c22e lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.332165:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727c22e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.332166:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1721880422.332178:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88013639b480/2, rc 0, transno 1052885 00000100:00100000:1.0:1721880422.332179:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011732736 00000100:00100000:1.0:1721880422.332181:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011732736 00000100:00100000:3.0:1721880422.332182:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013639b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011731072:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.332190:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632215 00000100:00100000:1.0:1721880422.332193:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d3d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2119:3686:x1805522011732736:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.332200:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64496 count 1 00010000:00010000:1.0:1721880422.332207:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c258 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbf0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.332214:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801351b0900/0x8a60d30f571b5778 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbf0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1173a0 expref: 1136 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.332218:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.332219:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.332220:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c258 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbf0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.332230:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801312d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011732864:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.332230:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801351b0900/0x8a60d30f571b5778 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbf0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1173a0 expref: 1136 pid: 16100 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.332235:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801351b0900/0x8a60d30f571b5778 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbf0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1173a0 expref: 1136 pid: 16100 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.332241:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d3d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011733120:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.332255:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2120:3689:x1805522011730944:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1549us (1594us total) trans 4296020182 rc 0/0 00000100:00100000:1.0:1721880422.332259:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb000 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.332259:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632209 00000100:00100000:0.0:1721880422.332260:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.332270:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011732864 00000100:00100000:2.0:1721880422.332272:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011732864 00000100:00100000:0.0:1721880422.332275:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1721880422.332279:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801341d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011732992:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.332282:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632216 00000100:00100000:2.0:1721880422.332285:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f020380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2120:3688:x1805522011732864:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.332292:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64497 count 1 00000100:00100000:0.0:1721880422.332294:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.332294:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d3d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011732352:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.332300:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727c25f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbf1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.332303:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c243 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.332310:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099aeef40/0x8a60d30f571b58eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbf1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117425 expref: 1136 pid: 16127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.332315:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.332316:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1721880422.332317:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011732992 00010000:00010000:2.0:1721880422.332317:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727c25f lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbf1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.332318:0:16088:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013639bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011732224:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.332319:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011732992 00000004:00080000:0.0:1721880422.332321:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880125a15180/2, rc 0, transno 1052886 00000100:00100000:0.0:1721880422.332327:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880125a15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011730944:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.332329:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632217 00010000:00010000:2.0:1721880422.332329:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099aeef40/0x8a60d30f571b58eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbf1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117425 expref: 1136 pid: 16127 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.332330:0:16088:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c24a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.332332:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f023100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2121:3688:x1805522011732992:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.332338:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099aeef40/0x8a60d30f571b58eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbf1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117425 expref: 1136 pid: 16127 timeout: 887 lvb_type: 0 00002000:00080000:1.0:1721880422.332347:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64498 count 1 00000100:00100000:2.0:1721880422.332347:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008c611500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011733248:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.332354:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727c266 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbf2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.332357:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800888f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011732096:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.332360:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d2d5200/0x8a60d30f571b5ba7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbf2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1174cd expref: 1136 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.332360:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.332364:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.332365:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.332366:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727c23c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.332366:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727c266 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbf2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.332369:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdecc0 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.332376:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d2d5200/0x8a60d30f571b5ba7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbf2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1174cd expref: 1136 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.332381:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d2d5200/0x8a60d30f571b5ba7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbf2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1174cd expref: 1136 pid: 15452 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.332383:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257727232 00000100:00100000:2.0:1721880422.332386:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257727232 00000100:00100000:1.0:1721880422.332387:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d3d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011733504:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.332391:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.332398:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a538d680/0x8a60d30f571b513c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117249 expref: 1137 pid: 16026 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.332400:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb840 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.332414:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011733376:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.332420:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257727104 00000100:00100000:2.0:1721880422.332422:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257727104 00000100:00100000:3.0:1721880422.332427:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914404 00010000:00010000:2.0:1721880422.332429:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801202fa400/0x8a60d30f571b48d7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117107 expref: 1138 pid: 16117 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.332432:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013639bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1138:2004:x1805522257727232:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.332434:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.332440:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914405 00010000:00010000:3.0:1721880422.332440:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.332444:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ab4d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1138:2004:x1805522257727104:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.332445:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a538d680/0x8a60d30f571b513c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117249 expref: 1138 pid: 16026 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.332448:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011733376 00010000:00010000:2.0:1721880422.332449:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1721880422.332450:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011733376 00010000:00010000:2.0:1721880422.332451:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801202fa400/0x8a60d30f571b48d7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117107 expref: 1138 pid: 16117 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.332454:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a538d680/0x8a60d30f571b513c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117249 expref: 1138 pid: 16026 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.332457:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801202fa400/0x8a60d30f571b48d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117107 expref: 1138 pid: 16117 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.332463:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632218 00010000:00010000:2.0:1721880422.332465:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801202fa400/0x8a60d30f571b48d7 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117107 expref: 1138 pid: 16117 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.332466:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096c9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2122:3686:x1805522011733376:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.332466:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a538d680/0x8a60d30f571b513c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117249 expref: 1138 pid: 16026 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.332471:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.332472:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00002000:00080000:0.0:1721880422.332474:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64499 count 1 00010000:00010000:2.0:1721880422.332474:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727c23c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.332477:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.332478:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727c23c lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.332478:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.332481:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c243 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.332482:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727c26d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbf3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.332488:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.332488:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c243 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.332489:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880120237600/0x8a60d30f571b5dfa lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbf3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117575 expref: 1136 pid: 15545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.332493:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.332494:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.332496:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727c26d lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbf3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.332498:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727c23c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.332499:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.332500:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ab4d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1136:2004:x1805522257727104:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 55us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.332503:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914405 00010000:00010000:0.0:1721880422.332505:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880120237600/0x8a60d30f571b5dfa lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbf3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117575 expref: 1136 pid: 15545 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.332506:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727c23c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.332511:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880120237600/0x8a60d30f571b5dfa lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbf3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117575 expref: 1135 pid: 15545 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.332513:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727c23c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.332515:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88013639bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1135:2004:x1805522257727232:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 82us (154us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.332519:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727c23c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.332520:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800888f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011733632:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.332521:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914404 00010000:00010000:1.0:1721880422.332526:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727c23c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.332531:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325d440 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.332534:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727c23c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.332535:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3ecc0 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.332541:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727c23c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.332550:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727c23c lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.332556:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727c23c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.332593:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.332607:0:15444:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257727360 00000100:00100000:2.0:1721880422.332610:0:15444:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257727360 00010000:00010000:2.0:1721880422.332619:0:15444:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012335fa80/0x8a60d30f571b4d22 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1171d2 expref: 1135 pid: 16118 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.332641:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914406 00000100:00100000:2.0:1721880422.332646:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013639aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1135:2004:x1805522257727360:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.332653:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.332657:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012335fa80/0x8a60d30f571b4d22 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1171d2 expref: 1135 pid: 16118 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.332665:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800888f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2123:3687:x1805522011731712:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1345us (1388us total) trans 4296020183 rc 0/0 00010000:00010000:2.0:1721880422.332667:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012335fa80/0x8a60d30f571b4d22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1171d2 expref: 1135 pid: 16118 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.332672:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632211 00000004:00080000:3.0:1721880422.332673:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800888fa680/2, rc 0, transno 1052887 00010000:00010000:2.0:1721880422.332679:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012335fa80/0x8a60d30f571b4d22 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1171d2 expref: 1135 pid: 16118 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.332680:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800888fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011731712:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.332691:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c243 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.332691:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.332693:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.332696:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c24a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.332697:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c243 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.332703:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c24a lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.332704:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c243 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.332705:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800994e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011733760:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.332709:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c243 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.332715:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c243 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.332717:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.332720:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b61c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.332723:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c243 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.332724:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.332747:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011733760 00010000:00010000:1.0:1721880422.332749:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c243 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.332750:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011733760 00000100:00100000:2.0:1721880422.332751:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88013639aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1134:2004:x1805522257727360:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 104us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.332755:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914406 00010000:00010000:1.0:1721880422.332758:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c243 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.332761:0:16088:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c24a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.332765:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c243 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.332767:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632219 00000100:00100000:0.0:1721880422.332771:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136398380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2123:3687:x1805522011733760:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.332774:0:16088:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c24a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.332781:0:16088:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c24a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.332787:0:16088:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c24a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.332793:0:16088:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c24a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.332798:0:16088:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aaad00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.332801:0:16088:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c24a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.332808:0:16088:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c24a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.332816:0:16088:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c24a lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.332823:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c24a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1721880422.332843:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64500 count 1 00010000:00010000:0.0:1721880422.332854:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727c274 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbf4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.332865:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a07a8d80/0x8a60d30f571b5fc1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbf4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117608 expref: 1133 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.332870:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2125:3689:x1805522011731968:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1352us (1435us total) trans 4296020184 rc 0/0 00010000:00010000:0.0:1721880422.332872:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.332873:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.332875:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727c274 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbf4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.332875:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632212 00010000:00010000:0.0:1721880422.332891:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a07a8d80/0x8a60d30f571b5fc1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbf4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117608 expref: 1133 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.332900:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a07a8d80/0x8a60d30f571b5fc1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbf4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117608 expref: 1133 pid: 15452 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.332907:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ea15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2124:3689:x1805522011731840:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1387us (1447us total) trans 4296020185 rc 0/0 00000100:00100000:0.0:1721880422.332908:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800994eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011733888:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.332914:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632213 00000100:00100000:0.0:1721880422.332935:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e780 going to sleep for 11 seconds 00000004:00080000:0.0:1721880422.332957:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800888f8700/2, rc 0, transno 1052888 00000100:00100000:0.0:1721880422.332963:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800888f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011731968:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1721880422.332971:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800888f8380/2, rc 0, transno 1052889 00000100:00100000:0.0:1721880422.332978:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800888f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011731840:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.332998:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011734016:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.333022:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009bdc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011734144:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.333027:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.333045:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.333045:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011734016 00000100:00100000:1.0:1721880422.333049:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011734016 00000100:00100000:3.0:1721880422.333059:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011734144 00000100:00100000:3.0:1721880422.333063:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011734144 00000100:00100000:1.0:1721880422.333066:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632220 00000100:00100000:1.0:1721880422.333070:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c610e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2125:3688:x1805522011734016:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.333078:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632221 00002000:00080000:1.0:1721880422.333080:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64501 count 1 00000100:00100000:3.0:1721880422.333083:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2125:3689:x1805522011734144:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.333090:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c27b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbf5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.333093:0:16088:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64502 count 1 00010000:00010000:1.0:1721880422.333101:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099b37180/0x8a60d30f571b6165 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbf5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117678 expref: 1133 pid: 15468 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.333102:0:16088:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c282 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbf6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.333107:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.333108:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.333110:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c27b lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbf5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.333112:0:16088:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c278900/0x8a60d30f571b6310 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbf6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117712 expref: 1133 pid: 16086 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.333118:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.333120:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.333122:0:16088:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c282 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbf6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.333125:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099b37180/0x8a60d30f571b6165 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbf5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117678 expref: 1133 pid: 15468 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.333133:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099b37180/0x8a60d30f571b6165 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbf5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117678 expref: 1133 pid: 15468 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.333135:0:16088:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c278900/0x8a60d30f571b6310 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbf6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117712 expref: 1133 pid: 16086 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.333142:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009bdc6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011734272:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.333144:0:16088:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c278900/0x8a60d30f571b6310 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbf6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117712 expref: 1133 pid: 16086 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.333152:0:16088:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013639bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011734400:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.333165:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb900 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.333170:0:16088:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdece40 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.333251:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800888f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011732608:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.333260:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c251 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.333272:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d3d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011733120:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.333276:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008c611500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011733248:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.333281:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.333282:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c258 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbf0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.333289:0:15444:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257727616 00000100:00100000:2.0:1721880422.333291:0:15444:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257727616 00010000:00010000:3.0:1721880422.333294:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727c25f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbf1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.333296:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d3d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011733504:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.333297:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.333299:0:15444:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800932ccb40/0x8a60d30f571b53a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1172dc expref: 1134 pid: 15452 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.333301:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727c266 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbf2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.333313:0:15444:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257727488 00000100:00100000:2.0:1721880422.333314:0:15444:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257727488 00010000:00010000:2.0:1721880422.333320:0:15444:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801351b0900/0x8a60d30f571b5778 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbf0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1173a0 expref: 1135 pid: 16100 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.333320:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914407 00000100:00100000:3.0:1721880422.333325:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1135:2005:x1805522257727616:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.333329:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914408 00010000:00010000:3.0:1721880422.333332:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.333333:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d040000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1135:2005:x1805522257727488:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.333337:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800932ccb40/0x8a60d30f571b53a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1172dc expref: 1135 pid: 15452 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.333344:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.333345:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800932ccb40/0x8a60d30f571b53a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1172dc expref: 1135 pid: 15452 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.333347:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801351b0900/0x8a60d30f571b5778 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbf0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1173a0 expref: 1135 pid: 16100 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.333354:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801351b0900/0x8a60d30f571b5778 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbf0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1173a0 expref: 1135 pid: 16100 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.333356:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800932ccb40/0x8a60d30f571b53a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1172dc expref: 1135 pid: 15452 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.333361:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801351b0900/0x8a60d30f571b5778 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbf0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1173a0 expref: 1135 pid: 16100 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.333366:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.333367:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.333370:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c251 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.333373:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.333374:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.333376:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c258 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbf0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.333377:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c251 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.333381:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c258 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbf0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.333388:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.333389:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.333389:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.333394:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c258 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.333400:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c258 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.333405:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c258 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.333408:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c258 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.333409:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d040000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1133:2005:x1805522257727488:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 76us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.333409:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1133:2005:x1805522257727616:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 84us (130us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.333412:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c258 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.333413:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914408 00000100:00100000:3.0:1721880422.333416:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914407 00010000:00010000:1.0:1721880422.333419:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4000 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.333421:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c258 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.333422:0:15444:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257727744 00010000:00010000:1.0:1721880422.333424:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c258 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.333424:0:15444:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257727744 00010000:00010000:1.0:1721880422.333430:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c258 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.333430:0:15444:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099aeef40/0x8a60d30f571b58eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbf1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117425 expref: 1132 pid: 16127 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.333434:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c258 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.333434:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c251 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.333441:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c251 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.333449:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914409 00010000:00010000:3.0:1721880422.333450:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c251 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.333452:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d042300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1132:2005:x1805522257727744:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.333456:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.333456:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c251 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.333458:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099aeef40/0x8a60d30f571b58eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbf1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117425 expref: 1132 pid: 16127 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.333463:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c251 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.333464:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099aeef40/0x8a60d30f571b58eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbf1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117425 expref: 1132 pid: 16127 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.333469:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325d8c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.333471:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c251 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.333475:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099aeef40/0x8a60d30f571b58eb lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbf1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117425 expref: 1132 pid: 16127 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.333478:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c251 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.333483:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.333484:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.333486:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727c25f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbf1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.333486:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c251 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.333491:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727c25f lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbf1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.333492:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c251 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.333498:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.333510:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d042300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1131:2005:x1805522257727744:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 57us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.333513:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914409 00000100:00100000:1.0:1721880422.333515:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d3d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2126:3686:x1805522011732736:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1321us (1347us total) trans 4296020186 rc 0/0 00000100:00100000:1.0:1721880422.333520:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632215 00010000:00010000:3.0:1721880422.333521:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727c25f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.333528:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727c25f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.333534:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727c25f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.333536:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d3d5180/2, rc 0, transno 1052890 00000100:00100000:1.0:1721880422.333540:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d3d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011732736:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.333540:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727c25f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.333546:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727c25f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.333552:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136351f80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.333554:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727c25f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.333559:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009bdc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011734528:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.333560:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727c25f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.333567:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727c25f lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.333570:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.333573:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727c25f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.333580:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011734528 00000100:00100000:1.0:1721880422.333582:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011734528 00000100:00100000:1.0:1721880422.333590:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632222 00000100:00100000:1.0:1721880422.333592:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bdc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2126:3686:x1805522011734528:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.333599:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64503 count 1 00010000:00010000:1.0:1721880422.333606:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c289 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbf7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.333612:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cb26400/0x8a60d30f571b655c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbf7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1177b3 expref: 1130 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.333616:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.333617:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.333619:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c289 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbf7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.333628:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cb26400/0x8a60d30f571b655c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbf7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1177b3 expref: 1130 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.333632:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cb26400/0x8a60d30f571b655c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbf7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1177b3 expref: 1130 pid: 15452 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.333636:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800888f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011733632:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.333639:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009bdc4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011734656:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.333648:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727c26d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbf3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.333654:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb840 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.333667:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f020380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2127:3688:x1805522011732864:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1379us (1405us total) trans 4296020187 rc 0/0 00000100:00100000:3.0:1721880422.333673:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632216 00000100:00100000:0.0:1721880422.333688:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000004:00080000:2.0:1721880422.333692:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801312d2680/2, rc 0, transno 1052891 00000100:00100000:2.0:1721880422.333699:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801312d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011732864:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.333706:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257727872 00000100:00100000:2.0:1721880422.333708:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257727872 00000100:00100000:1.0:1721880422.333715:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1721880422.333716:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880120237600/0x8a60d30f571b5dfa lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbf3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117575 expref: 1131 pid: 15545 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.333719:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009bdc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011734784:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.333742:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914410 00000100:00100000:1.0:1721880422.333745:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.333746:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d041180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1131:2007:x1805522257727872:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.333757:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.333760:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880120237600/0x8a60d30f571b5dfa lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbf3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117575 expref: 1131 pid: 15545 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.333766:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880120237600/0x8a60d30f571b5dfa lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbf3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117575 expref: 1131 pid: 15545 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.333773:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880120237600/0x8a60d30f571b5dfa lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbf3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117575 expref: 1131 pid: 15545 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.333774:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2127:3686:x1805522011732480:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2001us (2055us total) trans 4296020188 rc 0/0 00000004:00080000:1.0:1721880422.333777:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d3d5c00/2, rc 0, transno 1052892 00010000:00010000:2.0:1721880422.333780:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.333780:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632214 00000100:00100000:1.0:1721880422.333781:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d3d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011732480:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.333781:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.333783:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727c26d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbf3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.333789:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727c26d lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbf3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.333791:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011734784 00000100:00100000:0.0:1721880422.333792:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.333794:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011734784 00000100:00100000:3.0:1721880422.333806:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632223 00000100:00100000:3.0:1721880422.333809:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bdc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2127:3686:x1805522011734784:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.333810:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257728000 00000100:00100000:2.0:1721880422.333812:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257728000 00010000:00010000:2.0:1721880422.333818:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d2d5200/0x8a60d30f571b5ba7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbf2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1174cd expref: 1131 pid: 15452 timeout: 887 lvb_type: 0 00002000:00080000:3.0:1721880422.333818:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64504 count 1 00000100:00100000:2.0:1721880422.333826:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914411 00010000:00010000:3.0:1721880422.333828:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c290 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbf8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.333829:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d042680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1131:2005:x1805522257728000:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.333833:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.333835:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d2d5200/0x8a60d30f571b5ba7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbf2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1174cd expref: 1131 pid: 15452 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.333838:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134bc4240/0x8a60d30f571b6d12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbf8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117d94 expref: 1131 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.333844:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.333845:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d2d5200/0x8a60d30f571b5ba7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbf2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1174cd expref: 1131 pid: 15452 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.333846:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.333848:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c290 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbf8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.333852:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d2d5200/0x8a60d30f571b5ba7 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbf2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1174cd expref: 1131 pid: 15452 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.333858:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.333859:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.333860:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727c266 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbf2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.333862:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134bc4240/0x8a60d30f571b6d12 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbf8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117d94 expref: 1130 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.333865:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727c266 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbf2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.333870:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134bc4240/0x8a60d30f571b6d12 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbf8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117d94 expref: 1130 pid: 15514 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.333874:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.333877:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727c266 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.333880:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880136398700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011735040:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.333882:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727c266 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.333887:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727c266 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.333887:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d042680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1130:2005:x1805522257728000:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 56us (170us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.333891:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727c266 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.333893:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914411 00010000:00010000:1.0:1721880422.333894:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727c266 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.333897:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b58c0 already unused, calling callback (ffffffffa084e330) 00000100:00100000:3.0:1721880422.333897:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec0c0 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.333899:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727c266 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.333903:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727c266 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.333908:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727c266 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.333912:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727c266 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.333912:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.333927:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d041180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1129:2007:x1805522257727872:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 180us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.333932:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1721880422.333934:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914410 00010000:00010000:2.0:1721880422.333950:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727c26d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.333954:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.333958:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727c26d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.333965:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727c26d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.333965:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257728128 00000100:00100000:3.0:1721880422.333968:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257728128 00010000:00010000:2.0:1721880422.333972:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727c26d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.333978:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a07a8d80/0x8a60d30f571b5fc1 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfbf4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117608 expref: 1129 pid: 15452 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.333979:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727c26d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.333980:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f023100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2128:3688:x1805522011732992:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1646us (1685us total) trans 4296020189 rc 0/0 00000100:00100000:1.0:1721880422.333985:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632217 00010000:00010000:2.0:1721880422.333985:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325c000 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.333988:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727c26d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.333996:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727c26d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.333996:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914412 00000100:00100000:3.0:1721880422.334000:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129d22c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1129:2004:x1805522257728128:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.334005:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727c26d lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.334006:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.334010:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a07a8d80/0x8a60d30f571b5fc1 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfbf4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117608 expref: 1129 pid: 15452 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.334027:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727c26d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.334029:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d3d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011734912:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.334034:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a07a8d80/0x8a60d30f571b5fc1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbf4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117608 expref: 1129 pid: 15452 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.334044:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.334046:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.334048:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727c274 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbf4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.334052:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.334055:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727c274 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbf4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.334070:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011734912 00010000:00010000:3.0:1721880422.334070:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.334074:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011734912 00000100:00100000:3.0:1721880422.334084:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880129d22c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1129:2004:x1805522257728128:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 83us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.334089:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632224 00000100:00100000:3.0:1721880422.334090:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914412 00000100:00100000:1.0:1721880422.334092:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d043480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2129:3689:x1805522011734912:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.334102:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64505 count 1 00010000:00010000:1.0:1721880422.334111:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c297 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbf9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.334119:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a07a8d80/0x8a60d30f571b5fc1 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbf4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117608 expref: 1128 pid: 15452 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.334119:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800966a1200/0x8a60d30f571b6f6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbf9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117e51 expref: 1128 pid: 16122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.334124:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.334126:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.334128:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c297 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbf9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.334129:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800994eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011733888:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.334138:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727c274 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.334141:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800966a1200/0x8a60d30f571b6f6c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbf9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117e51 expref: 1127 pid: 16122 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.334145:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880096c9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2129:3686:x1805522011733376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1676us (1708us total) trans 4296020190 rc 0/0 00010000:00010000:0.0:1721880422.334147:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727c274 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.334149:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800966a1200/0x8a60d30f571b6f6c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbf9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117e51 expref: 1127 pid: 16122 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.334151:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727c274 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.334153:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632218 00010000:00010000:0.0:1721880422.334155:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727c274 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.334157:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d3d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011735168:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.334159:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727c274 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.334163:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727c274 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.334166:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325fa80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.334167:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727c274 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.334171:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727c274 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.334175:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb000 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.334177:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727c274 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.334177:0:16088:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013639bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011734400:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.334181:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727c274 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.334188:0:16088:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c282 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbf6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.334195:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122c1c380/2, rc 0, transno 1052894 00000100:00100000:1.0:1721880422.334202:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011733376:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.334215:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.334224:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257728256 00000100:00100000:3.0:1721880422.334226:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257728256 00000100:00100000:1.0:1721880422.334233:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009bdc6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011734272:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.334235:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099b37180/0x8a60d30f571b6165 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbf5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117678 expref: 1128 pid: 15468 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.334244:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c27b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbf5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.334249:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914413 00000100:00100000:3.0:1721880422.334253:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013639bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1128:2005:x1805522257728256:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.334259:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.334262:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099b37180/0x8a60d30f571b6165 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbf5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117678 expref: 1128 pid: 15468 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.334270:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880136398380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2129:3687:x1805522011733760:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1498us (1545us total) trans 4296020191 rc 0/0 00010000:00010000:3.0:1721880422.334271:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099b37180/0x8a60d30f571b6165 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbf5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117678 expref: 1128 pid: 15468 timeout: 887 lvb_type: 0 00000004:00080000:2.0:1721880422.334275:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801341d3100/2, rc 0, transno 1052893 00000100:00100000:0.0:1721880422.334276:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632219 00010000:00010000:3.0:1721880422.334281:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099b37180/0x8a60d30f571b6165 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbf5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117678 expref: 1128 pid: 15468 timeout: 887 lvb_type: 0 00000004:00080000:1.0:1721880422.334284:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800994e9180/2, rc 0, transno 1052895 00000100:00100000:0.0:1721880422.334292:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d3d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011735296:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.334294:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800994e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011733760:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.334294:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801341d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011732992:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.334296:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.334298:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.334300:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c27b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbf5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.334307:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c27b lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbf5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.334312:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.334318:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.334329:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011735296 00000100:00100000:0.0:1721880422.334331:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011735296 00000100:00100000:1.0:1721880422.334332:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d3d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011735424:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.334333:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88013639bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1127:2005:x1805522257728256:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 79us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.334338:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914413 00000100:00100000:0.0:1721880422.334341:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632225 00000100:00100000:0.0:1721880422.334344:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2129:3689:x1805522011735296:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.334347:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1721880422.334352:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64506 count 1 00000100:00100000:1.0:1721880422.334356:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1721880422.334358:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009bdc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011735552:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.334360:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727c29e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbfa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.334367:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.334368:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a8cd80/0x8a60d30f571b7141 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbfa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117ecf expref: 1126 pid: 16024 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.334372:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.334373:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.334373:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.334375:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727c29e lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbfa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.334377:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c27b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.334382:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c27b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.334384:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095a8cd80/0x8a60d30f571b7141 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbfa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117ecf expref: 1126 pid: 16024 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.334386:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c27b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.334386:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257728384 00010000:00010000:0.0:1721880422.334389:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095a8cd80/0x8a60d30f571b7141 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbfa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117ecf expref: 1126 pid: 16024 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.334389:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257728384 00010000:00010000:1.0:1721880422.334390:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c27b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.334393:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c27b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.334396:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4240 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.334398:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c27b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.334399:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d040e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011735680:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.334399:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c278900/0x8a60d30f571b6310 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbf6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117712 expref: 1127 pid: 16086 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.334405:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c27b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.334411:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c27b lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.334413:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914414 00000100:00100000:0.0:1721880422.334415:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e780 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.334415:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c27b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.334417:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c613100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1127:2005:x1805522257728384:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.334423:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.334426:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c278900/0x8a60d30f571b6310 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbf6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117712 expref: 1127 pid: 16086 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.334434:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c278900/0x8a60d30f571b6310 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbf6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117712 expref: 1127 pid: 16086 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.334440:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011735424 00000100:00100000:2.0:1721880422.334443:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011735424 00010000:00010000:3.0:1721880422.334450:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c278900/0x8a60d30f571b6310 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbf6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117712 expref: 1127 pid: 16086 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.334454:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011735552 00000100:00100000:2.0:1721880422.334455:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011735552 00000100:00100000:0.0:1721880422.334457:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.334458:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.334459:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.334462:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c282 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbf6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.334468:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c282 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbf6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.334472:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257728512 00000100:00100000:2.0:1721880422.334474:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257728512 00010000:00010000:3.0:1721880422.334479:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.334481:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb26400/0x8a60d30f571b655c lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfbf7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1177b3 expref: 1127 pid: 15452 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.334493:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914415 00000100:00100000:2.0:1721880422.334496:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d042a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1127:2005:x1805522257728512:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.334498:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c610e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2132:3688:x1805522011734016:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1428us (1470us total) trans 4296020192 rc 0/0 00000100:00100000:3.0:1721880422.334498:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c613100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1127:2005:x1805522257728384:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 80us (126us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.334501:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.334502:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632220 00010000:00010000:2.0:1721880422.334504:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cb26400/0x8a60d30f571b655c lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfbf7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1177b3 expref: 1127 pid: 15452 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.334504:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914414 00000004:00080000:0.0:1721880422.334509:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012ba66d80/2, rc 0, transno 1052896 00010000:00010000:2.0:1721880422.334511:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cb26400/0x8a60d30f571b655c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbf7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1177b3 expref: 1126 pid: 15452 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.334513:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632226 00000100:00100000:0.0:1721880422.334514:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012ba66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011734016:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.334516:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088614700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2131:3686:x1805522011735424:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.334518:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.334518:0:16088:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c282 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.334519:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.334521:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c289 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbf7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.334525:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c289 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbf7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.334525:0:16088:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c282 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.334530:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64507 count 1 00010000:00010000:3.0:1721880422.334532:0:16088:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c282 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.334535:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.334536:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1721880422.334537:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727c2a5 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbfb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.334538:0:16088:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c282 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.334540:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011735808:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.334545:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096366ac0/0x8a60d30f571b73cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbfb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117f70 expref: 1126 pid: 16051 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.334548:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d042a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1126:2005:x1805522257728512:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 50us (91us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.334549:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.334550:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.334550:0:16088:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c282 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.334551:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727c2a5 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbfb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.334552:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914415 00000100:00100000:0.0:1721880422.334554:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.334556:0:16088:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aabcc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.334558:0:16088:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c282 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.334565:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096366ac0/0x8a60d30f571b73cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbfb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117f70 expref: 1125 pid: 16051 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.334565:0:16088:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c282 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.334571:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096366ac0/0x8a60d30f571b73cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbfb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117f70 expref: 1125 pid: 16051 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.334573:0:9458:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011735808 00010000:00010000:3.0:1721880422.334573:0:16088:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c282 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.334575:0:9458:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011735808 00000100:00100000:1.0:1721880422.334577:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094636a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011735936:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.334579:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c282 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.334590:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb900 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.334590:0:9458:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632227 00000100:00100000:0.0:1721880422.334594:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632228 00000100:00100000:2.0:1721880422.334595:0:9458:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2132:3686:x1805522011735552:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.334597:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d042300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2132:3689:x1805522011735808:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.334606:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64509 count 1 00010000:00010000:1.0:1721880422.334606:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cb26400/0x8a60d30f571b655c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbf7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1177b3 expref: 1125 pid: 15452 timeout: 887 lvb_type: 0 00002000:00080000:2.0:1721880422.334606:0:9458:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64508 count 1 00010000:00010000:0.0:1721880422.334613:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727c2ac lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbfd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.334613:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009bdc4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011734656:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.334617:0:9458:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727c2b3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbfc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.334621:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091011440/0x8a60d30f571b781e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbfd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11809d expref: 1124 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.334622:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c289 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.334625:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.334626:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.334626:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c289 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.334627:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727c2ac lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbfd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.334628:0:9458:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880084d27600/0x8a60d30f571b762d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbfc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118018 expref: 1124 pid: 16058 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.334630:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c289 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.334634:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c289 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.334634:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.334636:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.334637:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091011440/0x8a60d30f571b781e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbfd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11809d expref: 1124 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.334638:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c289 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.334638:0:9458:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727c2b3 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbfc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.334642:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c289 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.334645:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4d80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.334646:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091011440/0x8a60d30f571b781e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbfd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11809d expref: 1124 pid: 15453 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.334647:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c289 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.334650:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c289 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.334652:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d042680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011736064:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.334654:0:9458:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880084d27600/0x8a60d30f571b762d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbfc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118018 expref: 1124 pid: 16058 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.334656:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c289 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.334659:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c289 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.334661:0:9458:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880084d27600/0x8a60d30f571b762d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbfc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118018 expref: 1124 pid: 16058 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.334667:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.334671:0:9458:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008c611180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011736192:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.334679:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2133:3689:x1805522011734144:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1595us (1633us total) trans 4296020193 rc 0/0 00000004:00080000:0.0:1721880422.334681:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009bdc6680/2, rc 0, transno 1052897 00000100:00100000:3.0:1721880422.334685:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632221 00000100:00100000:0.0:1721880422.334686:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009bdc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011734144:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.334687:0:9458:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde240 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.334702:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d041180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011736320:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.334715:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.334740:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011736320 00000100:00100000:2.0:1721880422.334742:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011736320 00000100:00100000:1.0:1721880422.334751:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bdc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2134:3686:x1805522011734528:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1156us (1179us total) trans 4296020194 rc 0/0 00000100:00100000:1.0:1721880422.334755:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632222 00000100:00100000:2.0:1721880422.334759:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632229 00000100:00100000:2.0:1721880422.334763:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800994eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2133:3689:x1805522011736320:12345-0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1721880422.334773:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009bdc4a80/2, rc 0, transno 1052898 00002000:00080000:2.0:1721880422.334774:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64510 count 1 00000100:00100000:1.0:1721880422.334778:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009bdc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011734528:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.334784:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727c2ba lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbfe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.334794:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800911b61c0/0x8a60d30f571b7a9b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbfe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118137 expref: 1124 pid: 16115 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.334800:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.334801:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1721880422.334803:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b16c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011736448:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.334804:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727c2ba lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbfe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.334816:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.334820:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800911b61c0/0x8a60d30f571b7a9b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbfe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118137 expref: 1124 pid: 16115 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.334829:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011736448 00010000:00010000:2.0:1721880422.334830:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800911b61c0/0x8a60d30f571b7a9b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbfe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118137 expref: 1124 pid: 16115 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.334832:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011736448 00000100:00100000:2.0:1721880422.334838:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008c612a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011736576:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.334846:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632230 00000100:00100000:3.0:1721880422.334850:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bdc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2134:3686:x1805522011736448:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.334860:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde9c0 going to sleep for 11 seconds 00002000:00080000:3.0:1721880422.334861:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64511 count 1 00010000:00010000:3.0:1721880422.334870:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c2c1 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.334884:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007bbb9f80/0x8a60d30f571b7c93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1181d8 expref: 1124 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.334891:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.334892:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.334895:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c2c1 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfbff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.334909:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007bbb9f80/0x8a60d30f571b7c93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1181d8 expref: 1124 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.334917:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007bbb9f80/0x8a60d30f571b7c93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1181d8 expref: 1124 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.334926:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013639aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011736704:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.334944:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdece40 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.335057:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880136398700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011735040:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.335069:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c290 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbf8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.335096:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.335106:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.335110:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257728768 00000100:00100000:3.0:1721880422.335113:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257728768 00000100:00100000:2.0:1721880422.335115:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257728640 00000100:00100000:2.0:1721880422.335118:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257728640 00010000:00010000:3.0:1721880422.335124:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800966a1200/0x8a60d30f571b6f6c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbf9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117e51 expref: 1126 pid: 16122 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.335125:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d3d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011735168:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.335127:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134bc4240/0x8a60d30f571b6d12 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbf8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117d94 expref: 1126 pid: 15514 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.335138:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c297 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbf9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.335141:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914416 00000100:00100000:2.0:1721880422.335147:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914417 00000100:00100000:3.0:1721880422.335148:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c611500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1126:2005:x1805522257728768:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.335150:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1126:2004:x1805522257728640:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.335154:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.335156:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.335158:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800966a1200/0x8a60d30f571b6f6c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbf9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117e51 expref: 1126 pid: 16122 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.335159:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134bc4240/0x8a60d30f571b6d12 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbf8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117d94 expref: 1126 pid: 15514 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.335165:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134bc4240/0x8a60d30f571b6d12 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbf8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117d94 expref: 1126 pid: 15514 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.335167:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800966a1200/0x8a60d30f571b6f6c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbf9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117e51 expref: 1126 pid: 16122 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.335172:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134bc4240/0x8a60d30f571b6d12 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbf8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117d94 expref: 1126 pid: 15514 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.335178:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800966a1200/0x8a60d30f571b6f6c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbf9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117e51 expref: 1125 pid: 16122 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.335180:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.335181:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.335183:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c290 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbf8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.335187:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.335188:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c290 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbf8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.335188:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.335191:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c297 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbf9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.335198:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c297 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbf9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.335203:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.335209:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.335215:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c290 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.335215:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1124:2004:x1805522257728640:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 64us (108us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.335218:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c297 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.335219:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914417 00010000:00010000:0.0:1721880422.335223:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c290 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.335225:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c611500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1124:2005:x1805522257728768:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 78us (130us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.335226:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c297 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.335230:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914416 00010000:00010000:0.0:1721880422.335231:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c290 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.335234:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c297 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.335238:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c290 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.335240:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c297 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.335244:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c290 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.335246:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c297 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.335251:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b5440 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.335254:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c297 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.335255:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa9f80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.335260:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c297 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.335270:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c297 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.335275:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c297 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.335371:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d043480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2135:3689:x1805522011734912:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1276us (1318us total) trans 4296020195 rc 0/0 00000100:00100000:2.0:1721880422.335373:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.335377:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c290 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.335378:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632224 00010000:00010000:0.0:1721880422.335385:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c290 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.335386:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257728896 00000100:00100000:3.0:1721880422.335388:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257728896 00010000:00010000:3.0:1721880422.335397:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095a8cd80/0x8a60d30f571b7141 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfbfa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117ecf expref: 1123 pid: 16024 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.335398:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c290 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.335405:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c290 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.335407:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d3d6680/2, rc 0, transno 1052899 00000100:00100000:1.0:1721880422.335414:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d3d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011734912:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.335418:0:9458:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008c611180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011736192:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.335418:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914418 00000100:00100000:3.0:1721880422.335422:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1123:2004:x1805522257728896:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.335428:0:9458:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727c2b3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbfc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.335428:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.335432:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095a8cd80/0x8a60d30f571b7141 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfbfa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117ecf expref: 1123 pid: 16024 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.335439:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d042680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011736064:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.335441:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095a8cd80/0x8a60d30f571b7141 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbfa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117ecf expref: 1123 pid: 16024 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.335445:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1721880422.335447:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.335450:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1721880422.335451:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d3d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011736832:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.335451:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.335452:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727c2ac lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbfd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.335454:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727c29e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbfa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.335456:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257729024 00000100:00100000:2.0:1721880422.335458:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257729024 00010000:00010000:3.0:1721880422.335460:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727c29e lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbfa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.335467:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091011440/0x8a60d30f571b781e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbfd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11809d expref: 1124 pid: 15453 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.335469:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.335470:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.335477:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914419 00000100:00100000:2.0:1721880422.335480:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a70ee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1124:2005:x1805522257729024:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.335485:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.335488:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091011440/0x8a60d30f571b781e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbfd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11809d expref: 1124 pid: 15453 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.335488:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1124:2004:x1805522257728896:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 65us (115us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.335494:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091011440/0x8a60d30f571b781e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbfd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11809d expref: 1124 pid: 15453 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.335494:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914418 00000100:00100000:1.0:1721880422.335500:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094636a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011735936:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.335502:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091011440/0x8a60d30f571b781e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbfd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11809d expref: 1123 pid: 15453 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.335512:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.335513:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727c2a5 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbfb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.335513:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.335515:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727c2ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbfd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.335519:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727c2ac lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbfd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.335526:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011736832 00010000:00010000:0.0:1721880422.335527:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727c2ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbfd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.335527:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.335529:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011736832 00010000:00010000:0.0:1721880422.335532:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727c2ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.335533:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.335537:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727c2ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.335539:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a70ee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1122:2005:x1805522257729024:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 57us (91us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.335542:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914419 00000100:00100000:1.0:1721880422.335544:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632231 00000100:00100000:3.0:1721880422.335544:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257729280 00010000:00010000:0.0:1721880422.335545:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727c2ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.335547:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257729280 00000100:00100000:1.0:1721880422.335548:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2135:3686:x1805522011736832:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.335549:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727c2ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.335552:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325cfc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.335554:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727c2ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.335556:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880084d27600/0x8a60d30f571b762d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbfc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118018 expref: 1122 pid: 16058 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.335557:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727c2ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.335558:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64512 count 1 00010000:00010000:0.0:1721880422.335563:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727c2ac lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.335567:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727c2ac lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.335567:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727c2c8 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc00:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.335575:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098bb0240/0x8a60d30f571b7e8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118280 expref: 1122 pid: 16087 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.335579:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.335580:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.335582:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727c2c8 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.335585:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914420 00000100:00100000:3.0:1721880422.335591:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136398700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1122:2005:x1805522257729280:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.335593:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098bb0240/0x8a60d30f571b7e8b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118280 expref: 1122 pid: 16087 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.335597:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.335599:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098bb0240/0x8a60d30f571b7e8b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118280 expref: 1122 pid: 16087 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.335599:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.335601:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880084d27600/0x8a60d30f571b762d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbfc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118018 expref: 1122 pid: 16058 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.335606:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011736960:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.335610:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257729152 00010000:00010000:3.0:1721880422.335610:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880084d27600/0x8a60d30f571b762d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbfc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118018 expref: 1122 pid: 16058 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.335614:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257729152 00000100:00100000:1.0:1721880422.335620:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb900 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.335621:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880084d27600/0x8a60d30f571b762d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbfc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118018 expref: 1123 pid: 16058 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.335625:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096366ac0/0x8a60d30f571b73cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbfb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117f70 expref: 1123 pid: 16051 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.335631:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.335632:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.335635:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727c2b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbfc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.335641:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914421 00010000:00010000:3.0:1721880422.335642:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727c2b3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbfc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.335646:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1122:2005:x1805522257729152:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.335653:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.335654:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.335657:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096366ac0/0x8a60d30f571b73cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbfb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117f70 expref: 1122 pid: 16051 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.335662:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d042300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2136:3689:x1805522011735808:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1064us (1106us total) trans 4296020196 rc 0/0 00010000:00010000:2.0:1721880422.335665:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096366ac0/0x8a60d30f571b73cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbfb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117f70 expref: 1122 pid: 16051 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.335666:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632228 00000100:00100000:3.0:1721880422.335670:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880136398700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1122:2005:x1805522257729280:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 78us (136us total) trans 0 rc 0/0 00000004:00080000:1.0:1721880422.335675:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009d040000/2, rc 0, transno 1052900 00000100:00100000:3.0:1721880422.335675:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914420 00010000:00010000:2.0:1721880422.335677:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096366ac0/0x8a60d30f571b73cc lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbfb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117f70 expref: 1122 pid: 16051 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.335682:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011735808:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.335684:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.335685:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.335687:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727c2a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbfb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.335688:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a8cd80/0x8a60d30f571b7141 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbfa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b117ecf expref: 1120 pid: 16024 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.335691:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727c2a5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbfb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.335692:0:9458:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727c2b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.335696:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d040e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011735680:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.335699:0:9458:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727c2b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.335701:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.335706:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1721880422.335706:0:9458:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727c2b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.335707:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727c29e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.335712:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727c29e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.335712:0:9458:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727c2b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.335713:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011737088:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.335713:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1119:2005:x1805522257729152:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 67us (115us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.335715:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727c29e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.335717:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914421 00010000:00010000:0.0:1721880422.335719:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727c29e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.335719:0:9458:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727c2b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.335723:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727c29e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.335724:0:9458:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801363506c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.335744:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727c29e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.335745:0:9458:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727c2b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.335747:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325db00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.335749:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727c29e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.335752:0:9458:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727c2b3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.335753:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727c29e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.335753:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.335759:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727c29e lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.335762:0:9458:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727c2b3 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.335768:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727c29e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.335768:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.335768:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727c2b3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.335774:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257729408 00000100:00100000:2.0:1721880422.335776:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257729408 00010000:00010000:1.0:1721880422.335781:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727c2a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.335782:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800911b61c0/0x8a60d30f571b7a9b lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfbfe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118137 expref: 1119 pid: 16115 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.335785:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011737088 00000100:00100000:0.0:1721880422.335787:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011737088 00010000:00010000:1.0:1721880422.335788:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727c2a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.335791:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914422 00000100:00100000:2.0:1721880422.335793:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1119:2004:x1805522257729408:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.335795:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727c2a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.335797:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.335799:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800911b61c0/0x8a60d30f571b7a9b lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfbfe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118137 expref: 1119 pid: 16115 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.335800:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632232 00010000:00010000:1.0:1721880422.335801:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727c2a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.335802:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2136:3689:x1805522011737088:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.335808:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800911b61c0/0x8a60d30f571b7a9b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbfe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118137 expref: 1119 pid: 16115 timeout: 887 lvb_type: 0 00002000:00080000:0.0:1721880422.335811:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64513 count 1 00010000:00010000:1.0:1721880422.335811:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727c2a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.335815:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.335816:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.335817:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727c2cf lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc01:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.335817:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4b40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.335817:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727c2ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbfe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.335820:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727c2a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.335821:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727c2ba lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbfe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.335824:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f96df80/0x8a60d30f571b80c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11830c expref: 1119 pid: 16024 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.335826:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727c2a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.335828:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.335828:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.335829:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.335831:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727c2cf lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.335835:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727c2a5 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.335836:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1119:2004:x1805522257729408:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 42us (69us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.335839:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727c2a5 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.335840:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f96df80/0x8a60d30f571b80c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11830c expref: 1119 pid: 16024 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.335840:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914422 00010000:00010000:0.0:1721880422.335846:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f96df80/0x8a60d30f571b80c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11830c expref: 1118 pid: 16024 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.335852:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b16ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011737216:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.335856:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800911b61c0/0x8a60d30f571b7a9b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbfe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118137 expref: 1118 pid: 16115 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.335865:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008c612a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011736576:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.335866:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e780 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.335872:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727c2ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.335877:0:9458:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2137:3686:x1805522011735552:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1281us (1507us total) trans 4296020197 rc 0/0 00010000:00010000:2.0:1721880422.335878:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727c2ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.335882:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727c2ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.335884:0:9458:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632227 00010000:00010000:2.0:1721880422.335887:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727c2ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.335892:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727c2ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.335895:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727c2ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.335899:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801363518c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.335900:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727c2ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.335904:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727c2ba lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.335909:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727c2ba lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.335912:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013639aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011736704:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.335913:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727c2ba lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.335920:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088614700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2138:3686:x1805522011735424:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1402us (1571us total) trans 4296020198 rc 0/0 00010000:00010000:3.0:1721880422.335924:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c2c1 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfbff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.335927:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632226 00000100:00100000:0.0:1721880422.335950:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2138:3689:x1805522011735296:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1605us (1637us total) trans 4296020199 rc 0/0 00000100:00100000:0.0:1721880422.335955:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632225 00000004:00080000:1.0:1721880422.335955:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009bdc6d80/2, rc 0, transno 1052901 00000100:00100000:1.0:1721880422.335962:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009bdc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011735552:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.335988:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800994eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2138:3689:x1805522011736320:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1224us (1271us total) trans 4296020200 rc 0/0 00000100:00100000:1.0:1721880422.335989:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011737344:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.335993:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632229 00000100:00100000:1.0:1721880422.336008:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.336025:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.336044:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257729536 00000100:00100000:2.0:1721880422.336046:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257729536 00000004:00080000:1.0:1721880422.336051:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009d041180/2, rc 0, transno 1052904 00000100:00100000:0.0:1721880422.336055:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bdc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2137:3686:x1805522011734784:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2243us (2307us total) trans 4296020201 rc 0/0 00010000:00010000:2.0:1721880422.336055:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007bbb9f80/0x8a60d30f571b7c93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1181d8 expref: 1118 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.336057:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d041180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011736320:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.336061:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632223 00000100:00100000:2.0:1721880422.336065:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914423 00000100:00100000:2.0:1721880422.336068:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013639aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1118:2004:x1805522257729536:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.336072:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1721880422.336075:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011737344 00010000:00010000:2.0:1721880422.336075:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007bbb9f80/0x8a60d30f571b7c93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1181d8 expref: 1118 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.336078:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011737344 00010000:00010000:2.0:1721880422.336080:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007bbb9f80/0x8a60d30f571b7c93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1181d8 expref: 1118 pid: 16130 timeout: 887 lvb_type: 0 00000004:00080000:1.0:1721880422.336083:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d3d7480/2, rc 0, transno 1052903 00000100:00100000:1.0:1721880422.336087:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d3d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011735296:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.336087:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007bbb9f80/0x8a60d30f571b7c93 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1181d8 expref: 1118 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.336094:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632233 00010000:00010000:2.0:1721880422.336096:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.336097:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1721880422.336098:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801362d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2137:3689:x1805522011737344:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.336098:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c2c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.336103:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c2c1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfbff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.336104:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d3d6a00/2, rc 0, transno 1052902 00000100:00100000:1.0:1721880422.336107:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d3d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011735424:0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.336109:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64514 count 1 00010000:00010000:2.0:1721880422.336111:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.336117:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1721880422.336120:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727c2d6 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc02:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.336120:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008ea3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011737728:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.336121:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c2c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.336124:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88013639aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1117:2004:x1805522257729536:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 55us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.336127:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914423 00010000:00010000:3.0:1721880422.336130:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c2c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.336131:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091a67180/0x8a60d30f571b82eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1183b4 expref: 1117 pid: 16096 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.336134:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.336137:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c2c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfbff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.336138:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.336139:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.336139:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011737728 00000100:00100000:2.0:1721880422.336141:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011737728 00010000:00010000:0.0:1721880422.336142:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727c2d6 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.336144:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c2c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfbff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.336146:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009bdc5c00/2, rc 0, transno 1052905 00000100:00100000:1.0:1721880422.336149:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009bdc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011734784:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.336150:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632234 00010000:00010000:3.0:1721880422.336151:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c2c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.336152:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2138:3689:x1805522011737728:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.336157:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aab600 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.336158:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091a67180/0x8a60d30f571b82eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1183b4 expref: 1116 pid: 16096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.336159:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c2c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfbff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.336160:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64517 count 1 00000100:00100000:1.0:1721880422.336162:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008ea3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011737984:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.336166:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c2c1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfbff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.336167:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727c2dd lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc05:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.336168:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091a67180/0x8a60d30f571b82eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1183b4 expref: 1116 pid: 16096 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.336170:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.336175:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a064af40/0x8a60d30f571b8a15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1185ac expref: 1116 pid: 16032 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.336176:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c2c1 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfbff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.336179:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b16ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011737856:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.336179:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.336179:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.336181:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727c2dd lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.336182:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c2c1 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfbff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.336183:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011737472:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.336191:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a064af40/0x8a60d30f571b8a15 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1185ac expref: 1116 pid: 16032 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.336195:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.336198:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.336198:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a064af40/0x8a60d30f571b8a15 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1185ac expref: 1116 pid: 16032 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.336204:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008c612a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011738112:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.336207:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011737984 00000100:00100000:0.0:1721880422.336209:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011737984 00000100:00100000:1.0:1721880422.336209:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1721880422.336213:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011737600:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.336217:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.336220:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011737472 00000100:00100000:0.0:1721880422.336222:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011737472 00000100:00100000:0.0:1721880422.336230:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632235 00000100:00100000:0.0:1721880422.336233:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2141:3689:x1805522011737984:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.336240:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1721880422.336241:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64518 count 1 00010000:00010000:0.0:1721880422.336247:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727c2e4 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc06:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.336258:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099da5440/0x8a60d30f571b8be3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc06:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11862a expref: 1116 pid: 16050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.336265:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.336266:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.336269:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727c2e4 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc06:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.336269:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011737600 00000100:00100000:1.0:1721880422.336272:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011737600 00000100:00100000:3.0:1721880422.336283:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bdc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2142:3686:x1805522011736448:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1430us (1464us total) trans 4296020202 rc 0/0 00000100:00100000:0.0:1721880422.336285:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632236 00000100:00100000:3.0:1721880422.336290:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632230 00000004:00080000:2.0:1721880422.336291:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009b16c380/2, rc 0, transno 1052906 00000100:00100000:0.0:1721880422.336292:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2142:3686:x1805522011737472:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.336294:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632237 00000100:00100000:1.0:1721880422.336297:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2142:3686:x1805522011737600:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.336298:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b16c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011736448:0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.336305:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64516 count 1 00002000:00080000:0.0:1721880422.336312:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64515 count 1 00010000:00010000:1.0:1721880422.336312:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c2eb lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc04:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.336320:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092ba7cc0/0x8a60d30f571b878a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc04:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1184fd expref: 1116 pid: 16048 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.336322:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c2f2 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc03:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.336323:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008c613100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011738240:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.336324:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.336325:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.336326:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c2eb lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc04:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.336337:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c321b00/0x8a60d30f571b8568 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118455 expref: 1116 pid: 16056 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.336337:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092ba7cc0/0x8a60d30f571b878a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc04:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1184fd expref: 1116 pid: 16048 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.336342:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092ba7cc0/0x8a60d30f571b878a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc04:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1184fd expref: 1116 pid: 16048 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.336343:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.336343:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.336344:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.336346:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c2f2 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.336349:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b146d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011738368:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.336357:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011738240 00010000:00010000:0.0:1721880422.336360:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c321b00/0x8a60d30f571b8568 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118455 expref: 1116 pid: 16056 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.336360:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011738240 00000100:00100000:1.0:1721880422.336366:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb000 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.336369:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c321b00/0x8a60d30f571b8568 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118455 expref: 1116 pid: 16056 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.336374:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632238 00000100:00100000:3.0:1721880422.336378:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c611500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2142:3686:x1805522011738240:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.336379:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b16fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011738496:192.168.201.24@tcp:104: 00002000:00080000:3.0:1721880422.336388:0:16088:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64519 count 1 00010000:00010000:3.0:1721880422.336397:0:16088:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c2f9 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc07:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.336407:0:16088:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a72c480/0x8a60d30f571b8d48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118693 expref: 1116 pid: 16053 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.336414:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.336415:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.336418:0:16088:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c2f9 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.336433:0:16088:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a72c480/0x8a60d30f571b8d48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118693 expref: 1116 pid: 16053 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.336447:0:16088:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a72c480/0x8a60d30f571b8d48 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118693 expref: 1116 pid: 16053 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.336456:0:16088:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880136398000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011738624:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.336464:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.336473:0:16088:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdece40 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.336487:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099da5440/0x8a60d30f571b8be3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc06:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11862a expref: 1116 pid: 16050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.336557:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099da5440/0x8a60d30f571b8be3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc06:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11862a expref: 1116 pid: 16050 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.336568:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b16d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011738752:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.336584:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d9ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011736960:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.336593:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727c2c8 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.336596:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e000 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.336613:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b16ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011737216:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.336688:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727c2cf lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.336698:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.336715:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257729664 00000100:00100000:3.0:1721880422.336718:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257729664 00000100:00100000:2.0:1721880422.336720:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.336744:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098bb0240/0x8a60d30f571b7e8b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118280 expref: 1117 pid: 16087 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.336747:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257729792 00000100:00100000:0.0:1721880422.336749:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008c612a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011738112:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.336750:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257729792 00010000:00010000:0.0:1721880422.336759:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727c2dd lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.336760:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f96df80/0x8a60d30f571b80c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11830c expref: 1118 pid: 16024 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.336760:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914424 00000100:00100000:3.0:1721880422.336764:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c611180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1118:2004:x1805522257729664:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.336771:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.336773:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914425 00010000:00010000:3.0:1721880422.336775:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098bb0240/0x8a60d30f571b7e8b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc00:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118280 expref: 1118 pid: 16087 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.336777:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801366a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1118:2004:x1805522257729792:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.336782:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.336785:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f96df80/0x8a60d30f571b80c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc01:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11830c expref: 1118 pid: 16024 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.336785:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098bb0240/0x8a60d30f571b7e8b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc00:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118280 expref: 1118 pid: 16087 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.336791:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f96df80/0x8a60d30f571b80c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc01:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11830c expref: 1118 pid: 16024 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.336796:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098bb0240/0x8a60d30f571b7e8b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc00:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118280 expref: 1118 pid: 16087 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.336799:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f96df80/0x8a60d30f571b80c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc01:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11830c expref: 1118 pid: 16024 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.336804:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.336805:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.336806:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.336807:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.336809:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727c2cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.336809:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727c2c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.336814:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727c2cf lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.336815:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727c2c8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.336826:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.336828:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.336838:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801366a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1116:2004:x1805522257729792:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 62us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.336843:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914425 00000100:00100000:3.0:1721880422.336844:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c611180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1116:2004:x1805522257729664:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 79us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.336850:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914424 00010000:00010000:0.0:1721880422.336865:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727c2cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.336874:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727c2cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.336881:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727c2cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.336888:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727c2cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.336893:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727c2c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.336895:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727c2cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.336899:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727c2c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.336903:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727c2c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.336910:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727c2c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.336914:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727c2c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.336917:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b7840 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.336919:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727c2c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.336923:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727c2c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.336929:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727c2c8 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.336932:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727c2c8 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.337009:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325df80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.337026:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727c2cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.337033:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2143:3686:x1805522011736832:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1483us (1562us total) trans 4296020203 rc 0/0 00010000:00010000:0.0:1721880422.337034:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727c2cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.337039:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632231 00000004:00080000:3.0:1721880422.337044:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d3d6300/2, rc 0, transno 1052907 00010000:00010000:0.0:1721880422.337045:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727c2cf lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.337046:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.337052:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727c2cf lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.337058:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d3d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011736832:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.337066:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b146d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011738368:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.337078:0:16088:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880136398000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011738624:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.337082:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c2eb lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc04:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.337086:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257730048 00000100:00100000:2.0:1721880422.337089:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257730048 00010000:00010000:3.0:1721880422.337091:0:16088:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c2f9 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.337098:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801366a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011738880:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.337101:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a064af40/0x8a60d30f571b8a15 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1185ac expref: 1115 pid: 16032 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.337113:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.337118:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914426 00000100:00100000:2.0:1721880422.337123:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129d23450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1115:2005:x1805522257730048:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.337131:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.337133:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011738880 00010000:00010000:2.0:1721880422.337134:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a064af40/0x8a60d30f571b8a15 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc05:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1185ac expref: 1115 pid: 16032 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.337136:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011738880 00010000:00010000:2.0:1721880422.337141:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a064af40/0x8a60d30f571b8a15 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc05:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1185ac expref: 1115 pid: 16032 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.337149:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a064af40/0x8a60d30f571b8a15 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc05:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1185ac expref: 1115 pid: 16032 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.337150:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632239 00000100:00100000:1.0:1721880422.337154:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2144:3687:x1805522011738880:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.337157:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.337158:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.337160:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727c2dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.337165:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64520 count 1 00010000:00010000:2.0:1721880422.337165:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727c2dd lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.337175:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c300 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc08:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.337175:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.337183:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727c2dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.337185:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c59b3c0/0x8a60d30f571b8f39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc08:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11872d expref: 1114 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.337189:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880129d23450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1114:2005:x1805522257730048:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 65us (144us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.337191:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.337191:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727c2dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.337192:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914426 00010000:00010000:1.0:1721880422.337193:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.337195:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c300 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc08:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.337197:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727c2dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.337204:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727c2dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.337207:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2144:3689:x1805522011737088:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1402us (1453us total) trans 4296020204 rc 0/0 00010000:00010000:1.0:1721880422.337209:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c59b3c0/0x8a60d30f571b8f39 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc08:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11872d expref: 1113 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.337213:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632232 00010000:00010000:1.0:1721880422.337215:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c59b3c0/0x8a60d30f571b8f39 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc08:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11872d expref: 1113 pid: 15453 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.337215:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727c2dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.337221:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353cc0 already unused, calling callback (ffffffffa084e330) 00000100:00100000:1.0:1721880422.337222:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b147b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011739008:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.337224:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727c2dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.337228:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.337230:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727c2dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.337234:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b16fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011738496:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.337236:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257729920 00000100:00100000:2.0:1721880422.337238:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257729920 00010000:00010000:3.0:1721880422.337239:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727c2dd lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.337241:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb000 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.337243:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c2f2 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.337245:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091a67180/0x8a60d30f571b82eb lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1183b4 expref: 1114 pid: 16096 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.337245:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727c2dd lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.337255:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b16ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011737856:192.168.201.24@tcp:104: 00000004:00080000:1.0:1721880422.337256:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009d9e9880/2, rc 0, transno 1052908 00010000:00010000:0.0:1721880422.337260:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727c2d6 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.337262:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d9e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011737088:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.337263:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914427 00000100:00100000:2.0:1721880422.337266:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801366a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1114:2004:x1805522257729920:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.337270:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.337273:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091a67180/0x8a60d30f571b82eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc02:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1183b4 expref: 1114 pid: 16096 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.337278:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091a67180/0x8a60d30f571b82eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc02:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1183b4 expref: 1114 pid: 16096 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.337280:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1721880422.337284:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b146300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011739136:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.337287:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091a67180/0x8a60d30f571b82eb lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc02:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1183b4 expref: 1114 pid: 16096 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.337296:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.337298:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.337299:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.337301:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727c2d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.337306:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011739136 00010000:00010000:2.0:1721880422.337306:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727c2d6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.337308:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011739136 00010000:00010000:2.0:1721880422.337314:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.337324:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727c2d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.337325:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632240 00000100:00100000:2.0:1721880422.337325:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801366a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1113:2004:x1805522257729920:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 58us (97us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.337328:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914427 00000100:00100000:0.0:1721880422.337329:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2145:3689:x1805522011739136:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.337329:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727c2d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.337333:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727c2d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.337337:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727c2d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1721880422.337338:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64521 count 1 00010000:00010000:1.0:1721880422.337340:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727c2d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.337343:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325cb40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.337345:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727c307 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc09:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.337345:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727c2d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.337349:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727c2d6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.337356:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d42f3c0/0x8a60d30f571b910e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1187b2 expref: 1112 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.337358:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727c2d6 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.337360:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.337361:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.337362:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727c2d6 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.337363:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727c307 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.337370:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.337372:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d42f3c0/0x8a60d30f571b910e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1187b2 expref: 1112 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.337378:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d42f3c0/0x8a60d30f571b910e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1187b2 expref: 1112 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.337378:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2145:3689:x1805522011737728:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1222us (1241us total) trans 4296020205 rc 0/0 00000100:00100000:2.0:1721880422.337381:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257730176 00000100:00100000:0.0:1721880422.337384:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b16ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011739264:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.337384:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257730176 00000100:00100000:3.0:1721880422.337384:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632234 00010000:00010000:2.0:1721880422.337395:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092ba7cc0/0x8a60d30f571b878a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc04:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1184fd expref: 1113 pid: 16048 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.337398:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.337410:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b16d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011738752:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.337411:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914428 00000100:00100000:2.0:1721880422.337416:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801366a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1113:2004:x1805522257730176:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.337417:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727c2e4 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc06:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.337423:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.337427:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092ba7cc0/0x8a60d30f571b878a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc04:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1184fd expref: 1113 pid: 16048 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.337435:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092ba7cc0/0x8a60d30f571b878a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc04:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1184fd expref: 1113 pid: 16048 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.337438:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801362d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2145:3689:x1805522011737344:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1339us (1429us total) trans 4296020206 rc 0/0 00000100:00100000:1.0:1721880422.337442:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632233 00010000:00010000:2.0:1721880422.337449:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092ba7cc0/0x8a60d30f571b878a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc04:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1184fd expref: 1113 pid: 16048 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.337457:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.337458:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.337460:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c2eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc04:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.337461:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008ea3ad80/2, rc 0, transno 1052909 00010000:00010000:2.0:1721880422.337464:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c2eb lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc04:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.337467:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008ea3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011737728:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1721880422.337471:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880076fdd180/2, rc 0, transno 1052910 00010000:00010000:2.0:1721880422.337474:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.337477:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011737344:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.337486:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801366a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1112:2004:x1805522257730176:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 70us (116us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.337487:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c2eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.337489:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914428 00010000:00010000:1.0:1721880422.337491:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c2eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.337496:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c2eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.337498:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1721880422.337500:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c2eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.337504:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b16d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011739392:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.337506:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c2eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.337506:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b16fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011739520:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.337510:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b46c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.337511:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c2eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.337515:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c2eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.337517:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.337520:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.337520:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c2eb lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.337524:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c2eb lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.337525:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257730432 00000100:00100000:2.0:1721880422.337527:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257730432 00010000:00010000:2.0:1721880422.337533:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a72c480/0x8a60d30f571b8d48 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118693 expref: 1112 pid: 16053 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.337537:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.337538:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011739392 00000100:00100000:0.0:1721880422.337540:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011739392 00000100:00100000:2.0:1721880422.337551:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914429 00000100:00100000:2.0:1721880422.337554:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1112:2004:x1805522257730432:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.337557:0:9458:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011739520 00010000:00010000:2.0:1721880422.337558:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1721880422.337559:0:9458:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011739520 00010000:00010000:2.0:1721880422.337560:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a72c480/0x8a60d30f571b8d48 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc07:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118693 expref: 1112 pid: 16053 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.337566:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632241 00010000:00010000:2.0:1721880422.337569:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a72c480/0x8a60d30f571b8d48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc07:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118693 expref: 1112 pid: 16053 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.337572:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b16ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2147:3688:x1805522011739392:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.337574:0:9458:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632242 00000100:00100000:0.0:1721880422.337577:0:9458:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136398000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2147:3686:x1805522011739520:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.337577:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a72c480/0x8a60d30f571b8d48 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc07:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118693 expref: 1112 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.337583:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00002000:00080000:3.0:1721880422.337583:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64522 count 1 00002000:00080000:0.0:1721880422.337585:0:9458:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64523 count 1 00010000:00010000:2.0:1721880422.337585:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.337586:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c2f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.337591:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c2f9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.337592:0:9458:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c315 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc0b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.337593:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2147:3686:x1805522011737600:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1294us (1353us total) trans 4296020207 rc 0/0 00010000:00010000:3.0:1721880422.337593:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c30e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc0a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.337596:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632237 00010000:00010000:2.0:1721880422.337599:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.337600:0:9458:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cb69d40/0x8a60d30f571b95a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118910 expref: 1111 pid: 10431 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.337604:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.337604:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099dde640/0x8a60d30f571b931b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc0a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118861 expref: 1111 pid: 16073 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.337605:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.337606:0:9458:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c315 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.337609:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1111:2004:x1805522257730432:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 53us (91us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.337610:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.337612:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.337613:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914429 00010000:00010000:3.0:1721880422.337614:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c30e lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc0a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.337616:0:9458:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cb69d40/0x8a60d30f571b95a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118910 expref: 1111 pid: 10431 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.337620:0:9458:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cb69d40/0x8a60d30f571b95a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118910 expref: 1110 pid: 10431 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.337626:0:9458:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b16df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011739648:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.337630:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099dde640/0x8a60d30f571b931b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc0a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118861 expref: 1110 pid: 16073 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.337638:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099dde640/0x8a60d30f571b931b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc0a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118861 expref: 1110 pid: 16073 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.337640:0:9458:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e000 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.337640:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.337647:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257730560 00000100:00100000:3.0:1721880422.337647:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880136398700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011739776:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.337649:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257730560 00010000:00010000:2.0:1721880422.337655:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099da5440/0x8a60d30f571b8be3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc06:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11862a expref: 1111 pid: 16050 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.337665:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914430 00000100:00100000:3.0:1721880422.337666:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdece40 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.337667:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1111:2004:x1805522257730560:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.337671:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.337673:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099da5440/0x8a60d30f571b8be3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc06:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11862a expref: 1111 pid: 16050 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.337678:0:16088:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c2f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.337679:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099da5440/0x8a60d30f571b8be3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc06:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11862a expref: 1111 pid: 16050 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.337685:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099da5440/0x8a60d30f571b8be3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc06:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11862a expref: 1111 pid: 16050 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.337685:0:16088:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c2f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.337691:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.337692:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.337692:0:16088:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c2f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.337693:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727c2e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc06:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.337698:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727c2e4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc06:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.337698:0:16088:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c2f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.337705:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.337705:0:16088:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c2f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.337710:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727c2e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.337711:0:16088:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aaba80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.337713:0:16088:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c2f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.337714:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1110:2004:x1805522257730560:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 47us (75us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.337715:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727c2e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.337718:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914430 00010000:00010000:0.0:1721880422.337720:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727c2e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.337720:0:16088:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c2f9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.337725:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727c2e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.337743:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727c2e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.337746:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325f840 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.337746:0:16088:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c2f9 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.337749:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727c2e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.337752:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727c2e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.337752:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c2f9 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.337759:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727c2e4 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.337762:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727c2e4 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.337788:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.337797:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257730304 00000100:00100000:2.0:1721880422.337799:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257730304 00010000:00010000:2.0:1721880422.337806:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c321b00/0x8a60d30f571b8568 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118455 expref: 1110 pid: 16056 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.337820:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914431 00000100:00100000:2.0:1721880422.337822:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135172680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1110:2005:x1805522257730304:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.337826:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.337828:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c321b00/0x8a60d30f571b8568 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc03:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118455 expref: 1110 pid: 16056 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.337834:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c321b00/0x8a60d30f571b8568 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc03:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118455 expref: 1110 pid: 16056 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.337841:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c321b00/0x8a60d30f571b8568 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc03:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118455 expref: 1110 pid: 16056 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.337845:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c611500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2148:3686:x1805522011738240:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1466us (1501us total) trans 4296020208 rc 0/0 00010000:00010000:2.0:1721880422.337849:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.337850:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.337851:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632238 00010000:00010000:2.0:1721880422.337852:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c2f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.337856:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c2f2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.337864:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.337871:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c2f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.337872:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008c613100/2, rc 0, transno 1052912 00000100:00100000:2.0:1721880422.337874:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135172680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1109:2005:x1805522257730304:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 51us (87us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.337875:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c2f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.337878:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914431 00010000:00010000:1.0:1721880422.337880:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c2f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.337885:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c2f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.337888:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c2f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.337888:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008c613100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011738240:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.337890:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2147:3689:x1805522011737984:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1654us (1717us total) trans 4296020209 rc 0/0 00010000:00010000:1.0:1721880422.337891:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325ed00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.337893:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c2f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.337895:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632235 00010000:00010000:1.0:1721880422.337897:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c2f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.337897:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012f09ca80/2, rc 0, transno 1052911 00000100:00100000:3.0:1721880422.337900:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f09ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011737600:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.337902:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c2f2 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.337906:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c2f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.337930:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1721880422.337936:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b16ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011739904:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.337938:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b16f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011740032:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.337955:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.337965:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011739904 00000100:00100000:0.0:1721880422.337968:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011739904 00000100:00100000:1.0:1721880422.337981:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2148:3686:x1805522011737472:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1690us (1782us total) trans 4296020210 rc 0/0 00000100:00100000:0.0:1721880422.337984:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632243 00000100:00100000:1.0:1721880422.337988:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632236 00000004:00080000:3.0:1721880422.337988:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012f09ea00/2, rc 0, transno 1052914 00000100:00100000:0.0:1721880422.337990:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013639aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2148:3686:x1805522011739904:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.337995:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f09ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011737472:0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.338000:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64524 count 1 00000004:00080000:1.0:1721880422.338010:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008ea3b800/2, rc 0, transno 1052913 00010000:00010000:0.0:1721880422.338021:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c31c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc0c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.338026:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008ea3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011737984:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.338030:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801361a7840/0x8a60d30f571b96fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc0c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118987 expref: 1108 pid: 16053 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.338034:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.338035:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1721880422.338035:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880125a15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011740160:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.338037:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c31c lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc0c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.338048:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880125a17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011740288:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.338049:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801361a7840/0x8a60d30f571b96fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc0c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118987 expref: 1108 pid: 16053 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.338049:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.338054:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801361a7840/0x8a60d30f571b96fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc0c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118987 expref: 1108 pid: 16053 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.338060:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b16d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011740416:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.338062:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011740160 00000100:00100000:1.0:1721880422.338064:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011740160 00000100:00100000:3.0:1721880422.338064:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.338075:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011740288 00000100:00100000:1.0:1721880422.338076:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011740288 00000100:00100000:0.0:1721880422.338078:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.338080:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632244 00000100:00100000:2.0:1721880422.338085:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2149:3689:x1805522011740160:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.338089:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.338090:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632245 00000100:00100000:1.0:1721880422.338093:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013639bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2149:3686:x1805522011740288:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.338097:0:16088:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64526 count 1 00002000:00080000:1.0:1721880422.338101:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64527 count 1 00000100:00100000:0.0:1721880422.338108:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011740032 00010000:00010000:1.0:1721880422.338108:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727c32a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc0f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.338108:0:16088:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727c323 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc0e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.338111:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011740032 00010000:00010000:1.0:1721880422.338114:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6b840/0x8a60d30f571b9e19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118b86 expref: 1108 pid: 16053 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.338118:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.338119:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.338120:0:16088:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a06098c0/0x8a60d30f571b9ba3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc0e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118ad7 expref: 1108 pid: 16073 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.338121:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727c32a lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.338122:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632246 00000100:00100000:0.0:1721880422.338126:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c611180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2150:3688:x1805522011740032:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.338126:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.338127:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.338130:0:16088:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727c323 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc0e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.338131:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cb6b840/0x8a60d30f571b9e19 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118b86 expref: 1108 pid: 16053 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1721880422.338133:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64525 count 1 00010000:00010000:1.0:1721880422.338136:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cb6b840/0x8a60d30f571b9e19 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118b86 expref: 1108 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.338140:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c331 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc0d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.338142:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88011f820700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011740544:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.338147:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801202a46c0/0x8a60d30f571b990a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc0d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118a21 expref: 1108 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.338147:0:16088:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a06098c0/0x8a60d30f571b9ba3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc0e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118ad7 expref: 1108 pid: 16073 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.338151:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.338152:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.338153:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c331 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc0d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.338156:0:16088:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a06098c0/0x8a60d30f571b9ba3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc0e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118ad7 expref: 1108 pid: 16073 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.338157:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb900 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.338163:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801202a46c0/0x8a60d30f571b990a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc0d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118a21 expref: 1108 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.338164:0:16088:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba65f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011740672:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.338171:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801202a46c0/0x8a60d30f571b990a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc0d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118a21 expref: 1108 pid: 15453 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.338180:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008c612a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011740800:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.338180:0:16088:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde000 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.338198:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e780 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.338804:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.338820:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.338831:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b16ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011739264:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.338841:0:9458:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b16df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011739648:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.338841:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727c307 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.338845:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257730688 00000100:00100000:1.0:1721880422.338849:0:15444:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257730816 00000100:00100000:3.0:1721880422.338849:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257730688 00010000:00010000:0.0:1721880422.338854:0:9458:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c315 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.338854:0:15444:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257730816 00010000:00010000:3.0:1721880422.338862:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c59b3c0/0x8a60d30f571b8f39 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc08:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11872d expref: 1110 pid: 15453 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.338867:0:15444:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d42f3c0/0x8a60d30f571b910e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1187b2 expref: 1110 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.338879:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914432 00000100:00100000:3.0:1721880422.338883:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d040e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1110:2004:x1805522257730688:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.338886:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914433 00010000:00010000:3.0:1721880422.338890:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.338892:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129d22850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1110:2004:x1805522257730816:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.338894:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c59b3c0/0x8a60d30f571b8f39 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc08:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11872d expref: 1110 pid: 15453 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.338899:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.338903:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c59b3c0/0x8a60d30f571b8f39 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc08:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11872d expref: 1110 pid: 15453 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.338904:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d42f3c0/0x8a60d30f571b910e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc09:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1187b2 expref: 1110 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.338913:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d42f3c0/0x8a60d30f571b910e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc09:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1187b2 expref: 1110 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.338913:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.338915:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.338917:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c300 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc08:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.338924:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c300 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc08:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.338925:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d42f3c0/0x8a60d30f571b910e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc09:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1187b2 expref: 1110 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.338938:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.338939:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.338939:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.338942:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727c307 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.338949:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727c307 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.338958:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d040e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1109:2004:x1805522257730688:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 74us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.338964:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914432 00010000:00010000:1.0:1721880422.338975:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.338980:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727c307 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.338988:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880136398700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011739776:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.338992:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727c307 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.338996:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880129d22850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1108:2004:x1805522257730816:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 104us (174us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.338999:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c30e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc0a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.339000:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727c307 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.339003:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914433 00010000:00010000:2.0:1721880422.339007:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727c307 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.339028:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727c307 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.339034:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325e1c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.339037:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727c307 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.339043:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727c307 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.339052:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727c307 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.339057:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727c307 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.339077:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c59b3c0/0x8a60d30f571b8f39 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc08:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11872d expref: 1107 pid: 15453 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.339087:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b147b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011739008:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.339099:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c300 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.339106:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c300 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.339112:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c300 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.339119:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c300 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.339125:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c300 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.339132:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c300 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.339137:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b7cc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.339140:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c300 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.339147:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c300 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.339156:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c300 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.339162:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c300 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.339173:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2151:3689:x1805522011739136:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1841us (1874us total) trans 4296020211 rc 0/0 00000100:00100000:2.0:1721880422.339180:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632240 00000004:00080000:0.0:1721880422.339191:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009b146300/2, rc 0, transno 1052915 00000100:00100000:0.0:1721880422.339203:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b146300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011739136:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.339250:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1721880422.339257:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880136398700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011740928:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.339272:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.339284:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.339286:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2151:3687:x1805522011738880:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2128us (2169us total) trans 4296020212 rc 0/0 00000100:00100000:1.0:1721880422.339294:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632239 00000100:00100000:0.0:1721880422.339301:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.339301:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011740928 00000100:00100000:2.0:1721880422.339305:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011740928 00000100:00100000:1.0:1721880422.339314:0:15444:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257730944 00000100:00100000:3.0:1721880422.339317:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257731072 00000100:00100000:1.0:1721880422.339318:0:15444:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257730944 00000100:00100000:3.0:1721880422.339320:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257731072 00000100:00100000:2.0:1721880422.339322:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632247 00000100:00100000:2.0:1721880422.339326:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f940050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2151:3686:x1805522011740928:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.339329:0:15444:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb69d40/0x8a60d30f571b95a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118910 expref: 1108 pid: 10431 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.339330:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099dde640/0x8a60d30f571b931b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc0a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118861 expref: 1108 pid: 16073 timeout: 887 lvb_type: 0 00002000:00080000:2.0:1721880422.339337:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64528 count 1 00000100:00100000:0.0:1721880422.339348:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.339362:0:15444:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257731200 00000100:00100000:1.0:1721880422.339365:0:15444:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257731200 00000100:00100000:0.0:1721880422.339367:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.339367:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914434 00000100:00100000:2.0:1721880422.339372:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d042a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1109:2005:x1805522257730944:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.339373:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914435 00010000:00010000:1.0:1721880422.339374:0:15444:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801361a7840/0x8a60d30f571b96fd lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc0c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118987 expref: 1109 pid: 16053 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.339378:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.339378:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.339378:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d042680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1109:2005:x1805522257731072:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.339381:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cb69d40/0x8a60d30f571b95a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc0b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118910 expref: 1109 pid: 10431 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.339385:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.339388:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cb69d40/0x8a60d30f571b95a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc0b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118910 expref: 1109 pid: 10431 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.339389:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099dde640/0x8a60d30f571b931b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc0a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118861 expref: 1109 pid: 16073 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.339390:0:15444:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257731456 00000100:00100000:1.0:1721880422.339392:0:15444:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257731456 00010000:00010000:3.0:1721880422.339398:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099dde640/0x8a60d30f571b931b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc0a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118861 expref: 1110 pid: 16073 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.339399:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cb69d40/0x8a60d30f571b95a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc0b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118910 expref: 1110 pid: 10431 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.339400:0:15444:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a06098c0/0x8a60d30f571b9ba3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc0e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118ad7 expref: 1110 pid: 16073 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.339403:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.339408:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.339410:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.339412:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c315 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.339413:0:15444:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257731328 00000100:00100000:1.0:1721880422.339415:0:15444:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257731328 00000100:00100000:0.0:1721880422.339416:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257731584 00000100:00100000:0.0:1721880422.339419:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257731584 00010000:00010000:2.0:1721880422.339420:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c315 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.339423:0:15444:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb6b840/0x8a60d30f571b9e19 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118b86 expref: 1111 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.339427:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099dde640/0x8a60d30f571b931b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc0a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118861 expref: 1111 pid: 16073 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.339429:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801202a46c0/0x8a60d30f571b990a lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc0d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118a21 expref: 1111 pid: 15453 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.339437:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.339439:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1721880422.339440:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914436 00010000:00010000:2.0:1721880422.339441:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.339442:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c30e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc0a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.339444:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d040e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1110:2004:x1805522257731200:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.339446:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914437 00010000:00010000:3.0:1721880422.339448:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c30e lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc0a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.339450:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087747b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1110:2004:x1805522257731456:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.339451:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.339455:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.339456:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801361a7840/0x8a60d30f571b96fd lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc0c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118987 expref: 1110 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.339458:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a06098c0/0x8a60d30f571b9ba3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc0e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118ad7 expref: 1110 pid: 16073 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.339461:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.339462:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d042a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1110:2005:x1805522257730944:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 89us (190us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.339464:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801361a7840/0x8a60d30f571b96fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc0c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118987 expref: 1110 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.339465:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a06098c0/0x8a60d30f571b9ba3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc0e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118ad7 expref: 1110 pid: 16073 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.339468:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914434 00010000:00010000:0.0:1721880422.339475:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.339476:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.339476:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.339476:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d042680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1110:2005:x1805522257731072:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 97us (175us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.339478:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727c323 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc0e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.339478:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.339481:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c31c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc0c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.339482:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914435 00010000:00010000:0.0:1721880422.339483:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727c323 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc0e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.339487:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c31c lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc0c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.339487:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914438 00010000:00010000:0.0:1721880422.339490:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.339491:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087745180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1108:2005:x1805522257731328:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.339495:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914439 00010000:00010000:1.0:1721880422.339497:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.339498:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.339499:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087746a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1108:2005:x1805522257731584:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.339502:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cb6b840/0x8a60d30f571b9e19 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc0f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118b86 expref: 1108 pid: 16053 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.339504:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087747b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1108:2004:x1805522257731456:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 53us (136us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.339506:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1721880422.339507:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914437 00010000:00010000:3.0:1721880422.339510:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801202a46c0/0x8a60d30f571b990a lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc0d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118a21 expref: 1108 pid: 15453 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.339511:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cb6b840/0x8a60d30f571b9e19 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc0f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118b86 expref: 1108 pid: 16053 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.339515:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d040e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1107:2004:x1805522257731200:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 70us (166us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.339520:0:9458:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c315 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.339520:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801202a46c0/0x8a60d30f571b990a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc0d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118a21 expref: 1107 pid: 15453 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.339521:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914436 00010000:00010000:2.0:1721880422.339521:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.339522:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.339525:0:9458:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c315 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.339525:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727c32a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc0f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.339529:0:9458:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c315 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.339529:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.339531:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727c32a lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc0f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.339531:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.339533:0:9458:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c315 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.339534:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c331 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc0d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.339536:0:9458:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c315 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.339539:0:9458:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325dd40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.339540:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.339540:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c331 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc0d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.339541:0:9458:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c315 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.339548:0:9458:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c315 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.339548:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.339552:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087745180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1106:2005:x1805522257731328:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 61us (174us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.339554:0:9458:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c315 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.339557:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c315 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.339557:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cb6b840/0x8a60d30f571b9e19 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118b86 expref: 1106 pid: 16053 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.339558:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914438 00000100:00100000:3.0:1721880422.339560:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087746a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1106:2005:x1805522257731584:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 60us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.339565:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914439 00000100:00100000:1.0:1721880422.339567:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88011f820700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011740544:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.339579:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727c32a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.339585:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c338 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc10:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.339586:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727c32a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.339588:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c30e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.339591:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727c32a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.339593:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bb59d40/0x8a60d30f571ba07a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118c2e expref: 1103 pid: 16083 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.339595:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c30e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.339597:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.339598:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727c32a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.339598:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.339599:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c338 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.339601:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c30e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.339604:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727c32a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.339608:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c30e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.339611:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727c32a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.339611:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bb59d40/0x8a60d30f571ba07a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118c2e expref: 1103 pid: 16083 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.339614:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c30e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.339616:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4900 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.339618:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727c32a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.339618:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bb59d40/0x8a60d30f571ba07a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118c2e expref: 1103 pid: 16083 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.339619:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aaa400 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.339622:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c30e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.339624:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727c32a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.339624:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba64000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011741056:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.339630:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c30e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.339633:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727c32a lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.339638:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c30e lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.339639:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.339642:0:9458:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880136398000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2152:3686:x1805522011739520:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2063us (2105us total) trans 4296020213 rc 0/0 00010000:00010000:1.0:1721880422.339644:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727c32a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.339644:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c30e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.339646:0:9458:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632242 00010000:00010000:2.0:1721880422.339653:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a06098c0/0x8a60d30f571b9ba3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc0e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118ad7 expref: 1103 pid: 16073 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.339661:0:16088:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012ba65f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011740672:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.339665:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801202a46c0/0x8a60d30f571b990a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc0d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118a21 expref: 1102 pid: 15453 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.339669:0:16088:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727c323 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.339674:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008c612a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011740800:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.339674:0:16088:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727c323 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.339679:0:16088:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727c323 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.339682:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c331 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.339683:0:16088:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727c323 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.339687:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c331 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.339687:0:16088:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727c323 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.339690:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c331 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.339690:0:16088:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727c323 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.339694:0:16088:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352f40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.339695:0:16088:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727c323 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.339698:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c331 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.339699:0:16088:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727c323 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.339702:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c331 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.339704:0:16088:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727c323 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.339705:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c331 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.339708:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727c323 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.339709:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325c6c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.339710:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c331 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.339714:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c331 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.339719:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c331 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.339723:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c331 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.339787:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b16ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2155:3688:x1805522011739392:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2214us (2264us total) trans 4296020214 rc 0/0 00000100:00100000:3.0:1721880422.339793:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632241 00000100:00100000:0.0:1721880422.339820:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c611180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2154:3688:x1805522011740032:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1692us (1729us total) trans 4296020217 rc 0/0 00000100:00100000:2.0:1721880422.339820:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2154:3689:x1805522011740160:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1734us (1769us total) trans 4296020216 rc 0/0 00000004:00080000:3.0:1721880422.339823:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009b16f100/2, rc 0, transno 1052921 00000100:00100000:0.0:1721880422.339824:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632246 00000100:00100000:2.0:1721880422.339827:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632244 00000100:00100000:3.0:1721880422.339829:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b16f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011740032:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1721880422.339847:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801366a3b80/2, rc 0, transno 1052916 00000004:00080000:2.0:1721880422.339848:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880125a15880/2, rc 0, transno 1052920 00000004:00080000:3.0:1721880422.339854:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009b16d880/2, rc 0, transno 1052918 00000100:00100000:0.0:1721880422.339861:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801366a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011738880:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.339861:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880125a15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011740160:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.339864:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b16d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011739392:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.339867:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1721880422.339871:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880136399500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011741184:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.339876:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801361a7840/0x8a60d30f571b96fd lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc0c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118987 expref: 1101 pid: 16053 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.339884:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b16d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011740416:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.339884:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.339893:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c31c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.339893:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880136399f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011741312:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.339897:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c31c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.339901:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c31c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.339902:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.339905:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c31c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.339907:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011741440:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.339908:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c31c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.339912:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c31c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.339915:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325e400 already unused, calling callback (ffffffffa084e330) 00000100:00100000:2.0:1721880422.339915:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011741184 00010000:00010000:0.0:1721880422.339917:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c31c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.339917:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011741184 00000100:00100000:3.0:1721880422.339926:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.339927:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011741312 00010000:00010000:0.0:1721880422.339928:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c31c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.339928:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011741312 00000100:00100000:2.0:1721880422.339934:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011741440 00000100:00100000:2.0:1721880422.339936:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011741440 00010000:00010000:0.0:1721880422.339938:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c31c lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.339942:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009b16fb80/2, rc 0, transno 1052917 00000100:00100000:2.0:1721880422.339943:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632248 00010000:00010000:0.0:1721880422.339944:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c31c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.339945:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2155:3689:x1805522011741184:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.339948:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b16fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011739520:0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.339953:0:16088:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64529 count 1 00010000:00010000:2.0:1721880422.339961:0:16088:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727c33f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.339968:0:16088:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a05ed680/0x8a60d30f571ba2e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118cb3 expref: 1100 pid: 15467 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.339969:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800920a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011741696:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.339973:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.339974:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.339975:0:16088:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727c33f lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.339984:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.339988:0:16088:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a05ed680/0x8a60d30f571ba2e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118cb3 expref: 1100 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.339994:0:16088:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a05ed680/0x8a60d30f571ba2e9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118cb3 expref: 1100 pid: 15467 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.339999:0:16088:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b16df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011741824:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.340000:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88013639bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2156:3686:x1805522011740288:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1904us (1934us total) trans 4296020215 rc 0/0 00000004:00080000:3.0:1721880422.340003:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880125a17480/2, rc 0, transno 1052919 00000100:00100000:1.0:1721880422.340007:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632245 00000100:00100000:3.0:1721880422.340007:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880125a17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011740288:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.340027:0:16088:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde000 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.340033:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011741696 00000100:00100000:1.0:1721880422.340037:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011741696 00000100:00100000:2.0:1721880422.340039:0:9458:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632249 00000100:00100000:2.0:1721880422.340042:0:9458:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b16d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2156:3689:x1805522011741312:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.340043:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1721880422.340049:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800920aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011741952:0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.340050:0:9458:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64530 count 1 00000100:00100000:1.0:1721880422.340053:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632250 00000100:00100000:0.0:1721880422.340055:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88013639aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2156:3686:x1805522011739904:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2065us (2099us total) trans 4296020218 rc 0/0 00010000:00010000:2.0:1721880422.340057:0:9458:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c346 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.340058:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2156:3686:x1805522011741440:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.340060:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632243 00010000:00010000:2.0:1721880422.340064:0:9458:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096165b00/0x8a60d30f571ba504 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118d62 expref: 1100 pid: 16053 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.340066:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.340069:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.340070:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1721880422.340071:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011741952 00002000:00080000:1.0:1721880422.340071:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64531 count 1 00010000:00010000:2.0:1721880422.340071:0:9458:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c346 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.340074:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011741952 00010000:00010000:2.0:1721880422.340080:0:9458:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096165b00/0x8a60d30f571ba504 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118d62 expref: 1100 pid: 16053 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.340081:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c34d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.340085:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632251 00010000:00010000:2.0:1721880422.340089:0:9458:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096165b00/0x8a60d30f571ba504 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118d62 expref: 1100 pid: 16053 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.340090:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632252 00010000:00010000:1.0:1721880422.340091:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009da70b40/0x8a60d30f571ba726 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118df5 expref: 1100 pid: 15487 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.340091:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2156:3688:x1805522011741696:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.340093:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2156:3688:x1805522011741952:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.340094:0:9458:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b16ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011742080:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.340097:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.340099:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00002000:00080000:0.0:1721880422.340101:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64534 count 1 00010000:00010000:1.0:1721880422.340101:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c34d lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.340103:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64533 count 1 00000100:00100000:2.0:1721880422.340105:0:9458:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdecc0 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.340108:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727c354 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.340112:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727c35b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.340115:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008cc1b3c0/0x8a60d30f571bad4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118fdf expref: 1100 pid: 16129 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.340117:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009da70b40/0x8a60d30f571ba726 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118df5 expref: 1100 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.340119:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.340120:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.340122:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727c354 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.340123:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009703dd40/0x8a60d30f571bab9b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118f45 expref: 1100 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.340127:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009da70b40/0x8a60d30f571ba726 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118df5 expref: 1100 pid: 15487 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.340130:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.340131:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.340133:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727c35b lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.340134:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008cc1b3c0/0x8a60d30f571bad4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118fdf expref: 1100 pid: 16129 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.340137:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88011f820700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011742208:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.340141:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008cc1b3c0/0x8a60d30f571bad4d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118fdf expref: 1100 pid: 16129 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.340147:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009703dd40/0x8a60d30f571bab9b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118f45 expref: 1100 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.340148:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880087745500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011742336:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.340155:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009703dd40/0x8a60d30f571bab9b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118f45 expref: 1100 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.340158:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb900 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.340162:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.340165:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800920a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011742464:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.340173:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011741568:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.340183:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdece40 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.340190:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.340201:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011741568 00000100:00100000:3.0:1721880422.340204:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011741568 00000100:00100000:0.0:1721880422.340219:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632253 00000100:00100000:0.0:1721880422.340225:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087746d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2157:3687:x1805522011741568:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.340236:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64532 count 1 00000004:00080000:3.0:1721880422.340240:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009b16ce00/2, rc 0, transno 1052922 00000100:00100000:3.0:1721880422.340246:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b16ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011739904:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.340247:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c362 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.340258:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d95680/0x8a60d30f571ba980 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118eab expref: 1100 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.340264:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.340266:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.340268:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c362 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.340285:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d95680/0x8a60d30f571ba980 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118eab expref: 1100 pid: 15467 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.340287:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007ea17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011742592:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.340295:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d95680/0x8a60d30f571ba980 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118eab expref: 1100 pid: 15467 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.340302:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880087746680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011742720:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.340304:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.340321:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e780 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.340323:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011742592 00000100:00100000:2.0:1721880422.340327:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011742592 00000100:00100000:2.0:1721880422.340346:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632254 00000100:00100000:2.0:1721880422.340351:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2158:3686:x1805522011742592:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.340362:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64535 count 1 00010000:00010000:2.0:1721880422.340373:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c369 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.340384:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0eb21c0/0x8a60d30f571baf3e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11906b expref: 1100 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.340390:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.340391:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.340393:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c369 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.340407:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0eb21c0/0x8a60d30f571baf3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11906b expref: 1100 pid: 15467 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.340414:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0eb21c0/0x8a60d30f571baf3e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11906b expref: 1100 pid: 15467 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.340427:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007ea15c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011742848:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.340448:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.341270:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012ba64000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011741056:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.341283:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c338 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.341296:0:16088:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b16df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011741824:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.341303:0:9458:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b16ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011742080:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.341310:0:9458:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c346 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.341314:0:16088:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727c33f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.341347:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.341348:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88011f820700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011742208:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.341359:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.341361:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c34d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.341365:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257731712 00000100:00100000:3.0:1721880422.341368:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257731712 00000100:00100000:0.0:1721880422.341370:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.341375:0:16188:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257731968 00000100:00100000:2.0:1721880422.341378:0:16188:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257731968 00000100:00100000:0.0:1721880422.341379:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.341379:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb59d40/0x8a60d30f571ba07a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118c2e expref: 1101 pid: 16083 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.341388:0:16188:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096165b00/0x8a60d30f571ba504 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118d62 expref: 1102 pid: 16053 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.341392:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257731840 00000100:00100000:3.0:1721880422.341394:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257731840 00000100:00100000:2.0:1721880422.341400:0:16188:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257732096 00000100:00100000:2.0:1721880422.341401:0:16188:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257732096 00010000:00010000:3.0:1721880422.341401:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a05ed680/0x8a60d30f571ba2e9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118cb3 expref: 1103 pid: 15467 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.341407:0:16188:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009da70b40/0x8a60d30f571ba726 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118df5 expref: 1104 pid: 15487 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.341410:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880087745500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011742336:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.341413:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914440 00000100:00100000:0.0:1721880422.341414:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.341417:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ab4d4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1104:2004:x1805522257731712:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.341426:0:16188:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257732352 00000100:00100000:2.0:1721880422.341427:0:16188:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257732352 00000100:00100000:0.0:1721880422.341430:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.341430:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727c354 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.341430:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.341433:0:16188:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009703dd40/0x8a60d30f571bab9b lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118f45 expref: 1105 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.341433:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bb59d40/0x8a60d30f571ba07a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118c2e expref: 1105 pid: 16083 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.341439:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bb59d40/0x8a60d30f571ba07a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118c2e expref: 1105 pid: 16083 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.341441:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257732224 00000100:00100000:0.0:1721880422.341444:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257732224 00000100:00100000:1.0:1721880422.341451:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914441 00010000:00010000:3.0:1721880422.341452:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bb59d40/0x8a60d30f571ba07a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118c2e expref: 1106 pid: 16083 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.341454:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008cc1b3c0/0x8a60d30f571bad4d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118fdf expref: 1106 pid: 16129 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.341456:0:16188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914442 00000100:00100000:1.0:1721880422.341457:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087744000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+1105:2004:x1805522257731968:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.341459:0:16188:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087745c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+1105:2004:x1805522257731840:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.341460:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.341461:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.341463:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c338 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.341466:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914443 00010000:00010000:1.0:1721880422.341466:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.341468:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c338 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.341469:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c612a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1105:2004:x1805522257732096:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.341471:0:16188:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.341472:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096165b00/0x8a60d30f571ba504 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118d62 expref: 1105 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.341475:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.341475:0:16188:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a05ed680/0x8a60d30f571ba2e9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118cb3 expref: 1105 pid: 15467 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.341478:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009da70b40/0x8a60d30f571ba726 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118df5 expref: 1105 pid: 15487 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.341481:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096165b00/0x8a60d30f571ba504 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118d62 expref: 1105 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.341482:0:16188:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a05ed680/0x8a60d30f571ba2e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118cb3 expref: 1105 pid: 15467 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.341483:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.341484:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009da70b40/0x8a60d30f571ba726 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118df5 expref: 1105 pid: 15487 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.341492:0:16188:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a05ed680/0x8a60d30f571ba2e9 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118cb3 expref: 1105 pid: 15467 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.341494:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096165b00/0x8a60d30f571ba504 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118d62 expref: 1105 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.341497:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009da70b40/0x8a60d30f571ba726 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118df5 expref: 1104 pid: 15487 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.341502:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.341503:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.341504:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.341505:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.341505:0:16188:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727c33f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.341506:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.341506:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.341508:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c34d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.341508:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ab4d4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1102:2004:x1805522257731712:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 89us (161us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.341509:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c346 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.341509:0:16188:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727c33f lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.341513:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c34d lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.341514:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914440 00010000:00010000:1.0:1721880422.341516:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c346 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.341519:0:16188:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.341522:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.341532:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.341533:0:16188:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087745c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+1101:2004:x1805522257731840:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 73us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.341534:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c612a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1101:2004:x1805522257732096:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 64us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.341537:0:16188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914442 00000100:00100000:0.0:1721880422.341539:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914443 00000100:00100000:2.0:1721880422.341548:0:16188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914444 00000100:00100000:0.0:1721880422.341551:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914445 00000100:00100000:2.0:1721880422.341551:0:16188:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800953c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+1099:2005:x1805522257732352:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.341552:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087744000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+1099:2004:x1805522257731968:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 94us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.341554:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800953c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1099:2005:x1805522257732224:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.341556:0:16188:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.341558:0:16188:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009703dd40/0x8a60d30f571bab9b lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118f45 expref: 1099 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.341559:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.341559:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914441 00010000:00010000:0.0:1721880422.341561:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008cc1b3c0/0x8a60d30f571bad4d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118fdf expref: 1099 pid: 16129 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.341564:0:16188:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009703dd40/0x8a60d30f571bab9b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118f45 expref: 1099 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.341567:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008cc1b3c0/0x8a60d30f571bad4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118fdf expref: 1099 pid: 16129 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.341571:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.341571:0:16088:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727c33f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.341572:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.341574:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008cc1b3c0/0x8a60d30f571bad4d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118fdf expref: 1098 pid: 16129 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.341574:0:16188:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727c35b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.341578:0:16188:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727c35b lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.341578:0:16088:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727c33f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.341582:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.341583:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.341583:0:16188:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.341584:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727c354 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.341584:0:16088:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727c33f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.341586:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c34d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.341589:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727c354 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.341590:0:16088:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727c33f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.341591:0:16188:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800953c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+1097:2005:x1805522257732352:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 40us (178us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.341594:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.341594:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c34d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.341595:0:16188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914444 00010000:00010000:3.0:1721880422.341600:0:16088:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727c33f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.341601:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800953c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1096:2005:x1805522257732224:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 46us (171us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.341601:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c34d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.341604:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914445 00010000:00010000:3.0:1721880422.341605:0:16088:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350b40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.341607:0:16088:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727c33f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.341608:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c34d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.341610:0:9458:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c346 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.341613:0:16088:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727c33f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.341615:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c34d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.341615:0:9458:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c346 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.341620:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b6d00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.341620:0:9458:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c346 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.341622:0:16088:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727c33f lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.341623:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c34d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.341624:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880087746680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011742720:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.341624:0:9458:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c346 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.341627:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727c33f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.341629:0:9458:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c346 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.341630:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c34d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.341632:0:9458:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350fc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.341633:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c362 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.341634:0:9458:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c346 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.341637:0:9458:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c346 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.341639:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c34d lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.341643:0:9458:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c346 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.341645:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c34d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.341646:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c346 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.341669:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.341675:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257732480 00000100:00100000:0.0:1721880422.341677:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257732480 00010000:00010000:0.0:1721880422.341684:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d95680/0x8a60d30f571ba980 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118eab expref: 1096 pid: 15467 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.341687:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c338 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.341692:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c338 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.341694:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914446 00010000:00010000:2.0:1721880422.341696:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c338 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.341697:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800953c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1096:2005:x1805522257732480:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.341701:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.341701:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c338 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.341704:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d95680/0x8a60d30f571ba980 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118eab expref: 1096 pid: 15467 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.341705:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c338 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.341708:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352640 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.341709:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d95680/0x8a60d30f571ba980 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118eab expref: 1096 pid: 15467 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.341709:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c338 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.341713:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c338 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.341716:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d95680/0x8a60d30f571ba980 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118eab expref: 1096 pid: 15467 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.341718:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c338 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.341721:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c338 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.341722:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.341722:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.341724:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c362 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.341745:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c362 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.341754:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.341764:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800953c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1095:2005:x1805522257732480:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 67us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.341769:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914446 00000100:00100000:3.0:1721880422.341769:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2162:3689:x1805522011741184:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1821us (1883us total) trans 4296020219 rc 0/0 00000100:00100000:3.0:1721880422.341776:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632248 00010000:00010000:0.0:1721880422.341781:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c362 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.341783:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2162:3686:x1805522011741440:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1723us (1855us total) trans 4296020221 rc 0/0 00010000:00010000:0.0:1721880422.341786:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c362 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.341789:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632250 00010000:00010000:0.0:1721880422.341790:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c362 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.341795:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c362 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.341799:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c362 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.341802:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325d8c0 already unused, calling callback (ffffffffa084e330) 00000004:00080000:3.0:1721880422.341802:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880136399500/2, rc 0, transno 1052923 00010000:00010000:0.0:1721880422.341803:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c362 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.341807:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c362 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.341808:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880136399500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011741184:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.341812:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c362 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.341814:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122c7d880/2, rc 0, transno 1052925 00010000:00010000:0.0:1721880422.341816:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c362 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.341819:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011741440:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.341827:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f940050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2160:3686:x1805522011740928:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2499us (2542us total) trans 4296020222 rc 0/0 00000004:00080000:1.0:1721880422.341829:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880136398700/2, rc 0, transno 1052926 00000100:00100000:1.0:1721880422.341833:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880136398700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011740928:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.341834:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632247 00000100:00100000:1.0:1721880422.341837:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1721880422.341844:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800920aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011742976:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.341847:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d042a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011743104:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.341865:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.341868:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011743232:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.341883:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011742976 00000100:00100000:3.0:1721880422.341884:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.341886:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011742976 00000100:00100000:0.0:1721880422.341896:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087746d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2161:3687:x1805522011741568:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1671us (1705us total) trans 4296020223 rc 0/0 00000100:00100000:0.0:1721880422.341900:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632253 00000100:00100000:1.0:1721880422.341900:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011743232 00000100:00100000:1.0:1721880422.341902:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011743232 00000100:00100000:3.0:1721880422.341906:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632255 00000100:00100000:3.0:1721880422.341909:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f820700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2161:3686:x1805522011742976:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.341911:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632256 00000100:00100000:0.0:1721880422.341914:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d040e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2161:3689:x1805522011743232:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.341919:0:16088:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64536 count 1 00002000:00080000:0.0:1721880422.341923:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64538 count 1 00010000:00010000:1.0:1721880422.341926:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727c354 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.341926:0:16088:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727c370 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.341931:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c377 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.341934:0:16088:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095d2a1c0/0x8a60d30f571bb1de lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119128 expref: 1094 pid: 16056 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.341938:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0449200/0x8a60d30f571bb64c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11927f expref: 1094 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.341938:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727c354 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.341938:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.341939:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.341940:0:16088:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727c370 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.341943:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.341943:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.341945:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c377 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.341946:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727c354 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.341952:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727c354 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.341952:0:16088:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095d2a1c0/0x8a60d30f571bb1de lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119128 expref: 1094 pid: 16056 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.341956:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0449200/0x8a60d30f571bb64c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11927f expref: 1094 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.341957:0:16088:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095d2a1c0/0x8a60d30f571bb1de lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119128 expref: 1094 pid: 16056 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.341959:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727c354 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.341962:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0449200/0x8a60d30f571bb64c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11927f expref: 1094 pid: 15453 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.341964:0:16088:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d043480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011743360:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.341965:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325c480 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.341968:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727c354 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.341969:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880098beca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011743488:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.341975:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727c354 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.341978:0:16088:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdeca80 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.341983:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e780 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.341984:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727c354 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.341986:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.341989:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727c354 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.342005:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011743104 00000100:00100000:3.0:1721880422.342007:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011743104 00000100:00100000:3.0:1721880422.342040:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632257 00000100:00100000:3.0:1721880422.342043:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d042300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2162:3688:x1805522011743104:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.342044:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.342044:0:9458:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b16d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2162:3689:x1805522011741312:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1999us (2138us total) trans 4296020220 rc 0/0 00000100:00100000:2.0:1721880422.342051:0:9458:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632249 00002000:00080000:3.0:1721880422.342051:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64537 count 1 00000100:00100000:0.0:1721880422.342055:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257732608 00000100:00100000:0.0:1721880422.342057:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257732608 00010000:00010000:3.0:1721880422.342059:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727c37e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.342066:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0eb21c0/0x8a60d30f571baf3e lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11906b expref: 1095 pid: 15467 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.342066:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d275d40/0x8a60d30f571bb446 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1191ec expref: 1095 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.342069:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.342070:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.342072:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727c37e lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.342076:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914447 00000100:00100000:2.0:1721880422.342077:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007ea15c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011742848:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.342079:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a70ee050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1095:2005:x1805522257732608:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.342084:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.342084:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d275d40/0x8a60d30f571bb446 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1191ec expref: 1095 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.342087:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0eb21c0/0x8a60d30f571baf3e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11906b expref: 1095 pid: 15467 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.342089:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d275d40/0x8a60d30f571bb446 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1191ec expref: 1095 pid: 16111 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.342091:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c369 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.342093:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0eb21c0/0x8a60d30f571baf3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11906b expref: 1095 pid: 15467 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.342095:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d040380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011743616:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.342101:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0eb21c0/0x8a60d30f571baf3e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11906b expref: 1095 pid: 15467 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.342106:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.342107:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.342108:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c369 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.342109:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec6c0 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.342113:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c369 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.342116:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122c7c000/2, rc 0, transno 1052927 00000100:00100000:1.0:1721880422.342120:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2162:3688:x1805522011741952:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2025us (2052us total) trans 4296020224 rc 0/0 00010000:00010000:0.0:1721880422.342122:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.342125:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011741568:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.342126:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009703dd40/0x8a60d30f571bab9b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b118f45 expref: 1094 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.342127:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632252 00000100:00100000:0.0:1721880422.342131:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a70ee050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1093:2005:x1805522257732608:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 51us (88us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.342133:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800920a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011742464:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.342136:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914447 00010000:00010000:3.0:1721880422.342142:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727c35b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.342147:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727c35b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.342151:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727c35b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.342155:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727c35b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.342156:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800920aad80/2, rc 0, transno 1052928 00010000:00010000:2.0:1721880422.342159:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c369 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.342159:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727c35b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.342162:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727c35b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.342165:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aaaf40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.342167:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727c35b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.342168:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c369 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.342171:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727c35b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.342173:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800920aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011741952:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.342176:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727c35b lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.342177:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c369 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.342180:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727c35b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.342183:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c369 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.342188:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007ea15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011743744:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.342189:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c369 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.342194:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352ac0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.342197:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c369 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.342203:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c369 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.342210:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.342216:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c369 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.342222:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c369 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.342230:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011743744 00000100:00100000:1.0:1721880422.342233:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011743744 00000100:00100000:1.0:1721880422.342249:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632258 00000100:00100000:1.0:1721880422.342253:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f822680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2163:3686:x1805522011743744:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.342253:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2163:3688:x1805522011741696:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2162us (2268us total) trans 4296020225 rc 0/0 00000100:00100000:3.0:1721880422.342258:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632251 00002000:00080000:1.0:1721880422.342264:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64539 count 1 00000100:00100000:0.0:1721880422.342272:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1721880422.342274:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727c385 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.342281:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007ea15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011743872:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1721880422.342281:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880136399f80/2, rc 0, transno 1052924 00010000:00010000:1.0:1721880422.342284:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800729258c0/0x8a60d30f571bb8b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11930b expref: 1092 pid: 16091 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.342287:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880136399f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011741312:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.342290:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.342292:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.342294:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727c385 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.342303:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1721880422.342304:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.342308:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800920a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011744000:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.342310:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800729258c0/0x8a60d30f571bb8b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11930b expref: 1092 pid: 16091 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.342319:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800729258c0/0x8a60d30f571bb8b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11930b expref: 1092 pid: 16091 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.342324:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.342334:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880087745c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011744128:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.342337:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011743872 00000100:00100000:3.0:1721880422.342339:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011743872 00000100:00100000:0.0:1721880422.342340:0:9458:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011744000 00000100:00100000:0.0:1721880422.342343:0:9458:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011744000 00000100:00100000:3.0:1721880422.342350:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632259 00000100:00100000:3.0:1721880422.342353:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098bef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2165:3686:x1805522011743872:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.342356:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2165:3686:x1805522011742592:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2004us (2051us total) trans 4296020226 rc 0/0 00000100:00100000:0.0:1721880422.342359:0:9458:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632260 00000100:00100000:1.0:1721880422.342360:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb900 going to sleep for 11 seconds 00002000:00080000:3.0:1721880422.342361:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64540 count 1 00000100:00100000:0.0:1721880422.342362:0:9458:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096f17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2165:3689:x1805522011744000:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.342363:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632254 00010000:00010000:3.0:1721880422.342368:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727c38c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1721880422.342372:0:9458:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64541 count 1 00010000:00010000:3.0:1721880422.342375:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095778240/0x8a60d30f571bbb38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11939e expref: 1092 pid: 16124 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.342379:0:9458:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727c393 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.342379:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800920a9f80/2, rc 0, transno 1052929 00010000:00010000:3.0:1721880422.342379:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.342380:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.342381:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727c38c lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.342387:0:9458:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cebef40/0x8a60d30f571bbe33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11945b expref: 1092 pid: 15515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.342392:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.342393:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1721880422.342394:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800920a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011741696:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.342395:0:9458:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727c393 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.342410:0:9458:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cebef40/0x8a60d30f571bbe33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11945b expref: 1092 pid: 15515 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.342410:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880096f17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011744256:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.342419:0:9458:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cebef40/0x8a60d30f571bbe33 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11945b expref: 1092 pid: 15515 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.342423:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.342429:0:9458:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880098bec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011744384:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.342431:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011744256 00000100:00100000:1.0:1721880422.342434:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011744256 00010000:00010000:3.0:1721880422.342439:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095778240/0x8a60d30f571bbb38 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11939e expref: 1092 pid: 16124 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.342449:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095778240/0x8a60d30f571bbb38 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11939e expref: 1092 pid: 16124 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.342450:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632261 00000100:00100000:0.0:1721880422.342453:0:9458:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e540 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.342453:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096f14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2165:3689:x1805522011744256:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.342454:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880096f14700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011744512:192.168.201.24@tcp:104: 00002000:00080000:1.0:1721880422.342463:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64542 count 1 00000100:00100000:3.0:1721880422.342467:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdece40 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.342472:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727c39a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.342477:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007ea17100/2, rc 0, transno 1052930 00010000:00010000:1.0:1721880422.342482:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009402df80/0x8a60d30f571bc127 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119550 expref: 1092 pid: 16050 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.342486:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007ea17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011742592:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.342488:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.342489:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.342490:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727c39a lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.342502:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009402df80/0x8a60d30f571bc127 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119550 expref: 1092 pid: 16050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.342508:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009402df80/0x8a60d30f571bc127 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119550 expref: 1092 pid: 16050 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.342513:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1721880422.342518:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880087744000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011744768:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.342523:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880096f16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011744640:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.342543:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb000 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.342543:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.342555:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011744640 00000100:00100000:3.0:1721880422.342557:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011744640 00000100:00100000:3.0:1721880422.342568:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632262 00000100:00100000:3.0:1721880422.342571:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2166:3687:x1805522011744640:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.342577:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64543 count 1 00010000:00010000:3.0:1721880422.342584:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727c3a1 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.342591:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800965c7cc0/0x8a60d30f571bc8ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119ac1 expref: 1092 pid: 16041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.342594:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.342595:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.342597:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727c3a1 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.342606:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800965c7cc0/0x8a60d30f571bc8ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119ac1 expref: 1092 pid: 16041 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.342611:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800965c7cc0/0x8a60d30f571bc8ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119ac1 expref: 1092 pid: 16041 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.342620:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880096f15180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011744896:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.342643:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec000 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.343429:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.343437:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257732736 00000100:00100000:0.0:1721880422.343440:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257732736 00010000:00010000:0.0:1721880422.343449:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d275d40/0x8a60d30f571bb446 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1191ec expref: 1093 pid: 16111 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.343464:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914448 00000100:00100000:3.0:1721880422.343466:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d040380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011743616:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.343467:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098bee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1093:2004:x1805522257732736:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.343470:0:16088:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d043480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011743360:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.343472:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.343474:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d275d40/0x8a60d30f571bb446 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1191ec expref: 1093 pid: 16111 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.343480:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880098beca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011743488:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.343480:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727c37e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.343481:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d275d40/0x8a60d30f571bb446 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1191ec expref: 1093 pid: 16111 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.343484:0:16088:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727c370 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.343489:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d275d40/0x8a60d30f571bb446 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1191ec expref: 1093 pid: 16111 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.343497:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.343498:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.343498:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c377 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.343500:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727c37e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.343505:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727c37e lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.343515:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.343520:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727c37e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.343522:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880087745c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011744128:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.343525:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727c37e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.343527:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098bee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1092:2004:x1805522257732736:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 59us (100us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.343530:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727c37e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.343531:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914448 00010000:00010000:1.0:1721880422.343533:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727c385 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.343534:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727c37e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.343538:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727c37e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.343541:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aaaac0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.343543:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727c37e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.343549:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.343550:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727c37e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.343556:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727c37e lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.343560:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727c37e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.343568:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257732992 00000100:00100000:1.0:1721880422.343572:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257732992 00010000:00010000:1.0:1721880422.343585:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800729258c0/0x8a60d30f571bb8b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11930b expref: 1092 pid: 16091 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.343601:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914449 00000100:00100000:1.0:1721880422.343605:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098bec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1092:2004:x1805522257732992:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.343607:0:9458:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880098bec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011744384:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.343610:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.343613:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800729258c0/0x8a60d30f571bb8b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11930b expref: 1092 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.343618:0:9458:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727c393 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.343619:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800729258c0/0x8a60d30f571bb8b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11930b expref: 1092 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.343630:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800729258c0/0x8a60d30f571bb8b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11930b expref: 1092 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.343637:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.343638:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.343639:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727c385 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.343644:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727c385 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.343652:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.343659:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d042300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2167:3688:x1805522011743104:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1615us (1671us total) trans 4296020227 rc 0/0 00000100:00100000:3.0:1721880422.343664:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632257 00000100:00100000:1.0:1721880422.343669:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098bec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1091:2004:x1805522257732992:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 63us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.343670:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.343673:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914449 00000100:00100000:2.0:1721880422.343678:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880096f14700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011744512:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.343682:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257732864 00000100:00100000:1.0:1721880422.343684:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257732864 00000004:00080000:3.0:1721880422.343686:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009d042a00/2, rc 0, transno 1052931 00010000:00010000:1.0:1721880422.343689:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095d2a1c0/0x8a60d30f571bb1de lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119128 expref: 1091 pid: 16056 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.343689:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727c38c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.343691:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d042a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011743104:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.343712:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914450 00000100:00100000:1.0:1721880422.343718:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098bec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1091:2004:x1805522257732864:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.343718:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880096f14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011745024:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.343719:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.343725:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.343747:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095d2a1c0/0x8a60d30f571bb1de lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119128 expref: 1091 pid: 16056 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.343749:0:7116:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257733120 00000100:00100000:3.0:1721880422.343751:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.343752:0:7116:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257733120 00010000:00010000:1.0:1721880422.343760:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095d2a1c0/0x8a60d30f571bb1de lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119128 expref: 1092 pid: 16056 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.343761:0:7116:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0449200/0x8a60d30f571bb64c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11927f expref: 1092 pid: 15453 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.343767:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.343767:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011745024 00000100:00100000:3.0:1721880422.343769:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011745024 00010000:00010000:1.0:1721880422.343772:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095d2a1c0/0x8a60d30f571bb1de lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119128 expref: 1092 pid: 16056 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.343778:0:7116:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257733248 00000100:00100000:2.0:1721880422.343779:0:7116:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257733248 00000100:00100000:3.0:1721880422.343781:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632263 00010000:00010000:1.0:1721880422.343783:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.343784:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.343784:0:7116:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cebef40/0x8a60d30f571bbe33 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11945b expref: 1092 pid: 15515 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.343786:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d043480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2167:3687:x1805522011745024:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.343787:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727c370 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.343792:0:7116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914451 00010000:00010000:1.0:1721880422.343794:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727c370 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.343796:0:7116:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098bed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1092:2004:x1805522257733120:12345-192.168.201.24@tcp:103:ldlm_bl.0 00002000:00080000:3.0:1721880422.343798:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64544 count 1 00000100:00100000:0.0:1721880422.343799:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.343803:0:7116:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.343807:0:7116:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0449200/0x8a60d30f571bb64c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11927f expref: 1092 pid: 15453 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.343809:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727c3a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.343810:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.343810:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.343817:0:7116:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0449200/0x8a60d30f571bb64c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11927f expref: 1092 pid: 15453 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.343820:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097504d80/0x8a60d30f571bcbed lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119b85 expref: 1092 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.343826:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.343828:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1721880422.343829:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098bec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1092:2004:x1805522257732864:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 110us (158us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.343830:0:7116:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0449200/0x8a60d30f571bb64c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11927f expref: 1092 pid: 15453 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.343830:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727c3a8 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.343836:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914450 00010000:00010000:2.0:1721880422.343841:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1721880422.343842:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.343842:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.343845:0:7116:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c377 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.343846:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097504d80/0x8a60d30f571bcbed lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119b85 expref: 1090 pid: 15487 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.343848:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257733376 00000100:00100000:1.0:1721880422.343850:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257733376 00010000:00010000:2.0:1721880422.343852:0:7116:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c377 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.343855:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097504d80/0x8a60d30f571bcbed lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119b85 expref: 1091 pid: 15487 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.343857:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095778240/0x8a60d30f571bbb38 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11939e expref: 1091 pid: 16124 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.343865:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d040380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011745152:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.343867:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257733504 00000100:00100000:1.0:1721880422.343869:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257733504 00010000:00010000:2.0:1721880422.343869:0:7116:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.343873:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009402df80/0x8a60d30f571bc127 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119550 expref: 1092 pid: 16050 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.343894:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257733632 00000100:00100000:2.0:1721880422.343894:0:7116:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098bed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1092:2004:x1805522257733120:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 96us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.343897:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257733632 00000100:00100000:2.0:1721880422.343902:0:7116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914451 00010000:00010000:1.0:1721880422.343906:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800965c7cc0/0x8a60d30f571bc8ac lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119ac1 expref: 1093 pid: 16041 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.343908:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914452 00000100:00100000:3.0:1721880422.343914:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098bec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1092:2005:x1805522257733248:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.343919:0:7116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914453 00010000:00010000:3.0:1721880422.343922:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.343924:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914454 00000100:00100000:2.0:1721880422.343925:0:7116:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098beca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1092:2005:x1805522257733376:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.343926:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cebef40/0x8a60d30f571bbe33 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11945b expref: 1092 pid: 15515 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.343929:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8064c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1092:2005:x1805522257733504:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.343933:0:7116:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.343935:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cebef40/0x8a60d30f571bbe33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11945b expref: 1092 pid: 15515 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.343936:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.343938:0:7116:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095778240/0x8a60d30f571bbb38 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11939e expref: 1092 pid: 16124 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.343940:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009402df80/0x8a60d30f571bc127 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119550 expref: 1092 pid: 16050 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.343946:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cebef40/0x8a60d30f571bbe33 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11945b expref: 1092 pid: 15515 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.343948:0:7116:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095778240/0x8a60d30f571bbb38 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11939e expref: 1092 pid: 16124 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.343949:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009402df80/0x8a60d30f571bc127 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119550 expref: 1092 pid: 16050 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.343961:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.343961:0:7116:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095778240/0x8a60d30f571bbb38 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11939e expref: 1091 pid: 16124 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.343961:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.343962:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.343962:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.343965:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727c39a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.343965:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727c393 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.343971:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727c39a lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.343971:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727c393 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.343974:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.343976:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.343979:0:7116:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727c38c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.343982:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.343986:0:7116:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727c38c lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.343986:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.344000:0:7116:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.344004:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8064c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1090:2005:x1805522257733504:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 73us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.344004:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098bec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1090:2005:x1805522257733248:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 89us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.344027:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914452 00010000:00010000:0.0:1721880422.344030:0:9458:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727c393 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.344032:0:7116:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098beca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1090:2005:x1805522257733376:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 107us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.344033:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914454 00010000:00010000:0.0:1721880422.344037:0:9458:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727c393 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.344040:0:7116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914453 00010000:00010000:0.0:1721880422.344041:0:9458:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727c393 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.344045:0:9458:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727c393 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.344046:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914455 00010000:00010000:0.0:1721880422.344049:0:9458:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727c393 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.344050:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800953c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1088:2005:x1805522257733632:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.344053:0:9458:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325c240 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.344054:0:9458:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727c393 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.344057:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.344059:0:9458:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727c393 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.344061:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800965c7cc0/0x8a60d30f571bc8ac lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119ac1 expref: 1087 pid: 16041 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.344065:0:9458:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727c393 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.344067:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727c385 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.344069:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727c393 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.344069:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800965c7cc0/0x8a60d30f571bc8ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119ac1 expref: 1087 pid: 16041 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.344075:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727c385 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.344078:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.344080:0:16088:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727c370 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.344080:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.344082:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727c385 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.344082:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727c3a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.344086:0:16088:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727c370 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.344089:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727c385 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.344091:0:16088:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727c370 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.344093:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727c3a1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.344095:0:16088:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727c370 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.344096:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727c385 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.344098:0:16088:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727c370 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.344102:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b5f80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.344102:0:16088:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aab3c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.344102:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.344103:0:16088:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727c370 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.344105:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727c385 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.344107:0:16088:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727c370 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.344111:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727c385 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.344113:0:16088:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727c370 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.344118:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727c370 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.344119:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800953c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1087:2005:x1805522257733632:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 68us (275us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.344121:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727c385 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.344125:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914455 00010000:00010000:1.0:1721880422.344128:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727c385 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.344150:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec6c0 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.344171:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800965c7cc0/0x8a60d30f571bc8ac lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119ac1 expref: 1086 pid: 16041 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.344180:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880096f15180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011744896:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.344191:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727c3a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.344198:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727c3a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.344204:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727c3a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.344210:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727c3a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.344216:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727c3a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.344222:0:9458:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880096f17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2170:3689:x1805522011744000:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1808us (1846us total) trans 4296020228 rc 0/0 00010000:00010000:3.0:1721880422.344222:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727c3a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.344227:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8d80 already unused, calling callback (ffffffffa084e330) 00000100:00100000:0.0:1721880422.344228:0:9458:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632260 00010000:00010000:3.0:1721880422.344230:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727c3a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.344236:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727c3a1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.344238:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f820700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2169:3686:x1805522011742976:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2326us (2371us total) trans 4296020229 rc 0/0 00000100:00100000:2.0:1721880422.344244:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632255 00010000:00010000:3.0:1721880422.344244:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727c3a1 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.344249:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f822680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2169:3686:x1805522011743744:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1994us (2037us total) trans 4296020230 rc 0/0 00010000:00010000:3.0:1721880422.344251:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727c3a1 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.344252:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007ea15c00/2, rc 0, transno 1052934 00000100:00100000:1.0:1721880422.344256:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632258 00010000:00010000:2.0:1721880422.344261:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727c38c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.344264:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007ea15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011743744:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.344268:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727c38c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.344271:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800920aa300/2, rc 0, transno 1052933 00000100:00100000:0.0:1721880422.344273:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800920aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011742976:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.344275:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727c38c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.344281:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727c38c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.344286:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009402df80/0x8a60d30f571bc127 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119550 expref: 1085 pid: 16050 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.344287:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727c38c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.344292:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8900 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.344295:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727c38c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.344297:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880087744000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011744768:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.344300:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727c38c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.344308:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727c38c lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.344311:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727c39a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.344311:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880096f15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011745280:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.344315:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727c38c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.344318:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727c39a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.344324:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727c39a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.344331:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727c39a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.344334:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.344338:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727c39a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.344345:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727c39a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.344355:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b5680 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.344358:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727c39a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.344360:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011745280 00000100:00100000:3.0:1721880422.344360:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1721880422.344364:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011745280 00010000:00010000:1.0:1721880422.344364:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727c39a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.344365:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800952a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011745408:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.344374:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727c39a lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.344379:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.344381:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727c39a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.344393:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011745408 00000100:00100000:0.0:1721880422.344396:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011745408 00000100:00100000:2.0:1721880422.344408:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098bef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2170:3686:x1805522011743872:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2053us (2103us total) trans 4296020231 rc 0/0 00000100:00100000:0.0:1721880422.344409:0:9458:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632264 00000100:00100000:2.0:1721880422.344413:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632259 00000100:00100000:0.0:1721880422.344414:0:9458:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800952a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2170:3688:x1805522011745280:12345-0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1721880422.344414:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800920a9c00/2, rc 0, transno 1052932 00000100:00100000:3.0:1721880422.344421:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800920a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011744000:0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.344424:0:9458:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64545 count 1 00010000:00010000:2.0:1721880422.344428:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c377 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.344432:0:9458:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727c3af lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.344432:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c377 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.344437:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c377 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.344440:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c377 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.344443:0:9458:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c8f61c0/0x8a60d30f571bce9b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119c2d expref: 1084 pid: 16041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.344444:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c377 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.344447:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325eac0 already unused, calling callback (ffffffffa084e330) 00000100:00100000:3.0:1721880422.344447:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1721880422.344448:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.344449:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.344449:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c377 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.344451:0:9458:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727c3af lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.344452:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c377 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.344453:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c0d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011745536:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.344459:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c377 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.344461:0:9458:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c8f61c0/0x8a60d30f571bce9b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119c2d expref: 1084 pid: 16041 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.344464:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c377 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.344466:0:9458:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c8f61c0/0x8a60d30f571bce9b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119c2d expref: 1084 pid: 16041 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.344472:0:9458:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800953c5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011745664:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.344472:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.344490:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880096f14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2170:3689:x1805522011744256:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2034us (2064us total) trans 4296020232 rc 0/0 00000100:00100000:0.0:1721880422.344495:0:9458:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e540 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.344496:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632261 00000100:00100000:0.0:1721880422.344503:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011745536 00000100:00100000:0.0:1721880422.344505:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011745536 00000100:00100000:0.0:1721880422.344518:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632265 00000100:00100000:0.0:1721880422.344521:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2172:3687:x1805522011745536:12345-0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1721880422.344522:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880096f17b80/2, rc 0, transno 1052936 00000004:00080000:0.0:1721880422.344536:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007ea15880/2, rc 0, transno 1052935 00000100:00100000:1.0:1721880422.344537:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880096f17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011744256:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.344539:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007ea15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011743872:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.344569:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d040e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2172:3689:x1805522011743232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2652us (2683us total) trans 4296020233 rc 0/0 00000100:00100000:2.0:1721880422.344574:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632256 00000004:00080000:1.0:1721880422.344575:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009d042680/2, rc 0, transno 1052937 00000100:00100000:0.0:1721880422.344581:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1721880422.344582:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011743232:0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.344587:0:16088:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64547 count 1 00000100:00100000:0.0:1721880422.344589:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c0d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011745792:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.344589:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1721880422.344598:0:16088:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c3b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.344608:0:16088:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094090d80/0x8a60d30f571bd444 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119d68 expref: 1084 pid: 15487 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.344609:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.344612:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c0d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011745920:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.344614:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.344615:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.344617:0:16088:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c3b6 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.344625:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011745792 00000100:00100000:2.0:1721880422.344628:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011745792 00000100:00100000:1.0:1721880422.344631:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.344632:0:16088:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094090d80/0x8a60d30f571bd444 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119d68 expref: 1084 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.344640:0:16088:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094090d80/0x8a60d30f571bd444 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119d68 expref: 1084 pid: 15487 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.344641:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011745920 00000100:00100000:0.0:1721880422.344644:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011745920 00000100:00100000:2.0:1721880422.344645:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632266 00000100:00100000:1.0:1721880422.344648:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880087744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011746048:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.344648:0:16088:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c0d0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011746176:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.344650:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800952a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2173:3688:x1805522011745408:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.344658:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632267 00000100:00100000:0.0:1721880422.344661:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800953c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2173:3686:x1805522011745792:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.344663:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64546 count 1 00002000:00080000:0.0:1721880422.344670:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64548 count 1 00010000:00010000:2.0:1721880422.344672:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727c3bd lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.344672:0:16088:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec000 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.344676:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.344678:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c3c4 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc24:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.344683:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009431b180/0x8a60d30f571bd11f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119cc0 expref: 1084 pid: 16059 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.344686:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c56d440/0x8a60d30f571bd707 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119e10 expref: 1084 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.344689:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.344690:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.344691:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.344691:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.344692:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c3c4 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.344693:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727c3bd lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.344696:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011746048 00000100:00100000:1.0:1721880422.344699:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011746048 00010000:00010000:0.0:1721880422.344704:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c56d440/0x8a60d30f571bd707 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119e10 expref: 1084 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.344711:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c56d440/0x8a60d30f571bd707 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119e10 expref: 1084 pid: 16125 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.344711:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009431b180/0x8a60d30f571bd11f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119cc0 expref: 1084 pid: 16059 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.344716:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632268 00000100:00100000:0.0:1721880422.344721:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880092a4b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011746304:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.344721:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2174:3689:x1805522011745920:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.344745:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009431b180/0x8a60d30f571bd11f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119cc0 expref: 1084 pid: 16059 timeout: 887 lvb_type: 0 00002000:00080000:1.0:1721880422.344751:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64549 count 1 00000100:00100000:2.0:1721880422.344757:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880098bee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011746432:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.344763:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727c3cb lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc25:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.344774:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d5af180/0x8a60d30f571bd930 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119eb8 expref: 1084 pid: 9459 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.344778:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdecc0 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.344781:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.344783:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.344785:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727c3cb lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.344792:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632269 00000100:00100000:2.0:1721880422.344797:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2174:3689:x1805522011746048:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.344808:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64550 count 1 00000100:00100000:0.0:1721880422.344813:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e6c0 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.344817:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727c3d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc26:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.344826:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d0edf80/0x8a60d30f571bdbd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119f52 expref: 1084 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.344833:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.344834:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.344836:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727c3d2 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.344849:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d0edf80/0x8a60d30f571bdbd7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119f52 expref: 1084 pid: 16018 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.344856:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d0edf80/0x8a60d30f571bdbd7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119f52 expref: 1084 pid: 16018 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.344870:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880098bec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011746560:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.344877:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d040380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011745152:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.344887:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde9c0 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.344890:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727c3a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.344900:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d5af180/0x8a60d30f571bd930 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119eb8 expref: 1084 pid: 9459 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.344910:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d5af180/0x8a60d30f571bd930 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119eb8 expref: 1084 pid: 9459 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.344919:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880087747b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011746688:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.344920:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2174:3687:x1805522011744640:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2347us (2376us total) trans 4296020234 rc 0/0 00000100:00100000:3.0:1721880422.344930:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632262 00000100:00100000:1.0:1721880422.344938:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb000 going to sleep for 11 seconds 00000004:00080000:2.0:1721880422.344946:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880096f16680/2, rc 0, transno 1052938 00000100:00100000:2.0:1721880422.344954:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880096f16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011744640:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.344961:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.344978:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257733760 00000100:00100000:3.0:1721880422.344982:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257733760 00000100:00100000:1.0:1721880422.344992:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880087745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011746816:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.344997:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097504d80/0x8a60d30f571bcbed lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119b85 expref: 1085 pid: 15487 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.345031:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.345031:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914456 00000100:00100000:3.0:1721880422.345036:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a4b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1085:2004:x1805522257733760:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.345044:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1721880422.345048:0:9458:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800953c5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011745664:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.345048:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097504d80/0x8a60d30f571bcbed lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119b85 expref: 1085 pid: 15487 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.345056:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011746816 00010000:00010000:3.0:1721880422.345057:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097504d80/0x8a60d30f571bcbed lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119b85 expref: 1085 pid: 15487 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.345059:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011746816 00010000:00010000:3.0:1721880422.345068:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097504d80/0x8a60d30f571bcbed lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119b85 expref: 1085 pid: 15487 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.345072:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632270 00000100:00100000:1.0:1721880422.345075:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2174:3686:x1805522011746816:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.345080:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.345081:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1721880422.345084:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64551 count 1 00010000:00010000:3.0:1721880422.345084:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727c3a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.345090:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727c3a8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.345091:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727c3d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc27:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.345098:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c56c000/0x8a60d30f571bde00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119fde expref: 1084 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.345102:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.345103:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.345104:0:9458:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727c3af lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.345104:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727c3d9 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.345104:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.345113:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727c3a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.345114:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c56c000/0x8a60d30f571bde00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119fde expref: 1084 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.345119:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c56c000/0x8a60d30f571bde00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119fde expref: 1084 pid: 16110 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.345119:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727c3a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.345122:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a4b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1084:2004:x1805522257733760:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 84us (162us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.345124:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727c3a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.345125:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880087745500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011746944:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.345128:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727c3a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.345128:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914456 00010000:00010000:2.0:1721880422.345131:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727c3a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.345135:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aab840 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.345136:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727c3a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.345140:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727c3a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.345141:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb900 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.345154:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727c3a8 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.345159:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.345161:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727c3a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.345177:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257733888 00000100:00100000:3.0:1721880422.345181:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257733888 00010000:00010000:3.0:1721880422.345193:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c8f61c0/0x8a60d30f571bce9b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119c2d expref: 1084 pid: 16041 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.345215:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914457 00000100:00100000:3.0:1721880422.345219:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800953c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1084:2005:x1805522257733888:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.345226:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.345230:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c8f61c0/0x8a60d30f571bce9b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119c2d expref: 1084 pid: 16041 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.345238:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c8f61c0/0x8a60d30f571bce9b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119c2d expref: 1084 pid: 16041 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.345248:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c8f61c0/0x8a60d30f571bce9b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119c2d expref: 1084 pid: 16041 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.345254:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.345255:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.345257:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727c3af lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.345261:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727c3af lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.345275:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.345284:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d043480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2175:3687:x1805522011745024:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1496us (1530us total) trans 4296020235 rc 0/0 00010000:00010000:0.0:1721880422.345285:0:9458:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727c3af lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.345290:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632263 00010000:00010000:0.0:1721880422.345291:0:9458:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727c3af lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.345293:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800953c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1083:2005:x1805522257733888:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 73us (134us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.345296:0:9458:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727c3af lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.345297:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914457 00010000:00010000:0.0:1721880422.345300:0:9458:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727c3af lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.345304:0:9458:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727c3af lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.345308:0:9458:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325d440 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.345309:0:9458:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727c3af lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.345313:0:9458:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727c3af lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.345319:0:9458:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727c3af lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.345327:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727c3af lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.345439:0:9458:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800952a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2175:3688:x1805522011745280:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1024us (1103us total) trans 4296020236 rc 0/0 00000100:00100000:0.0:1721880422.345444:0:9458:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632264 00000004:00080000:0.0:1721880422.345464:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880096f14700/2, rc 0, transno 1052939 00000004:00080000:3.0:1721880422.345472:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880096f15180/2, rc 0, transno 1052940 00000100:00100000:0.0:1721880422.345474:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880096f14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011745024:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.345477:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880096f15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011745280:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.345528:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b144e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011747072:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.345544:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.345547:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1721880422.345555:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b146d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011747200:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.345558:0:9458:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011747072 00000100:00100000:0.0:1721880422.345560:0:9458:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011747072 00000100:00100000:0.0:1721880422.345569:0:9458:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632271 00000100:00100000:0.0:1721880422.345572:0:9458:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076fe5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2175:3687:x1805522011747072:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.345576:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1721880422.345581:0:9458:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64552 count 1 00010000:00010000:0.0:1721880422.345588:0:9458:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c3e0 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc28:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.345589:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011747200 00000100:00100000:2.0:1721880422.345592:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011747200 00010000:00010000:0.0:1721880422.345596:0:9458:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c291680/0x8a60d30f571be05a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a063 expref: 1082 pid: 16032 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.345600:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.345601:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.345603:0:9458:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c3e0 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.345605:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632272 00000100:00100000:2.0:1721880422.345608:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2176:3689:x1805522011747200:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.345616:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64553 count 1 00010000:00010000:0.0:1721880422.345617:0:9458:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c291680/0x8a60d30f571be05a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a063 expref: 1082 pid: 16032 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.345623:0:9458:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c291680/0x8a60d30f571be05a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a063 expref: 1082 pid: 16032 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.345623:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c3e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc29:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.345629:0:9458:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088f16a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011747328:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.345631:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095cc3cc0/0x8a60d30f571be347 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a10b expref: 1082 pid: 16073 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.345635:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.345636:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.345637:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c3e7 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.345648:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095cc3cc0/0x8a60d30f571be347 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a10b expref: 1082 pid: 16073 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.345652:0:9458:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e540 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.345657:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095cc3cc0/0x8a60d30f571be347 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a10b expref: 1082 pid: 16073 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.345662:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880098bec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011747456:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.345676:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.345926:0:16088:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c0d0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011746176:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.345934:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880098bee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011746432:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.345939:0:16088:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c3b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.345945:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727c3bd lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.345959:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.345959:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880098bec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011746560:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.345963:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880087747b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011746688:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.345970:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.345970:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727c3d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.345979:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727c3cb lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.345980:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257734016 00000100:00100000:3.0:1721880422.345981:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257734272 00000100:00100000:0.0:1721880422.345982:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257734016 00000100:00100000:3.0:1721880422.345985:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257734272 00010000:00010000:0.0:1721880422.345993:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094090d80/0x8a60d30f571bd444 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119d68 expref: 1084 pid: 15487 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.345999:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c56d440/0x8a60d30f571bd707 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119e10 expref: 1084 pid: 16125 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.346002:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880087745500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011746944:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.346006:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914458 00000100:00100000:0.0:1721880422.346009:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1084:2004:x1805522257734016:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.346032:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.346033:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727c3d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.346035:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094090d80/0x8a60d30f571bd444 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119d68 expref: 1084 pid: 15487 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.346037:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914459 00010000:00010000:0.0:1721880422.346042:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094090d80/0x8a60d30f571bd444 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119d68 expref: 1084 pid: 15487 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.346042:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1084:2004:x1805522257734272:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.346050:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.346051:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094090d80/0x8a60d30f571bd444 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119d68 expref: 1084 pid: 15487 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.346055:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c56d440/0x8a60d30f571bd707 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119e10 expref: 1084 pid: 16125 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.346058:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880092a4b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011746304:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.346059:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.346060:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.346062:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c3b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.346065:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c56d440/0x8a60d30f571bd707 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119e10 expref: 1083 pid: 16125 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.346067:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c3b6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.346077:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.346078:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c3c4 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.346084:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c56d440/0x8a60d30f571bd707 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc24:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119e10 expref: 1083 pid: 16125 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.346085:0:16088:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c3b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.346092:0:16088:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c3b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.346093:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1082:2004:x1805522257734016:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 82us (135us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.346095:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.346097:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1721880422.346099:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914458 00010000:00010000:2.0:1721880422.346099:0:16088:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c3b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.346099:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c3c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.346104:0:16088:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c3b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.346106:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c3c4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.346115:0:16088:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c3b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.346120:0:16088:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8000 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.346121:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.346123:0:16088:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c3b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.346128:0:16088:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c3b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.346129:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c3c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.346136:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c3c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.346136:0:16088:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c3b6 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.346140:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1081:2004:x1805522257734272:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 97us (168us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.346142:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c3b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.346144:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c3c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.346147:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914459 00010000:00010000:1.0:1721880422.346150:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c3c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.346156:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c3c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.346166:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325f600 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.346168:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c3c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.346175:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c3c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.346184:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c3c4 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.346188:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c3c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.346232:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2177:3687:x1805522011745536:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1709us (1759us total) trans 4296020237 rc 0/0 00000100:00100000:2.0:1721880422.346236:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632265 00000100:00100000:1.0:1721880422.346296:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800953c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2177:3686:x1805522011745792:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1633us (1686us total) trans 4296020238 rc 0/0 00000100:00100000:1.0:1721880422.346301:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632267 00000004:00080000:3.0:1721880422.346326:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009c0d0e00/2, rc 0, transno 1052942 00000100:00100000:3.0:1721880422.346334:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c0d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011745792:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.346361:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1721880422.346369:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880092a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011747584:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.346391:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.346395:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.346401:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011747584 00000100:00100000:1.0:1721880422.346404:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011747584 00000100:00100000:2.0:1721880422.346411:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257734528 00000100:00100000:1.0:1721880422.346415:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632273 00000100:00100000:2.0:1721880422.346415:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257734528 00000100:00100000:0.0:1721880422.346416:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.346417:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2177:3688:x1805522011747584:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.346424:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257734144 00000100:00100000:0.0:1721880422.346427:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257734144 00010000:00010000:2.0:1721880422.346427:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d0edf80/0x8a60d30f571bdbd7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119f52 expref: 1081 pid: 16018 timeout: 887 lvb_type: 0 00002000:00080000:1.0:1721880422.346434:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64554 count 1 00010000:00010000:0.0:1721880422.346435:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009431b180/0x8a60d30f571bd11f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119cc0 expref: 1082 pid: 16059 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.346442:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727c3ee lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc2a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.346449:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135799440/0x8a60d30f571be5d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a197 expref: 1082 pid: 16022 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.346452:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914460 00000100:00100000:0.0:1721880422.346456:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914461 00010000:00010000:1.0:1721880422.346457:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.346457:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1082:2004:x1805522257734528:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.346458:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1721880422.346459:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ab4d5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1082:2005:x1805522257734144:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.346459:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727c3ee lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.346465:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.346467:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009431b180/0x8a60d30f571bd11f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119cc0 expref: 1082 pid: 16059 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.346468:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.346470:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135799440/0x8a60d30f571be5d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a197 expref: 1082 pid: 16022 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.346471:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d0edf80/0x8a60d30f571bdbd7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119f52 expref: 1082 pid: 16018 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.346473:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009431b180/0x8a60d30f571bd11f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119cc0 expref: 1082 pid: 16059 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.346476:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135799440/0x8a60d30f571be5d2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a197 expref: 1082 pid: 16022 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.346478:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d0edf80/0x8a60d30f571bdbd7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119f52 expref: 1082 pid: 16018 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.346482:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880087745500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011747712:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.346483:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009431b180/0x8a60d30f571bd11f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119cc0 expref: 1082 pid: 16059 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.346486:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d0edf80/0x8a60d30f571bdbd7 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119f52 expref: 1082 pid: 16018 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.346492:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.346493:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.346495:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727c3bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.346496:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.346497:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.346499:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727c3bd lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.346499:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727c3d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.346501:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb900 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.346504:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727c3d2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.346508:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.346513:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.346521:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ab4d5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1080:2005:x1805522257734144:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 61us (105us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.346521:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727c3bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.346525:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914461 00000100:00100000:1.0:1721880422.346526:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.346527:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1080:2004:x1805522257734528:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 70us (400us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.346530:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727c3bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.346532:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914460 00000100:00100000:0.0:1721880422.346540:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257734400 00000100:00100000:0.0:1721880422.346541:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257734400 00010000:00010000:3.0:1721880422.346544:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727c3bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.346547:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d5af180/0x8a60d30f571bd930 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119eb8 expref: 1079 pid: 9459 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.346551:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727c3bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.346557:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.346558:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727c3bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.346563:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350d80 already unused, calling callback (ffffffffa084e330) 00000100:00100000:0.0:1721880422.346564:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257734656 00000100:00100000:0.0:1721880422.346566:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257734656 00010000:00010000:3.0:1721880422.346566:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727c3bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.346572:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c56c000/0x8a60d30f571bde00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119fde expref: 1080 pid: 16110 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.346572:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727c3bd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.346574:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914462 00000100:00100000:2.0:1721880422.346579:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087747b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1080:2005:x1805522257734400:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.346582:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727c3bd lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.346583:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914463 00000100:00100000:0.0:1721880422.346585:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801366a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1080:2005:x1805522257734656:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.346587:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.346588:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727c3bd lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.346589:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.346591:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c56c000/0x8a60d30f571bde00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119fde expref: 1080 pid: 16110 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.346592:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d5af180/0x8a60d30f571bd930 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119eb8 expref: 1080 pid: 9459 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.346597:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c56c000/0x8a60d30f571bde00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119fde expref: 1080 pid: 16110 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.346602:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d5af180/0x8a60d30f571bd930 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119eb8 expref: 1080 pid: 9459 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.346607:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c56c000/0x8a60d30f571bde00 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119fde expref: 1080 pid: 16110 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.346615:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d5af180/0x8a60d30f571bd930 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b119eb8 expref: 1079 pid: 9459 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.346617:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.346618:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.346621:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727c3d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.346624:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.346627:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727c3d9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.346627:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.346629:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.346631:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727c3cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.346638:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727c3cb lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.346638:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257734784 00010000:00010000:0.0:1721880422.346641:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.346642:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257734784 00010000:00010000:2.0:1721880422.346653:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.346656:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c291680/0x8a60d30f571be05a lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a063 expref: 1079 pid: 16032 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.346664:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801366a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1079:2005:x1805522257734656:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 76us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.346668:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087747b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+1079:2005:x1805522257734400:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 88us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.346671:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914463 00000100:00100000:1.0:1721880422.346675:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.346675:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914462 00000100:00100000:3.0:1721880422.346680:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914464 00000100:00100000:0.0:1721880422.346685:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257734912 00000100:00100000:3.0:1721880422.346685:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801366a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1077:2005:x1805522257734784:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.346687:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257734912 00010000:00010000:1.0:1721880422.346690:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727c3cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.346692:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.346695:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727c3cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.346695:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727c3d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.346696:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c291680/0x8a60d30f571be05a lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a063 expref: 1078 pid: 16032 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.346697:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095cc3cc0/0x8a60d30f571be347 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a10b expref: 1078 pid: 16073 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.346699:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727c3cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.346702:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727c3d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.346706:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727c3cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.346706:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c291680/0x8a60d30f571be05a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a063 expref: 1078 pid: 16032 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.346710:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727c3cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.346710:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727c3d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.346713:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b6ac0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.346714:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727c3cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.346715:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914465 00000100:00100000:0.0:1721880422.346718:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1078:2005:x1805522257734912:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.346718:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727c3cb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.346718:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.346719:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.346721:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727c3d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.346722:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c3e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.346723:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.346724:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727c3cb lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.346743:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727c3d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.346744:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095cc3cc0/0x8a60d30f571be347 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc29:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a10b expref: 1078 pid: 16073 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.346745:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727c3cb lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.346748:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136351200 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.346750:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095cc3cc0/0x8a60d30f571be347 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc29:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a10b expref: 1078 pid: 16073 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.346751:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727c3d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.346751:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c3e0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.346758:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.346759:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.346759:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727c3d2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.346761:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c3e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc29:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.346762:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.346766:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c3e7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc29:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.346767:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727c3d2 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.346771:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727c3d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.346772:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.346780:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801366a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1078:2005:x1805522257734784:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 94us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.346784:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1078:2005:x1805522257734912:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 65us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.346787:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914464 00000100:00100000:0.0:1721880422.346790:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914465 00010000:00010000:0.0:1721880422.346813:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c291680/0x8a60d30f571be05a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a063 expref: 1076 pid: 16032 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.346822:0:9458:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088f16a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011747328:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.346827:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2180:3689:x1805522011745920:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2106us (2196us total) trans 4296020239 rc 0/0 00010000:00010000:0.0:1721880422.346830:0:9458:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c3e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.346831:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632268 00010000:00010000:0.0:1721880422.346839:0:9458:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c3e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.346843:0:9458:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c3e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.346847:0:9458:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c3e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.346848:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095cc3cc0/0x8a60d30f571be347 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a10b expref: 1075 pid: 16073 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.346850:0:9458:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c3e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.346851:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009c0d1f80/2, rc 0, transno 1052943 00010000:00010000:0.0:1721880422.346854:0:9458:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c3e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.346856:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c0d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011745920:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.346857:0:9458:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325e880 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.346859:0:9458:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c3e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.346859:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880098bec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011747456:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.346862:0:9458:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c3e0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.346867:0:9458:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c3e0 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.346870:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c3e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.346871:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c3e0 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.346878:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727c3d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.346881:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c3e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.346883:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727c3d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.346887:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727c3d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.346887:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c3e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.346891:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727c3d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.346893:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c3e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.346895:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727c3d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.346898:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b5d40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.346899:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c3e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.346900:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727c3d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.346903:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727c3d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.346904:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c3e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.346908:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2179:3689:x1805522011746048:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2109us (2229us total) trans 4296020241 rc 0/0 00010000:00010000:1.0:1721880422.346909:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727c3d9 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.346909:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353180 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.346911:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c3e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.346913:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727c3d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.346914:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632269 00010000:00010000:2.0:1721880422.346917:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c3e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.346926:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c3e7 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.346932:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c3e7 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.346937:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800920c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011747840:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.346955:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.346973:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011747840 00000100:00100000:3.0:1721880422.346976:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011747840 00000100:00100000:1.0:1721880422.346991:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2182:3686:x1805522011746816:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1915us (1961us total) trans 4296020243 rc 0/0 00000100:00100000:3.0:1721880422.346992:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632274 00000100:00100000:1.0:1721880422.346996:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632270 00000100:00100000:3.0:1721880422.346996:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2182:3686:x1805522011747840:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.347009:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64555 count 1 00000004:00080000:1.0:1721880422.347030:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880087744000/2, rc 0, transno 1052945 00000100:00100000:1.0:1721880422.347036:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880087744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011746048:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.347038:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c3f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc2b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.347042:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2181:3689:x1805522011747200:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1432us (1465us total) trans 4296020244 rc 0/0 00000100:00100000:2.0:1721880422.347047:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632272 00010000:00010000:3.0:1721880422.347049:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c8e4d80/0x8a60d30f571be8f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a285 expref: 1074 pid: 16076 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.347055:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.347056:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000004:00080000:1.0:1721880422.347057:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009b146d80/2, rc 0, transno 1052948 00010000:00010000:3.0:1721880422.347059:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c3f5 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.347061:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b146d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011747200:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.347067:0:9458:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880076fe5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2180:3687:x1805522011747072:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1492us (1520us total) trans 4296020242 rc 0/0 00000100:00100000:1.0:1721880422.347074:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1721880422.347075:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c8e4d80/0x8a60d30f571be8f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a285 expref: 1074 pid: 16076 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.347078:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011748096:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.347084:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c8e4d80/0x8a60d30f571be8f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a285 expref: 1074 pid: 16076 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.347092:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.347094:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c0d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011748224:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.347105:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011748096 00000100:00100000:2.0:1721880422.347108:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011748096 00000100:00100000:3.0:1721880422.347114:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec000 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.347118:0:9458:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632271 00000100:00100000:2.0:1721880422.347129:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632275 00000100:00100000:2.0:1721880422.347132:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2180:3689:x1805522011748096:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.347140:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135172680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011747968:0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.347141:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64557 count 1 00010000:00010000:2.0:1721880422.347150:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c3fc lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc2d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.347158:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a7c9f80/0x8a60d30f571bef64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a414 expref: 1074 pid: 15487 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.347159:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.347162:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.347163:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.347165:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c3fc lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.347168:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.347175:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a7c9f80/0x8a60d30f571bef64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a414 expref: 1074 pid: 15487 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.347179:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009b144e00/2, rc 0, transno 1052946 00010000:00010000:2.0:1721880422.347181:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a7c9f80/0x8a60d30f571bef64 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a414 expref: 1074 pid: 15487 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.347187:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b144e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011747072:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.347187:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880098bec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011748352:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.347200:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800952a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2180:3688:x1805522011745408:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2548us (2818us total) trans 4296020240 rc 0/0 00000100:00100000:2.0:1721880422.347205:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.347210:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632266 00000100:00100000:2.0:1721880422.347214:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011747968 00000100:00100000:2.0:1721880422.347216:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011747968 00000100:00100000:0.0:1721880422.347220:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088f16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011748480:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.347228:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257735040 00000100:00100000:2.0:1721880422.347228:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632276 00000100:00100000:1.0:1721880422.347231:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257735040 00000100:00100000:2.0:1721880422.347231:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f624c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2180:3687:x1805522011747968:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.347238:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64556 count 1 00010000:00010000:1.0:1721880422.347240:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135799440/0x8a60d30f571be5d2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a197 expref: 1075 pid: 16022 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.347245:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c403 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc2c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.347251:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.347252:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130243180/0x8a60d30f571bec3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a33b expref: 1075 pid: 16114 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.347254:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880087745180/2, rc 0, transno 1052947 00010000:00010000:2.0:1721880422.347257:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.347257:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1721880422.347258:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914466 00010000:00010000:2.0:1721880422.347259:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c403 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.347261:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1075:2004:x1805522257735040:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.347266:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.347267:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130243180/0x8a60d30f571bec3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a33b expref: 1075 pid: 16114 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.347269:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135799440/0x8a60d30f571be5d2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc2a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a197 expref: 1075 pid: 16022 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.347272:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130243180/0x8a60d30f571bec3f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a33b expref: 1075 pid: 16114 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.347272:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880087745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011746816:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.347275:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135799440/0x8a60d30f571be5d2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc2a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a197 expref: 1075 pid: 16022 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.347278:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880098bec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011748608:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.347283:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.347284:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.347286:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727c3ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc2a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.347288:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011748480 00010000:00010000:1.0:1721880422.347290:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727c3ee lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc2a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.347291:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011748480 00000100:00100000:2.0:1721880422.347293:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdecc0 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.347298:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:0.0:1721880422.347303:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009c0d3480/2, rc 0, transno 1052941 00000100:00100000:0.0:1721880422.347308:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c0d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011745536:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.347311:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1075:2004:x1805522257735040:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 49us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.347314:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914466 00000100:00100000:3.0:1721880422.347318:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632277 00000100:00100000:0.0:1721880422.347320:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088f14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011748864:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.347324:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2181:3689:x1805522011748480:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.347335:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64558 count 1 00000100:00100000:0.0:1721880422.347336:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1721880422.347337:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800952a2a00/2, rc 0, transno 1052944 00010000:00010000:3.0:1721880422.347346:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c40a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc2e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.347347:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800952a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011745408:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.347355:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c552880/0x8a60d30f571bf2a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a4d1 expref: 1074 pid: 16053 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.347361:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.347362:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.347363:0:9458:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011748864 00010000:00010000:1.0:1721880422.347364:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135799440/0x8a60d30f571be5d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a197 expref: 1074 pid: 16022 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.347364:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c40a lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.347366:0:9458:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011748864 00000100:00100000:1.0:1721880422.347373:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880087745500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011747712:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.347377:0:9458:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632278 00000100:00100000:0.0:1721880422.347379:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1721880422.347380:0:9458:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2182:3687:x1805522011748864:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.347381:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c552880/0x8a60d30f571bf2a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a4d1 expref: 1073 pid: 16053 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.347382:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727c3ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.347385:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d27a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011748992:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.347387:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727c3ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.347388:0:9458:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64560 count 1 00010000:00010000:1.0:1721880422.347390:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727c3ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.347391:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c552880/0x8a60d30f571bf2a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a4d1 expref: 1073 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.347394:0:9458:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c411 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc30:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.347395:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727c3ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.347400:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c0d2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011749120:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.347402:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727c3ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.347402:0:9458:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095b8a880/0x8a60d30f571bfa00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a659 expref: 1073 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.347403:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.347406:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727c3ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.347406:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.347407:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.347408:0:9458:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c411 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.347409:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b6640 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.347411:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727c3ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.347414:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727c3ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.347418:0:9458:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095b8a880/0x8a60d30f571bfa00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a659 expref: 1073 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.347420:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727c3ee lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.347423:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1721880422.347423:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727c3ee lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.347423:0:9458:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095b8a880/0x8a60d30f571bfa00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a659 expref: 1073 pid: 16017 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.347428:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088f15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011748736:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.347428:0:9458:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880098bee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011749248:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.347428:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.347442:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011748992 00000100:00100000:2.0:1721880422.347443:0:9458:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde600 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.347445:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011748992 00000100:00100000:0.0:1721880422.347447:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.347461:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011748736 00000100:00100000:3.0:1721880422.347463:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011748736 00000100:00100000:0.0:1721880422.347465:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632279 00000100:00100000:0.0:1721880422.347469:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d27bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2185:3689:x1805522011748992:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.347481:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64561 count 1 00000100:00100000:3.0:1721880422.347486:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632280 00000100:00100000:3.0:1721880422.347490:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d278700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2185:3687:x1805522011748736:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.347492:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727c418 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc31:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.347501:0:16088:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64559 count 1 00010000:00010000:0.0:1721880422.347504:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f632400/0x8a60d30f571c0058 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a701 expref: 1073 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.347510:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.347511:0:16088:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c41f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc2f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.347512:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.347514:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727c418 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.347521:0:16088:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880084e821c0/0x8a60d30f571bf61e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a5bf expref: 1073 pid: 16052 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.347526:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.347527:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.347529:0:16088:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c41f lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.347530:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f632400/0x8a60d30f571c0058 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a701 expref: 1073 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.347539:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f632400/0x8a60d30f571c0058 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a701 expref: 1073 pid: 16111 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.347539:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2185:3688:x1805522011747584:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1118us (1146us total) trans 4296020245 rc 0/0 00000100:00100000:1.0:1721880422.347544:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632273 00010000:00010000:3.0:1721880422.347546:0:16088:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880084e821c0/0x8a60d30f571bf61e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a5bf expref: 1073 pid: 16052 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.347554:0:16088:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880084e821c0/0x8a60d30f571bf61e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a5bf expref: 1073 pid: 16052 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.347564:0:16088:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c0d1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011749504:192.168.201.24@tcp:104: 00000004:00080000:1.0:1721880422.347568:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880092a4b480/2, rc 0, transno 1052949 00000100:00100000:1.0:1721880422.347576:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880092a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011747584:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.347586:0:16088:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdecc00 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.347604:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d27aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011749376:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.347605:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1721880422.347610:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011749632:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.347622:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e540 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.347626:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.347636:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011749632 00000100:00100000:3.0:1721880422.347639:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011749632 00000100:00100000:3.0:1721880422.347653:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632281 00000100:00100000:3.0:1721880422.347657:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2185:3688:x1805522011749632:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.347674:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64562 count 1 00010000:00010000:3.0:1721880422.347683:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c426 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc32:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.347693:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099efe640/0x8a60d30f571c0727 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a7b7 expref: 1073 pid: 16056 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.347699:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.347701:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.347703:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c426 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.347719:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099efe640/0x8a60d30f571c0727 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a7b7 expref: 1073 pid: 16056 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.347752:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099efe640/0x8a60d30f571c0727 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a7b7 expref: 1073 pid: 16056 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.347763:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c0d1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011749760:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.347794:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdece40 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.347815:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c0d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011748224:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.347825:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c3f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.347881:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880098bec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011748352:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.347890:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c3fc lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.348069:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.348095:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.348111:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257735168 00000100:00100000:1.0:1721880422.348116:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257735168 00010000:00010000:1.0:1721880422.348128:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c8e4d80/0x8a60d30f571be8f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a285 expref: 1074 pid: 16076 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.348132:0:7116:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257735296 00000100:00100000:3.0:1721880422.348135:0:7116:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257735296 00010000:00010000:3.0:1721880422.348146:0:7116:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a7c9f80/0x8a60d30f571bef64 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a414 expref: 1075 pid: 15487 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.348151:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914467 00000100:00100000:1.0:1721880422.348156:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d278380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1075:2004:x1805522257735168:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.348161:0:7116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914468 00010000:00010000:1.0:1721880422.348163:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.348164:0:7116:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129d21450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1075:2005:x1805522257735296:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.348166:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c8e4d80/0x8a60d30f571be8f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc2b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a285 expref: 1075 pid: 16076 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.348169:0:7116:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.348172:0:7116:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a7c9f80/0x8a60d30f571bef64 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a414 expref: 1075 pid: 15487 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.348174:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c8e4d80/0x8a60d30f571be8f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc2b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a285 expref: 1075 pid: 16076 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.348178:0:7116:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a7c9f80/0x8a60d30f571bef64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a414 expref: 1075 pid: 15487 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.348185:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c8e4d80/0x8a60d30f571be8f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc2b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a285 expref: 1075 pid: 16076 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.348186:0:7116:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a7c9f80/0x8a60d30f571bef64 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a414 expref: 1075 pid: 15487 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.348193:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.348194:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.348194:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.348196:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.348196:0:7116:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c3fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.348198:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c3f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.348200:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c0d2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011749120:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.348201:0:7116:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c3fc lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.348204:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c3f5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.348210:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c40a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.348211:0:7116:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.348216:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.348224:0:9458:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880098bee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011749248:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.348230:0:9458:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c411 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.348230:0:7116:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880129d21450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1073:2005:x1805522257735296:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 64us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.348234:0:7116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914468 00000100:00100000:0.0:1721880422.348236:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.348236:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d278380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1073:2004:x1805522257735168:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 79us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.348242:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914467 00000100:00100000:3.0:1721880422.348243:0:7116:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257735552 00010000:00010000:2.0:1721880422.348244:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c3fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.348245:0:7116:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257735552 00010000:00010000:2.0:1721880422.348251:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c3fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.348251:0:7116:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095b8a880/0x8a60d30f571bfa00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a659 expref: 1072 pid: 16017 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.348258:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c3fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.348261:0:7116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914469 00000100:00100000:3.0:1721880422.348264:0:7116:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d27b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1072:2004:x1805522257735552:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.348265:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c3fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.348267:0:7116:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.348270:0:7116:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095b8a880/0x8a60d30f571bfa00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc30:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a659 expref: 1072 pid: 16017 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.348272:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c3fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.348275:0:7116:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095b8a880/0x8a60d30f571bfa00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc30:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a659 expref: 1072 pid: 16017 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.348283:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353a80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.348286:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c3fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.348289:0:7116:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095b8a880/0x8a60d30f571bfa00 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc30:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a659 expref: 1072 pid: 16017 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.348295:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c3fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.348300:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c3f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.348301:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.348302:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.348303:0:7116:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c411 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.348305:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c3f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.348310:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c3fc lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.348311:0:7116:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c411 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.348313:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c3f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.348317:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c3f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.348317:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c3fc lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.348321:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c3f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.348324:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aaa400 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.348325:0:7116:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.348326:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c3f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.348330:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c3f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.348336:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c3f5 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.348338:0:7116:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d27b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1071:2004:x1805522257735552:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 73us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.348342:0:7116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914469 00010000:00010000:1.0:1721880422.348343:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c3f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.348364:0:16088:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c0d1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011749504:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.348372:0:16088:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c41f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.348389:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.348401:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257735680 00000100:00100000:3.0:1721880422.348403:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257735680 00000100:00100000:0.0:1721880422.348406:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.348411:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130243180/0x8a60d30f571bec3f lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a33b expref: 1071 pid: 16114 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.348427:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257735808 00000100:00100000:3.0:1721880422.348429:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257735808 00000100:00100000:2.0:1721880422.348435:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2187:3689:x1805522011748096:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1301us (1341us total) trans 4296020246 rc 0/0 00010000:00010000:3.0:1721880422.348435:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880084e821c0/0x8a60d30f571bf61e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a5bf expref: 1072 pid: 16052 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.348437:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914470 00000100:00100000:2.0:1721880422.348440:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632275 00000100:00100000:1.0:1721880422.348444:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2187:3686:x1805522011747840:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1447us (1488us total) trans 4296020247 rc 0/0 00000100:00100000:0.0:1721880422.348445:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d278e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1072:2004:x1805522257735680:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.348447:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914471 00000100:00100000:1.0:1721880422.348449:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632274 00000100:00100000:3.0:1721880422.348450:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d27b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1072:2004:x1805522257735808:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.348454:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.348455:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.348457:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880084e821c0/0x8a60d30f571bf61e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc2f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a5bf expref: 1072 pid: 16052 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.348458:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130243180/0x8a60d30f571bec3f lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a33b expref: 1072 pid: 16114 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.348460:0:9458:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c411 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.348463:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880084e821c0/0x8a60d30f571bf61e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc2f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a5bf expref: 1072 pid: 16052 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.348466:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130243180/0x8a60d30f571bec3f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a33b expref: 1072 pid: 16114 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.348468:0:9458:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c411 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.348472:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009e86c700/2, rc 0, transno 1052950 00010000:00010000:3.0:1721880422.348472:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880084e821c0/0x8a60d30f571bf61e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc2f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a5bf expref: 1072 pid: 16052 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.348475:0:9458:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c411 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.348476:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.348477:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.348478:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c403 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.348478:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009e86c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011748096:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.348479:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.348480:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.348481:0:9458:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c411 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.348481:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c41f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.348483:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c403 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.348486:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c41f lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.348488:0:9458:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c411 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.348490:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.348493:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.348494:0:9458:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136351680 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.348497:0:9458:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c411 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.348504:0:9458:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c411 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.348506:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d278e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1071:2004:x1805522257735680:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 62us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.348506:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d27b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1071:2004:x1805522257735808:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 55us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.348509:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1721880422.348510:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914470 00010000:00010000:2.0:1721880422.348513:0:9458:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c411 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.348513:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914471 00000100:00100000:1.0:1721880422.348516:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011749888:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.348520:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c411 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.348525:0:16088:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c41f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.348529:0:16088:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c41f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.348534:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d27aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011749376:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.348534:0:16088:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c41f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.348536:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.348538:0:16088:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c41f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.348545:0:16088:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c41f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.348548:0:16088:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aab600 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.348550:0:16088:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c41f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.348554:0:16088:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c41f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.348555:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011749888 00010000:00010000:0.0:1721880422.348557:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727c418 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.348559:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011749888 00010000:00010000:3.0:1721880422.348559:0:16088:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c41f lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.348562:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c41f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.348573:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632282 00000100:00100000:1.0:1721880422.348575:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2187:3687:x1805522011749888:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.348579:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00002000:00080000:1.0:1721880422.348584:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64563 count 1 00010000:00010000:1.0:1721880422.348591:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727c42d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc33:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.348598:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fdc6880/0x8a60d30f571c3285 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11bea1 expref: 1069 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.348602:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.348603:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.348605:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727c42d lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.348617:0:9458:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2188:3687:x1805522011748864:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1234us (1279us total) trans 4296020248 rc 0/0 00010000:00010000:1.0:1721880422.348619:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fdc6880/0x8a60d30f571c3285 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11bea1 expref: 1069 pid: 16126 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.348624:0:9458:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632278 00010000:00010000:1.0:1721880422.348625:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fdc6880/0x8a60d30f571c3285 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11bea1 expref: 1069 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.348630:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011750016:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.348641:0:7118:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257735424 00000100:00100000:0.0:1721880422.348644:0:7118:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257735424 00000100:00100000:1.0:1721880422.348647:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb000 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.348648:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130243180/0x8a60d30f571bec3f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a33b expref: 1070 pid: 16114 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.348654:0:7118:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c552880/0x8a60d30f571bf2a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a4d1 expref: 1069 pid: 16053 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.348655:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d278700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2187:3687:x1805522011748736:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1164us (1206us total) trans 4296020249 rc 0/0 00000100:00100000:2.0:1721880422.348656:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880098bec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011748608:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.348660:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632280 00000004:00080000:1.0:1721880422.348661:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088f15500/2, rc 0, transno 1052953 00010000:00010000:2.0:1721880422.348663:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c403 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.348666:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088f15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011748736:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.348668:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c403 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.348672:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914472 00010000:00010000:2.0:1721880422.348672:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c403 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.348676:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d27aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+1069:2005:x1805522257735424:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.348679:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c403 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.348681:0:7118:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00080000:1.0:1721880422.348681:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088f14e00/2, rc 0, transno 1052952 00010000:00010000:0.0:1721880422.348683:0:7118:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c552880/0x8a60d30f571bf2a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc2e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a4d1 expref: 1069 pid: 16053 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.348684:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088f14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011748864:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.348684:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c403 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.348687:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c403 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.348688:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800920c8a80/2, rc 0, transno 1052951 00010000:00010000:0.0:1721880422.348690:0:7118:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c552880/0x8a60d30f571bf2a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc2e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a4d1 expref: 1069 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.348690:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352d00 already unused, calling callback (ffffffffa084e330) 00000100:00100000:3.0:1721880422.348691:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800920c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011747840:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.348692:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c403 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.348696:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c403 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.348696:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1721880422.348698:0:7118:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c552880/0x8a60d30f571bf2a5 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc2e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a4d1 expref: 1069 pid: 16053 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.348699:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801366a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011750272:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.348700:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801366a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011750144:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.348701:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c403 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.348705:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.348705:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c403 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.348706:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.348708:0:7118:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c40a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.348711:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.348713:0:7118:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c40a lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.348721:0:7118:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.348723:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011750272 00000100:00100000:1.0:1721880422.348725:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1721880422.348725:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011750272 00000100:00100000:0.0:1721880422.348748:0:7118:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d27aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+1068:2005:x1805522257735424:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 71us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.348749:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800920cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011750400:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.348752:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914472 00000100:00100000:3.0:1721880422.348753:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632283 00000100:00100000:3.0:1721880422.348755:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087747b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2187:3688:x1805522011750272:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.348764:0:16088:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64565 count 1 00000100:00100000:1.0:1721880422.348768:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.348771:0:16088:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c434 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc35:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.348778:0:16088:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095bd8d80/0x8a60d30f571c5347 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11cca1 expref: 1067 pid: 16053 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.348782:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1721880422.348783:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.348783:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.348785:0:16088:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c434 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.348790:0:7118:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257735936 00000100:00100000:0.0:1721880422.348792:0:7118:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257735936 00010000:00010000:3.0:1721880422.348795:0:16088:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095bd8d80/0x8a60d30f571c5347 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11cca1 expref: 1068 pid: 16053 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.348799:0:7118:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f632400/0x8a60d30f571c0058 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a701 expref: 1068 pid: 16111 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.348800:0:16088:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095bd8d80/0x8a60d30f571c5347 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11cca1 expref: 1068 pid: 16053 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.348805:0:16088:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c0d1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011750528:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.348815:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f624c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2188:3687:x1805522011747968:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1582us (1654us total) trans 4296020250 rc 0/0 00000100:00100000:0.0:1721880422.348819:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914473 00000100:00100000:2.0:1721880422.348819:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632276 00000100:00100000:0.0:1721880422.348823:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d279500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+1068:2006:x1805522257735936:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.348828:0:7118:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.348830:0:7118:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f632400/0x8a60d30f571c0058 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc31:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a701 expref: 1068 pid: 16111 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.348835:0:7118:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f632400/0x8a60d30f571c0058 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc31:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a701 expref: 1068 pid: 16111 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.348835:0:16088:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdecc00 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.348842:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.348843:0:7118:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f632400/0x8a60d30f571c0058 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc31:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a701 expref: 1068 pid: 16111 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.348850:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.348851:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1721880422.348851:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.348853:0:7118:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727c418 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.348857:0:7118:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727c418 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.348864:0:7118:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.348866:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c0d1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011749760:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.348873:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c426 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.348875:0:7118:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d279500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+1067:2006:x1805522257735936:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 52us (93us total) trans 0 rc 0/0 00000004:00080000:1.0:1721880422.348877:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880135172680/2, rc 0, transno 1052954 00000100:00100000:0.0:1721880422.348879:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914473 00000100:00100000:1.0:1721880422.348881:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135172680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011747968:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.348884:0:7116:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257736064 00000100:00100000:3.0:1721880422.348886:0:7116:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257736064 00010000:00010000:0.0:1721880422.348890:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727c418 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.348892:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011750400 00010000:00010000:3.0:1721880422.348893:0:7116:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099efe640/0x8a60d30f571c0727 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a7b7 expref: 1067 pid: 16056 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.348895:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727c418 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.348895:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011750400 00000100:00100000:1.0:1721880422.348896:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1721880422.348899:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727c418 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.348901:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880087746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011750656:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.348903:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727c418 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.348905:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011750144 00000100:00100000:2.0:1721880422.348906:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011750144 00010000:00010000:0.0:1721880422.348909:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727c418 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.348912:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325d200 already unused, calling callback (ffffffffa084e330) 00000100:00100000:3.0:1721880422.348912:0:7116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914474 00010000:00010000:0.0:1721880422.348913:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727c418 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.348913:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632284 00000100:00100000:1.0:1721880422.348914:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.348915:0:7116:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087745c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1067:2005:x1805522257736064:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.348916:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087745500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2189:3688:x1805522011750400:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.348917:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727c418 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.348920:0:7116:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.348922:0:7116:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099efe640/0x8a60d30f571c0727 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc32:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a7b7 expref: 1067 pid: 16056 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.348923:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727c418 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.348925:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64566 count 1 00010000:00010000:0.0:1721880422.348927:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727c418 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.348928:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011750656 00010000:00010000:3.0:1721880422.348928:0:7116:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099efe640/0x8a60d30f571c0727 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc32:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a7b7 expref: 1067 pid: 16056 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.348930:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011750656 00010000:00010000:2.0:1721880422.348932:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c43b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc36:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.348935:0:7116:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099efe640/0x8a60d30f571c0727 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc32:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11a7b7 expref: 1067 pid: 16056 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.348940:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c8b0240/0x8a60d30f571c5650 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11cd49 expref: 1067 pid: 9459 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.348942:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632285 00010000:00010000:3.0:1721880422.348942:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.348943:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.348944:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.348945:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.348945:0:7116:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c426 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.348946:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2190:3686:x1805522011750144:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.348947:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632286 00010000:00010000:2.0:1721880422.348947:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c43b lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.348949:0:7116:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c426 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.348951:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2190:3687:x1805522011750656:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.348955:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64564 count 1 00010000:00010000:3.0:1721880422.348955:0:7116:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.348957:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c8b0240/0x8a60d30f571c5650 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11cd49 expref: 1066 pid: 9459 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1721880422.348960:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64567 count 1 00010000:00010000:1.0:1721880422.348962:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727c442 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc34:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.348962:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c8b0240/0x8a60d30f571c5650 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11cd49 expref: 1066 pid: 9459 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.348967:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727c449 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc37:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.348967:0:7116:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087745c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1066:2005:x1805522257736064:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 51us (116us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.348969:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880084d25680/0x8a60d30f571c4d9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11cbf2 expref: 1066 pid: 16076 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.348969:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880098bef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011750784:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.348971:0:7116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914474 00010000:00010000:1.0:1721880422.348974:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.348975:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131b95440/0x8a60d30f571c58fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11cde3 expref: 1066 pid: 16053 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.348975:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.348976:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727c442 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.348979:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.348980:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.348981:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727c449 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.348984:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdecc0 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.348984:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c426 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.348987:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880084d25680/0x8a60d30f571c4d9e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11cbf2 expref: 1065 pid: 16076 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.348988:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c426 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.348991:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131b95440/0x8a60d30f571c58fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11cde3 expref: 1065 pid: 16053 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.348992:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880084d25680/0x8a60d30f571c4d9e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11cbf2 expref: 1065 pid: 16076 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.348993:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c426 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.348994:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c40a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.348997:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c426 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.348998:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131b95440/0x8a60d30f571c58fe lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11cde3 expref: 1065 pid: 16053 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.348999:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880087746d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011750912:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.349000:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c426 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.349002:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c40a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.349003:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aabcc0 already unused, calling callback (ffffffffa084e330) 00000100:00100000:0.0:1721880422.349004:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d27ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011751040:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.349005:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c426 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.349007:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c40a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.349009:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c426 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.349026:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c40a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.349028:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c426 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.349030:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c40a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.349031:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb240 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.349033:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aaba80 already unused, calling callback (ffffffffa084e330) 00000100:00100000:0.0:1721880422.349035:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e540 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.349035:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c40a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.349035:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c426 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.349040:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c40a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.349046:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c40a lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.349050:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c40a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.349120:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d27bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2193:3689:x1805522011748992:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1650us (1716us total) trans 4296020251 rc 0/0 00000100:00100000:0.0:1721880422.349124:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632279 00000004:00080000:1.0:1721880422.349130:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d27a300/2, rc 0, transno 1052955 00000100:00100000:1.0:1721880422.349135:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d27a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011748992:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.349142:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2192:3689:x1805522011748480:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1818us (1891us total) trans 4296020253 rc 0/0 00000100:00100000:2.0:1721880422.349148:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632277 00000004:00080000:1.0:1721880422.349156:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088f16a00/2, rc 0, transno 1052957 00000100:00100000:3.0:1721880422.349157:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2191:3688:x1805522011749632:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1498us (1529us total) trans 4296020252 rc 0/0 00000100:00100000:1.0:1721880422.349160:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088f16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011748480:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.349161:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632281 00000100:00100000:1.0:1721880422.349171:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1721880422.349174:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011751296:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1721880422.349180:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009e86d880/2, rc 0, transno 1052956 00000100:00100000:1.0:1721880422.349189:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.349191:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009e86d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011749632:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.349198:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1721880422.349202:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c602a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011751168:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.349208:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011751296 00000100:00100000:2.0:1721880422.349212:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011751296 00000100:00100000:3.0:1721880422.349215:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.349226:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120346680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011751424:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.349229:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011751168 00000100:00100000:2.0:1721880422.349231:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011751168 00000100:00100000:2.0:1721880422.349243:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632287 00000100:00100000:2.0:1721880422.349248:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120344a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2192:3689:x1805522011751296:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.349249:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632288 00000100:00100000:0.0:1721880422.349250:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.349253:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2192:3686:x1805522011751168:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.349260:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64569 count 1 00002000:00080000:3.0:1721880422.349262:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64568 count 1 00000100:00100000:1.0:1721880422.349264:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011751424 00000100:00100000:1.0:1721880422.349266:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011751424 00010000:00010000:3.0:1721880422.349270:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c450 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc38:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.349271:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c457 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc39:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.349277:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c1ec240/0x8a60d30f571c6220 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d3d2 expref: 1065 pid: 16053 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.349279:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632289 00010000:00010000:2.0:1721880422.349281:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092802d00/0x8a60d30f571c643b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d4b2 expref: 1065 pid: 16124 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.349282:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d278380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2193:3689:x1805522011751424:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.349282:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.349282:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.349284:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c450 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.349289:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64570 count 1 00010000:00010000:2.0:1721880422.349289:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.349290:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.349292:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c457 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.349294:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c1ec240/0x8a60d30f571c6220 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d3d2 expref: 1065 pid: 16053 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.349296:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727c45e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc3a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.349300:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c1ec240/0x8a60d30f571c6220 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d3d2 expref: 1065 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.349304:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801203e73c0/0x8a60d30f571c6744 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d54c expref: 1065 pid: 16077 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.349306:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c0d3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011751552:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.349307:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.349308:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.349309:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092802d00/0x8a60d30f571c643b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d4b2 expref: 1065 pid: 16124 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.349310:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727c45e lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.349318:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092802d00/0x8a60d30f571c643b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d4b2 expref: 1065 pid: 16124 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.349320:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801203e73c0/0x8a60d30f571c6744 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d54c expref: 1065 pid: 16077 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.349323:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdece40 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.349325:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801203e73c0/0x8a60d30f571c6744 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d54c expref: 1065 pid: 16077 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.349329:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880098bec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011751680:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.349331:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120344700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011751808:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.349348:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde600 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.349350:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb540 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.349788:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009e86ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011750016:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.349799:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727c42d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.349829:0:16088:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c0d1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011750528:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.349844:0:16088:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c434 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.349910:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.349942:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.349943:0:7116:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257736320 00000100:00100000:3.0:1721880422.349947:0:7116:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257736320 00010000:00010000:3.0:1721880422.349958:0:7116:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095bd8d80/0x8a60d30f571c5347 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11cca1 expref: 1066 pid: 16053 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.349979:0:7116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914475 00000100:00100000:3.0:1721880422.349982:0:7116:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8067850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1066:2005:x1805522257736320:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.349988:0:7116:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.349991:0:7116:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095bd8d80/0x8a60d30f571c5347 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc35:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11cca1 expref: 1066 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.349996:0:7116:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095bd8d80/0x8a60d30f571c5347 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc35:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11cca1 expref: 1066 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.350005:0:7116:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095bd8d80/0x8a60d30f571c5347 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc35:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11cca1 expref: 1066 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.350025:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.350027:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.350030:0:7116:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c434 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.350035:0:7116:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c434 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.350036:0:7118:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257736192 00000100:00100000:1.0:1721880422.350040:0:7118:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257736192 00010000:00010000:3.0:1721880422.350045:0:7116:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.350052:0:7118:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdc6880/0x8a60d30f571c3285 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11bea1 expref: 1066 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.350065:0:7116:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8067850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1066:2005:x1805522257736320:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 81us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.350069:0:7116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914475 00000100:00100000:1.0:1721880422.350074:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914476 00000100:00100000:1.0:1721880422.350078:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+1065:2004:x1805522257736192:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.350085:0:7118:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.350086:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880098bef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011750784:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.350088:0:7118:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fdc6880/0x8a60d30f571c3285 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc33:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11bea1 expref: 1065 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.350097:0:7118:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fdc6880/0x8a60d30f571c3285 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc33:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11bea1 expref: 1065 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.350098:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c43b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.350106:0:7118:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fdc6880/0x8a60d30f571c3285 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc33:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11bea1 expref: 1065 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.350115:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.350116:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.350117:0:7118:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727c42d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.350125:0:7118:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727c42d lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.350131:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.350135:0:7118:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.350145:0:16088:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c434 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.350152:0:7118:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+1064:2004:x1805522257736192:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 73us (211us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.350153:0:16088:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c434 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.350156:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914476 00010000:00010000:3.0:1721880422.350160:0:16088:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c434 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.350167:0:16088:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c434 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.350174:0:16088:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c434 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.350176:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880087746d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011750912:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.350185:0:16088:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa9f80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.350187:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727c442 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.350188:0:16088:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c434 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.350194:0:16088:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c434 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.350203:0:7118:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257736448 00010000:00010000:3.0:1721880422.350204:0:16088:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c434 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.350205:0:7118:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257736448 00010000:00010000:3.0:1721880422.350210:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c434 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.350211:0:7118:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c8b0240/0x8a60d30f571c5650 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11cd49 expref: 1064 pid: 9459 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.350229:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914477 00000100:00100000:1.0:1721880422.350231:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095b71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+1064:2004:x1805522257736448:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.350235:0:7118:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.350238:0:7118:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c8b0240/0x8a60d30f571c5650 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11cd49 expref: 1064 pid: 9459 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.350243:0:7118:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c8b0240/0x8a60d30f571c5650 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11cd49 expref: 1064 pid: 9459 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.350247:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.350253:0:7118:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c8b0240/0x8a60d30f571c5650 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11cd49 expref: 1064 pid: 9459 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.350259:0:7116:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257736576 00010000:00010000:1.0:1721880422.350260:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.350261:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.350262:0:7118:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c43b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.350263:0:7116:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257736576 00010000:00010000:1.0:1721880422.350266:0:7118:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c43b lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.350275:0:7118:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.350275:0:7116:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880084d25680/0x8a60d30f571c4d9e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11cbf2 expref: 1064 pid: 16076 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.350280:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d27ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011751040:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.350288:0:7118:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880095b71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+1064:2004:x1805522257736448:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 55us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.350288:0:7116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914478 00000100:00100000:1.0:1721880422.350293:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914477 00000100:00100000:2.0:1721880422.350293:0:7116:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fe6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1064:2004:x1805522257736576:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.350298:0:7116:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.350301:0:7116:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880084d25680/0x8a60d30f571c4d9e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc34:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11cbf2 expref: 1063 pid: 16076 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.350301:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087747b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2194:3688:x1805522011750272:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1544us (1588us total) trans 4296020254 rc 0/0 00010000:00010000:0.0:1721880422.350303:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727c449 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.350306:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632283 00010000:00010000:2.0:1721880422.350308:0:7116:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880084d25680/0x8a60d30f571c4d9e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc34:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11cbf2 expref: 1063 pid: 16076 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.350309:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727c42d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.350313:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727c42d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.350317:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727c42d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.350317:0:7116:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880084d25680/0x8a60d30f571c4d9e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc34:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11cbf2 expref: 1063 pid: 16076 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.350321:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727c42d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.350323:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.350324:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.350326:0:7116:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727c442 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.350326:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801366a2d80/2, rc 0, transno 1052958 00010000:00010000:1.0:1721880422.350328:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727c42d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.350331:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b6400 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.350331:0:7116:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727c442 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.350333:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727c42d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.350338:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727c42d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.350338:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801366a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011750272:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.350341:0:7116:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.350344:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727c42d lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.350347:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727c42d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.350355:0:7116:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fe6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1062:2004:x1805522257736576:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 63us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.350359:0:7116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914478 00010000:00010000:2.0:1721880422.350373:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c43b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.350378:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c43b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.350382:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727c442 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.350383:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c43b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.350387:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727c442 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.350389:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c43b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.350389:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011751936:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.350391:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727c442 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.350394:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727c442 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.350395:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c43b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.350398:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727c442 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.350401:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801363533c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.350402:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b7a80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.350403:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727c442 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.350403:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c43b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.350407:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727c442 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.350410:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c43b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.350411:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727c442 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.350411:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.350415:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727c442 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.350425:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c43b lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.350432:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c43b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.350433:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011751936 00000100:00100000:3.0:1721880422.350437:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011751936 00000100:00100000:3.0:1721880422.350451:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632290 00000100:00100000:3.0:1721880422.350454:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2195:3686:x1805522011751936:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.350463:0:16088:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64571 count 1 00010000:00010000:3.0:1721880422.350471:0:16088:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c465 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc3b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.350478:0:16088:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ef0f600/0x8a60d30f571c6943 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d5d1 expref: 1061 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.350483:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.350484:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.350485:0:16088:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c465 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.350495:0:16088:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ef0f600/0x8a60d30f571c6943 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d5d1 expref: 1061 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.350500:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2196:3686:x1805522011750144:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1552us (1656us total) trans 4296020255 rc 0/0 00010000:00010000:3.0:1721880422.350501:0:16088:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ef0f600/0x8a60d30f571c6943 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d5d1 expref: 1061 pid: 16075 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.350504:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632285 00000100:00100000:3.0:1721880422.350507:0:16088:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c0d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011752064:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.350534:0:16088:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec000 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.350542:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087745500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2196:3688:x1805522011750400:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1623us (1772us total) trans 4296020256 rc 0/0 00000100:00100000:2.0:1721880422.350548:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632284 00000004:00080000:3.0:1721880422.350549:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801366a0380/2, rc 0, transno 1052959 00000100:00100000:3.0:1721880422.350557:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801366a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011750144:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1721880422.350576:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800920cad80/2, rc 0, transno 1052960 00000100:00100000:2.0:1721880422.350591:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800920cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011750400:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.350595:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.350614:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.350619:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257736704 00000100:00100000:2.0:1721880422.350621:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257736704 00000100:00100000:0.0:1721880422.350629:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1721880422.350632:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131b95440/0x8a60d30f571c58fe lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11cde3 expref: 1062 pid: 16053 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.350635:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.350639:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120345f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011752320:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.350653:0:7118:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257736832 00000100:00100000:2.0:1721880422.350654:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257737088 00000100:00100000:1.0:1721880422.350656:0:7118:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257736832 00000100:00100000:2.0:1721880422.350656:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257737088 00000100:00100000:3.0:1721880422.350659:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914479 00000100:00100000:0.0:1721880422.350661:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.350663:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1064:2004:x1805522257736704:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.350666:0:7118:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c1ec240/0x8a60d30f571c6220 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d3d2 expref: 1064 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.350666:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801203e73c0/0x8a60d30f571c6744 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d54c expref: 1064 pid: 16077 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.350669:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.350673:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131b95440/0x8a60d30f571c58fe lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc37:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11cde3 expref: 1064 pid: 16053 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.350678:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914480 00010000:00010000:3.0:1721880422.350679:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131b95440/0x8a60d30f571c58fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc37:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11cde3 expref: 1064 pid: 16053 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.350681:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+1064:2007:x1805522257736832:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.350682:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914481 00010000:00010000:1.0:1721880422.350686:0:7118:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.350687:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1064:2004:x1805522257737088:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.350687:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131b95440/0x8a60d30f571c58fe lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc37:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11cde3 expref: 1064 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.350689:0:7118:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c1ec240/0x8a60d30f571c6220 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc38:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d3d2 expref: 1064 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.350694:0:7118:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c1ec240/0x8a60d30f571c6220 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc38:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d3d2 expref: 1063 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.350695:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.350696:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.350697:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.350698:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801203e73c0/0x8a60d30f571c6744 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc3a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d54c expref: 1063 pid: 16077 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.350699:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727c449 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.350701:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.350701:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.350703:0:7118:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c450 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc38:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.350703:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727c449 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.350705:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801203e73c0/0x8a60d30f571c6744 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc3a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d54c expref: 1063 pid: 16077 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.350707:0:7118:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c450 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc38:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.350712:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.350713:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.350714:0:7118:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.350714:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.350716:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727c45e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc3a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.350718:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727c449 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.350720:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727c45e lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc3a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.350724:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727c449 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.350741:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1063:2004:x1805522257736704:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 63us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.350742:0:7118:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+1063:2007:x1805522257736832:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 44us (112us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.350745:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727c449 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.350745:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914479 00010000:00010000:2.0:1721880422.350746:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.350748:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914480 00010000:00010000:0.0:1721880422.350750:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727c449 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.350754:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727c449 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.350757:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325d680 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.350759:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727c449 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.350760:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1061:2004:x1805522257737088:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 73us (124us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.350765:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727c449 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.350765:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914481 00010000:00010000:3.0:1721880422.350768:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c1ec240/0x8a60d30f571c6220 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d3d2 expref: 1061 pid: 16053 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.350772:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2195:3687:x1805522011749888:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2195us (2236us total) trans 4296020257 rc 0/0 00010000:00010000:0.0:1721880422.350773:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727c449 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.350775:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c0d3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011751552:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.350776:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632282 00010000:00010000:0.0:1721880422.350780:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727c449 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.350783:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011752320 00010000:00010000:3.0:1721880422.350783:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c450 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.350785:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011752320 00010000:00010000:3.0:1721880422.350790:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c450 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.350794:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c450 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.350795:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632291 00000100:00100000:1.0:1721880422.350797:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009625b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2195:3689:x1805522011752320:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.350798:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c450 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.350802:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c450 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.350806:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64573 count 1 00010000:00010000:3.0:1721880422.350806:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c450 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.350809:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aaad00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.350811:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c450 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.350813:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727c46c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc3d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.350815:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c450 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.350819:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a538f600/0x8a60d30f571c6d79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc3d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d705 expref: 1059 pid: 16096 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.350820:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c450 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.350823:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.350823:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.350824:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c450 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.350825:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727c46c lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc3d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.350834:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a538f600/0x8a60d30f571c6d79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc3d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d705 expref: 1059 pid: 16096 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.350840:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a538f600/0x8a60d30f571c6d79 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc3d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d705 expref: 1059 pid: 16096 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.350846:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120346a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011752448:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.350858:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb240 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.350869:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120344000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011752192:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.350869:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880098bec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011751680:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.350881:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.350882:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c457 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.350896:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009e86f100/2, rc 0, transno 1052961 00000100:00100000:2.0:1721880422.350898:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011752192 00000100:00100000:1.0:1721880422.350899:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009e86f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011749888:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.350899:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2196:3686:x1805522011751168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1646us (1683us total) trans 4296020258 rc 0/0 00000100:00100000:2.0:1721880422.350901:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011752192 00000100:00100000:3.0:1721880422.350904:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632288 00000100:00100000:3.0:1721880422.350915:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632292 00000100:00100000:3.0:1721880422.350919:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120346d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2196:3687:x1805522011752192:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.350927:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00002000:00080000:3.0:1721880422.350927:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64572 count 1 00010000:00010000:1.0:1721880422.350928:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801203e73c0/0x8a60d30f571c6744 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d54c expref: 1059 pid: 16077 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.350934:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120347800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011752576:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.350934:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727c473 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc3c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.350935:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120344700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011751808:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.350941:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095eeb3c0/0x8a60d30f571c6b1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d664 expref: 1058 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.350944:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.350945:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.350947:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727c45e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.350947:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727c473 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.350951:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727c45e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.350955:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727c45e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.350955:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.350956:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095eeb3c0/0x8a60d30f571c6b1f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d664 expref: 1058 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.350959:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727c45e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.350961:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095eeb3c0/0x8a60d30f571c6b1f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d664 expref: 1058 pid: 16075 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.350962:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727c45e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.350966:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727c45e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.350967:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c0d3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011752704:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.350969:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b73c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.350970:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727c45e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.350972:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011752576 00010000:00010000:1.0:1721880422.350974:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727c45e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.350974:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011752576 00010000:00010000:1.0:1721880422.350979:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727c45e lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.350981:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdece40 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.350986:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727c45e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.350987:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632293 00000100:00100000:2.0:1721880422.350991:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098bec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2197:3688:x1805522011752576:12345-0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1721880422.350996:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009c602a00/2, rc 0, transno 1052962 00002000:00080000:2.0:1721880422.351001:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64574 count 1 00000100:00100000:3.0:1721880422.351008:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c602a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011751168:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.351024:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727c47a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc3e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.351035:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800975046c0/0x8a60d30f571c709e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d7ad expref: 1058 pid: 16021 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.351035:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.351041:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1721880422.351041:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.351043:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.351045:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727c47a lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.351046:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120344700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011752832:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.351059:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800975046c0/0x8a60d30f571c709e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d7ad expref: 1058 pid: 16021 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.351061:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.351068:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800975046c0/0x8a60d30f571c709e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d7ad expref: 1058 pid: 16021 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.351077:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880098bef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011752960:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.351096:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde600 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.351111:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011752832 00000100:00100000:2.0:1721880422.351113:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011752832 00000100:00100000:2.0:1721880422.351127:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632294 00000100:00100000:0.0:1721880422.351130:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2200:3687:x1805522011750656:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2177us (2214us total) trans 4296020259 rc 0/0 00000100:00100000:2.0:1721880422.351131:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120347100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2200:3687:x1805522011752832:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.351136:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d278380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2200:3689:x1805522011751424:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1853us (1886us total) trans 4296020260 rc 0/0 00000100:00100000:0.0:1721880422.351137:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632286 00000100:00100000:3.0:1721880422.351139:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00002000:00080000:2.0:1721880422.351140:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64575 count 1 00000100:00100000:1.0:1721880422.351141:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632289 00000100:00100000:2.0:1721880422.351156:0:7116:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257736960 00000100:00100000:2.0:1721880422.351158:0:7116:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257736960 00000004:00080000:1.0:1721880422.351162:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880087746680/2, rc 0, transno 1052963 00000100:00100000:1.0:1721880422.351166:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880087746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011750656:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.351168:0:7116:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092802d00/0x8a60d30f571c643b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d4b2 expref: 1059 pid: 16124 timeout: 887 lvb_type: 0 00000004:00080000:0.0:1721880422.351172:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880120346680/2, rc 0, transno 1052964 00000100:00100000:0.0:1721880422.351177:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120346680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011751424:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.351178:0:7116:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257737216 00000100:00100000:2.0:1721880422.351179:0:7116:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257737216 00000100:00100000:3.0:1721880422.351185:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914482 00010000:00010000:2.0:1721880422.351186:0:7116:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ef0f600/0x8a60d30f571c6943 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d5d1 expref: 1060 pid: 16075 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.351189:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8067450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1060:2005:x1805522257736960:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.351195:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120346300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011753216:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.351196:0:7116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914483 00010000:00010000:3.0:1721880422.351196:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.351200:0:7116:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1060:2005:x1805522257737216:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.351200:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092802d00/0x8a60d30f571c643b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d4b2 expref: 1060 pid: 16124 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.351204:0:7116:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.351206:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092802d00/0x8a60d30f571c643b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d4b2 expref: 1060 pid: 16124 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.351207:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.351207:0:7116:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ef0f600/0x8a60d30f571c6943 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc3b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d5d1 expref: 1060 pid: 16075 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.351214:0:7116:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ef0f600/0x8a60d30f571c6943 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc3b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d5d1 expref: 1060 pid: 16075 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.351214:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092802d00/0x8a60d30f571c643b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d4b2 expref: 1060 pid: 16124 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.351220:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011753088:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.351221:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.351221:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1721880422.351222:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011753216 00010000:00010000:2.0:1721880422.351222:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.351222:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.351224:0:7116:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c465 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc3b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.351224:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c457 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.351226:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011753216 00000100:00100000:1.0:1721880422.351228:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.351228:0:7116:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c465 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc3b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.351229:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c457 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.351235:0:7116:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.351238:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.351242:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011753088 00000100:00100000:0.0:1721880422.351244:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632295 00000100:00100000:1.0:1721880422.351244:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011753088 00000100:00100000:0.0:1721880422.351247:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120347b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2200:3688:x1805522011753216:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.351252:0:7116:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1059:2005:x1805522257737216:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 51us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.351252:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8067450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1059:2005:x1805522257736960:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 63us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.351255:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632296 00000100:00100000:2.0:1721880422.351256:0:7116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914483 00002000:00080000:0.0:1721880422.351257:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64577 count 1 00000100:00100000:1.0:1721880422.351258:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2200:3687:x1805522011753088:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.351259:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914482 00010000:00010000:0.0:1721880422.351264:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727c481 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc41:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.351265:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64576 count 1 00010000:00010000:2.0:1721880422.351269:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c488 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc3f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.351272:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f15f80/0x8a60d30f571c7a7d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc41:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11da1c expref: 1057 pid: 16109 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.351272:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727c48f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc40:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.351276:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009afe7600/0x8a60d30f571c7361 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc3f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d840 expref: 1057 pid: 15545 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.351277:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.351278:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.351279:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007b962ac0/0x8a60d30f571c775f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d92e expref: 1057 pid: 16037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.351279:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.351280:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727c481 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc41:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.351280:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.351282:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c488 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc3f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.351286:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.351287:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.351289:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727c48f lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.351291:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f15f80/0x8a60d30f571c7a7d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc41:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11da1c expref: 1057 pid: 16109 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.351291:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009afe7600/0x8a60d30f571c7361 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc3f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d840 expref: 1057 pid: 15545 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.351296:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009afe7600/0x8a60d30f571c7361 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc3f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d840 expref: 1057 pid: 15545 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.351297:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f15f80/0x8a60d30f571c7a7d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc41:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11da1c expref: 1057 pid: 16109 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.351297:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ef0f600/0x8a60d30f571c6943 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d5d1 expref: 1057 pid: 16075 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.351299:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007b962ac0/0x8a60d30f571c775f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d92e expref: 1057 pid: 16037 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.351301:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880098bee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011753344:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.351304:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009625aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011753472:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.351304:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007b962ac0/0x8a60d30f571c775f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d92e expref: 1056 pid: 16037 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.351304:0:16088:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c0d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011752064:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.351311:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880130769180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011753600:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.351312:0:16088:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c465 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.351314:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdecc0 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.351316:0:16088:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c465 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.351319:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e540 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.351320:0:16088:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c465 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.351324:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb540 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.351324:0:16088:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c465 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.351327:0:16088:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c465 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.351331:0:16088:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c465 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.351334:0:16088:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa9b00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.351336:0:16088:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c465 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.351343:0:16088:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c465 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.351349:0:16088:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c465 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.351352:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c465 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.351418:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2201:3686:x1805522011751936:12345-0@lo:6:osp-syn-1-0.0 Request processed in 963us (1007us total) trans 4296020261 rc 0/0 00000100:00100000:3.0:1721880422.351423:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632290 00000004:00080000:3.0:1721880422.351439:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880120345880/2, rc 0, transno 1052965 00000100:00100000:3.0:1721880422.351444:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011751936:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.351453:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c457 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.351457:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c457 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.351461:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c457 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.351465:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c457 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.351468:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1721880422.351472:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013076ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011753728:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.351472:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c457 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.351475:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350480 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.351477:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c457 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.351481:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c457 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.351485:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.351486:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c457 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.351489:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c457 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.351498:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011753728 00000100:00100000:0.0:1721880422.351501:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011753728 00000100:00100000:0.0:1721880422.351515:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632297 00000100:00100000:0.0:1721880422.351518:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2201:3688:x1805522011753728:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.351526:0:16088:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64578 count 1 00010000:00010000:0.0:1721880422.351534:0:16088:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c496 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.351541:0:16088:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099feb600/0x8a60d30f571c7c28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11dab6 expref: 1056 pid: 16080 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.351545:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.351546:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.351548:0:16088:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c496 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.351558:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880120344a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2202:3689:x1805522011751296:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2310us (2369us total) trans 4296020262 rc 0/0 00010000:00010000:0.0:1721880422.351559:0:16088:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099feb600/0x8a60d30f571c7c28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11dab6 expref: 1056 pid: 16080 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.351562:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632287 00010000:00010000:0.0:1721880422.351566:0:16088:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099feb600/0x8a60d30f571c7c28 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11dab6 expref: 1056 pid: 16080 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.351571:0:16088:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007b874a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011753856:192.168.201.24@tcp:104: 00000004:00080000:1.0:1721880422.351573:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009c602680/2, rc 0, transno 1052966 00000100:00100000:1.0:1721880422.351581:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011751296:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.351588:0:16088:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.351648:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800858b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011753984:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.351669:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.351683:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011753984 00000100:00100000:3.0:1721880422.351686:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011753984 00000100:00100000:3.0:1721880422.351698:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632298 00000100:00100000:3.0:1721880422.351700:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098bec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2202:3686:x1805522011753984:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.351708:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64579 count 1 00010000:00010000:3.0:1721880422.351715:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c49d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc43:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.351743:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800966e1b00/0x8a60d30f571c7e82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11db50 expref: 1056 pid: 16031 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.351747:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.351748:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.351750:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c49d lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.351761:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800966e1b00/0x8a60d30f571c7e82 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11db50 expref: 1056 pid: 16031 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.351766:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800966e1b00/0x8a60d30f571c7e82 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11db50 expref: 1056 pid: 16031 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.351772:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c0d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011754112:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.351792:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec000 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.351803:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120346a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011752448:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.351808:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c0d3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011752704:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.351816:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727c473 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.351817:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727c46c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc3d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.351859:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.351860:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880098bef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011752960:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.351871:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257737344 00010000:00010000:2.0:1721880422.351872:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727c47a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.351874:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257737344 00000100:00100000:0.0:1721880422.351878:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.351882:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a538f600/0x8a60d30f571c6d79 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc3d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d705 expref: 1057 pid: 16096 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.351899:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257737472 00000100:00100000:2.0:1721880422.351902:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257737472 00000100:00100000:3.0:1721880422.351902:0:16188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914484 00000100:00100000:3.0:1721880422.351905:0:16188:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+1058:2004:x1805522257737344:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.351909:0:16188:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.351911:0:16188:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a538f600/0x8a60d30f571c6d79 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc3d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d705 expref: 1058 pid: 16096 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.351914:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095eeb3c0/0x8a60d30f571c6b1f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d664 expref: 1058 pid: 16075 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.351917:0:16188:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a538f600/0x8a60d30f571c6d79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc3d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d705 expref: 1058 pid: 16096 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.351919:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.351925:0:16188:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a538f600/0x8a60d30f571c6d79 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc3d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d705 expref: 1058 pid: 16096 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.351932:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257737600 00010000:00010000:3.0:1721880422.351933:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.351934:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257737600 00010000:00010000:3.0:1721880422.351934:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.351935:0:16188:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727c46c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc3d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.351939:0:16188:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727c46c lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc3d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.351941:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800975046c0/0x8a60d30f571c709e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d7ad expref: 1058 pid: 16021 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.351954:0:16188:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.351956:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914485 00000100:00100000:0.0:1721880422.351960:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914486 00000100:00100000:2.0:1721880422.351961:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098222d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1058:2004:x1805522257737472:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.351964:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098221180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+1058:2004:x1805522257737600:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.351968:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.351969:0:16188:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+1058:2004:x1805522257737344:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 63us (112us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.351971:0:7118:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.351972:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095eeb3c0/0x8a60d30f571c6b1f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc3c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d664 expref: 1058 pid: 16075 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.351973:0:16188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914484 00010000:00010000:0.0:1721880422.351975:0:7118:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800975046c0/0x8a60d30f571c709e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc3e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d7ad expref: 1058 pid: 16021 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.351975:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727c46c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.351981:0:7118:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800975046c0/0x8a60d30f571c709e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc3e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d7ad expref: 1057 pid: 16021 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.351981:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095eeb3c0/0x8a60d30f571c6b1f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc3c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d664 expref: 1057 pid: 16075 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.351987:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727c46c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.351990:0:7118:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800975046c0/0x8a60d30f571c709e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc3e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d7ad expref: 1057 pid: 16021 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.351994:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727c46c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.351994:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095eeb3c0/0x8a60d30f571c6b1f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc3c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d664 expref: 1057 pid: 16075 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.351999:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.352000:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.352001:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727c46c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.352002:0:7118:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727c47a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.352004:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.352006:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.352007:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727c46c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.352008:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727c473 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.352027:0:7118:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727c47a lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.352028:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b5b00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.352031:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727c46c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.352036:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727c473 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.352037:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727c46c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.352040:0:7118:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.352047:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727c46c lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.352051:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.352053:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727c46c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.352057:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727c473 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.352061:0:7118:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098221180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+1055:2004:x1805522257737600:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 96us (141us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.352063:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727c473 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.352067:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727c473 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.352068:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914486 00000100:00100000:2.0:1721880422.352068:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098222d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1055:2004:x1805522257737472:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 105us (189us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.352071:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727c473 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.352075:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914485 00010000:00010000:3.0:1721880422.352075:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727c473 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.352078:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8b40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.352080:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727c473 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.352083:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727c473 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.352089:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727c473 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.352092:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727c47a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.352093:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727c473 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.352100:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727c47a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.352107:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727c47a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.352114:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727c47a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.352121:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727c47a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.352127:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353840 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.352130:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727c47a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.352142:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727c47a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.352152:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727c47a lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.352159:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727c47a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.352166:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009625b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2204:3689:x1805522011752320:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1366us (1503us total) trans 4296020263 rc 0/0 00000100:00100000:1.0:1721880422.352173:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632291 00000100:00100000:3.0:1721880422.352174:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880120346d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2204:3687:x1805522011752192:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1254us (1291us total) trans 4296020264 rc 0/0 00000100:00100000:3.0:1721880422.352178:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632292 00000100:00100000:2.0:1721880422.352274:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098bec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2203:3688:x1805522011752576:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1280us (1317us total) trans 4296020265 rc 0/0 00000100:00100000:2.0:1721880422.352280:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632293 00000004:00080000:0.0:1721880422.352306:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880120345f80/2, rc 0, transno 1052967 00000100:00100000:0.0:1721880422.352316:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120345f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011752320:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.352320:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880098bee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011753344:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.352331:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.352332:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c488 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc3f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.352366:0:7116:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257737728 00000100:00100000:3.0:1721880422.352369:0:7116:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257737728 00000100:00100000:1.0:1721880422.352372:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.352379:0:7116:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009afe7600/0x8a60d30f571c7361 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc3f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d840 expref: 1054 pid: 15545 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.352387:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257737856 00000100:00100000:2.0:1721880422.352390:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257737856 00000100:00100000:3.0:1721880422.352391:0:7116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914487 00000100:00100000:3.0:1721880422.352394:0:7116:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1055:2006:x1805522257737728:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.352399:0:7116:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.352401:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007b962ac0/0x8a60d30f571c775f lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d92e expref: 1055 pid: 16037 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.352402:0:7116:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009afe7600/0x8a60d30f571c7361 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc3f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d840 expref: 1055 pid: 15545 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.352408:0:7116:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009afe7600/0x8a60d30f571c7361 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc3f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d840 expref: 1055 pid: 15545 timeout: 887 lvb_type: 0 00000004:00080000:1.0:1721880422.352413:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880120347800/2, rc 0, transno 1052969 00010000:00010000:3.0:1721880422.352416:0:7116:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009afe7600/0x8a60d30f571c7361 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc3f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d840 expref: 1055 pid: 15545 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.352417:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914488 00000100:00100000:1.0:1721880422.352418:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120347800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011752576:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.352421:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1054:2005:x1805522257737856:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.352423:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.352424:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.352426:0:7116:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c488 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc3f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.352428:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.352430:0:7116:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c488 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc3f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.352431:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007b962ac0/0x8a60d30f571c775f lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc40:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d92e expref: 1054 pid: 16037 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.352434:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880130769180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011753600:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.352440:0:7116:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.352441:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007b962ac0/0x8a60d30f571c775f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc40:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d92e expref: 1054 pid: 16037 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.352452:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727c48f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc40:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.352452:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007b962ac0/0x8a60d30f571c775f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc40:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11d92e expref: 1054 pid: 16037 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.352455:0:7116:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1054:2006:x1805522257737728:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 59us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.352458:0:7116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914487 00010000:00010000:2.0:1721880422.352462:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.352463:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.352466:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727c48f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.352468:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880098220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011754368:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.352473:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727c48f lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.352477:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009625aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011753472:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.352484:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.352485:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.352487:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727c481 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc41:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.352487:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c0d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011754112:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.352497:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c49d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.352500:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880098222300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011754240:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.352501:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727c48f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.352502:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1052:2005:x1805522257737856:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 80us (130us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.352506:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727c48f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.352507:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914488 00010000:00010000:1.0:1721880422.352510:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727c48f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.352514:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727c48f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.352515:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.352517:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727c48f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.352522:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011754368 00010000:00010000:1.0:1721880422.352524:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b6f40 already unused, calling callback (ffffffffa084e330) 00000100:00100000:2.0:1721880422.352524:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011754368 00010000:00010000:1.0:1721880422.352526:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727c48f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.352530:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727c48f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.352530:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000004:00080000:0.0:1721880422.352534:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880120344000/2, rc 0, transno 1052968 00000100:00100000:2.0:1721880422.352534:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011754240 00010000:00010000:1.0:1721880422.352536:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727c48f lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.352536:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011754240 00000100:00100000:0.0:1721880422.352538:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120344000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011752192:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.352540:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727c48f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.352543:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257738112 00000100:00100000:2.0:1721880422.352545:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632299 00000100:00100000:3.0:1721880422.352546:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257738112 00000100:00100000:2.0:1721880422.352548:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2204:3688:x1805522011754368:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.352555:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099feb600/0x8a60d30f571c7c28 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11dab6 expref: 1052 pid: 16080 timeout: 887 lvb_type: 0 00002000:00080000:2.0:1721880422.352558:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64581 count 1 00000100:00100000:0.0:1721880422.352559:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011754496:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.352565:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914489 00010000:00010000:2.0:1721880422.352568:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727c4a4 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc45:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.352568:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e194c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1052:2005:x1805522257738112:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.352569:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.352572:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.352575:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099feb600/0x8a60d30f571c7c28 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11dab6 expref: 1052 pid: 16080 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.352579:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007b922400/0x8a60d30f571c8401 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11dc99 expref: 1052 pid: 16057 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.352581:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099feb600/0x8a60d30f571c7c28 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11dab6 expref: 1052 pid: 16080 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.352584:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.352585:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.352586:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727c4a4 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.352589:0:16088:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007b874a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011753856:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.352589:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099feb600/0x8a60d30f571c7c28 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11dab6 expref: 1052 pid: 16080 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.352596:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.352597:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007b922400/0x8a60d30f571c8401 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11dc99 expref: 1051 pid: 16057 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.352597:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.352599:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c496 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.352602:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007b922400/0x8a60d30f571c8401 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11dc99 expref: 1051 pid: 16057 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.352607:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c496 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.352608:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880098bee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011754624:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.352613:0:16088:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c496 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.352615:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.352622:0:16088:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c496 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.352625:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdecc0 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.352626:0:16088:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c496 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.352629:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880130769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2205:3687:x1805522011753088:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1370us (1398us total) trans 4296020266 rc 0/0 00010000:00010000:0.0:1721880422.352630:0:16088:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c496 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.352633:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632296 00010000:00010000:0.0:1721880422.352634:0:16088:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c496 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.352637:0:16088:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c496 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.352638:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e194c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1051:2005:x1805522257738112:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 69us (107us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.352639:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c488 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.352641:0:16088:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325ed00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.352643:0:16088:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c496 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.352643:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011754496 00010000:00010000:2.0:1721880422.352644:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c488 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.352644:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914489 00000100:00100000:1.0:1721880422.352645:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011754496 00010000:00010000:0.0:1721880422.352647:0:16088:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c496 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.352648:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c488 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.352652:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c488 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.352654:0:16088:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c496 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.352654:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632300 00010000:00010000:2.0:1721880422.352656:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c488 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.352657:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c496 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.352657:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009625aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2205:3687:x1805522011754240:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.352660:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350240 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.352662:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c488 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.352666:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64580 count 1 00010000:00010000:2.0:1721880422.352666:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c488 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.352671:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c488 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.352672:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727c4ab lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc44:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.352674:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c488 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.352679:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800911461c0/0x8a60d30f571c81ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11dbff expref: 1050 pid: 16077 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.352686:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.352687:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.352689:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727c4ab lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.352690:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632301 00000100:00100000:3.0:1721880422.352693:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f70b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2205:3689:x1805522011754496:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.352699:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800911461c0/0x8a60d30f571c81ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11dbff expref: 1050 pid: 16077 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.352704:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800911461c0/0x8a60d30f571c81ae lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11dbff expref: 1050 pid: 16077 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.352710:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800858b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011754752:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.352724:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb540 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.352724:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.352750:0:7118:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257737984 00000100:00100000:3.0:1721880422.352752:0:7118:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257737984 00010000:00010000:3.0:1721880422.352760:0:7118:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f15f80/0x8a60d30f571c7a7d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc41:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11da1c expref: 1051 pid: 16109 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.352770:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914490 00000100:00100000:3.0:1721880422.352772:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+1051:2005:x1805522257737984:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.352776:0:7118:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.352778:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880120347100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2207:3687:x1805522011752832:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1647us (1716us total) trans 4296020268 rc 0/0 00010000:00010000:3.0:1721880422.352779:0:7118:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f15f80/0x8a60d30f571c7a7d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc41:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11da1c expref: 1051 pid: 16109 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.352783:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632294 00010000:00010000:3.0:1721880422.352784:0:7118:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f15f80/0x8a60d30f571c7a7d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc41:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11da1c expref: 1051 pid: 16109 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.352792:0:7118:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f15f80/0x8a60d30f571c7a7d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc41:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11da1c expref: 1051 pid: 16109 timeout: 887 lvb_type: 0 00000004:00080000:0.0:1721880422.352794:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880120344380/2, rc 0, transno 1052970 00000100:00100000:0.0:1721880422.352800:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011753088:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.352800:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.352801:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.352802:0:7118:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727c481 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc41:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.352805:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880120344700/2, rc 0, transno 1052972 00010000:00010000:3.0:1721880422.352807:0:7118:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727c481 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc41:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.352810:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120344700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011752832:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.352816:0:7118:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.352820:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727c481 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.352825:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727c481 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.352826:0:7118:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+1050:2005:x1805522257737984:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 53us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.352827:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800858b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011754880:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.352829:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727c481 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.352830:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800858b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011755008:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.352830:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914490 00010000:00010000:0.0:1721880422.352833:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727c481 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.352836:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727c481 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.352839:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325c480 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.352841:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727c481 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.352841:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1721880422.352843:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64582 count 1 00010000:00010000:0.0:1721880422.352844:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727c481 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.352850:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727c4b2 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc46:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.352854:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727c481 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.352856:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.352857:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f815f80/0x8a60d30f571c903a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11e62b expref: 1049 pid: 15514 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.352859:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727c481 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.352860:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011754880 00010000:00010000:3.0:1721880422.352860:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.352861:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.352862:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011754880 00010000:00010000:3.0:1721880422.352862:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727c4b2 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.352871:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f815f80/0x8a60d30f571c903a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11e62b expref: 1049 pid: 15514 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.352872:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011755008 00000100:00100000:2.0:1721880422.352874:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011755008 00000100:00100000:1.0:1721880422.352877:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632302 00010000:00010000:3.0:1721880422.352880:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f815f80/0x8a60d30f571c903a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11e62b expref: 1049 pid: 15514 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.352881:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098bef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2208:3686:x1805522011754880:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.352886:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632303 00000100:00100000:3.0:1721880422.352886:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c0d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011755136:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.352889:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2208:3687:x1805522011755008:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.352890:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64583 count 1 00000100:00100000:3.0:1721880422.352897:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec000 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.352898:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c4b9 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc47:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.352904:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a08133c0/0x8a60d30f571c9454 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11e870 expref: 1049 pid: 16054 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.352910:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64584 count 1 00010000:00010000:2.0:1721880422.352917:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727c4c0 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc48:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.352920:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.352921:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.352922:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c4b9 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.352924:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009212d440/0x8a60d30f571c96c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11e918 expref: 1049 pid: 16076 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.352929:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.352930:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.352931:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727c4c0 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.352933:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a08133c0/0x8a60d30f571c9454 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11e870 expref: 1049 pid: 16054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.352939:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a08133c0/0x8a60d30f571c9454 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11e870 expref: 1049 pid: 16054 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.352941:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009212d440/0x8a60d30f571c96c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11e918 expref: 1049 pid: 16076 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.352945:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800858b6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011755264:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.352947:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009212d440/0x8a60d30f571c96c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11e918 expref: 1049 pid: 16076 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.352948:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880120347b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2209:3688:x1805522011753216:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1699us (1740us total) trans 4296020269 rc 0/0 00000100:00100000:0.0:1721880422.352952:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632295 00000100:00100000:2.0:1721880422.352954:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880098bed880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011755392:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.352958:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb240 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.352968:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde600 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.352970:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000004:00080000:1.0:1721880422.352982:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880120346300/2, rc 0, transno 1052973 00000100:00100000:3.0:1721880422.352982:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257738240 00000100:00100000:3.0:1721880422.352984:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257738240 00000100:00100000:1.0:1721880422.352989:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120346300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011753216:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.352993:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800966e1b00/0x8a60d30f571c7e82 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11db50 expref: 1050 pid: 16031 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.353003:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914491 00000100:00100000:0.0:1721880422.353007:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880130768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2208:3688:x1805522011753728:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1487us (1519us total) trans 4296020267 rc 0/0 00000100:00100000:3.0:1721880422.353007:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1050:2005:x1805522257738240:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.353026:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1721880422.353029:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632297 00010000:00010000:3.0:1721880422.353029:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800966e1b00/0x8a60d30f571c7e82 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11db50 expref: 1050 pid: 16031 timeout: 887 lvb_type: 0 00000004:00080000:1.0:1721880422.353033:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88013076ad80/2, rc 0, transno 1052971 00010000:00010000:3.0:1721880422.353035:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800966e1b00/0x8a60d30f571c7e82 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11db50 expref: 1050 pid: 16031 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.353039:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013076ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011753728:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.353042:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800966e1b00/0x8a60d30f571c7e82 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11db50 expref: 1050 pid: 16031 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.353050:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.353052:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.353054:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c49d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.353058:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c49d lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.353066:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800858b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011755520:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.353067:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.353072:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c49d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.353077:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c49d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.353079:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1049:2005:x1805522257738240:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 72us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.353082:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800858b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011755648:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.353082:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.353083:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914491 00010000:00010000:2.0:1721880422.353085:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c49d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.353089:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c49d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.353092:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c49d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.353095:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa9680 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.353097:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c49d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.353101:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c49d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.353103:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.353106:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c49d lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.353110:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c49d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.353115:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011755520 00000100:00100000:1.0:1721880422.353117:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011755520 00000100:00100000:0.0:1721880422.353121:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011755648 00000100:00100000:0.0:1721880422.353123:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011755648 00000100:00100000:1.0:1721880422.353130:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632304 00000100:00100000:1.0:1721880422.353133:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2209:3688:x1805522011755520:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.353138:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632305 00002000:00080000:1.0:1721880422.353141:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64585 count 1 00000100:00100000:0.0:1721880422.353142:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c849450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2209:3689:x1805522011755648:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.353148:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727c4c7 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc49:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1721880422.353155:0:16088:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64586 count 1 00010000:00010000:1.0:1721880422.353156:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097919680/0x8a60d30f571c97c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11e996 expref: 1048 pid: 16077 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.353160:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.353161:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.353162:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727c4c7 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.353165:0:16088:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727c4ce lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc4a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.353171:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097919680/0x8a60d30f571c97c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11e996 expref: 1048 pid: 16077 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.353176:0:16088:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962b4900/0x8a60d30f571c9986 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ea29 expref: 1048 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.353178:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097919680/0x8a60d30f571c97c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11e996 expref: 1048 pid: 16077 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.353182:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.353184:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1721880422.353186:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880130769180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011755776:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.353187:0:16088:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727c4ce lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.353190:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098bec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2210:3686:x1805522011753984:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1488us (1520us total) trans 4296020270 rc 0/0 00000100:00100000:2.0:1721880422.353194:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632298 00000004:00080000:3.0:1721880422.353200:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800858b4000/2, rc 0, transno 1052974 00010000:00010000:0.0:1721880422.353204:0:16088:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800962b4900/0x8a60d30f571c9986 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ea29 expref: 1048 pid: 16039 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.353211:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800858b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011753984:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.353214:0:16088:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800962b4900/0x8a60d30f571c9986 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ea29 expref: 1048 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.353214:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb000 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.353224:0:16088:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f709880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011755904:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.353239:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120346a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011756032:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.353244:0:16088:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.353253:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.353268:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011756032 00000100:00100000:0.0:1721880422.353271:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011756032 00000100:00100000:0.0:1721880422.353285:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632306 00000100:00100000:0.0:1721880422.353289:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2210:3686:x1805522011756032:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.353300:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64587 count 1 00010000:00010000:0.0:1721880422.353309:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727c4d5 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc4b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.353320:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009400b840/0x8a60d30f571c9b70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11eaa0 expref: 1048 pid: 16041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.353326:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.353327:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.353329:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727c4d5 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.353345:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009400b840/0x8a60d30f571c9b70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11eaa0 expref: 1048 pid: 16041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.353355:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009400b840/0x8a60d30f571c9b70 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11eaa0 expref: 1048 pid: 16041 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.353364:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007b874a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011756160:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.353384:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e540 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.353705:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880098bee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011754624:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.353716:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727c4a4 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.353770:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800858b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011754752:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.353785:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727c4ab lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.354175:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c0d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011755136:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.354183:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.354184:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727c4b2 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.354209:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.354219:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.354224:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257738368 00000100:00100000:3.0:1721880422.354224:0:7118:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257738496 00000100:00100000:3.0:1721880422.354227:0:7118:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257738496 00000100:00100000:2.0:1721880422.354228:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257738368 00010000:00010000:3.0:1721880422.354239:0:7118:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800911461c0/0x8a60d30f571c81ae lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11dbff expref: 1050 pid: 16077 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.354241:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007b922400/0x8a60d30f571c8401 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11dc99 expref: 1050 pid: 16057 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.354246:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.354251:0:7118:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257738624 00000100:00100000:3.0:1721880422.354252:0:7118:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257738624 00000100:00100000:2.0:1721880422.354258:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257738752 00000100:00100000:2.0:1721880422.354260:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257738752 00010000:00010000:3.0:1721880422.354263:0:7118:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f815f80/0x8a60d30f571c903a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11e62b expref: 1052 pid: 15514 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.354268:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a08133c0/0x8a60d30f571c9454 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11e870 expref: 1052 pid: 16054 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.354272:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.354276:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800858b6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011755264:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.354283:0:7118:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257739008 00000100:00100000:3.0:1721880422.354285:0:7118:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257739008 00000100:00100000:2.0:1721880422.354289:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914492 00010000:00010000:1.0:1721880422.354290:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c4b9 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.354291:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.354291:0:7118:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800962b4900/0x8a60d30f571c9986 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ea29 expref: 1053 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.354293:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076e5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1053:2004:x1805522257738496:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.354298:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1721880422.354301:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.354301:0:7118:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257738880 00010000:00010000:2.0:1721880422.354302:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800911461c0/0x8a60d30f571c81ae lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc44:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11dbff expref: 1053 pid: 16077 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.354302:0:7118:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257738880 00000100:00100000:1.0:1721880422.354305:0:15444:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257739136 00000100:00100000:1.0:1721880422.354307:0:15444:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257739136 00010000:00010000:2.0:1721880422.354308:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800911461c0/0x8a60d30f571c81ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc44:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11dbff expref: 1054 pid: 16077 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.354308:0:7118:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009212d440/0x8a60d30f571c96c3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11e918 expref: 1054 pid: 16076 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.354316:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914493 00010000:00010000:1.0:1721880422.354316:0:15444:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097919680/0x8a60d30f571c97c6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11e996 expref: 1055 pid: 16077 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.354317:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800911461c0/0x8a60d30f571c81ae lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc44:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11dbff expref: 1055 pid: 16077 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.354320:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1055:2005:x1805522257738368:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.354321:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914494 00000100:00100000:3.0:1721880422.354324:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076e5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+1054:2007:x1805522257738624:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.354325:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.354326:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.354328:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.354328:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727c4ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.354330:0:7118:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.354331:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007b922400/0x8a60d30f571c8401 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc45:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11dc99 expref: 1054 pid: 16057 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.354333:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727c4ab lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.354333:0:7118:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f815f80/0x8a60d30f571c903a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc46:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11e62b expref: 1054 pid: 15514 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.354334:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914495 00000100:00100000:1.0:1721880422.354338:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076e5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1054:2004:x1805522257738752:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.354339:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007b922400/0x8a60d30f571c8401 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc45:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11dc99 expref: 1054 pid: 16057 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.354339:0:7118:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f815f80/0x8a60d30f571c903a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc46:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11e62b expref: 1054 pid: 15514 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.354343:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.354343:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.354346:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a08133c0/0x8a60d30f571c9454 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc47:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11e870 expref: 1054 pid: 16054 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.354349:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007b922400/0x8a60d30f571c8401 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc45:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11dc99 expref: 1054 pid: 16057 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.354349:0:7118:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f815f80/0x8a60d30f571c903a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc46:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11e62b expref: 1054 pid: 15514 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.354352:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a08133c0/0x8a60d30f571c9454 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc47:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11e870 expref: 1054 pid: 16054 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.354356:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.354357:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880076e5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1053:2004:x1805522257738496:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 63us (147us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.354357:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.354358:0:7118:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727c4b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.354360:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a08133c0/0x8a60d30f571c9454 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc47:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11e870 expref: 1052 pid: 16054 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.354361:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.354361:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914492 00010000:00010000:0.0:1721880422.354362:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.354364:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727c4a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.354366:0:7118:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727c4b2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.354367:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.354368:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.354369:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727c4a4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.354369:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c4b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.354370:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914496 00010000:00010000:1.0:1721880422.354374:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c4b9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.354374:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ab4d6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1050:2007:x1805522257739008:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.354375:0:7118:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.354378:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.354378:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.354380:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.354381:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800962b4900/0x8a60d30f571c9986 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc4a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ea29 expref: 1050 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.354387:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800962b4900/0x8a60d30f571c9986 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc4a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ea29 expref: 1050 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.354389:0:7118:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880076e5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+1050:2007:x1805522257738624:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 64us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.354391:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1050:2005:x1805522257738368:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 70us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.354394:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880076e5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1050:2004:x1805522257738752:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 56us (148us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.354394:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.354394:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914494 00010000:00010000:2.0:1721880422.354395:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1721880422.354397:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914493 00010000:00010000:2.0:1721880422.354397:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727c4ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc4a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.354400:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914495 00010000:00010000:2.0:1721880422.354401:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727c4ce lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc4a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.354403:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914497 00010000:00010000:2.0:1721880422.354406:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.354406:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076e5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+1047:2005:x1805522257738880:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.354408:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914498 00010000:00010000:3.0:1721880422.354411:0:7118:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1721880422.354412:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076e5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1047:2005:x1805522257739136:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.354413:0:7118:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009212d440/0x8a60d30f571c96c3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc48:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11e918 expref: 1047 pid: 16076 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.354416:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ab4d6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1047:2007:x1805522257739008:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 42us (144us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.354417:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.354419:0:7118:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009212d440/0x8a60d30f571c96c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc48:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11e918 expref: 1047 pid: 16076 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.354420:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097919680/0x8a60d30f571c97c6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc49:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11e996 expref: 1047 pid: 16077 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.354420:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914496 00010000:00010000:3.0:1721880422.354425:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.354426:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097919680/0x8a60d30f571c97c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc49:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11e996 expref: 1047 pid: 16077 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.354426:0:7118:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.354428:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c4b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.354428:0:7118:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727c4c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc48:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.354432:0:7118:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727c4c0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc48:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.354433:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.354433:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c4b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.354434:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.354436:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727c4c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc49:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.354437:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c4b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.354437:0:7118:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.354441:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c4b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.354444:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727c4c7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc49:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.354445:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c4b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.354446:0:7118:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880076e5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30425778-2709-4512-9d75-01ec53c4cfad+1046:2005:x1805522257738880:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 39us (155us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.354448:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b6d00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.354449:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.354450:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c4b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.354450:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914497 00010000:00010000:1.0:1721880422.354454:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c4b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.354458:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880076e5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1045:2005:x1805522257739136:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 46us (157us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.354459:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c4b9 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.354461:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009212d440/0x8a60d30f571c96c3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11e918 expref: 1045 pid: 16076 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.354462:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914498 00010000:00010000:1.0:1721880422.354462:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c4b9 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.354468:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880098bed880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011755392:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.354469:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727c4b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.354474:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727c4b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.354475:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727c4a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.354476:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727c4c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.354478:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727c4b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.354479:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727c4a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.354481:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727c4c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.354482:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727c4b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.354484:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727c4a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.354485:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727c4b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.354486:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727c4c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.354488:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727c4a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.354488:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa9440 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.354490:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727c4c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.354490:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727c4b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.354491:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727c4a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.354493:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727c4c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.354494:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727c4b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.354495:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801363521c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.354496:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727c4a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.354497:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727c4c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.354499:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727c4b2 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.354500:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352400 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.354502:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727c4c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.354502:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727c4b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.354504:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727c4a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.354506:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727c4c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.354509:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727c4a4 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.354512:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727c4c0 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.354513:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727c4a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.354516:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727c4c0 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.354560:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098bef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2214:3686:x1805522011754880:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1677us (1717us total) trans 4296020271 rc 0/0 00000100:00100000:1.0:1721880422.354564:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632302 00010000:00010000:0.0:1721880422.354567:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962b4900/0x8a60d30f571c9986 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ea29 expref: 1043 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.354573:0:16088:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f709880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011755904:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.354584:0:16088:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727c4ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.354586:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097919680/0x8a60d30f571c97c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11e996 expref: 1042 pid: 16077 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.354587:0:16088:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727c4ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.354591:0:16088:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727c4ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.354593:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f70b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2213:3689:x1805522011754496:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1899us (2022us total) trans 4296020272 rc 0/0 00000100:00100000:1.0:1721880422.354594:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880130769180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011755776:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.354595:0:16088:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727c4ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.354598:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632301 00010000:00010000:0.0:1721880422.354602:0:16088:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727c4ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.354604:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727c4c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.354606:0:16088:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727c4ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.354608:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727c4c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.354608:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2212:3687:x1805522011755008:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1717us (1750us total) trans 4296020273 rc 0/0 00010000:00010000:0.0:1721880422.354609:0:16088:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325cb40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.354611:0:16088:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727c4ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.354612:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727c4c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.354612:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632303 00010000:00010000:0.0:1721880422.354614:0:16088:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727c4ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.354616:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727c4c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.354619:0:16088:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727c4ce lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.354619:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727c4c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.354619:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012f709f80/2, rc 0, transno 1052976 00010000:00010000:0.0:1721880422.354623:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727c4ce lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.354623:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727c4c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.354626:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727c4ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.354627:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4900 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.354630:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727c4c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.354631:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727c4ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.354631:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011754496:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.354635:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727c4ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.354637:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727c4c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.354639:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727c4ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.354642:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727c4ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.354643:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727c4c7 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.354645:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800858b4380/2, rc 0, transno 1052975 00010000:00010000:1.0:1721880422.354647:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727c4c7 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.354647:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800858b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011754880:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.354649:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b5200 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.354651:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727c4ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.354655:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727c4ab lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.354661:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727c4ab lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.354664:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727c4ab lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.354678:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1721880422.354683:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880130769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011756288:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.354699:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.354708:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c849450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2213:3689:x1805522011755648:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1563us (1601us total) trans 4296020275 rc 0/0 00000100:00100000:0.0:1721880422.354713:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632305 00000004:00080000:3.0:1721880422.354717:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800858b7800/2, rc 0, transno 1052979 00000100:00100000:3.0:1721880422.354721:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800858b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011755648:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.354725:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011756288 00000100:00100000:3.0:1721880422.354725:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1721880422.354750:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011756288 00000100:00100000:2.0:1721880422.354753:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009625aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2213:3687:x1805522011754240:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2094us (2236us total) trans 4296020276 rc 0/0 00000100:00100000:2.0:1721880422.354758:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632300 00000100:00100000:3.0:1721880422.354758:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800858b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011756416:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.354767:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632307 00000100:00100000:0.0:1721880422.354770:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2213:3686:x1805522011756288:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.354771:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.354779:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011756416 00002000:00080000:0.0:1721880422.354780:0:16088:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64588 count 1 00000100:00100000:2.0:1721880422.354781:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011756416 00000100:00100000:3.0:1721880422.354782:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c0d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011756544:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.354786:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2214:3688:x1805522011755520:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1651us (1703us total) trans 4296020277 rc 0/0 00010000:00010000:0.0:1721880422.354788:0:16088:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c4dc lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc4c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.354790:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.354791:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632304 00010000:00010000:0.0:1721880422.354795:0:16088:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009106d8c0/0x8a60d30f571c9d61 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11eb3a expref: 1041 pid: 16105 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.354795:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632308 00000100:00100000:2.0:1721880422.354798:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2213:3689:x1805522011756416:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.354800:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.354801:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1721880422.354801:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011756544 00010000:00010000:0.0:1721880422.354802:0:16088:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c4dc lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.354804:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011756544 00002000:00080000:2.0:1721880422.354807:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64589 count 1 00010000:00010000:0.0:1721880422.354812:0:16088:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009106d8c0/0x8a60d30f571c9d61 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11eb3a expref: 1041 pid: 16105 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.354814:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c4e3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc4d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.354818:0:16088:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009106d8c0/0x8a60d30f571c9d61 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11eb3a expref: 1041 pid: 16105 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.354821:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632309 00010000:00010000:2.0:1721880422.354821:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095b8aac0/0x8a60d30f571c9f60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ebc6 expref: 1041 pid: 15497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.354824:0:16088:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076e5d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011756672:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.354824:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2214:3689:x1805522011756544:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.354829:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.354830:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.354831:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c4e3 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.354834:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64590 count 1 00000100:00100000:0.0:1721880422.354838:0:16088:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e3c0 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.354840:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c4ea lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc4e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.354840:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095b8aac0/0x8a60d30f571c9f60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ebc6 expref: 1041 pid: 15497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.354846:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095b8aac0/0x8a60d30f571c9f60 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ebc6 expref: 1041 pid: 15497 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.354848:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801232db600/0x8a60d30f571ca22a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ec67 expref: 1041 pid: 16077 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.354852:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.354852:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880098bed880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011756800:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.354853:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.354855:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c4ea lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.354863:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde600 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.354866:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801232db600/0x8a60d30f571ca22a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ec67 expref: 1041 pid: 16077 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.354871:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801232db600/0x8a60d30f571ca22a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ec67 expref: 1041 pid: 16077 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.354878:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800858b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011756928:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.354892:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb000 going to sleep for 11 seconds 00000004:00080000:1.0:1721880422.354908:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800858b6300/2, rc 0, transno 1052981 00000100:00100000:0.0:1721880422.354912:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2214:3688:x1805522011754368:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2362us (2426us total) trans 4296020274 rc 0/0 00000100:00100000:0.0:1721880422.354916:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632299 00000100:00100000:1.0:1721880422.354920:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800858b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011755520:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1721880422.354926:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880098220380/2, rc 0, transno 1052978 00000100:00100000:1.0:1721880422.354928:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880098220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011754368:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1721880422.354939:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800858b7b80/2, rc 0, transno 1052977 00000100:00100000:1.0:1721880422.354941:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800858b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011755008:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1721880422.354949:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880098222300/2, rc 0, transno 1052980 00000100:00100000:1.0:1721880422.354952:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880098222300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011754240:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.354955:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.354957:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1721880422.354962:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c0d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011757056:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.354967:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257739264 00000100:00100000:2.0:1721880422.354969:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257739264 00010000:00010000:2.0:1721880422.354978:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009400b840/0x8a60d30f571c9b70 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11eaa0 expref: 1042 pid: 16041 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.354981:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.354985:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c0d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011757440:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.354995:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914499 00000100:00100000:1.0:1721880422.354997:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c0d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011757184:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.354999:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098bee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1042:2004:x1805522257739264:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.355004:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.355007:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009400b840/0x8a60d30f571c9b70 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc4b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11eaa0 expref: 1042 pid: 16041 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.355029:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.355030:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011757056 00000100:00100000:0.0:1721880422.355033:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011757056 00010000:00010000:2.0:1721880422.355033:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009400b840/0x8a60d30f571c9b70 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc4b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11eaa0 expref: 1042 pid: 16041 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.355042:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.355043:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.355045:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727c4d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc4b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.355049:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011757184 00010000:00010000:2.0:1721880422.355049:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727c4d5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc4b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.355050:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011757184 00010000:00010000:2.0:1721880422.355056:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.355056:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.355057:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632310 00000100:00100000:1.0:1721880422.355061:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2215:3687:x1805522011757056:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.355064:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011757440 00000100:00100000:0.0:1721880422.355066:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011757440 00000100:00100000:2.0:1721880422.355067:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098bee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1042:2004:x1805522257739264:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 67us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.355070:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914499 00000100:00100000:3.0:1721880422.355070:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00002000:00080000:1.0:1721880422.355071:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64591 count 1 00000100:00100000:3.0:1721880422.355074:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c0d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011757312:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.355076:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632311 00010000:00010000:1.0:1721880422.355078:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c4f1 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc4f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.355080:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2216:3687:x1805522011757184:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.355084:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632312 00010000:00010000:1.0:1721880422.355085:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fb3fa80/0x8a60d30f571ca46f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ed01 expref: 1041 pid: 16022 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.355087:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2216:3689:x1805522011757440:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.355088:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64592 count 1 00010000:00010000:1.0:1721880422.355090:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.355091:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.355092:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c4f1 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.355092:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:2.0:1721880422.355094:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64594 count 1 00010000:00010000:0.0:1721880422.355096:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c4f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc50:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.355101:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c4ff lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc52:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.355102:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fb3fa80/0x8a60d30f571ca46f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ed01 expref: 1041 pid: 16022 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.355104:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099b55680/0x8a60d30f571ca6c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ed9b expref: 1041 pid: 9460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.355107:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fb3fa80/0x8a60d30f571ca46f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ed01 expref: 1041 pid: 16022 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.355107:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008426d440/0x8a60d30f571cac8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ef07 expref: 1041 pid: 16117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.355108:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.355109:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.355110:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1721880422.355110:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011757312 00010000:00010000:0.0:1721880422.355111:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c4f8 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.355111:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.355113:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c4ff lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.355113:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011757312 00000100:00100000:1.0:1721880422.355114:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800858b5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011757568:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.355121:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099b55680/0x8a60d30f571ca6c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ed9b expref: 1041 pid: 9460 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.355122:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008426d440/0x8a60d30f571cac8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ef07 expref: 1041 pid: 16117 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.355124:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb240 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.355126:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099b55680/0x8a60d30f571ca6c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ed9b expref: 1041 pid: 9460 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.355128:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008426d440/0x8a60d30f571cac8e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ef07 expref: 1041 pid: 16117 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.355130:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632313 00000100:00100000:0.0:1721880422.355133:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076e5d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011757696:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.355134:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880098bec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011757824:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.355134:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2217:3689:x1805522011757312:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.355145:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde3c0 going to sleep for 11 seconds 00002000:00080000:3.0:1721880422.355145:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64593 count 1 00000100:00100000:0.0:1721880422.355148:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e840 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.355155:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727c506 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc51:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.355164:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009400b840/0x8a60d30f571c9b70 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11eaa0 expref: 1041 pid: 16041 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.355165:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ba5af40/0x8a60d30f571ca993 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ee58 expref: 1041 pid: 9460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.355171:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1721880422.355172:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007b874a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011756160:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.355173:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.355175:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727c506 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.355181:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727c4d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.355186:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727c4d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.355190:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727c4d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.355191:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ba5af40/0x8a60d30f571ca993 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ee58 expref: 1040 pid: 9460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.355194:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727c4d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.355197:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727c4d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.355199:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ba5af40/0x8a60d30f571ca993 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ee58 expref: 1040 pid: 9460 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.355201:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727c4d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.355204:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325f3c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.355206:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727c4d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.355209:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c0d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011757952:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.355210:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727c4d5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.355215:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727c4d5 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.355223:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727c4d5 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.355231:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec000 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.355330:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2218:3686:x1805522011756032:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2039us (2074us total) trans 4296020278 rc 0/0 00000100:00100000:0.0:1721880422.355336:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632306 00000004:00080000:3.0:1721880422.355352:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880120346a00/2, rc 0, transno 1052982 00000100:00100000:3.0:1721880422.355359:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120346a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011756032:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.355387:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076e5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011758080:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.355402:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.355432:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011758080 00000100:00100000:0.0:1721880422.355435:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011758080 00000100:00100000:0.0:1721880422.355447:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632314 00000100:00100000:0.0:1721880422.355450:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2218:3686:x1805522011758080:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.355458:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64595 count 1 00010000:00010000:0.0:1721880422.355465:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c50d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc53:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.355473:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800920bcb40/0x8a60d30f571cbccc lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11fdcb expref: 1040 pid: 9460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.355477:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.355478:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.355480:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c50d lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.355489:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800920bcb40/0x8a60d30f571cbccc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11fdcb expref: 1040 pid: 9460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.355495:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800920bcb40/0x8a60d30f571cbccc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11fdcb expref: 1040 pid: 9460 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.355501:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007b874a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011758208:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.355522:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e540 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.356194:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880098bed880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011756800:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.356202:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.356203:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c4e3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.356209:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800858b5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011757568:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.356214:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257739392 00000100:00100000:0.0:1721880422.356216:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.356216:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257739392 00010000:00010000:1.0:1721880422.356221:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c4f1 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.356223:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095b8aac0/0x8a60d30f571c9f60 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ebc6 expref: 1041 pid: 15497 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.356225:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.356235:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800858b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011756928:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.356236:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257739776 00000100:00100000:2.0:1721880422.356237:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257739776 00000100:00100000:3.0:1721880422.356238:0:7116:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257739648 00000100:00100000:0.0:1721880422.356239:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.356242:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c4ea lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc4e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.356243:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801232db600/0x8a60d30f571ca22a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc4e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ec67 expref: 1042 pid: 16077 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.356243:0:7116:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257739648 00000100:00100000:2.0:1721880422.356251:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257739520 00000100:00100000:2.0:1721880422.356253:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257739520 00010000:00010000:3.0:1721880422.356256:0:7116:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fb3fa80/0x8a60d30f571ca46f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ed01 expref: 1044 pid: 16022 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.356258:0:16088:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076e5d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011756672:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.356258:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009106d8c0/0x8a60d30f571c9d61 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11eb3a expref: 1044 pid: 16105 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.356259:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076e5d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011757696:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.356266:0:16088:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c4dc lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.356268:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c4f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.356280:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914500 00000100:00100000:2.0:1721880422.356283:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1044:2005:x1805522257739392:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.356286:0:7116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914501 00010000:00010000:2.0:1721880422.356288:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1721880422.356290:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.356291:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095b8aac0/0x8a60d30f571c9f60 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc4d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ebc6 expref: 1044 pid: 15497 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.356291:0:7116:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120344a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1044:2004:x1805522257739776:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.356296:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095b8aac0/0x8a60d30f571c9f60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc4d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ebc6 expref: 1044 pid: 15497 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.356297:0:7116:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.356301:0:7116:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801232db600/0x8a60d30f571ca22a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc4e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ec67 expref: 1044 pid: 16077 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.356305:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095b8aac0/0x8a60d30f571c9f60 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc4d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ebc6 expref: 1044 pid: 15497 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.356308:0:7116:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801232db600/0x8a60d30f571ca22a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc4e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ec67 expref: 1044 pid: 16077 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.356313:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.356314:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.356316:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c4e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.356318:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.356318:0:7116:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801232db600/0x8a60d30f571ca22a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc4e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ec67 expref: 1043 pid: 16077 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.356321:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c4e3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.356326:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.356327:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.356327:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.356329:0:7116:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c4ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.356333:0:7116:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c4ea lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.356341:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1042:2005:x1805522257739392:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 57us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.356345:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914500 00010000:00010000:3.0:1721880422.356346:0:7116:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.356347:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257739904 00000100:00100000:1.0:1721880422.356350:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257739904 00000100:00100000:2.0:1721880422.356353:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257740032 00000100:00100000:2.0:1721880422.356356:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257740032 00010000:00010000:1.0:1721880422.356360:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008426d440/0x8a60d30f571cac8e lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ef07 expref: 1043 pid: 16117 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.356361:0:7116:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880120344a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1043:2004:x1805522257739776:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 71us (145us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.356364:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099b55680/0x8a60d30f571ca6c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ed9b expref: 1043 pid: 9460 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.356368:0:7116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914501 00000100:00100000:1.0:1721880422.356373:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914502 00000100:00100000:1.0:1721880422.356377:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120346d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1042:2006:x1805522257739648:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.356379:0:7116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914503 00000100:00100000:3.0:1721880422.356382:0:7116:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a70eec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1042:2006:x1805522257739520:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.356383:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.356385:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fb3fa80/0x8a60d30f571ca46f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc4f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ed01 expref: 1042 pid: 16022 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.356388:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914504 00010000:00010000:1.0:1721880422.356392:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fb3fa80/0x8a60d30f571ca46f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc4f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ed01 expref: 1042 pid: 16022 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.356393:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.356393:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120347100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1042:2006:x1805522257739904:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.356393:0:7116:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.356397:0:7116:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009106d8c0/0x8a60d30f571c9d61 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11eb3a expref: 1042 pid: 16105 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.356400:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fb3fa80/0x8a60d30f571ca46f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc4f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ed01 expref: 1042 pid: 16022 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.356400:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.356403:0:7116:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009106d8c0/0x8a60d30f571c9d61 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11eb3a expref: 1042 pid: 16105 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.356404:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008426d440/0x8a60d30f571cac8e lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ef07 expref: 1041 pid: 16117 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.356406:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.356407:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.356409:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c4f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.356411:0:7116:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106d8c0/0x8a60d30f571c9d61 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11eb3a expref: 1041 pid: 16105 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.356414:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008426d440/0x8a60d30f571cac8e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ef07 expref: 1041 pid: 16117 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.356417:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c4f1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.356419:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.356419:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.356421:0:7116:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c4dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.356425:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.356425:0:7116:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c4dc lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.356426:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.356426:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.356429:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c4ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.356433:0:7116:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.356434:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.356436:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c4ff lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.356444:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880120346d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1040:2006:x1805522257739648:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 66us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.356445:0:7116:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a70eec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1040:2006:x1805522257739520:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 63us (206us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.356447:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.356448:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914502 00000100:00100000:3.0:1721880422.356451:0:7116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914503 00000100:00100000:1.0:1721880422.356456:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257740160 00000100:00100000:1.0:1721880422.356458:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257740160 00000100:00100000:2.0:1721880422.356462:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880120347100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1039:2006:x1805522257739904:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 69us (172us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.356464:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ba5af40/0x8a60d30f571ca993 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ee58 expref: 1039 pid: 9460 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.356468:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914504 00000100:00100000:1.0:1721880422.356475:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257740288 00000100:00100000:1.0:1721880422.356477:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257740288 00000100:00100000:3.0:1721880422.356480:0:7116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914505 00010000:00010000:1.0:1721880422.356482:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800920bcb40/0x8a60d30f571cbccc lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11fdcb expref: 1039 pid: 9460 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.356485:0:7116:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120347b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1039:2004:x1805522257740032:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.356486:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914506 00010000:00010000:3.0:1721880422.356489:0:7116:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.356491:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130769880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1039:2004:x1805522257740160:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.356492:0:7116:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099b55680/0x8a60d30f571ca6c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc50:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ed9b expref: 1039 pid: 9460 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.356494:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007b874a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011758208:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.356494:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914507 00000100:00100000:1.0:1721880422.356497:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130768000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1039:2005:x1805522257740288:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.356498:0:7116:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099b55680/0x8a60d30f571ca6c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc50:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ed9b expref: 1039 pid: 9460 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.356500:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.356500:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.356502:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c50d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.356503:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800920bcb40/0x8a60d30f571cbccc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc53:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11fdcb expref: 1039 pid: 9460 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.356504:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ba5af40/0x8a60d30f571ca993 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ee58 expref: 1039 pid: 9460 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.356505:0:7116:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099b55680/0x8a60d30f571ca6c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc50:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ed9b expref: 1039 pid: 9460 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.356509:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800920bcb40/0x8a60d30f571cbccc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11fdcb expref: 1039 pid: 9460 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.356512:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.356513:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ba5af40/0x8a60d30f571ca993 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ee58 expref: 1038 pid: 9460 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.356513:0:7116:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.356514:0:7116:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c4f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.356519:0:7116:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c4f8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.356522:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800920bcb40/0x8a60d30f571cbccc lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11fdcb expref: 1038 pid: 9460 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.356522:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.356523:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.356526:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727c506 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.356527:0:7116:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.356529:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.356531:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.356532:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727c506 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.356533:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c50d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.356534:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c4f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.356539:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c4f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.356539:0:7116:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880120347b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30425778-2709-4512-9d75-01ec53c4cfad+1037:2004:x1805522257740032:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 54us (222us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.356540:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c50d lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.356540:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.356542:0:7116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914505 00010000:00010000:0.0:1721880422.356547:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c4f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.356552:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c4f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.356552:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880130769880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1036:2004:x1805522257740160:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 61us (159us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.356553:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.356556:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c4f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.356558:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914506 00010000:00010000:0.0:1721880422.356559:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325eac0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.356561:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c4f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.356564:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c4f8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.356569:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ba5af40/0x8a60d30f571ca993 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ee58 expref: 1035 pid: 9460 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.356570:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c4f8 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.356570:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880130768000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1035:2005:x1805522257740288:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 71us (134us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.356574:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c4f8 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.356576:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914507 00000100:00100000:3.0:1721880422.356576:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c0d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011757952:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.356582:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c4e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.356585:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727c506 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.356589:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c4e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.356589:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727c506 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.356593:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727c506 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.356597:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c4e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.356597:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727c506 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.356601:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727c506 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.356605:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727c506 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.356608:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aaa880 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.356609:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c4f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.356609:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c4e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.356610:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727c506 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.356614:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727c506 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.356615:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c4e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.356616:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c4f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.356619:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727c506 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.356621:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352ac0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.356623:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c4f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.356624:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c4e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.356626:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727c506 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.356628:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c4f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.356631:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c4e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.356635:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c4f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.356638:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b46c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.356640:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c4f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.356641:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c4e3 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.356644:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c4f1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.356649:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c4e3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.356650:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c4f1 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.356654:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c4f1 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.356704:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2222:3687:x1805522011757184:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1623us (1675us total) trans 4296020279 rc 0/0 00000100:00100000:0.0:1721880422.356709:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632311 00000100:00100000:3.0:1721880422.356726:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2221:3689:x1805522011757312:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1591us (1633us total) trans 4296020280 rc 0/0 00000100:00100000:3.0:1721880422.356750:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632313 00000100:00100000:1.0:1721880422.356758:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2220:3687:x1805522011757056:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1695us (1776us total) trans 4296020281 rc 0/0 00000100:00100000:1.0:1721880422.356762:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632310 00000100:00100000:2.0:1721880422.356774:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2219:3689:x1805522011756416:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1973us (2001us total) trans 4296020282 rc 0/0 00000004:00080000:3.0:1721880422.356774:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009c0d2680/2, rc 0, transno 1052984 00010000:00010000:1.0:1721880422.356777:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c4ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.356780:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632308 00010000:00010000:0.0:1721880422.356782:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c50d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.356782:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c4ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.356786:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c4ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.356787:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c0d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011757312:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.356790:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c50d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.356790:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c4ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.356794:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c4ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.356795:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c50d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.356797:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b7cc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.356799:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c50d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.356799:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c4ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.356802:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c4ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.356803:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c50d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.356807:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325d8c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.356808:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c4ea lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.356808:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800858b6d80/2, rc 0, transno 1052986 00010000:00010000:0.0:1721880422.356809:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c50d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.356810:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800858b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011756416:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.356811:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c4ea lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.356812:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c50d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.356819:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c50d lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.356822:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c50d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.356827:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008426d440/0x8a60d30f571cac8e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b11ef07 expref: 1033 pid: 16117 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.356834:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880098bec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011757824:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.356843:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c4ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.356848:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c4ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.356852:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c4ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.356857:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c4ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.356861:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c4ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.356865:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c4ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.356868:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352640 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.356870:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c4ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.356874:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c4ff lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.356880:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c4ff lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.356883:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c4ff lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.356889:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2219:3689:x1805522011756544:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2063us (2097us total) trans 4296020283 rc 0/0 00000100:00100000:1.0:1721880422.356893:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632309 00000100:00100000:1.0:1721880422.356907:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009625b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011758464:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.356927:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.356943:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011758464 00000100:00100000:1.0:1721880422.356946:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011758464 00000100:00100000:1.0:1721880422.356957:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632315 00000100:00100000:1.0:1721880422.356959:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2220:3688:x1805522011758464:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.356959:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2220:3689:x1805522011757440:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1872us (1904us total) trans 4296020284 rc 0/0 00000100:00100000:3.0:1721880422.356964:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632312 00002000:00080000:1.0:1721880422.356968:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64597 count 1 00010000:00010000:1.0:1721880422.356975:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727c514 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc55:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.356982:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c706ac0/0x8a60d30f571cd132 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b120db5 expref: 1032 pid: 16098 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.356983:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009c0d0a80/2, rc 0, transno 1052988 00010000:00010000:1.0:1721880422.356986:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.356987:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.356988:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727c514 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.356995:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c0d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011757440:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.356998:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c706ac0/0x8a60d30f571cd132 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b120db5 expref: 1032 pid: 16098 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.357000:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009c0d1c00/2, rc 0, transno 1052987 00010000:00010000:1.0:1721880422.357003:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c706ac0/0x8a60d30f571cd132 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b120db5 expref: 1032 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.357003:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c0d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011756544:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.357009:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800858b5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011758592:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.357026:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1721880422.357033:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007b874a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011758336:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.357041:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009625aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011758720:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.357045:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb000 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.357055:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.357060:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2220:3686:x1805522011758080:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1608us (1656us total) trans 4296020285 rc 0/0 00000004:00080000:1.0:1721880422.357065:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009c0d3800/2, rc 0, transno 1052983 00000100:00100000:0.0:1721880422.357066:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632314 00000100:00100000:2.0:1721880422.357066:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.357070:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c0d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011757184:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1721880422.357071:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880076e5e680/2, rc 0, transno 1052989 00000100:00100000:3.0:1721880422.357075:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076e5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011758080:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.357076:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011758336 00000100:00100000:0.0:1721880422.357078:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011758336 00000100:00100000:3.0:1721880422.357083:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f70b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011758848:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.357087:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011758720 00000100:00100000:0.0:1721880422.357088:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011758720 00000100:00100000:2.0:1721880422.357092:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632316 00000100:00100000:2.0:1721880422.357095:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2221:3686:x1805522011758336:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.357096:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076e5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011759104:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.357099:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632317 00000100:00100000:3.0:1721880422.357100:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.357102:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098bed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2221:3689:x1805522011758720:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.357105:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64596 count 1 00002000:00080000:0.0:1721880422.357109:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64598 count 1 00000100:00100000:1.0:1721880422.357109:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.357113:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c51b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc54:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.357113:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1721880422.357116:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c522 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc56:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.357118:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076e5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011758976:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.357121:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800982f5b00/0x8a60d30f571cce68 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b120d30 expref: 1032 pid: 16058 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.357123:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098b5df80/0x8a60d30f571cd4a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b120e8e expref: 1032 pid: 16109 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.357125:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009c0d2d80/2, rc 0, transno 1052985 00010000:00010000:2.0:1721880422.357125:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.357126:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.357128:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1721880422.357128:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c0d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011757056:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.357128:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c51b lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.357129:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.357130:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c522 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.357133:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.357140:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098b5df80/0x8a60d30f571cd4a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b120e8e expref: 1032 pid: 16109 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.357142:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1721880422.357142:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800982f5b00/0x8a60d30f571cce68 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b120d30 expref: 1032 pid: 16058 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.357146:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098b5df80/0x8a60d30f571cd4a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b120e8e expref: 1032 pid: 16109 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.357146:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076e5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011759232:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.357149:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800982f5b00/0x8a60d30f571cce68 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b120d30 expref: 1032 pid: 16058 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.357150:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011758848 00000100:00100000:0.0:1721880422.357153:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f709880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011759360:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.357154:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011758848 00000100:00100000:1.0:1721880422.357156:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.357159:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880098beca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011759488:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.357168:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e540 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.357169:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011759104 00000100:00100000:3.0:1721880422.357171:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011759104 00000100:00100000:1.0:1721880422.357177:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011758976 00000100:00100000:0.0:1721880422.357178:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011759232 00000100:00100000:2.0:1721880422.357178:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde600 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.357179:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011758976 00000100:00100000:0.0:1721880422.357180:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011759232 00000100:00100000:3.0:1721880422.357185:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632318 00000100:00100000:3.0:1721880422.357190:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2225:3686:x1805522011758848:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.357195:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632319 00000100:00100000:0.0:1721880422.357199:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632320 00000100:00100000:1.0:1721880422.357199:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076e5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2225:3688:x1805522011759104:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.357202:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2225:3686:x1805522011758976:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.357202:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64599 count 1 00000100:00100000:2.0:1721880422.357203:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632321 00002000:00080000:1.0:1721880422.357207:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64601 count 1 00000100:00100000:2.0:1721880422.357207:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2225:3688:x1805522011759232:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.357210:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64600 count 1 00010000:00010000:3.0:1721880422.357212:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727c529 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc57:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.357214:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727c530 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc59:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.357216:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c537 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc58:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.357217:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64602 count 1 00010000:00010000:1.0:1721880422.357222:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880072948240/0x8a60d30f571ce265 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12109b expref: 1032 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.357222:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c5b2f40/0x8a60d30f571cd798 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b120f4b expref: 1032 pid: 16041 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.357223:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0c89680/0x8a60d30f571cdc30 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b120ff3 expref: 1032 pid: 16076 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.357225:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.357225:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727c53e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc5a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.357226:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.357227:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.357228:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.357228:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727c530 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.357228:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.357229:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c537 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.357230:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.357233:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727c529 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.357234:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013064fcc0/0x8a60d30f571ce99d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12114a expref: 1032 pid: 16108 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.357239:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0c89680/0x8a60d30f571cdc30 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b120ff3 expref: 1032 pid: 16076 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.357239:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880072948240/0x8a60d30f571ce265 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12109b expref: 1032 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.357241:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.357242:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.357245:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727c53e lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.357246:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0c89680/0x8a60d30f571cdc30 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b120ff3 expref: 1032 pid: 16076 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.357246:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880072948240/0x8a60d30f571ce265 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12109b expref: 1032 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.357250:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c5b2f40/0x8a60d30f571cd798 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b120f4b expref: 1032 pid: 16041 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.357252:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801360cd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011759744:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.357252:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca5c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011759616:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.357259:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013064fcc0/0x8a60d30f571ce99d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12114a expref: 1032 pid: 16108 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.357259:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c5b2f40/0x8a60d30f571cd798 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b120f4b expref: 1032 pid: 16041 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.357266:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013064fcc0/0x8a60d30f571ce99d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12114a expref: 1032 pid: 16108 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.357267:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb240 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.357269:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e840 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.357269:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120344a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011759872:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.357275:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880098bec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011760000:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.357277:0:16088:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c4dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.357282:0:16088:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c4dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.357286:0:16088:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c4dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.357289:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec000 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.357290:0:16088:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c4dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.357291:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde180 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.357293:0:16088:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c4dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.357296:0:16088:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325cd80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.357298:0:16088:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c4dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.357301:0:16088:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c4dc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.357307:0:16088:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c4dc lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.357311:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c4dc lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.357403:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2226:3686:x1805522011756288:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2632us (2703us total) trans 4296020286 rc 0/0 00000100:00100000:1.0:1721880422.357408:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632307 00000004:00080000:3.0:1721880422.357429:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880130769180/2, rc 0, transno 1052990 00000100:00100000:3.0:1721880422.357436:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880130769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011756288:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.357461:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011760128:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.357480:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.357490:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011760128 00000100:00100000:1.0:1721880422.357492:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011760128 00000100:00100000:1.0:1721880422.357506:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632322 00000100:00100000:1.0:1721880422.357509:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120346d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2226:3686:x1805522011760128:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.357516:0:16088:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64603 count 1 00010000:00010000:1.0:1721880422.357522:0:16088:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c545 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc5b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.357529:0:16088:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800959e5200/0x8a60d30f571cef1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12122a expref: 1032 pid: 16024 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.357534:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.357535:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.357538:0:16088:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c545 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.357552:0:16088:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800959e5200/0x8a60d30f571cef1c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12122a expref: 1032 pid: 16024 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.357561:0:16088:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800959e5200/0x8a60d30f571cef1c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12122a expref: 1032 pid: 16024 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.357570:0:16088:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca5e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011760256:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.357594:0:16088:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb540 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.358303:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800858b5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011758592:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.358314:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727c514 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.358323:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.358332:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f709880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011759360:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.358337:0:15444:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257740416 00000100:00100000:1.0:1721880422.358339:0:15444:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257740416 00000100:00100000:3.0:1721880422.358342:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880098beca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011759488:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.358344:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c522 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.358348:0:15444:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098b5df80/0x8a60d30f571cd4a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b120e8e expref: 1033 pid: 16109 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.358352:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c51b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.358360:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914508 00000100:00100000:1.0:1721880422.358362:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801360cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1033:2007:x1805522257740416:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.358367:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.358370:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098b5df80/0x8a60d30f571cd4a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b120e8e expref: 1033 pid: 16109 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.358375:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098b5df80/0x8a60d30f571cd4a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b120e8e expref: 1033 pid: 16109 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.358383:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098b5df80/0x8a60d30f571cd4a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b120e8e expref: 1033 pid: 16109 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.358388:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.358389:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.358391:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c522 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.358398:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c522 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.358408:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.358414:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.358416:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007ca5c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011759616:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.358428:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727c530 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.358428:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c522 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.358432:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801360cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1032:2007:x1805522257740416:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 68us (111us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.358433:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c522 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.358435:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914508 00010000:00010000:3.0:1721880422.358437:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c522 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.358440:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.358444:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c522 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.358448:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c522 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.358451:0:15444:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257740672 00010000:00010000:3.0:1721880422.358451:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325f600 already unused, calling callback (ffffffffa084e330) 00000100:00100000:1.0:1721880422.358453:0:15444:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257740672 00010000:00010000:3.0:1721880422.358453:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c522 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.358457:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c522 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.358458:0:15444:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800982f5b00/0x8a60d30f571cce68 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b120d30 expref: 1032 pid: 16058 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.358466:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c522 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.358467:0:15444:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257740544 00000100:00100000:1.0:1721880422.358468:0:15444:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257740544 00010000:00010000:3.0:1721880422.358470:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c522 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.358473:0:15444:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c706ac0/0x8a60d30f571cd132 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b120db5 expref: 1033 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.358480:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914509 00000100:00100000:1.0:1721880422.358484:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801360cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1033:2005:x1805522257740672:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.358489:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.358493:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800982f5b00/0x8a60d30f571cce68 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b120d30 expref: 1033 pid: 16058 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.358495:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.358500:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800982f5b00/0x8a60d30f571cce68 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b120d30 expref: 1033 pid: 16058 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.358511:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257740928 00010000:00010000:1.0:1721880422.358514:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800982f5b00/0x8a60d30f571cce68 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b120d30 expref: 1033 pid: 16058 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.358515:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257740928 00010000:00010000:1.0:1721880422.358522:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.358524:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.358526:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c51b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.358527:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880072948240/0x8a60d30f571ce265 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12109b expref: 1033 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.358532:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c51b lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.358545:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.358551:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914510 00000100:00100000:0.0:1721880422.358555:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8064450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1033:2004:x1805522257740544:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.358561:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.358564:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c706ac0/0x8a60d30f571cd132 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc55:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b120db5 expref: 1033 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.358564:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098bed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2227:3689:x1805522011758720:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1460us (1497us total) trans 4296020287 rc 0/0 00000100:00100000:2.0:1721880422.358566:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914511 00000100:00100000:1.0:1721880422.358567:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801360cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1033:2005:x1805522257740672:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 82us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.358569:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632317 00000100:00100000:2.0:1721880422.358570:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1033:2005:x1805522257740928:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.358571:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c706ac0/0x8a60d30f571cd132 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc55:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b120db5 expref: 1033 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.358574:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914509 00010000:00010000:2.0:1721880422.358576:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.358580:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c706ac0/0x8a60d30f571cd132 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc55:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b120db5 expref: 1033 pid: 16098 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.358580:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880072948240/0x8a60d30f571ce265 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc59:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12109b expref: 1033 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.358584:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c51b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.358587:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880072948240/0x8a60d30f571ce265 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc59:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12109b expref: 1031 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.358588:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.358588:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c51b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.358589:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.358591:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727c514 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.358595:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880072948240/0x8a60d30f571ce265 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc59:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12109b expref: 1031 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.358595:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c51b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.358596:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727c514 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.358600:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.358601:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.358602:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c51b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.358603:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727c530 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.358605:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.358608:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727c530 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.358608:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c51b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.358612:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350fc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.358615:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c51b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.358617:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727c514 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.358618:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8064450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1030:2004:x1805522257740544:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 63us (179us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.358618:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.358621:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c51b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.358625:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914510 00010000:00010000:1.0:1721880422.358625:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727c514 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.358630:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1030:2005:x1805522257740928:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 60us (136us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.358630:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c51b lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.358632:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727c514 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.358633:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914511 00010000:00010000:3.0:1721880422.358635:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c51b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.358636:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727c514 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.358644:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727c514 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.358647:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b7840 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.358649:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727c514 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.358652:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727c514 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.358655:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009625aa00/2, rc 0, transno 1052991 00000100:00100000:0.0:1721880422.358659:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801360cd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011759744:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.358659:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727c514 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.358662:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727c514 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.358666:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c537 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.358667:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009625aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011758720:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.358676:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727c530 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.358680:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727c530 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.358686:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.358689:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727c530 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.358693:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727c530 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.358694:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257740800 00000100:00100000:0.0:1721880422.358696:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257740800 00010000:00010000:2.0:1721880422.358697:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727c530 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.358700:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4b40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.358702:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727c530 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.358703:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0c89680/0x8a60d30f571cdc30 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b120ff3 expref: 1029 pid: 16076 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.358706:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727c530 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.358712:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727c530 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.358713:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914512 00010000:00010000:2.0:1721880422.358715:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727c530 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.358716:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1029:2004:x1805522257740800:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.358721:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.358723:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0c89680/0x8a60d30f571cdc30 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b120ff3 expref: 1029 pid: 16076 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.358744:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0c89680/0x8a60d30f571cdc30 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b120ff3 expref: 1029 pid: 16076 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.358748:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2227:3686:x1805522011758336:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1651us (1691us total) trans 4296020288 rc 0/0 00010000:00010000:0.0:1721880422.358753:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0c89680/0x8a60d30f571cdc30 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b120ff3 expref: 1029 pid: 16076 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.358753:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632316 00010000:00010000:0.0:1721880422.358761:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.358762:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.358764:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c537 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.358769:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c537 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.358774:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b874a80/2, rc 0, transno 1052992 00010000:00010000:0.0:1721880422.358776:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.358780:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007b874a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011758336:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.358783:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1721880422.358787:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1028:2004:x1805522257740800:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 70us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.358790:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914512 00010000:00010000:0.0:1721880422.358801:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c537 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.358803:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1721880422.358806:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c537 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.358807:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120347100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011760512:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.358811:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c537 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.358814:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c537 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.358818:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c537 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.358821:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325e400 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.358822:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c537 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.358823:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2228:3688:x1805522011758464:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1860us (1893us total) trans 4296020289 rc 0/0 00000100:00100000:3.0:1721880422.358825:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.358829:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632315 00010000:00010000:0.0:1721880422.358830:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c537 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.358830:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880076e5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2228:3688:x1805522011759104:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1631us (1720us total) trans 4296020290 rc 0/0 00010000:00010000:0.0:1721880422.358835:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c537 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.358835:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632319 00000100:00100000:3.0:1721880422.358838:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011760512 00010000:00010000:0.0:1721880422.358839:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c537 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.358840:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011760512 00000100:00100000:3.0:1721880422.358855:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632323 00000004:00080000:1.0:1721880422.358857:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880076e5e300/2, rc 0, transno 1052994 00000100:00100000:3.0:1721880422.358858:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120347b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2227:3689:x1805522011760512:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.358872:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076e5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011759104:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1721880422.358881:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009625b800/2, rc 0, transno 1052993 00000100:00100000:1.0:1721880422.358884:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009625b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011758464:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.358887:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.358888:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1721880422.358895:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800911eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011760640:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.358896:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.358906:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120344a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011759872:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.358910:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257741184 00000100:00100000:0.0:1721880422.358912:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257741184 00000100:00100000:1.0:1721880422.358916:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.358919:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013064fcc0/0x8a60d30f571ce99d lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12114a expref: 1028 pid: 16108 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.358919:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727c529 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.358932:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00002000:00080000:3.0:1721880422.358939:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64605 count 1 00000100:00100000:0.0:1721880422.358940:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257741056 00000100:00100000:0.0:1721880422.358941:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257741056 00000100:00100000:1.0:1721880422.358946:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257741312 00010000:00010000:0.0:1721880422.358947:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c5b2f40/0x8a60d30f571cd798 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b120f4b expref: 1029 pid: 16041 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.358949:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914513 00010000:00010000:3.0:1721880422.358949:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727c54c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc5d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.358950:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257741312 00000100:00100000:2.0:1721880422.358952:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098bee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1030:2005:x1805522257741184:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.358957:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914514 00010000:00010000:3.0:1721880422.358957:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800842f58c0/0x8a60d30f571cfa4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1213ab expref: 1030 pid: 16087 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.358958:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1721880422.358961:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098bec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1030:2004:x1805522257741056:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.358962:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800959e5200/0x8a60d30f571cef1c lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12122a expref: 1030 pid: 16024 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.358962:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013064fcc0/0x8a60d30f571ce99d lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc5a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12114a expref: 1030 pid: 16108 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.358963:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.358964:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.358966:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.358966:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727c54c lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.358968:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c5b2f40/0x8a60d30f571cd798 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b120f4b expref: 1030 pid: 16041 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.358968:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013064fcc0/0x8a60d30f571ce99d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc5a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12114a expref: 1030 pid: 16108 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.358974:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c5b2f40/0x8a60d30f571cd798 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b120f4b expref: 1030 pid: 16041 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.358975:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.358976:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.358977:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727c53e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc5a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.358980:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914515 00010000:00010000:3.0:1721880422.358981:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800842f58c0/0x8a60d30f571cfa4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1213ab expref: 1030 pid: 16087 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.358982:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727c53e lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc5a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.358983:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c5b2f40/0x8a60d30f571cd798 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b120f4b expref: 1030 pid: 16041 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.358985:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098bec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1030:2004:x1805522257741312:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.358989:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.358992:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.358992:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.358993:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.358995:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727c529 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.358995:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800842f58c0/0x8a60d30f571cfa4b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1213ab expref: 1029 pid: 16087 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.358996:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800959e5200/0x8a60d30f571cef1c lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc5b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12122a expref: 1029 pid: 16024 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.358999:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727c529 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.358999:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098bee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1029:2005:x1805522257741184:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 46us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.359003:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914513 00010000:00010000:1.0:1721880422.359004:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800959e5200/0x8a60d30f571cef1c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc5b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12122a expref: 1029 pid: 16024 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.359004:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880098222d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011760896:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.359008:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.359029:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1721880422.359030:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098bec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1028:2004:x1805522257741056:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 69us (133us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.359031:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1721880422.359034:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914514 00010000:00010000:1.0:1721880422.359034:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c545 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc5b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.359035:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013064fcc0/0x8a60d30f571ce99d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12114a expref: 1028 pid: 16108 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.359038:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec000 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.359040:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c545 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc5b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.359042:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880098bec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011760000:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.359050:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727c53e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.359050:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727c529 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.359051:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.359054:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727c53e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.359057:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727c529 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.359058:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727c53e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.359059:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2228:3686:x1805522011758976:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1857us (1926us total) trans 4296020291 rc 0/0 00010000:00010000:2.0:1721880422.359062:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727c53e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.359062:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727c529 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.359063:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632320 00010000:00010000:2.0:1721880422.359066:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727c53e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.359068:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727c529 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.359069:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098bec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1026:2004:x1805522257741312:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 83us (136us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.359070:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727c53e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.359072:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011760640 00010000:00010000:2.0:1721880422.359073:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353600 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.359073:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727c529 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.359074:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011760640 00010000:00010000:2.0:1721880422.359074:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727c53e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.359075:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914515 00010000:00010000:2.0:1721880422.359078:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727c53e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.359079:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa86c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.359082:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727c529 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.359083:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727c53e lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.359084:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632324 00000100:00100000:0.0:1721880422.359086:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2228:3688:x1805522011760640:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.359088:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727c529 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.359091:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727c53e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1721880422.359095:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64606 count 1 00010000:00010000:3.0:1721880422.359097:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727c529 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.359098:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1721880422.359102:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c553 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc5e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.359102:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727c529 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.359105:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880098221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011760768:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.359110:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007c9e1200/0x8a60d30f571d022b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1216d0 expref: 1025 pid: 16097 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.359114:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.359115:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.359117:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c553 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.359124:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.359127:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007c9e1200/0x8a60d30f571d022b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1216d0 expref: 1025 pid: 16097 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.359132:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007c9e1200/0x8a60d30f571d022b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1216d0 expref: 1025 pid: 16097 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.359138:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800995f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011761024:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.359142:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011760768 00000100:00100000:1.0:1721880422.359144:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011760768 00000100:00100000:0.0:1721880422.359150:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e840 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.359156:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632325 00000100:00100000:1.0:1721880422.359159:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2231:3687:x1805522011760768:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.359168:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64607 count 1 00010000:00010000:1.0:1721880422.359175:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c55a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc5f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.359183:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082e79f80/0x8a60d30f571d0542 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121763 expref: 1025 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.359186:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.359187:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.359189:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c55a lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.359190:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2231:3688:x1805522011759232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1981us (2031us total) trans 4296020292 rc 0/0 00000100:00100000:2.0:1721880422.359196:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632321 00010000:00010000:1.0:1721880422.359199:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082e79f80/0x8a60d30f571d0542 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121763 expref: 1025 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.359204:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082e79f80/0x8a60d30f571d0542 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121763 expref: 1025 pid: 16125 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.359210:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca5d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011761152:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.359214:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2230:3686:x1805522011758848:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2022us (2112us total) trans 4296020293 rc 0/0 00000100:00100000:3.0:1721880422.359220:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632318 00000100:00100000:1.0:1721880422.359228:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb000 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.359238:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011760384:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1721880422.359243:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880076e5d180/2, rc 0, transno 1052996 00000100:00100000:1.0:1721880422.359248:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076e5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011759232:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.359256:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.359260:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800959e5200/0x8a60d30f571cef1c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12122a expref: 1025 pid: 16024 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.359266:0:16088:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007ca5e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011760256:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.359275:0:16088:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c545 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.359277:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880076e5ca80/2, rc 0, transno 1052995 00010000:00010000:1.0:1721880422.359280:0:16088:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c545 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.359283:0:16088:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c545 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.359285:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076e5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011758976:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.359287:0:16088:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c545 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.359291:0:16088:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c545 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.359293:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880098bec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011761280:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.359295:0:16088:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c545 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.359296:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012f70b480/2, rc 0, transno 1052997 00010000:00010000:1.0:1721880422.359298:0:16088:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b5440 already unused, calling callback (ffffffffa084e330) 00000100:00100000:3.0:1721880422.359299:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f70b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011758848:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.359300:0:16088:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c545 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.359307:0:16088:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c545 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.359312:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011760384 00010000:00010000:1.0:1721880422.359313:0:16088:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c545 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.359314:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.359314:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011760384 00010000:00010000:1.0:1721880422.359316:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c545 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.359323:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880098beca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011761536:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.359328:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011761280 00000100:00100000:3.0:1721880422.359329:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011761280 00000100:00100000:3.0:1721880422.359339:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632326 00000100:00100000:2.0:1721880422.359343:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.359343:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120344a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2231:3686:x1805522011760384:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.359356:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880098bef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011761408:0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.359360:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64604 count 1 00000100:00100000:2.0:1721880422.359367:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011761536 00010000:00010000:3.0:1721880422.359368:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727c561 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc5c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.359370:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011761536 00000100:00100000:1.0:1721880422.359371:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.359379:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009750bcc0/0x8a60d30f571cf574 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1212e0 expref: 1024 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.359383:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011761408 00010000:00010000:3.0:1721880422.359383:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.359384:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011761408 00010000:00010000:3.0:1721880422.359384:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.359385:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727c561 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.359389:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632327 00000100:00100000:1.0:1721880422.359393:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2234:3687:x1805522011761280:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.359396:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009750bcc0/0x8a60d30f571cf574 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1212e0 expref: 1024 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.359398:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632328 00000100:00100000:2.0:1721880422.359401:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f709880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2234:3689:x1805522011761536:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.359401:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009750bcc0/0x8a60d30f571cf574 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1212e0 expref: 1024 pid: 16040 timeout: 887 lvb_type: 0 00002000:00080000:1.0:1721880422.359407:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64608 count 1 00000100:00100000:3.0:1721880422.359407:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800942e6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011761664:192.168.201.24@tcp:104: 00002000:00080000:2.0:1721880422.359410:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64610 count 1 00010000:00010000:1.0:1721880422.359414:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c568 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc60:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.359418:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727c56f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc62:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.359422:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c644480/0x8a60d30f571d0852 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1217fd expref: 1024 pid: 16096 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.359424:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec900 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.359425:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.359426:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.359426:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c4c4d80/0x8a60d30f571d0e33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12191c expref: 1024 pid: 16092 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.359428:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c568 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.359430:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.359431:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.359433:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727c56f lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.359438:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c644480/0x8a60d30f571d0852 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1217fd expref: 1024 pid: 16096 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.359439:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632329 00000100:00100000:0.0:1721880422.359442:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880120346d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2234:3686:x1805522011760128:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1928us (1957us total) trans 4296020294 rc 0/0 00010000:00010000:2.0:1721880422.359443:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c4c4d80/0x8a60d30f571d0e33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12191c expref: 1024 pid: 16092 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.359443:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2234:3688:x1805522011761408:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.359444:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c644480/0x8a60d30f571d0852 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1217fd expref: 1024 pid: 16096 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.359449:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632322 00000100:00100000:1.0:1721880422.359450:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca5d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011761792:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.359450:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c4c4d80/0x8a60d30f571d0e33 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12191c expref: 1024 pid: 16092 timeout: 887 lvb_type: 0 00002000:00080000:3.0:1721880422.359451:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64609 count 1 00000100:00100000:2.0:1721880422.359456:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800913b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011761920:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.359457:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727c576 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc61:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.359464:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb540 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.359464:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094091b00/0x8a60d30f571d0be0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12189e expref: 1024 pid: 16048 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.359467:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.359468:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.359470:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde180 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.359470:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727c576 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.359477:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007ca5df80/2, rc 0, transno 1052998 00010000:00010000:3.0:1721880422.359480:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094091b00/0x8a60d30f571d0be0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12189e expref: 1024 pid: 16048 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.359482:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007ca5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011760128:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.359486:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094091b00/0x8a60d30f571d0be0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12189e expref: 1024 pid: 16048 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.359492:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880095b71c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011762048:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.359506:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec600 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.359516:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800920a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011762176:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.359535:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.359545:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011762176 00000100:00100000:3.0:1721880422.359547:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011762176 00000100:00100000:3.0:1721880422.359558:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632330 00000100:00100000:3.0:1721880422.359561:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2234:3686:x1805522011762176:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.359567:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64611 count 1 00010000:00010000:3.0:1721880422.359572:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727c57d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc63:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.359579:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800946eba80/0x8a60d30f571d14ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1219c4 expref: 1024 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.359583:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.359584:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.359585:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727c57d lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.359595:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800946eba80/0x8a60d30f571d14ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1219c4 expref: 1024 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.359600:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800946eba80/0x8a60d30f571d14ae lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1219c4 expref: 1024 pid: 16125 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.359605:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088fe6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011762304:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.359620:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.359662:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880098222d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011760896:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.359673:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727c54c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.359724:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800995f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011761024:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.359752:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c553 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.359759:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007ca5d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011761152:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.359770:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c55a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.359893:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.359929:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257741568 00000100:00100000:1.0:1721880422.359933:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257741568 00010000:00010000:1.0:1721880422.359946:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007c9e1200/0x8a60d30f571d022b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1216d0 expref: 1025 pid: 16097 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.359972:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914516 00000100:00100000:1.0:1721880422.359977:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+1025:2004:x1805522257741568:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.359984:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.359988:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007c9e1200/0x8a60d30f571d022b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc5e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1216d0 expref: 1025 pid: 16097 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.359996:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007c9e1200/0x8a60d30f571d022b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc5e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1216d0 expref: 1025 pid: 16097 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.360008:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007c9e1200/0x8a60d30f571d022b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc5e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1216d0 expref: 1025 pid: 16097 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.360027:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.360028:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.360030:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.360033:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c553 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.360039:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c553 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.360040:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.360048:0:8793:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257741440 00000100:00100000:2.0:1721880422.360052:0:8793:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257741440 00010000:00010000:2.0:1721880422.360065:0:8793:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800842f58c0/0x8a60d30f571cfa4b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1213ab expref: 1025 pid: 16087 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.360066:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.360076:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c553 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.360081:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c553 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.360086:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c553 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.360087:0:8793:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257741696 00000100:00100000:2.0:1721880422.360089:0:8793:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257741696 00010000:00010000:3.0:1721880422.360089:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c553 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.360091:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+1025:2004:x1805522257741568:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 112us (197us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.360093:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c553 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.360094:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914517 00010000:00010000:3.0:1721880422.360096:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325c6c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.360098:0:8793:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880082e79f80/0x8a60d30f571d0542 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121763 expref: 1026 pid: 16125 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.360099:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e196050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+1026:2004:x1805522257741440:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.360099:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c553 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.360100:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914516 00010000:00010000:3.0:1721880422.360103:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c553 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.360107:0:15473:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.360109:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c553 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.360112:0:15473:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800842f58c0/0x8a60d30f571cfa4b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc5d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1213ab expref: 1025 pid: 16087 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.360112:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c553 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.360113:0:8793:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914518 00000100:00100000:2.0:1721880422.360118:0:8793:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130769880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30425778-2709-4512-9d75-01ec53c4cfad+1025:2004:x1805522257741696:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.360124:0:8793:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.360128:0:8793:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082e79f80/0x8a60d30f571d0542 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc5f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121763 expref: 1025 pid: 16125 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.360136:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007ca5d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011761792:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.360143:0:8793:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082e79f80/0x8a60d30f571d0542 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc5f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121763 expref: 1025 pid: 16125 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.360147:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c568 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.360152:0:8793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082e79f80/0x8a60d30f571d0542 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc5f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121763 expref: 1025 pid: 16125 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.360159:0:8793:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.360160:0:8793:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.360162:0:8793:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c55a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.360167:0:8793:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c55a lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.360174:0:15473:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800842f58c0/0x8a60d30f571cfa4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc5d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1213ab expref: 1024 pid: 16087 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.360176:0:8793:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.360185:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c55a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.360187:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800842f58c0/0x8a60d30f571cfa4b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc5d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1213ab expref: 1024 pid: 16087 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.360189:0:8793:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880130769880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30425778-2709-4512-9d75-01ec53c4cfad+1024:2004:x1805522257741696:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 71us (148us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.360192:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c55a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.360192:0:8793:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914518 00010000:00010000:0.0:1721880422.360197:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.360199:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.360199:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c55a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.360200:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2235:3688:x1805522011760640:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1112us (1284us total) trans 4296020295 rc 0/0 00010000:00010000:0.0:1721880422.360201:0:15473:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727c54c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.360204:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632324 00010000:00010000:1.0:1721880422.360206:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c55a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.360207:0:15473:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727c54c lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.360212:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800913b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011761920:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.360213:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c55a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.360218:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4d80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.360220:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727c56f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.360221:0:15473:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.360221:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c55a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.360228:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c55a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.360228:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800942e6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011761664:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.360234:0:15473:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e196050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+1022:2004:x1805522257741440:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 135us (207us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.360237:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727c561 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.360238:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914517 00010000:00010000:1.0:1721880422.360238:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c55a lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.360244:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c55a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.360247:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727c54c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.360252:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727c54c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.360256:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727c54c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.360263:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727c54c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.360266:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727c54c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.360270:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8fc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.360271:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727c54c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.360275:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727c54c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.360280:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727c54c lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.360284:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727c54c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.360289:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880095b71c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011762048:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.360297:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.360299:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727c576 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.360303:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257741952 00000100:00100000:0.0:1721880422.360306:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257741952 00010000:00010000:0.0:1721880422.360313:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c644480/0x8a60d30f571d0852 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1217fd expref: 1022 pid: 16096 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.360327:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914519 00000100:00100000:0.0:1721880422.360330:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130768000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+1022:2005:x1805522257741952:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.360335:0:15473:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.360337:0:15473:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c644480/0x8a60d30f571d0852 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc60:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1217fd expref: 1022 pid: 16096 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.360342:0:15473:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c644480/0x8a60d30f571d0852 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc60:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1217fd expref: 1022 pid: 16096 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.360350:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c644480/0x8a60d30f571d0852 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc60:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1217fd expref: 1022 pid: 16096 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.360352:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2236:3687:x1805522011760768:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1191us (1227us total) trans 4296020296 rc 0/0 00000100:00100000:3.0:1721880422.360356:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880120347b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2236:3689:x1805522011760512:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1497us (1530us total) trans 4296020297 rc 0/0 00010000:00010000:0.0:1721880422.360357:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.360358:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1721880422.360359:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632325 00010000:00010000:0.0:1721880422.360360:0:15473:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c568 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.360362:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632323 00010000:00010000:0.0:1721880422.360364:0:15473:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c568 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.360364:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880120347100/2, rc 0, transno 1053001 00000100:00100000:2.0:1721880422.360369:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120347100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011760512:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.360377:0:15473:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.360381:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088fe6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011762304:192.168.201.24@tcp:104: 00000004:00080000:1.0:1721880422.360385:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800911eed80/2, rc 0, transno 1052999 00000100:00100000:0.0:1721880422.360386:0:15473:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880130768000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+1021:2005:x1805522257741952:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 55us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.360389:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914519 00000100:00100000:1.0:1721880422.360389:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800911eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011760640:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.360393:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727c57d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.360404:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1721880422.360405:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800920a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011762432:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.360410:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800920a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011762560:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.360413:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.360421:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257742208 00000100:00100000:0.0:1721880422.360423:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257742208 00000100:00100000:1.0:1721880422.360429:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.360430:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800946eba80/0x8a60d30f571d14ae lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1219c4 expref: 1021 pid: 16125 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.360448:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.360449:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914520 00000004:00080000:1.0:1721880422.360449:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880098221180/2, rc 0, transno 1053000 00000100:00100000:0.0:1721880422.360452:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098bee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+1021:2005:x1805522257742208:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.360457:0:15473:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.360458:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011762432 00010000:00010000:0.0:1721880422.360459:0:15473:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800946eba80/0x8a60d30f571d14ae lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1219c4 expref: 1021 pid: 16125 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.360460:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011762432 00000100:00100000:1.0:1721880422.360464:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880098221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011760768:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.360465:0:15473:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800946eba80/0x8a60d30f571d14ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1219c4 expref: 1021 pid: 16125 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.360468:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011762560 00000100:00100000:3.0:1721880422.360469:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011762560 00010000:00010000:0.0:1721880422.360472:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800946eba80/0x8a60d30f571d14ae lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1219c4 expref: 1021 pid: 16125 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.360478:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.360478:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880095b71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011762688:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.360479:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.360479:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632331 00010000:00010000:0.0:1721880422.360481:0:15473:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727c57d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.360482:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2236:3687:x1805522011762432:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.360483:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632332 00010000:00010000:0.0:1721880422.360485:0:15473:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727c57d lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.360487:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800920abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2236:3689:x1805522011762560:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.360489:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1721880422.360490:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64612 count 1 00010000:00010000:0.0:1721880422.360494:0:15473:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.360496:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727c584 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc64:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.360499:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64613 count 1 00000100:00100000:0.0:1721880422.360503:0:15473:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098bee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+1020:2005:x1805522257742208:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 50us (89us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.360503:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011762688 00010000:00010000:3.0:1721880422.360503:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800911a6d00/0x8a60d30f571d1a8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121a7a expref: 1020 pid: 15445 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.360506:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011762688 00010000:00010000:3.0:1721880422.360507:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.360508:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.360509:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727c58b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc65:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.360510:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914520 00010000:00010000:3.0:1721880422.360510:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727c584 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.360516:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632333 00000100:00100000:2.0:1721880422.360519:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2237:3689:x1805522011762688:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.360519:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800911a6d00/0x8a60d30f571d1a8f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121a7a expref: 1019 pid: 15445 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.360520:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800946d21c0/0x8a60d30f571d1ea9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121b3e expref: 1019 pid: 16056 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.360524:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800911a6d00/0x8a60d30f571d1a8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121a7a expref: 1019 pid: 15445 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.360526:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00002000:00080000:2.0:1721880422.360527:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64614 count 1 00010000:00010000:1.0:1721880422.360528:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.360530:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727c58b lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.360530:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088fe6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011762816:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.360533:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.360535:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727c592 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc66:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.360540:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257742080 00000100:00100000:0.0:1721880422.360541:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257742080 00010000:00010000:2.0:1721880422.360543:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008425aac0/0x8a60d30f571d2594 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121bfb expref: 1019 pid: 16056 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.360544:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800946d21c0/0x8a60d30f571d1ea9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121b3e expref: 1019 pid: 16056 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.360544:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec6c0 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.360547:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.360548:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c4c4d80/0x8a60d30f571d0e33 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12191c expref: 1020 pid: 16092 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.360548:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.360550:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727c592 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.360553:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800946d21c0/0x8a60d30f571d1ea9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121b3e expref: 1020 pid: 16056 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.360556:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727c57d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.360560:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008425aac0/0x8a60d30f571d2594 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121bfb expref: 1020 pid: 16056 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.360562:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca5d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011762944:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.360562:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727c57d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.360565:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914521 00010000:00010000:3.0:1721880422.360566:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727c57d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.360568:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098bec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+1020:2005:x1805522257742080:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.360569:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008425aac0/0x8a60d30f571d2594 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121bfb expref: 1020 pid: 16056 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.360569:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727c57d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.360572:0:15473:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.360573:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727c57d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.360574:0:15473:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c4c4d80/0x8a60d30f571d0e33 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12191c expref: 1020 pid: 16092 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.360575:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88011f820700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011763072:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.360577:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8480 already unused, calling callback (ffffffffa084e330) 00000100:00100000:1.0:1721880422.360579:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb540 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.360579:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727c57d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.360580:0:15473:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c4c4d80/0x8a60d30f571d0e33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12191c expref: 1020 pid: 16092 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.360582:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727c57d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.360588:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c4c4d80/0x8a60d30f571d0e33 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12191c expref: 1020 pid: 16092 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.360588:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde180 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.360588:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727c57d lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.360591:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727c57d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.360595:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.360595:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c568 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.360596:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.360598:0:15473:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727c56f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.360602:0:15473:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727c56f lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.360603:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c568 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.360610:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c568 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.360613:0:15473:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.360616:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c568 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.360619:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727c56f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.360623:0:15473:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098bec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+1019:2005:x1805522257742080:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 54us (90us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.360623:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c568 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.360624:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727c56f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.360627:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914521 00010000:00010000:1.0:1721880422.360628:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4240 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.360629:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727c56f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.360631:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c568 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.360633:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727c56f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.360636:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727c56f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.360638:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c568 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.360639:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352880 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.360641:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727c56f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.360645:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727c56f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.360647:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c568 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.360650:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.360652:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727c56f lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.360654:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c568 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.360656:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727c56f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.360658:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257742336 00000100:00100000:0.0:1721880422.360660:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257742336 00010000:00010000:0.0:1721880422.360665:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094091b00/0x8a60d30f571d0be0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12189e expref: 1019 pid: 16048 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.360669:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2238:3686:x1805522011762176:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1106us (1133us total) trans 4296020298 rc 0/0 00000100:00100000:3.0:1721880422.360673:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632330 00000100:00100000:0.0:1721880422.360681:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914522 00000100:00100000:0.0:1721880422.360684:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098bec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+1019:2007:x1805522257742336:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.360689:0:15473:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.360691:0:15473:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094091b00/0x8a60d30f571d0be0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc61:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12189e expref: 1019 pid: 16048 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.360697:0:15473:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094091b00/0x8a60d30f571d0be0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc61:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12189e expref: 1019 pid: 16048 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.360703:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094091b00/0x8a60d30f571d0be0 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc61:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12189e expref: 1019 pid: 16048 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.360709:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.360710:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.360712:0:15473:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727c576 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.360712:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800920a8e00/2, rc 0, transno 1053002 00010000:00010000:0.0:1721880422.360717:0:15473:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727c576 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.360717:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800920a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011762176:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.360725:0:15473:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.360750:0:15473:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098bec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+1018:2007:x1805522257742336:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 64us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.360753:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914522 00010000:00010000:2.0:1721880422.360759:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727c576 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.360764:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727c576 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.360769:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727c576 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.360772:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727c576 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.360776:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727c576 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.360779:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa9d40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.360781:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727c576 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.360783:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2239:3687:x1805522011761280:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1387us (1466us total) trans 4296020299 rc 0/0 00010000:00010000:2.0:1721880422.360785:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727c576 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.360789:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632327 00010000:00010000:2.0:1721880422.360791:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727c576 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.360795:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727c576 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.360815:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880098bec380/2, rc 0, transno 1053003 00000100:00100000:1.0:1721880422.360822:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880098bec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011761280:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.360827:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1721880422.360849:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88011f822680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011763200:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.360869:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.360880:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011763328:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.360886:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2239:3688:x1805522011761408:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1443us (1514us total) trans 4296020301 rc 0/0 00000100:00100000:2.0:1721880422.360893:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632329 00000100:00100000:1.0:1721880422.360894:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.360903:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011763200 00000100:00100000:2.0:1721880422.360905:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011763200 00000100:00100000:2.0:1721880422.360914:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011763328 00000004:00080000:1.0:1721880422.360915:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880098bef480/2, rc 0, transno 1053005 00000100:00100000:2.0:1721880422.360915:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011763328 00000100:00100000:1.0:1721880422.360920:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880098bef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011761408:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.360922:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632334 00000100:00100000:3.0:1721880422.360923:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f709880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2240:3689:x1805522011761536:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1520us (1579us total) trans 4296020300 rc 0/0 00000100:00100000:2.0:1721880422.360925:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2240:3687:x1805522011763200:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.360928:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632328 00002000:00080000:2.0:1721880422.360933:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64615 count 1 00000100:00100000:3.0:1721880422.360939:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632335 00010000:00010000:2.0:1721880422.360940:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c599 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc67:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.360942:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011763456:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.360942:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2239:3687:x1805522011763328:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.360947:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007c9e6d00/0x8a60d30f571d2803 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121cbf expref: 1017 pid: 15487 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.360949:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64616 count 1 00000100:00100000:0.0:1721880422.360951:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.360951:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.360952:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.360954:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c599 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.360956:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c5a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc68:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.360959:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.360962:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257741824 00010000:00010000:3.0:1721880422.360963:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098b0a640/0x8a60d30f571d2afe lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121d44 expref: 1017 pid: 15515 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.360965:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257741824 00010000:00010000:2.0:1721880422.360965:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007c9e6d00/0x8a60d30f571d2803 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121cbf expref: 1017 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.360967:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.360968:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.360970:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c5a0 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.360973:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009750bcc0/0x8a60d30f571cf574 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1212e0 expref: 1018 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.360974:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007c9e6d00/0x8a60d30f571d2803 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121cbf expref: 1018 pid: 15487 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.360978:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011763456 00010000:00010000:3.0:1721880422.360980:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098b0a640/0x8a60d30f571d2afe lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121d44 expref: 1018 pid: 15515 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.360981:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011763456 00000100:00100000:2.0:1721880422.360983:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880096f17800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011763584:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.360984:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914523 00010000:00010000:3.0:1721880422.360985:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098b0a640/0x8a60d30f571d2afe lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121d44 expref: 1018 pid: 15515 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.360987:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+1018:2004:x1805522257741824:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.360992:0:15473:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.360994:0:15473:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009750bcc0/0x8a60d30f571cf574 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc5c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1212e0 expref: 1018 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.360995:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800942e6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011763712:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.360997:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632336 00010000:00010000:0.0:1721880422.361000:0:15473:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009750bcc0/0x8a60d30f571cf574 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc5c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1212e0 expref: 1018 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.361001:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2240:3688:x1805522011763456:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.361002:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde600 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.361008:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009750bcc0/0x8a60d30f571cf574 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc5c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1212e0 expref: 1018 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.361008:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec900 going to sleep for 11 seconds 00002000:00080000:1.0:1721880422.361027:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64617 count 1 00010000:00010000:0.0:1721880422.361033:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.361034:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.361036:0:15473:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727c561 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.361037:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c5a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc69:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.361040:0:15473:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727c561 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.361043:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880098beca80/2, rc 0, transno 1053004 00010000:00010000:1.0:1721880422.361048:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f82fcc0/0x8a60d30f571d2d7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121dfa expref: 1017 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.361049:0:15473:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.361054:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1721880422.361054:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880098beca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011761536:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.361055:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.361057:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c5a7 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.361059:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727c561 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.361062:0:15473:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+1017:2004:x1805522257741824:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 74us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.361065:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914523 00010000:00010000:2.0:1721880422.361067:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727c561 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.361074:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727c561 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.361079:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1721880422.361081:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727c561 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.361084:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800858b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011763840:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.361087:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727c561 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.361091:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8240 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.361094:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727c561 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.361101:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.361101:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727c561 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.361109:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727c561 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.361114:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727c561 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.361116:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011763840 00000100:00100000:3.0:1721880422.361119:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011763840 00010000:00010000:1.0:1721880422.361128:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f82fcc0/0x8a60d30f571d2d7b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121dfa expref: 1016 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.361134:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f82fcc0/0x8a60d30f571d2d7b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121dfa expref: 1016 pid: 16120 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.361136:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632337 00000100:00100000:1.0:1721880422.361140:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094692d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011763968:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.361141:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2241:3688:x1805522011763840:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.361152:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64618 count 1 00000100:00100000:1.0:1721880422.361154:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb000 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.361161:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c5ae lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc6a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.361170:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5bd7cc0/0x8a60d30f571d30bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121e9b expref: 1016 pid: 15447 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.361176:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.361177:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.361179:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c5ae lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.361193:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5bd7cc0/0x8a60d30f571d30bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121e9b expref: 1016 pid: 15447 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.361198:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5bd7cc0/0x8a60d30f571d30bc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121e9b expref: 1016 pid: 15447 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.361203:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880120344a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2242:3686:x1805522011760384:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1859us (1946us total) trans 4296020302 rc 0/0 00000100:00100000:2.0:1721880422.361208:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632326 00000100:00100000:3.0:1721880422.361209:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880098222d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011764096:192.168.201.24@tcp:104: 00000004:00080000:0.0:1721880422.361211:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007ca5e300/2, rc 0, transno 1053006 00000100:00100000:0.0:1721880422.361217:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007ca5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011760384:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.361226:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec000 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.361237:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1721880422.361242:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011764224:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.361256:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.361267:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011764224 00000100:00100000:2.0:1721880422.361269:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011764224 00000100:00100000:2.0:1721880422.361279:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632338 00000100:00100000:2.0:1721880422.361282:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800887a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2242:3687:x1805522011764224:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.361290:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64619 count 1 00010000:00010000:2.0:1721880422.361297:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c5b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc6b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.361305:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130240fc0/0x8a60d30f571d347b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121f20 expref: 1016 pid: 16027 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.361309:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.361310:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.361312:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c5b5 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.361323:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130240fc0/0x8a60d30f571d347b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121f20 expref: 1016 pid: 16027 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.361329:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130240fc0/0x8a60d30f571d347b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121f20 expref: 1016 pid: 16027 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.361335:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880096f14380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011764352:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.361350:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.361954:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088fe6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011762816:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.361969:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727c584 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.361996:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880096f17800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011763584:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.362000:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007ca5d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011762944:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.362009:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c599 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.362022:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727c58b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.362046:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88011f820700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011763072:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.362054:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727c592 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.362069:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.362082:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257742464 00000100:00100000:2.0:1721880422.362084:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257742464 00000100:00100000:0.0:1721880422.362093:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.362095:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800911a6d00/0x8a60d30f571d1a8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121a7a expref: 1017 pid: 15445 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.362105:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257742720 00000100:00100000:0.0:1721880422.362106:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.362107:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257742720 00010000:00010000:2.0:1721880422.362113:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800946d21c0/0x8a60d30f571d1ea9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121b3e expref: 1018 pid: 16056 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.362115:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.362116:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800942e6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011763712:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.362121:0:16182:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257742592 00000100:00100000:2.0:1721880422.362123:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257742848 00000100:00100000:2.0:1721880422.362124:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257742848 00000100:00100000:0.0:1721880422.362125:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.362125:0:16182:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257742592 00010000:00010000:3.0:1721880422.362125:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c5a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.362130:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007c9e6d00/0x8a60d30f571d2803 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121cbf expref: 1020 pid: 15487 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.362136:0:16182:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008425aac0/0x8a60d30f571d2594 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121bfb expref: 1020 pid: 16056 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.362145:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257742976 00000100:00100000:2.0:1721880422.362147:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257742976 00000100:00100000:1.0:1721880422.362152:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914524 00000100:00100000:0.0:1721880422.362153:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.362153:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098b0a640/0x8a60d30f571d2afe lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121d44 expref: 1021 pid: 15515 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.362158:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e195c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1021:2004:x1805522257742464:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.362158:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914525 00010000:00010000:1.0:1721880422.362163:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.362163:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1021:2004:x1805522257742720:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.362164:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.362165:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257743104 00000100:00100000:2.0:1721880422.362166:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257743104 00010000:00010000:1.0:1721880422.362167:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800911a6d00/0x8a60d30f571d1a8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121a7a expref: 1021 pid: 15445 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.362172:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800911a6d00/0x8a60d30f571d1a8f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121a7a expref: 1022 pid: 15445 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.362172:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f82fcc0/0x8a60d30f571d2d7b lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121dfa expref: 1022 pid: 16120 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.362174:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257743232 00010000:00010000:3.0:1721880422.362176:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.362181:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800911a6d00/0x8a60d30f571d1a8f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121a7a expref: 1022 pid: 15445 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.362181:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800946d21c0/0x8a60d30f571d1ea9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121b3e expref: 1022 pid: 16056 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.362182:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914526 00000100:00100000:2.0:1721880422.362185:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801360cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1021:2004:x1805522257742848:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.362187:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800946d21c0/0x8a60d30f571d1ea9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121b3e expref: 1021 pid: 16056 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.362188:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.362189:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.362191:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727c584 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.362191:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.362194:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007c9e6d00/0x8a60d30f571d2803 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121cbf expref: 1021 pid: 15487 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.362195:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727c584 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.362195:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800946d21c0/0x8a60d30f571d1ea9 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121b3e expref: 1021 pid: 16056 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.362200:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007c9e6d00/0x8a60d30f571d2803 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121cbf expref: 1020 pid: 15487 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.362202:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.362203:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.362205:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.362205:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727c58b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.362209:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007c9e6d00/0x8a60d30f571d2803 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121cbf expref: 1020 pid: 15487 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.362209:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727c58b lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.362219:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.362220:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1721880422.362221:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e195c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1019:2004:x1805522257742464:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 63us (154us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.362221:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.362224:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c599 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.362225:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914524 00010000:00010000:2.0:1721880422.362228:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c599 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.362231:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1018:2004:x1805522257742720:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 68us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.362235:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914525 00010000:00010000:2.0:1721880422.362237:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.362246:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914527 00000100:00100000:0.0:1721880422.362247:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257743232 00000100:00100000:3.0:1721880422.362249:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1017:2004:x1805522257742592:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.362254:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.362255:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801360cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1018:2004:x1805522257742848:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 67us (137us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.362257:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008425aac0/0x8a60d30f571d2594 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121bfb expref: 1018 pid: 16056 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.362260:0:16182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914528 00010000:00010000:3.0:1721880422.362262:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008425aac0/0x8a60d30f571d2594 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121bfb expref: 1018 pid: 16056 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.362263:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5bd7cc0/0x8a60d30f571d30bc lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121e9b expref: 1018 pid: 15447 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.362263:0:16182:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801360cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1018:2005:x1805522257742976:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.362264:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914526 00010000:00010000:1.0:1721880422.362267:0:16182:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.362269:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008425aac0/0x8a60d30f571d2594 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121bfb expref: 1018 pid: 16056 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.362271:0:16182:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098b0a640/0x8a60d30f571d2afe lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121d44 expref: 1018 pid: 15515 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.362275:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.362276:0:16182:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098b0a640/0x8a60d30f571d2afe lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121d44 expref: 1016 pid: 15515 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.362276:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.362277:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727c592 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.362279:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914529 00000100:00100000:2.0:1721880422.362283:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801360cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1016:2005:x1805522257743104:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.362284:0:16182:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098b0a640/0x8a60d30f571d2afe lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121d44 expref: 1016 pid: 15515 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.362284:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727c592 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.362289:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.362290:0:16182:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.362291:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.362292:0:16182:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c5a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.362292:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.362294:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914530 00010000:00010000:2.0:1721880422.362295:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f82fcc0/0x8a60d30f571d2d7b lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc69:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121dfa expref: 1015 pid: 16120 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.362296:0:16182:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c5a0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.362299:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088414a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1015:2006:x1805522257743232:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.362302:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+1015:2004:x1805522257742592:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 52us (195us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.362304:0:16182:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.362304:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f82fcc0/0x8a60d30f571d2d7b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc69:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121dfa expref: 1015 pid: 16120 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.362305:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914527 00010000:00010000:0.0:1721880422.362309:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.362313:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5bd7cc0/0x8a60d30f571d30bc lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc6a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121e9b expref: 1014 pid: 15447 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.362313:0:16182:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801360cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_013:30425778-2709-4512-9d75-01ec53c4cfad+1014:2005:x1805522257742976:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 49us (186us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.362315:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.362316:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1721880422.362317:0:16182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914528 00010000:00010000:2.0:1721880422.362319:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c5a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc69:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.362320:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727c58b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.362323:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5bd7cc0/0x8a60d30f571d30bc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc6a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121e9b expref: 1013 pid: 15447 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.362324:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727c58b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.362328:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727c58b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.362331:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c5a7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc69:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.362332:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727c58b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.362334:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c5a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.362336:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.362336:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727c58b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.362338:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.362339:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c5a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.362339:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b58c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.362340:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c5ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc6a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.362341:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727c58b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.362342:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.362343:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c5a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.362347:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727c58b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.362348:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c5ae lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc6a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.362348:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c5a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.362352:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c5a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.362353:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727c58b lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.362356:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727c58b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.362357:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa9680 already unused, calling callback (ffffffffa084e330) 00000100:00100000:2.0:1721880422.362357:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801360cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+1013:2005:x1805522257743104:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 73us (204us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.362359:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.362359:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c5a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.362362:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914529 00010000:00010000:1.0:1721880422.362365:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c5a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.362374:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c5a0 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.362378:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088414a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1012:2006:x1805522257743232:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 77us (211us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.362380:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c5a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.362382:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c599 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.362385:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914530 00010000:00010000:2.0:1721880422.362387:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c599 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.362392:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c599 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.362396:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c599 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.362399:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c599 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.362403:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350240 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.362404:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c599 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.362412:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c599 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.362418:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c599 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.362421:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c599 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.362438:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800920abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2244:3689:x1805522011762560:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1950us (1989us total) trans 4296020303 rc 0/0 00000100:00100000:3.0:1721880422.362442:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632332 00000004:00080000:3.0:1721880422.362460:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800920a9180/2, rc 0, transno 1053007 00000100:00100000:0.0:1721880422.362469:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.362471:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800920a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011762560:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.362480:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727c584 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.362484:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727c584 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.362485:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257743360 00000100:00100000:0.0:1721880422.362489:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257743360 00010000:00010000:3.0:1721880422.362489:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727c584 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.362492:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727c584 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.362493:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800887aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011764480:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.362499:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727c584 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.362500:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130240fc0/0x8a60d30f571d347b lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121f20 expref: 1012 pid: 16027 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.362503:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa9200 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.362504:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727c584 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.362508:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.362508:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727c584 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.362514:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727c584 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.362517:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727c584 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.362523:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914531 00000100:00100000:2.0:1721880422.362523:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2244:3687:x1805522011763200:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1596us (1653us total) trans 4296020305 rc 0/0 00000004:00080000:1.0:1721880422.362525:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011f822680/2, rc 0, transno 1053009 00000100:00100000:0.0:1721880422.362528:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ab4d5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1012:2004:x1805522257743360:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.362528:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632334 00000100:00100000:1.0:1721880422.362529:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88011f822680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011763200:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.362535:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.362537:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011764480 00010000:00010000:0.0:1721880422.362539:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130240fc0/0x8a60d30f571d347b lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc6b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121f20 expref: 1012 pid: 16027 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.362539:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011764480 00000100:00100000:1.0:1721880422.362543:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800887ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011764608:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.362549:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130240fc0/0x8a60d30f571d347b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc6b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121f20 expref: 1012 pid: 16027 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.362551:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632339 00000100:00100000:2.0:1721880422.362555:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800887aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2245:3687:x1805522011764480:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.362556:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.362561:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.362563:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00002000:00080000:2.0:1721880422.362564:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64620 count 1 00010000:00010000:0.0:1721880422.362565:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c5b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc6b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.362572:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727c5bc lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc6c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.362573:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c5b5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc6b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.362580:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800998cbcc0/0x8a60d30f571d3a86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121fc8 expref: 1012 pid: 16078 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.362584:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.362585:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.362585:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.362587:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727c5bc lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.362590:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2245:3687:x1805522011763328:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1646us (1695us total) trans 4296020304 rc 0/0 00000100:00100000:3.0:1721880422.362590:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2245:3687:x1805522011762432:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2107us (2162us total) trans 4296020306 rc 0/0 00000100:00100000:3.0:1721880422.362594:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632331 00000100:00100000:1.0:1721880422.362598:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632335 00010000:00010000:2.0:1721880422.362598:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800998cbcc0/0x8a60d30f571d3a86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121fc8 expref: 1012 pid: 16078 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.362603:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ab4d5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1012:2004:x1805522257743360:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 73us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.362603:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011764608 00010000:00010000:2.0:1721880422.362605:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800998cbcc0/0x8a60d30f571d3a86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121fc8 expref: 1012 pid: 16078 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.362605:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011764608 00000100:00100000:0.0:1721880422.362610:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914531 00000100:00100000:2.0:1721880422.362611:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880096f17800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011764736:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.362616:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632340 00000100:00100000:3.0:1721880422.362619:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800887a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2244:3688:x1805522011764608:12345-0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1721880422.362621:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007ca5dc00/2, rc 0, transno 1053008 00000100:00100000:2.0:1721880422.362626:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde180 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.362627:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007ca5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011763328:0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.362627:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64621 count 1 00010000:00010000:3.0:1721880422.362634:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c5c3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc6d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.362641:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130240fc0/0x8a60d30f571d347b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121f20 expref: 1011 pid: 16027 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.362644:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007bbf8900/0x8a60d30f571d3f64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1220a8 expref: 1011 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.362646:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1721880422.362648:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880096f14380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011764352:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.362648:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.362649:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.362650:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c5c3 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.362652:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880130769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011764864:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.362657:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c5b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.362660:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007bbf8900/0x8a60d30f571d3f64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1220a8 expref: 1010 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.362662:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c5b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.362665:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007bbf8900/0x8a60d30f571d3f64 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1220a8 expref: 1010 pid: 15453 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.362666:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c5b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.362670:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c5b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.362671:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800942e6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011764992:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.362672:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.362673:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c5b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.362678:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c5b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.362682:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350480 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.362684:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c5b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.362688:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c5b5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.362688:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec900 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.362693:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c5b5 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.362696:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c5b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.362697:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011764864 00000100:00100000:3.0:1721880422.362698:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011764864 00000004:00080000:1.0:1721880422.362699:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800920a9880/2, rc 0, transno 1053010 00000100:00100000:1.0:1721880422.362704:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800920a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011762432:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.362708:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632341 00000100:00100000:3.0:1721880422.362710:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2245:3688:x1805522011764864:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.362717:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64622 count 1 00010000:00010000:3.0:1721880422.362723:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727c5ca lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.362746:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008cf8f840/0x8a60d30f571d41a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12213b expref: 1010 pid: 15445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.362753:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.362754:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.362755:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727c5ca lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.362760:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1721880422.362764:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008cf8f840/0x8a60d30f571d41a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12213b expref: 1010 pid: 15445 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.362769:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880098bee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011765120:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.362769:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008cf8f840/0x8a60d30f571d41a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12213b expref: 1010 pid: 15445 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.362770:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f82fcc0/0x8a60d30f571d2d7b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121dfa expref: 1010 pid: 16120 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.362775:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088fe6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011765248:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.362782:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094692d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011763968:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.362789:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.362792:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec6c0 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.362796:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c5a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.362801:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800887a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2246:3687:x1805522011764224:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1517us (1543us total) trans 4296020307 rc 0/0 00010000:00010000:1.0:1721880422.362804:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c5a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.362805:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632338 00000004:00080000:0.0:1721880422.362808:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880094693480/2, rc 0, transno 1053011 00010000:00010000:1.0:1721880422.362810:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c5a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.362810:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011765120 00000100:00100000:3.0:1721880422.362811:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011765120 00000100:00100000:0.0:1721880422.362819:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011764224:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.362819:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c5a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.362826:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632342 00000100:00100000:3.0:1721880422.362829:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088414a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2246:3687:x1805522011765120:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.362831:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c5a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.362836:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64623 count 1 00010000:00010000:1.0:1721880422.362837:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c5a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.362842:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727c5d1 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.362843:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4000 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.362846:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c5a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.362849:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b0c5d40/0x8a60d30f571d43a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1221dc expref: 1009 pid: 16122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.362852:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c5a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.362852:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.362853:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.362855:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727c5d1 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.362861:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c5a7 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.362865:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b0c5d40/0x8a60d30f571d43a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1221dc expref: 1009 pid: 16122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.362868:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c5a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.362870:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b0c5d40/0x8a60d30f571d43a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1221dc expref: 1009 pid: 16122 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.362874:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d279f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011765376:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.362889:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec600 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.362900:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727c592 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.362905:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727c592 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.362909:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727c592 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.362912:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727c592 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.362916:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727c592 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.362919:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880098bec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011765504:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.362919:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350000 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.362920:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727c592 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.362925:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727c592 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.362931:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727c592 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.362932:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.362934:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727c592 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.362943:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011765504 00000100:00100000:2.0:1721880422.362945:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011765504 00000100:00100000:2.0:1721880422.362957:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632343 00000100:00100000:2.0:1721880422.362960:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088417b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2248:3687:x1805522011765504:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.362969:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64624 count 1 00010000:00010000:2.0:1721880422.362976:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c5d8 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.362987:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800982d1200/0x8a60d30f571d46f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122292 expref: 1009 pid: 16043 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.362992:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.362993:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.362994:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c5d8 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.363000:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2249:3688:x1805522011763456:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1997us (2039us total) trans 4296020308 rc 0/0 00010000:00010000:2.0:1721880422.363005:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800982d1200/0x8a60d30f571d46f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122292 expref: 1009 pid: 16043 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.363006:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007ca5ea00/2, rc 0, transno 1053012 00000100:00100000:1.0:1721880422.363007:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632336 00010000:00010000:2.0:1721880422.363024:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800982d1200/0x8a60d30f571d46f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122292 expref: 1009 pid: 16043 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.363027:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2249:3689:x1805522011762688:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2505us (2536us total) trans 4296020309 rc 0/0 00000100:00100000:0.0:1721880422.363028:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007ca5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011763456:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.363032:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880096f14380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011765632:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.363032:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632333 00000100:00100000:2.0:1721880422.363050:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.363084:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880098bec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011765760:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.363098:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.363112:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011765760 00000100:00100000:1.0:1721880422.363115:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011765760 00000004:00080000:3.0:1721880422.363124:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880095b71c00/2, rc 0, transno 1053013 00000100:00100000:3.0:1721880422.363135:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880095b71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011762688:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.363139:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632344 00000100:00100000:0.0:1721880422.363143:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2248:3688:x1805522011765760:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.363151:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5bd7cc0/0x8a60d30f571d30bc lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121e9b expref: 1009 pid: 15447 timeout: 887 lvb_type: 0 00002000:00080000:0.0:1721880422.363154:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64625 count 1 00000100:00100000:3.0:1721880422.363158:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880098222d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011764096:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.363163:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c5df lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc71:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.363168:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c5ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.363171:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099a59680/0x8a60d30f571d494a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc71:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12231e expref: 1008 pid: 9459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.363172:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c5ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.363176:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.363176:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c5ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.363177:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.363178:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c5df lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc71:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.363181:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c5ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.363185:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c5ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.363189:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099a59680/0x8a60d30f571d494a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc71:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12231e expref: 1008 pid: 9459 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.363189:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c5ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.363190:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880098bed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011765888:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.363192:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aaba80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.363193:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c5ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.363195:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099a59680/0x8a60d30f571d494a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc71:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12231e expref: 1008 pid: 9459 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.363197:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c5ae lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.363203:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c5ae lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.363204:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088417800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011766016:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.363206:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727c5ae lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.363214:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.363223:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.363277:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2249:3688:x1805522011763840:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2136us (2174us total) trans 4296020310 rc 0/0 00000100:00100000:3.0:1721880422.363282:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632337 00000100:00100000:3.0:1721880422.363290:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011765888 00000100:00100000:3.0:1721880422.363293:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011765888 00000100:00100000:3.0:1721880422.363300:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632345 00000100:00100000:3.0:1721880422.363303:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f820700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2249:3689:x1805522011765888:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.363309:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64626 count 1 00010000:00010000:3.0:1721880422.363316:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c5e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc72:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.363322:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fb3eac0/0x8a60d30f571d4c37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc72:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1223cd expref: 1008 pid: 16053 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.363325:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800858b5880/2, rc 0, transno 1053014 00010000:00010000:3.0:1721880422.363326:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.363327:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.363329:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c5e6 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc72:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.363333:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800858b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011763840:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.363339:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fb3eac0/0x8a60d30f571d4c37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc72:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1223cd expref: 1008 pid: 16053 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.363344:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fb3eac0/0x8a60d30f571d4c37 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc72:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1223cd expref: 1008 pid: 16053 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.363349:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d278700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011766144:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.363364:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec000 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.363374:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1721880422.363381:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011766272:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.363399:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.363413:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011766272 00000100:00100000:1.0:1721880422.363417:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011766272 00000100:00100000:1.0:1721880422.363435:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632346 00000100:00100000:1.0:1721880422.363439:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088417480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2250:3687:x1805522011766272:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.363451:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64627 count 1 00010000:00010000:1.0:1721880422.363460:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c5ed lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc73:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.363471:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099fe33c0/0x8a60d30f571d4e52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc73:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122444 expref: 1008 pid: 15447 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.363477:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.363479:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.363481:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c5ed lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc73:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.363497:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099fe33c0/0x8a60d30f571d4e52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc73:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122444 expref: 1008 pid: 15447 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.363505:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099fe33c0/0x8a60d30f571d4e52 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc73:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122444 expref: 1008 pid: 15447 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.363515:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800995f5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011766400:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.363537:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb000 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.363593:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088fe6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011765248:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.363596:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800942e6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011764992:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.363604:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727c5ca lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.363605:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.363608:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c5c3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.363620:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.363623:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d279f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011765376:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.363629:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257743872 00000100:00100000:2.0:1721880422.363630:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.363631:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257743872 00000100:00100000:1.0:1721880422.363636:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257743488 00000100:00100000:2.0:1721880422.363638:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257743744 00000100:00100000:1.0:1721880422.363639:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257743488 00010000:00010000:0.0:1721880422.363640:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b0c5d40/0x8a60d30f571d43a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1221dc expref: 1009 pid: 16122 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.363641:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257743744 00010000:00010000:1.0:1721880422.363651:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007bbf8900/0x8a60d30f571d3f64 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1220a8 expref: 1011 pid: 15453 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.363651:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800982d1200/0x8a60d30f571d46f0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122292 expref: 1011 pid: 16043 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.363652:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727c5d1 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.363665:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914532 00000100:00100000:1.0:1721880422.363669:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b147b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1011:2005:x1805522257743488:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.363674:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.363677:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007bbf8900/0x8a60d30f571d3f64 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc6d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1220a8 expref: 1011 pid: 15453 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.363679:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914533 00010000:00010000:1.0:1721880422.363683:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007bbf8900/0x8a60d30f571d3f64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc6d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1220a8 expref: 1011 pid: 15453 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.363685:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076fe5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1011:2005:x1805522257743744:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.363691:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007bbf8900/0x8a60d30f571d3f64 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc6d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1220a8 expref: 1011 pid: 15453 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.363693:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.363694:0:8793:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914534 00010000:00010000:2.0:1721880422.363697:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800982d1200/0x8a60d30f571d46f0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122292 expref: 1010 pid: 16043 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.363698:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.363698:0:8793:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30425778-2709-4512-9d75-01ec53c4cfad+1010:2007:x1805522257743872:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.363699:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.363701:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c5c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.363704:0:8793:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.363705:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c5c3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.363707:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800982d1200/0x8a60d30f571d46f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122292 expref: 1010 pid: 16043 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.363708:0:8793:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b0c5d40/0x8a60d30f571d43a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1221dc expref: 1010 pid: 16122 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.363713:0:8793:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b0c5d40/0x8a60d30f571d43a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1221dc expref: 1010 pid: 16122 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.363714:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.363718:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.363720:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.363721:0:8793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b0c5d40/0x8a60d30f571d43a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1221dc expref: 1010 pid: 16122 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.363723:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c5d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.363744:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b147b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1009:2005:x1805522257743488:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 73us (123us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.363745:0:8793:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.363747:0:8793:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1721880422.363748:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914532 00010000:00010000:3.0:1721880422.363748:0:8793:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727c5d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.363749:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c5d8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.363753:0:8793:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727c5d1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.363761:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.363761:0:8793:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.363771:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c5c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.363773:0:8793:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30425778-2709-4512-9d75-01ec53c4cfad+1008:2007:x1805522257743872:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 74us (170us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.363777:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c5c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.363777:0:8793:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914534 00000100:00100000:1.0:1721880422.363779:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.363782:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c5c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.363782:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880076fe5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1008:2005:x1805522257743744:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 97us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.363786:0:8793:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257743616 00000100:00100000:3.0:1721880422.363788:0:8793:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257743616 00000100:00100000:2.0:1721880422.363789:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914533 00010000:00010000:0.0:1721880422.363790:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c5c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.363794:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c5c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.363795:0:8793:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008cf8f840/0x8a60d30f571d41a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12213b expref: 1008 pid: 15445 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.363797:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8000 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.363799:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c5c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.363803:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c5c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.363804:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.363804:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914535 00010000:00010000:0.0:1721880422.363809:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c5c3 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.363810:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1007:2005:x1805522257743616:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.363810:0:8793:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257744000 00000100:00100000:3.0:1721880422.363812:0:8793:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257744000 00010000:00010000:0.0:1721880422.363813:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c5c3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.363817:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.363817:0:8793:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800998cbcc0/0x8a60d30f571d3a86 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121fc8 expref: 1008 pid: 16078 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.363822:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008cf8f840/0x8a60d30f571d41a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12213b expref: 1008 pid: 15445 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.363829:0:8793:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914536 00010000:00010000:2.0:1721880422.363831:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008cf8f840/0x8a60d30f571d41a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12213b expref: 1008 pid: 15445 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.363832:0:8793:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30425778-2709-4512-9d75-01ec53c4cfad+1008:2005:x1805522257744000:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.363836:0:8793:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.363839:0:8793:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800998cbcc0/0x8a60d30f571d3a86 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc6c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121fc8 expref: 1008 pid: 16078 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.363843:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008cf8f840/0x8a60d30f571d41a2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12213b expref: 1008 pid: 15445 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.363845:0:8793:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800998cbcc0/0x8a60d30f571d3a86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc6c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121fc8 expref: 1008 pid: 16078 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.363852:0:8793:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.363853:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.363853:0:8793:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.363854:0:8793:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727c5bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc6c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.363855:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.363857:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727c5ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.363858:0:8793:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727c5bc lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc6c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.363863:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727c5ca lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.363864:0:8793:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.363874:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.363881:0:8793:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30425778-2709-4512-9d75-01ec53c4cfad+1007:2005:x1805522257744000:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 48us (77us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.363885:0:8793:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914536 00000100:00100000:2.0:1721880422.363888:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+1007:2005:x1805522257743616:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 78us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.363889:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.363892:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914535 00000100:00100000:3.0:1721880422.363894:0:8793:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257744128 00000100:00100000:3.0:1721880422.363895:0:8793:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257744128 00010000:00010000:3.0:1721880422.363901:0:8793:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099a59680/0x8a60d30f571d494a lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc71:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12231e expref: 1006 pid: 9459 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.363911:0:8793:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914537 00000100:00100000:3.0:1721880422.363913:0:8793:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30425778-2709-4512-9d75-01ec53c4cfad+1006:2004:x1805522257744128:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.363915:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800998cbcc0/0x8a60d30f571d3a86 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b121fc8 expref: 1006 pid: 16078 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.363917:0:8793:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.363919:0:8793:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099a59680/0x8a60d30f571d494a lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc71:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12231e expref: 1006 pid: 9459 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.363923:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880096f17800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011764736:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.363924:0:8793:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099a59680/0x8a60d30f571d494a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc71:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12231e expref: 1005 pid: 9459 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.363931:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727c5bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.363931:0:8793:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.363931:0:8793:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.363933:0:8793:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c5df lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc71:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.363937:0:8793:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c5df lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc71:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.363939:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727c5bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.363943:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727c5bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.363945:0:8793:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.363947:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727c5bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.363951:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727c5bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.363954:0:8793:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30425778-2709-4512-9d75-01ec53c4cfad+1005:2004:x1805522257744128:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 40us (65us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.363955:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727c5bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.363957:0:8793:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914537 00010000:00010000:2.0:1721880422.363958:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353840 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.363960:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727c5bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.363963:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727c5bc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.363969:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727c5bc lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.363971:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727c5ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.363972:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727c5bc lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.363976:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727c5ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.363980:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727c5ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.363983:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800887a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2251:3688:x1805522011764608:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1361us (1426us total) trans 4296020311 rc 0/0 00010000:00010000:3.0:1721880422.363983:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727c5ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.363987:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727c5ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.363990:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632340 00010000:00010000:3.0:1721880422.363990:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aab840 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.363992:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727c5ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.363995:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727c5ca lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.364000:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.364004:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727c5ca lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.364009:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727c5ca lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.364033:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800887ab800/2, rc 0, transno 1053015 00000100:00100000:1.0:1721880422.364036:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.364049:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800887ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011764608:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.364052:0:8793:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257744256 00000100:00100000:3.0:1721880422.364054:0:8793:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257744256 00010000:00010000:3.0:1721880422.364063:0:8793:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fb3eac0/0x8a60d30f571d4c37 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc72:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1223cd expref: 1005 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.364075:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099a59680/0x8a60d30f571d494a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc71:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12231e expref: 1005 pid: 9459 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.364077:0:8793:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257744384 00000100:00100000:1.0:1721880422.364079:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914538 00000100:00100000:3.0:1721880422.364079:0:8793:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257744384 00000100:00100000:1.0:1721880422.364083:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ab4d7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1006:2004:x1805522257744256:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.364085:0:8793:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099fe33c0/0x8a60d30f571d4e52 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc73:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122444 expref: 1005 pid: 15447 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.364087:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088417800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011766016:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.364088:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.364089:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800887aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2251:3687:x1805522011764480:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1532us (1579us total) trans 4296020312 rc 0/0 00010000:00010000:1.0:1721880422.364091:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fb3eac0/0x8a60d30f571d4c37 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc72:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1223cd expref: 1005 pid: 16053 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.364095:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632339 00010000:00010000:1.0:1721880422.364097:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fb3eac0/0x8a60d30f571d4c37 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc72:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1223cd expref: 1005 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.364104:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c5df lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.364104:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.364105:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.364107:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c5e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc72:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.364108:0:8793:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914539 00010000:00010000:1.0:1721880422.364111:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c5e6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc72:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.364114:0:8793:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30425778-2709-4512-9d75-01ec53c4cfad+1005:2005:x1805522257744384:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.364118:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.364120:0:8793:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.364124:0:8793:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099fe33c0/0x8a60d30f571d4e52 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc73:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122444 expref: 1005 pid: 15447 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.364125:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800982d1200/0x8a60d30f571d46f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122292 expref: 1005 pid: 16043 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.364129:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ab4d7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+1005:2004:x1805522257744256:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 45us (129us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.364132:0:8793:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099fe33c0/0x8a60d30f571d4e52 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc73:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122444 expref: 1004 pid: 15447 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.364133:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914538 00000100:00100000:2.0:1721880422.364135:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880096f14380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011765632:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.364143:0:8793:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.364144:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c5d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.364145:0:8793:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.364147:0:8793:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c5ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc73:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.364151:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c5d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.364153:0:8793:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c5ed lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc73:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.364157:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c5d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.364163:0:8793:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.364164:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c5d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.364170:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c5d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.364176:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c5d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.364179:0:8793:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30425778-2709-4512-9d75-01ec53c4cfad+1003:2005:x1805522257744384:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 64us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.364184:0:8793:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914539 00010000:00010000:2.0:1721880422.364186:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801363533c0 already unused, calling callback (ffffffffa084e330) 00000100:00100000:0.0:1721880422.364189:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011766528:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.364189:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c5d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.364196:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c5d8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.364203:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c5d8 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.364208:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c5d8 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.364214:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1721880422.364234:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800887aaa00/2, rc 0, transno 1053016 00010000:00010000:1.0:1721880422.364240:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099fe33c0/0x8a60d30f571d4e52 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc73:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122444 expref: 1002 pid: 15447 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.364250:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800887aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011764480:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.364256:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800995f5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011766400:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.364265:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c5df lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.364267:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c5ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.364272:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c5df lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.364275:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880130768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2252:3688:x1805522011764864:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1563us (1602us total) trans 4296020313 rc 0/0 00000100:00100000:3.0:1721880422.364279:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632341 00010000:00010000:0.0:1721880422.364280:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c5df lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.364287:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c5df lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.364287:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011766528 00000100:00100000:3.0:1721880422.364289:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011766528 00010000:00010000:0.0:1721880422.364294:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c5df lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.364295:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1721880422.364295:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088417b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2252:3687:x1805522011765504:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1333us (1361us total) trans 4296020314 rc 0/0 00000100:00100000:3.0:1721880422.364298:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632347 00010000:00010000:0.0:1721880422.364300:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325dd40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.364303:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c5df lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.364303:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011766656:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.364303:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632343 00000100:00100000:3.0:1721880422.364303:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088417800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2252:3687:x1805522011766528:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.364310:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c5df lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.364310:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64628 count 1 00010000:00010000:3.0:1721880422.364317:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c5f4 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc74:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.364320:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c5df lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.364323:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.364323:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013132b600/0x8a60d30f571d50cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc74:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1224d7 expref: 1001 pid: 16057 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.364327:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c5df lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.364327:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.364328:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.364330:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c5f4 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc74:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.364341:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011766656 00010000:00010000:3.0:1721880422.364342:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013132b600/0x8a60d30f571d50cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc74:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1224d7 expref: 1001 pid: 16057 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.364344:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011766656 00010000:00010000:3.0:1721880422.364348:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013132b600/0x8a60d30f571d50cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc74:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1224d7 expref: 1001 pid: 16057 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.364352:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c5ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.364354:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632348 00000100:00100000:3.0:1721880422.364354:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d279f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011766784:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.364357:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2252:3689:x1805522011766656:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.364359:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c5ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.364366:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64629 count 1 00010000:00010000:1.0:1721880422.364367:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c5ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.364368:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec600 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.364373:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c5ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.364374:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c5fb lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.364378:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727c5d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.364379:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c5ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.364382:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ee8d680/0x8a60d30f571d5345 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122578 expref: 1001 pid: 15465 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.364382:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727c5d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.364385:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b61c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.364386:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727c5d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.364387:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c5ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.364390:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.364390:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727c5d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.364391:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.364393:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c5fb lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.364393:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727c5d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.364394:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c5ed lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.364397:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8b40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.364398:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727c5d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.364403:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727c5d1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.364404:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c5ed lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.364404:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ee8d680/0x8a60d30f571d5345 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122578 expref: 1001 pid: 15465 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.364408:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c5ed lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.364408:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727c5d1 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.364409:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ee8d680/0x8a60d30f571d5345 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122578 expref: 1001 pid: 15465 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.364412:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727c5d1 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.364416:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076fe5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011766912:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.364432:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.364481:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088414a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2255:3687:x1805522011765120:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1651us (1691us total) trans 4296020316 rc 0/0 00000100:00100000:3.0:1721880422.364486:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632342 00000100:00100000:0.0:1721880422.364500:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2254:3688:x1805522011765760:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1355us (1399us total) trans 4296020315 rc 0/0 00000100:00100000:0.0:1721880422.364505:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632344 00000100:00100000:1.0:1721880422.364506:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088417480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2254:3687:x1805522011766272:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1065us (1104us total) trans 4296020317 rc 0/0 00010000:00010000:3.0:1721880422.364509:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fb3eac0/0x8a60d30f571d4c37 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc72:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1223cd expref: 1001 pid: 16053 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.364512:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632346 00000100:00100000:3.0:1721880422.364516:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d278700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011766144:192.168.201.24@tcp:104: 00000004:00080000:0.0:1721880422.364527:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880098bec700/2, rc 0, transno 1053019 00010000:00010000:3.0:1721880422.364531:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c5e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.364535:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c5e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.364539:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c5e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.364541:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880098bec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011765760:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.364546:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c5e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.364548:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880130769880/2, rc 0, transno 1053017 00000100:00100000:0.0:1721880422.364550:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880130769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011764864:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.364550:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c5e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.364553:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c5e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.364556:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa9b00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.364558:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c5e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.364561:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c5e6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.364562:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880094692d80/2, rc 0, transno 1053021 00000100:00100000:0.0:1721880422.364565:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011766272:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.364567:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c5e6 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.364570:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880098bec000/2, rc 0, transno 1053018 00010000:00010000:3.0:1721880422.364570:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727c5e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.364573:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880098bec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011765504:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1721880422.364578:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880098bee680/2, rc 0, transno 1053020 00000100:00100000:0.0:1721880422.364580:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880098bee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011765120:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.364583:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1721880422.364588:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011767168:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.364599:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1721880422.364603:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.364606:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011767040:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.364606:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011767296:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.364617:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b147b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011767424:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.364622:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.364632:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.364639:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f820700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2253:3689:x1805522011765888:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1335us (1424us total) trans 4296020318 rc 0/0 00000100:00100000:2.0:1721880422.364641:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011767168 00000100:00100000:2.0:1721880422.364643:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011767168 00000100:00100000:3.0:1721880422.364643:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632345 00000100:00100000:1.0:1721880422.364649:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011767552:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.364651:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.364651:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011767296 00000100:00100000:3.0:1721880422.364653:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011767296 00000100:00100000:2.0:1721880422.364655:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011767040 00000100:00100000:2.0:1721880422.364657:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011767040 00000100:00100000:3.0:1721880422.364664:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011767424 00000100:00100000:3.0:1721880422.364665:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011767424 00000100:00100000:1.0:1721880422.364666:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.364667:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632349 00000100:00100000:2.0:1721880422.364671:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2256:3687:x1805522011767168:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.364672:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011767552 00000100:00100000:0.0:1721880422.364675:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011767552 00000100:00100000:3.0:1721880422.364677:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632350 00002000:00080000:2.0:1721880422.364679:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64631 count 1 00000100:00100000:3.0:1721880422.364680:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096f14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2257:3686:x1805522011767296:12345-0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1721880422.364686:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880098bed880/2, rc 0, transno 1053022 00010000:00010000:2.0:1721880422.364686:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c602 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.364687:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632351 00002000:00080000:3.0:1721880422.364687:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64632 count 1 00000100:00100000:0.0:1721880422.364690:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2257:3689:x1805522011767040:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.364693:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880098bed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011765888:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.364694:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c609 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.364697:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a04ed200/0x8a60d30f571d5b79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122a10 expref: 1000 pid: 16099 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1721880422.364700:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64630 count 1 00010000:00010000:3.0:1721880422.364700:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800965d73c0/0x8a60d30f571d5e43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122a8e expref: 1000 pid: 16129 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.364701:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.364702:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.364704:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c602 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.364704:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.364705:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.364707:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c609 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.364708:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727c610 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc76:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.364716:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008427b180/0x8a60d30f571d5608 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc76:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12264a expref: 1000 pid: 16079 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.364716:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800965d73c0/0x8a60d30f571d5e43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122a8e expref: 1000 pid: 16129 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.364720:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.364720:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a04ed200/0x8a60d30f571d5b79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122a10 expref: 1000 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.364721:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.364722:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800965d73c0/0x8a60d30f571d5e43 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122a8e expref: 1000 pid: 16129 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.364723:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727c610 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc76:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.364740:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a04ed200/0x8a60d30f571d5b79 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122a10 expref: 1000 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.364744:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d278700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011767680:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.364747:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880096f17800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011767936:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.364757:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008427b180/0x8a60d30f571d5608 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc76:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12264a expref: 1000 pid: 16079 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.364761:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde180 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.364764:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008427b180/0x8a60d30f571d5608 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc76:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12264a expref: 1000 pid: 16079 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.364770:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800942e6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011768064:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.364772:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632352 00000100:00100000:2.0:1721880422.364775:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2257:3688:x1805522011767424:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.364782:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64633 count 1 00010000:00010000:2.0:1721880422.364789:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c617 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.364796:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c5ccfc0/0x8a60d30f571d60b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122b4b expref: 1000 pid: 16022 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.364800:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.364801:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.364803:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c617 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.364813:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c5ccfc0/0x8a60d30f571d60b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122b4b expref: 1000 pid: 16022 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.364818:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c5ccfc0/0x8a60d30f571d60b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122b4b expref: 1000 pid: 16022 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.364824:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632353 00000100:00100000:2.0:1721880422.364824:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800952a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011768192:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.364830:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2257:3689:x1805522011767552:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.364836:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde600 going to sleep for 11 seconds 00002000:00080000:1.0:1721880422.364842:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64634 count 1 00010000:00010000:1.0:1721880422.364851:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727c61e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.364851:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800995f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011767808:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.364862:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800982f4b40/0x8a60d30f571d633d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122bc2 expref: 1000 pid: 16029 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.364863:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.364869:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.364870:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1721880422.364871:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3eb40 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.364873:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727c61e lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.364878:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec000 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.364887:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011767808 00000100:00100000:3.0:1721880422.364889:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011767808 00010000:00010000:1.0:1721880422.364893:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800982f4b40/0x8a60d30f571d633d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122bc2 expref: 1000 pid: 16029 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.364900:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632354 00010000:00010000:1.0:1721880422.364902:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800982f4b40/0x8a60d30f571d633d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122bc2 expref: 1000 pid: 16029 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.364903:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800952a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2258:3686:x1805522011767808:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.364910:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64635 count 1 00000100:00100000:1.0:1721880422.364913:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800995f7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011768320:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.364917:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c625 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.364923:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d3c0240/0x8a60d30f571d6589 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122c71 expref: 1000 pid: 16109 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.364927:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.364928:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.364929:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c625 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.364937:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb000 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.364941:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d3c0240/0x8a60d30f571d6589 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122c71 expref: 1000 pid: 16109 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.364948:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d3c0240/0x8a60d30f571d6589 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122c71 expref: 1000 pid: 16109 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.364956:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d27bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011768448:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.364973:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.365442:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d279f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011766784:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.365456:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c5f4 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc74:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.365466:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076fe5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011766912:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.365481:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c5fb lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.365502:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800952a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011768192:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.365512:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c617 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.365530:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880096f17800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011767936:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.365539:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c602 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.365596:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.365613:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.365654:0:8793:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257744640 00000100:00100000:1.0:1721880422.365655:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257744768 00000100:00100000:3.0:1721880422.365657:0:8793:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257744640 00000100:00100000:1.0:1721880422.365658:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257744768 00010000:00010000:3.0:1721880422.365666:0:8793:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a04ed200/0x8a60d30f571d5b79 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122a10 expref: 1002 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.365669:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee8d680/0x8a60d30f571d5345 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122578 expref: 1002 pid: 15465 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.365678:0:8793:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914540 00000100:00100000:1.0:1721880422.365682:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914541 00000100:00100000:3.0:1721880422.365682:0:8793:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801360cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30425778-2709-4512-9d75-01ec53c4cfad+1002:2007:x1805522257744640:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.365683:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.365686:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801360cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1002:2005:x1805522257744768:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.365687:0:8793:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.365689:0:8793:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a04ed200/0x8a60d30f571d5b79 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122a10 expref: 1002 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.365691:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1721880422.365693:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.365693:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ee8d680/0x8a60d30f571d5345 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122578 expref: 1002 pid: 15465 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.365695:0:8793:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a04ed200/0x8a60d30f571d5b79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122a10 expref: 1002 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.365699:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ee8d680/0x8a60d30f571d5345 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122578 expref: 1002 pid: 15465 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.365703:0:8793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a04ed200/0x8a60d30f571d5b79 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122a10 expref: 1002 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.365707:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257744512 00000100:00100000:0.0:1721880422.365708:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.365708:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee8d680/0x8a60d30f571d5345 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122578 expref: 1001 pid: 15465 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.365709:0:8793:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.365710:0:8793:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.365711:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257744512 00010000:00010000:3.0:1721880422.365712:0:8793:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c602 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.365716:0:8793:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c602 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.365718:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.365719:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.365721:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c5fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.365722:0:7117:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257745024 00000100:00100000:2.0:1721880422.365723:0:7117:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257745024 00000100:00100000:0.0:1721880422.365725:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.365725:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c5fb lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.365725:0:8793:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.365749:0:7117:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008427b180/0x8a60d30f571d5608 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc76:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12264a expref: 1002 pid: 16079 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.365750:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.365760:0:8793:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801360cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30425778-2709-4512-9d75-01ec53c4cfad+1002:2007:x1805522257744640:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 77us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.365763:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801360cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1002:2005:x1805522257744768:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 77us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.365764:0:8793:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914540 00000100:00100000:1.0:1721880422.365767:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914541 00000100:00100000:2.0:1721880422.365768:0:7117:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257745152 00000100:00100000:2.0:1721880422.365770:0:7117:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257745152 00000100:00100000:3.0:1721880422.365772:0:8793:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257744896 00000100:00100000:3.0:1721880422.365774:0:8793:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257744896 00010000:00010000:2.0:1721880422.365776:0:7117:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800965d73c0/0x8a60d30f571d5e43 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122a8e expref: 1002 pid: 16129 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.365781:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914542 00010000:00010000:3.0:1721880422.365781:0:8793:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c5ccfc0/0x8a60d30f571d60b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122b4b expref: 1002 pid: 16022 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.365785:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1002:2005:x1805522257745024:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.365789:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.365792:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008427b180/0x8a60d30f571d5608 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc76:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12264a expref: 1002 pid: 16079 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.365796:0:7117:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914543 00010000:00010000:1.0:1721880422.365797:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008427b180/0x8a60d30f571d5608 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc76:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12264a expref: 1002 pid: 16079 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.365801:0:7117:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131eee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30425778-2709-4512-9d75-01ec53c4cfad+1002:2005:x1805522257745152:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.365801:0:8793:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914544 00010000:00010000:1.0:1721880422.365804:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.365804:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.365805:0:8793:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ab4d6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30425778-2709-4512-9d75-01ec53c4cfad+1002:2004:x1805522257744896:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.365806:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727c610 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc76:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.365807:0:7117:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.365809:0:8793:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.365810:0:7117:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800965d73c0/0x8a60d30f571d5e43 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122a8e expref: 1002 pid: 16129 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.365812:0:8793:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c5ccfc0/0x8a60d30f571d60b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122b4b expref: 1002 pid: 16022 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.365813:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727c610 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc76:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.365816:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008427b180/0x8a60d30f571d5608 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc76:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12264a expref: 1002 pid: 16079 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.365816:0:7117:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800965d73c0/0x8a60d30f571d5e43 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122a8e expref: 1002 pid: 16129 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.365818:0:8793:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c5ccfc0/0x8a60d30f571d60b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122b4b expref: 1002 pid: 16022 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.365819:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.365825:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800942e6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011768064:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.365826:0:7117:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.365826:0:8793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c5ccfc0/0x8a60d30f571d60b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122b4b expref: 1001 pid: 16022 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.365827:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+1001:2005:x1805522257745024:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 42us (134us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.365827:0:7117:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.365829:0:7117:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c609 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.365831:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914542 00010000:00010000:3.0:1721880422.365832:0:8793:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.365833:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727c610 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.365833:0:8793:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.365834:0:7117:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c609 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.365835:0:8793:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c617 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.365838:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727c610 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.365839:0:8793:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c617 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.365842:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727c610 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.365842:0:7117:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.365847:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727c610 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.365848:0:8793:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.365849:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c5fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.365850:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727c610 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.365854:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727c610 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.365854:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c5fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.365856:0:7117:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880131eee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30425778-2709-4512-9d75-01ec53c4cfad+999:2005:x1805522257745152:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 55us (148us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.365858:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c5fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.365858:0:8793:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ab4d6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30425778-2709-4512-9d75-01ec53c4cfad+999:2004:x1805522257744896:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 53us (132us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.365859:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325f840 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.365861:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727c610 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.365861:0:7117:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914543 00010000:00010000:1.0:1721880422.365862:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c5fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.365864:0:8793:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914544 00010000:00010000:0.0:1721880422.365865:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727c610 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.365866:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c5fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.365869:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352d00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.365871:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727c610 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.365871:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c5fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.365875:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727c610 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.365878:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c5fb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.365879:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013132b600/0x8a60d30f571d50cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc74:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1224d7 expref: 997 pid: 16057 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.365883:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c5fb lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.365883:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d27bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011768448:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.365887:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c5fb lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.365893:0:16188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914545 00000100:00100000:2.0:1721880422.365895:0:16188:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801360cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+997:2004:x1805522257744512:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.365898:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c625 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.365907:0:16188:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.365907:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c602 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.365910:0:16188:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013132b600/0x8a60d30f571d50cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc74:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1224d7 expref: 997 pid: 16057 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.365911:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c602 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.365916:0:16188:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013132b600/0x8a60d30f571d50cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc74:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1224d7 expref: 997 pid: 16057 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.365916:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c602 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.365919:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c602 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.365923:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c602 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.365924:0:16188:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013132b600/0x8a60d30f571d50cf lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc74:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1224d7 expref: 997 pid: 16057 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.365926:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136351680 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.365927:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c602 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.365931:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c602 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.365934:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.365935:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.365936:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c602 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.365937:0:16188:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c5f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc74:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.365941:0:16188:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c5f4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc74:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.365941:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c602 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.365952:0:16188:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.365964:0:16188:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801360cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+996:2004:x1805522257744512:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 68us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.365969:0:16188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914545 00000100:00100000:0.0:1721880422.365980:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2261:3689:x1805522011767040:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1288us (1347us total) trans 4296020319 rc 0/0 00000100:00100000:0.0:1721880422.365984:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632351 00000100:00100000:1.0:1721880422.365989:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2261:3689:x1805522011766656:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1630us (1665us total) trans 4296020320 rc 0/0 00000100:00100000:1.0:1721880422.365993:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632348 00010000:00010000:2.0:1721880422.365997:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c617 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.366002:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c617 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.366006:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c617 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.366029:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c617 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.366035:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007ca5e680/2, rc 0, transno 1053023 00010000:00010000:2.0:1721880422.366035:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c617 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.366038:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353a80 already unused, calling callback (ffffffffa084e330) 00000100:00100000:1.0:1721880422.366040:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007ca5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011767040:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.366040:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c617 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.366044:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c617 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.366045:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.366045:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2259:3687:x1805522011767168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1371us (1439us total) trans 4296020321 rc 0/0 00000100:00100000:3.0:1721880422.366049:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632349 00010000:00010000:2.0:1721880422.366054:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c617 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.366059:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c617 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.366063:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c5f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.366065:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007ca5d180/2, rc 0, transno 1053024 00010000:00010000:3.0:1721880422.366067:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c5f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.366068:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007ca5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011766656:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.366072:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c5f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.366075:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c5f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.366079:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1721880422.366079:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c5f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.366082:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aaad00 already unused, calling callback (ffffffffa084e330) 00000100:00100000:1.0:1721880422.366083:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009f12c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011768704:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.366084:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c5f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.366087:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c5f4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.366092:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.366094:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c5f4 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.366097:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.366098:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727c5f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.366106:0:16188:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257745280 00000100:00100000:2.0:1721880422.366109:0:16188:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257745280 00010000:00010000:2.0:1721880422.366116:0:16188:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d3c0240/0x8a60d30f571d6589 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122c71 expref: 996 pid: 16109 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.366117:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800995f7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011768320:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.366119:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009f12d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011768576:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.366129:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727c61e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.366133:0:16188:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257745408 00000100:00100000:2.0:1721880422.366135:0:16188:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257745408 00000100:00100000:0.0:1721880422.366136:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.366140:0:16188:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800982f4b40/0x8a60d30f571d633d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122bc2 expref: 997 pid: 16029 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.366141:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914546 00000100:00100000:3.0:1721880422.366144:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131eee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+997:2005:x1805522257745280:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000004:00080000:0.0:1721880422.366150:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007ca5d880/2, rc 0, transno 1053025 00000100:00100000:1.0:1721880422.366151:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011768704 00010000:00010000:3.0:1721880422.366151:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.366152:0:16188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914547 00000100:00100000:1.0:1721880422.366154:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011768704 00010000:00010000:3.0:1721880422.366154:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d3c0240/0x8a60d30f571d6589 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122c71 expref: 997 pid: 16109 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.366156:0:16188:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+997:2006:x1805522257745408:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.366160:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007ca5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011767168:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.366160:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d3c0240/0x8a60d30f571d6589 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122c71 expref: 997 pid: 16109 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.366161:0:16188:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.366164:0:16188:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800982f4b40/0x8a60d30f571d633d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122bc2 expref: 997 pid: 16029 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.366168:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d3c0240/0x8a60d30f571d6589 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122c71 expref: 997 pid: 16109 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.366170:0:16188:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800982f4b40/0x8a60d30f571d633d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122bc2 expref: 997 pid: 16029 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.366174:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.366175:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.366177:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c625 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.366179:0:16188:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800982f4b40/0x8a60d30f571d633d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122bc2 expref: 996 pid: 16029 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.366181:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c625 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.366184:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011768576 00000100:00100000:1.0:1721880422.366185:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011768576 00010000:00010000:2.0:1721880422.366186:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.366187:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.366189:0:16188:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727c61e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.366193:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632355 00010000:00010000:3.0:1721880422.366193:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.366194:0:16188:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727c61e lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.366196:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f12f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2261:3689:x1805522011768704:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.366203:0:16188:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.366206:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880131eee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+995:2005:x1805522257745280:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 61us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.366207:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800995f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011768832:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.366210:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914546 00000100:00100000:2.0:1721880422.366216:0:16188:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+994:2006:x1805522257745408:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 60us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.366220:0:16188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914547 00000100:00100000:1.0:1721880422.366223:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.366230:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c625 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.366234:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c625 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.366238:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c625 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.366241:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c625 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.366245:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64637 count 1 00010000:00010000:3.0:1721880422.366245:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c625 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.366247:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011768832 00010000:00010000:3.0:1721880422.366248:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aabcc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.366249:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c625 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.366250:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011768832 00010000:00010000:1.0:1721880422.366253:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c62c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc7d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.366253:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c625 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.366260:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096f8eac0/0x8a60d30f571d6a60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc7d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122d97 expref: 993 pid: 16115 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.366261:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c625 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.366263:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632356 00010000:00010000:1.0:1721880422.366264:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.366265:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.366265:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727c625 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.366266:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c62c lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc7d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.366267:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2263:3687:x1805522011768576:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.366276:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096f8eac0/0x8a60d30f571d6a60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc7d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122d97 expref: 993 pid: 16115 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1721880422.366277:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64636 count 1 00010000:00010000:1.0:1721880422.366282:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096f8eac0/0x8a60d30f571d6a60 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc7d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122d97 expref: 993 pid: 16115 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.366286:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727c633 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc7c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.366286:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2263:3688:x1805522011767424:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1510us (1634us total) trans 4296020322 rc 0/0 00000100:00100000:1.0:1721880422.366288:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880125987800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011768960:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.366291:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632352 00010000:00010000:0.0:1721880422.366293:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0565680/0x8a60d30f571d6837 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc7c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122d04 expref: 993 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.366298:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.366299:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.366300:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632357 00010000:00010000:0.0:1721880422.366301:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727c633 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc7c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.366303:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880125984e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2263:3689:x1805522011768832:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.366304:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb000 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.366312:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0565680/0x8a60d30f571d6837 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc7c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122d04 expref: 993 pid: 16130 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.366312:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64638 count 1 00010000:00010000:0.0:1721880422.366318:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0565680/0x8a60d30f571d6837 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc7c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122d04 expref: 993 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.366319:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c63a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc7e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.366324:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088dd7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011769088:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.366327:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880084d25f80/0x8a60d30f571d6d46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc7e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122e4d expref: 993 pid: 16127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.366331:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.366332:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1721880422.366333:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800952a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2263:3686:x1805522011767808:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1429us (1469us total) trans 4296020324 rc 0/0 00010000:00010000:2.0:1721880422.366334:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c63a lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc7e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.366337:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632354 00000100:00100000:0.0:1721880422.366340:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3eb40 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.366344:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880084d25f80/0x8a60d30f571d6d46 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc7e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122e4d expref: 993 pid: 16127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.366350:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880084d25f80/0x8a60d30f571d6d46 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc7e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122e4d expref: 993 pid: 16127 timeout: 887 lvb_type: 0 00000004:00080000:0.0:1721880422.366355:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009b147b80/2, rc 0, transno 1053026 00000100:00100000:2.0:1721880422.366356:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800952a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011769216:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.366367:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b147b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011767424:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.366374:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde600 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.366382:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088417800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2262:3687:x1805522011766528:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2079us (2169us total) trans 4296020323 rc 0/0 00000100:00100000:3.0:1721880422.366386:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632347 00010000:00010000:1.0:1721880422.366387:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727c61e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.366388:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880125987100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011769344:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.366392:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727c61e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.366396:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727c61e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.366400:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727c61e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.366403:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727c61e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.366406:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.366407:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4fc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.366408:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727c61e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.366412:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727c61e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.366418:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727c61e lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.366420:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011769344 00010000:00010000:1.0:1721880422.366421:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727c61e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.366422:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011769344 00000004:00080000:2.0:1721880422.366428:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800995f6300/2, rc 0, transno 1053028 00000100:00100000:3.0:1721880422.366431:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632358 00000100:00100000:3.0:1721880422.366433:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2262:3686:x1805522011769344:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.366442:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64639 count 1 00000100:00100000:2.0:1721880422.366444:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800995f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011767808:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.366448:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c641 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.366455:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007bb57180/0x8a60d30f571d6f30 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122eee expref: 993 pid: 16056 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.366458:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1721880422.366459:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.366459:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.366461:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c641 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.366464:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011769472:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.366472:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007bb57180/0x8a60d30f571d6f30 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122eee expref: 993 pid: 16056 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.366477:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007bb57180/0x8a60d30f571d6f30 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122eee expref: 993 pid: 16056 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.366483:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d27bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011769600:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.366486:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1721880422.366497:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007ca5fb80/2, rc 0, transno 1053027 00000100:00100000:3.0:1721880422.366501:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.366510:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007ca5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011766528:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.366510:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011769472 00000100:00100000:3.0:1721880422.366512:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011769472 00000100:00100000:3.0:1721880422.366523:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632359 00010000:00010000:2.0:1721880422.366524:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800965d73c0/0x8a60d30f571d5e43 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122a8e expref: 993 pid: 16129 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.366525:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2264:3686:x1805522011769472:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.366528:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00002000:00080000:3.0:1721880422.366532:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64640 count 1 00000100:00100000:1.0:1721880422.366534:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011769728:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.366535:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d278700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011767680:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.366537:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c648 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc80:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.366544:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ffea400/0x8a60d30f571d71d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc80:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122fc0 expref: 992 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.366547:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.366548:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.366549:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.366550:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c648 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc80:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.366552:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c609 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.366559:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ffea400/0x8a60d30f571d71d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc80:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122fc0 expref: 992 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.366560:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011769728 00010000:00010000:2.0:1721880422.366560:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c609 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.366563:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011769728 00000100:00100000:1.0:1721880422.366566:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2265:3689:x1805522011767552:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1737us (1900us total) trans 4296020325 rc 0/0 00010000:00010000:2.0:1721880422.366567:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c609 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.366567:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ffea400/0x8a60d30f571d71d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc80:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122fc0 expref: 992 pid: 15466 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.366570:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632353 00000100:00100000:3.0:1721880422.366572:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d279f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011769856:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.366574:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c609 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.366581:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c609 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.366585:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec600 going to sleep for 11 seconds 00000004:00080000:1.0:1721880422.366586:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122c7fb80/2, rc 0, transno 1053029 00010000:00010000:2.0:1721880422.366588:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c609 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.366590:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011767552:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.366594:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa9f80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.366597:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c609 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.366604:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c609 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.366605:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011769984:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.366614:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c609 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.366616:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.366621:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727c609 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.366627:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011769984 00000100:00100000:3.0:1721880422.366629:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011769984 00000100:00100000:3.0:1721880422.366639:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632360 00000100:00100000:3.0:1721880422.366642:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ea4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2265:3689:x1805522011769984:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.366649:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64642 count 1 00000100:00100000:0.0:1721880422.366655:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632361 00010000:00010000:3.0:1721880422.366656:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727c64f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.366659:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2265:3689:x1805522011769728:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.366662:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b705200/0x8a60d30f571d7748 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12311e expref: 992 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.366666:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.366667:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.366668:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727c64f lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1721880422.366669:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64641 count 1 00010000:00010000:0.0:1721880422.366677:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727c656 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.366677:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b705200/0x8a60d30f571d7748 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12311e expref: 992 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.366682:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b705200/0x8a60d30f571d7748 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12311e expref: 992 pid: 16098 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.366685:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a2c0d80/0x8a60d30f571d74af lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12305a expref: 992 pid: 15465 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.366690:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1721880422.366690:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d278380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011770112:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.366691:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.366692:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727c656 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.366704:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a2c0d80/0x8a60d30f571d74af lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12305a expref: 992 pid: 15465 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.366710:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a2c0d80/0x8a60d30f571d74af lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12305a expref: 992 pid: 15465 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.366712:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec000 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.366716:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088dd6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011770240:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.366756:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e300 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.366774:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880096f14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2266:3686:x1805522011767296:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2091us (2149us total) trans 4296020326 rc 0/0 00000004:00080000:3.0:1721880422.366777:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007ca5d500/2, rc 0, transno 1053030 00000100:00100000:2.0:1721880422.366781:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632350 00000100:00100000:3.0:1721880422.366787:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007ca5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011767296:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.366979:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880125987800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011768960:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.366990:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c62c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc7d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.367009:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1721880422.367026:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011770368:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.367030:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.367033:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800952a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011769216:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.367043:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.367043:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257745664 00010000:00010000:3.0:1721880422.367044:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c63a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc7e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.367046:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257745664 00010000:00010000:2.0:1721880422.367058:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0565680/0x8a60d30f571d6837 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc7c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122d04 expref: 993 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.367060:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011770368 00000100:00100000:1.0:1721880422.367062:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011770368 00000100:00100000:0.0:1721880422.367073:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088dd7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011769088:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.367075:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632362 00000100:00100000:2.0:1721880422.367077:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914548 00000100:00100000:1.0:1721880422.367078:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ea6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2266:3687:x1805522011770368:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.367082:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801360cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+993:2005:x1805522257745664:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.367084:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727c633 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc7c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.367086:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64643 count 1 00010000:00010000:2.0:1721880422.367090:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.367093:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c65d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc83:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.367094:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0565680/0x8a60d30f571d6837 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc7c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122d04 expref: 993 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.367101:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096f95f80/0x8a60d30f571d797f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1231e9 expref: 993 pid: 16127 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.367102:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0565680/0x8a60d30f571d6837 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc7c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122d04 expref: 993 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.367108:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.367109:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.367111:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c65d lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.367115:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0565680/0x8a60d30f571d6837 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc7c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122d04 expref: 993 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.367121:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096f95f80/0x8a60d30f571d797f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1231e9 expref: 993 pid: 16127 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.367126:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096f95f80/0x8a60d30f571d797f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1231e9 expref: 992 pid: 16127 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.367127:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.367129:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.367131:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727c633 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc7c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.367132:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880131ea6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011770496:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.367138:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727c633 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc7c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.367149:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb000 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.367159:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.367172:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727c633 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.367178:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801360cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+992:2005:x1805522257745664:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 94us (148us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.367179:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727c633 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.367184:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914548 00010000:00010000:1.0:1721880422.367186:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727c633 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.367188:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d27bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011769600:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.367192:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.367192:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727c633 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.367198:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727c633 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.367202:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257745792 00010000:00010000:1.0:1721880422.367204:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325df80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.367204:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c641 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.367205:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257745792 00010000:00010000:1.0:1721880422.367207:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727c633 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.367213:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727c633 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.367214:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880084d25f80/0x8a60d30f571d6d46 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc7e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122e4d expref: 992 pid: 16127 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.367223:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727c633 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.367229:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727c633 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.367232:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914549 00000100:00100000:2.0:1721880422.367237:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+992:2005:x1805522257745792:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.367244:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.367248:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880084d25f80/0x8a60d30f571d6d46 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc7e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122e4d expref: 992 pid: 16127 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.367255:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d279f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011769856:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.367257:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880084d25f80/0x8a60d30f571d6d46 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc7e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122e4d expref: 992 pid: 16127 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.367268:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c648 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc80:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.367269:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880084d25f80/0x8a60d30f571d6d46 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc7e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122e4d expref: 992 pid: 16127 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.367278:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.367279:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.367282:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c63a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc7e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.367292:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c63a lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc7e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.367306:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.367310:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c63a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.367314:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c63a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.367319:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c63a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.367323:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c63a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.367326:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+991:2005:x1805522257745792:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 89us (134us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.367328:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c63a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.367329:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2267:3687:x1805522011768576:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1060us (1191us total) trans 4296020327 rc 0/0 00000100:00100000:2.0:1721880422.367330:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914549 00010000:00010000:3.0:1721880422.367331:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353180 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.367332:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c63a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.367333:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632356 00010000:00010000:3.0:1721880422.367336:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c63a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.367342:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c63a lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.367346:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c63a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.367383:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009f12d180/2, rc 0, transno 1053031 00000100:00100000:2.0:1721880422.367387:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.367392:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009f12d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011768576:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.367397:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257745536 00000100:00100000:2.0:1721880422.367400:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257745536 00010000:00010000:2.0:1721880422.367411:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096f8eac0/0x8a60d30f571d6a60 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc7d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122d97 expref: 991 pid: 16115 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.367421:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.367426:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880125984e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2267:3689:x1805522011768832:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1122us (1201us total) trans 4296020328 rc 0/0 00000100:00100000:3.0:1721880422.367432:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632357 00000100:00100000:2.0:1721880422.367436:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257745920 00000100:00100000:2.0:1721880422.367439:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257745920 00000100:00100000:3.0:1721880422.367447:0:16188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914550 00010000:00010000:2.0:1721880422.367448:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007bb57180/0x8a60d30f571d6f30 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122eee expref: 992 pid: 16056 timeout: 887 lvb_type: 0 00000004:00080000:1.0:1721880422.367449:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800995f7800/2, rc 0, transno 1053032 00000100:00100000:3.0:1721880422.367450:0:16188:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801360cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+992:2004:x1805522257745536:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.367455:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.367455:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800995f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011768832:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.367456:0:16188:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.367460:0:16188:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096f8eac0/0x8a60d30f571d6a60 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc7d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122d97 expref: 992 pid: 16115 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.367465:0:16188:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096f8eac0/0x8a60d30f571d6a60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc7d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122d97 expref: 992 pid: 16115 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.367469:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257746048 00000100:00100000:2.0:1721880422.367471:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257746048 00010000:00010000:3.0:1721880422.367473:0:16188:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096f8eac0/0x8a60d30f571d6a60 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc7d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122d97 expref: 992 pid: 16115 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.367475:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1721880422.367480:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1721880422.367481:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880091134a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011770752:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.367481:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.367482:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ffea400/0x8a60d30f571d71d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc80:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122fc0 expref: 992 pid: 15466 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.367483:0:16188:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c62c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc7d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.367487:0:16188:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c62c lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc7d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.367498:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.367504:0:16188:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.367508:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257746176 00000100:00100000:2.0:1721880422.367511:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257746176 00000100:00100000:1.0:1721880422.367517:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914551 00000100:00100000:3.0:1721880422.367517:0:16188:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801360cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+993:2004:x1805522257745536:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 66us (131us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.367520:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b705200/0x8a60d30f571d7748 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12311e expref: 993 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.367521:0:16188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914550 00000100:00100000:1.0:1721880422.367523:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+993:2005:x1805522257745920:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.367530:0:16188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914552 00000100:00100000:0.0:1721880422.367531:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.367531:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.367533:0:16188:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a70edc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+992:2004:x1805522257746048:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.367537:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007bb57180/0x8a60d30f571d6f30 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122eee expref: 992 pid: 16056 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.367537:0:16188:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.367540:0:16188:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ffea400/0x8a60d30f571d71d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc80:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122fc0 expref: 992 pid: 15466 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.367542:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257746304 00000100:00100000:2.0:1721880422.367544:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257746304 00010000:00010000:1.0:1721880422.367547:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007bb57180/0x8a60d30f571d6f30 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122eee expref: 993 pid: 16056 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.367549:0:16188:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ffea400/0x8a60d30f571d71d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc80:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122fc0 expref: 993 pid: 15466 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.367553:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a2c0d80/0x8a60d30f571d74af lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12305a expref: 993 pid: 15465 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.367555:0:16188:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ffea400/0x8a60d30f571d71d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc80:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122fc0 expref: 993 pid: 15466 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.367559:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007bb57180/0x8a60d30f571d6f30 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b122eee expref: 993 pid: 16056 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.367561:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.367562:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.367564:0:16188:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c648 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc80:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.367568:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.367568:0:16188:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c648 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc80:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.367570:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.367570:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914553 00010000:00010000:1.0:1721880422.367573:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c641 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.367574:0:16188:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.367575:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+991:2005:x1805522257746176:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.367579:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c641 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.367582:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.367583:0:16188:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a70edc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+991:2004:x1805522257746048:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 49us (128us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.367586:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b705200/0x8a60d30f571d7748 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12311e expref: 991 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.367586:0:16188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914552 00000100:00100000:3.0:1721880422.367593:0:16188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914554 00010000:00010000:1.0:1721880422.367594:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.367595:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b705200/0x8a60d30f571d7748 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12311e expref: 990 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.367596:0:16188:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d0c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+990:2006:x1805522257746304:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.367600:0:16188:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.367603:0:16188:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a2c0d80/0x8a60d30f571d74af lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12305a expref: 990 pid: 15465 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.367606:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.367607:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.367608:0:16188:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a2c0d80/0x8a60d30f571d74af lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12305a expref: 990 pid: 15465 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.367610:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+990:2005:x1805522257745920:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 86us (189us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.367610:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727c64f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.367615:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.367615:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1721880422.367616:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914551 00010000:00010000:2.0:1721880422.367617:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727c64f lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.367617:0:16188:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727c656 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.367619:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880125987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011770624:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.367621:0:16188:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727c656 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.367626:0:16188:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.367627:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.367634:0:16188:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+989:2006:x1805522257746304:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 38us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.367637:0:16188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914554 00000100:00100000:2.0:1721880422.367642:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+988:2005:x1805522257746176:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 66us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.367646:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914553 00000100:00100000:0.0:1721880422.367651:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.367652:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c648 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.367656:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c648 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.367660:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c648 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.367662:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c62c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.367664:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c648 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.367667:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c648 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.367669:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c62c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.367674:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011770624 00010000:00010000:3.0:1721880422.367674:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aaa400 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.367675:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c62c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.367676:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c648 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.367677:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011770624 00010000:00010000:3.0:1721880422.367679:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c648 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.367684:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c648 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.367685:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c62c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.367687:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727c648 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.367691:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c62c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.367697:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b7cc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.367699:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c62c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.367705:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c62c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.367713:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c62c lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.367719:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c62c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.367768:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632363 00000100:00100000:0.0:1721880422.367772:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c84b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2268:3687:x1805522011770624:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.367777:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2268:3686:x1805522011769472:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1250us (1291us total) trans 4296020329 rc 0/0 00000100:00100000:3.0:1721880422.367781:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632359 00002000:00080000:0.0:1721880422.367785:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64644 count 1 00010000:00010000:0.0:1721880422.367795:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727c664 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc84:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.367801:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b705200/0x8a60d30f571d7748 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12311e expref: 987 pid: 16098 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.367804:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095d89200/0x8a60d30f571d7c11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123252 expref: 987 pid: 16078 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.367809:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1721880422.367809:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d278380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011770112:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.367810:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.367811:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727c664 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.367821:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727c64f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.367824:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095d89200/0x8a60d30f571d7c11 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123252 expref: 986 pid: 16078 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.367825:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727c64f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.367831:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095d89200/0x8a60d30f571d7c11 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123252 expref: 986 pid: 16078 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.367831:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727c64f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.367836:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727c64f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.367838:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880087799c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011770880:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.367839:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727c64f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.367843:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f12f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2268:3689:x1805522011768704:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1644us (1743us total) trans 4296020330 rc 0/0 00010000:00010000:3.0:1721880422.367843:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727c64f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.367846:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8900 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.367847:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727c64f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.367849:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632355 00010000:00010000:3.0:1721880422.367851:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727c64f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.367854:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3eb40 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.367857:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727c64f lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.367863:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727c64f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.367872:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a2c0d80/0x8a60d30f571d74af lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12305a expref: 986 pid: 15465 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.367874:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.367880:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088dd6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011770240:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.367890:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727c656 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.367894:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009f12c380/2, rc 0, transno 1053034 00010000:00010000:0.0:1721880422.367895:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727c656 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.367898:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727c656 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.367899:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009f12c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011768704:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.367903:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727c656 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.367906:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727c656 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.367910:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727c656 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.367917:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325e1c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.367920:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727c656 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.367921:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880091137100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011771008:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.367927:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727c656 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.367933:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.367936:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727c656 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.367943:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727c656 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.367946:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011770752 00000100:00100000:1.0:1721880422.367948:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011770752 00000100:00100000:3.0:1721880422.367950:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ea4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2268:3689:x1805522011769984:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1306us (1332us total) trans 4296020331 rc 0/0 00000100:00100000:3.0:1721880422.367956:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632360 00000100:00100000:1.0:1721880422.367957:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011771008 00000100:00100000:1.0:1721880422.367959:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011771008 00000100:00100000:1.0:1721880422.367966:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632364 00000100:00100000:1.0:1721880422.367969:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2269:3689:x1805522011770752:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.367970:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632365 00000100:00100000:3.0:1721880422.367973:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2269:3689:x1805522011771008:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.367977:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64645 count 1 00002000:00080000:3.0:1721880422.367983:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64646 count 1 00010000:00010000:1.0:1721880422.367984:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727c66b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc85:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.367991:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c9c3a80/0x8a60d30f571d7d76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1232d7 expref: 985 pid: 11675 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.367992:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727c672 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc86:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.367995:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.367996:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.367997:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727c66b lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.368002:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c3cd440/0x8a60d30f571d7ddf lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123324 expref: 985 pid: 9459 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.368007:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c9c3a80/0x8a60d30f571d7d76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1232d7 expref: 985 pid: 11675 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.368007:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.368008:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.368024:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727c672 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.368026:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c9c3a80/0x8a60d30f571d7d76 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1232d7 expref: 985 pid: 11675 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.368032:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880091135880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011771136:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.368040:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c3cd440/0x8a60d30f571d7ddf lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123324 expref: 985 pid: 9459 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.368049:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb180 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.368049:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c3cd440/0x8a60d30f571d7ddf lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123324 expref: 985 pid: 9459 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.368058:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2270:3689:x1805522011769728:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1397us (1508us total) trans 4296020332 rc 0/0 00000100:00100000:3.0:1721880422.368058:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d278380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011771264:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.368063:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632361 00000004:00080000:1.0:1721880422.368064:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012fc35880/2, rc 0, transno 1053035 00000100:00100000:1.0:1721880422.368069:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012fc35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011769984:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.368075:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec000 going to sleep for 11 seconds 00000004:00080000:1.0:1721880422.368087:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012fc37800/2, rc 0, transno 1053036 00000100:00100000:1.0:1721880422.368091:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012fc37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011769728:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.368092:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880091134e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011771392:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.368109:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.368120:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011771392 00000100:00100000:1.0:1721880422.368121:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011771392 00000004:00080000:3.0:1721880422.368129:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012fc35180/2, rc 0, transno 1053033 00000100:00100000:1.0:1721880422.368132:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632366 00000100:00100000:1.0:1721880422.368134:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2270:3686:x1805522011771392:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.368144:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012fc35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011769472:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.368152:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1721880422.368157:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1721880422.368157:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880091137800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011771520:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.368161:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880091136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011771648:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.368176:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:1.0:1721880422.368182:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64647 count 1 00000100:00100000:2.0:1721880422.368188:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.368189:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c679 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc87:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.368196:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880070084000/0x8a60d30f571d7f59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123363 expref: 985 pid: 11675 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.368196:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.368199:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.368199:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257746432 00010000:00010000:1.0:1721880422.368200:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.368202:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c679 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.368202:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257746432 00000100:00100000:3.0:1721880422.368210:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011771520 00010000:00010000:1.0:1721880422.368211:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880070084000/0x8a60d30f571d7f59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123363 expref: 986 pid: 11675 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.368211:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096f95f80/0x8a60d30f571d797f lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1231e9 expref: 986 pid: 16127 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.368213:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011771520 00010000:00010000:1.0:1721880422.368216:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880070084000/0x8a60d30f571d7f59 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123363 expref: 986 pid: 11675 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.368222:0:7117:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914555 00000100:00100000:1.0:1721880422.368224:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880091136680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011771776:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.368226:0:7117:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801360cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30425778-2709-4512-9d75-01ec53c4cfad+986:2004:x1805522257746432:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.368226:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011771648 00000100:00100000:3.0:1721880422.368228:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011771648 00010000:00010000:2.0:1721880422.368231:0:7117:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.368233:0:7117:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096f95f80/0x8a60d30f571d797f lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc83:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1231e9 expref: 986 pid: 16127 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.368236:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632367 00000100:00100000:1.0:1721880422.368239:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302ebcc0 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.368239:0:7117:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096f95f80/0x8a60d30f571d797f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc83:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1231e9 expref: 986 pid: 16127 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.368240:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d27bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2272:3686:x1805522011771520:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.368241:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632368 00000100:00100000:3.0:1721880422.368244:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d27ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2272:3689:x1805522011771648:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.368247:0:7117:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.368248:0:7117:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00002000:00080000:0.0:1721880422.368250:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64648 count 1 00010000:00010000:2.0:1721880422.368250:0:7117:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c65d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc83:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.368253:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096f95f80/0x8a60d30f571d797f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc83:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1231e9 expref: 986 pid: 16127 timeout: 887 lvb_type: 0 00002000:00080000:3.0:1721880422.368254:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64649 count 1 00010000:00010000:2.0:1721880422.368256:0:7117:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c65d lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc83:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.368258:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727c680 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc88:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.368261:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880131ea6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011770496:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.368262:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727c687 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc89:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.368266:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c4cba80/0x8a60d30f571d8151 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1233e1 expref: 985 pid: 16062 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.368267:0:7117:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.368270:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918cba80/0x8a60d30f571d8311 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12344a expref: 985 pid: 16129 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.368271:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.368271:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c65d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.368272:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.368273:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727c680 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.368275:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c65d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.368275:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.368276:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.368278:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727c687 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.368279:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c65d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.368283:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c65d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.368286:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c4cba80/0x8a60d30f571d8151 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1233e1 expref: 985 pid: 16062 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.368286:0:7117:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801360cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30425778-2709-4512-9d75-01ec53c4cfad+985:2004:x1805522257746432:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 58us (97us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.368287:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c65d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.368291:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c65d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.368292:0:7117:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914555 00010000:00010000:3.0:1721880422.368293:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800918cba80/0x8a60d30f571d8311 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12344a expref: 985 pid: 16129 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.368294:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b46c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.368295:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c4cba80/0x8a60d30f571d8151 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1233e1 expref: 985 pid: 16062 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.368296:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c65d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.368300:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c65d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.368300:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800918cba80/0x8a60d30f571d8311 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12344a expref: 984 pid: 16129 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.368306:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008779b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011771904:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.368306:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c65d lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.368309:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c65d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.368313:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d27b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011772032:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.368326:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e300 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.368331:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec6c0 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.368341:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c641 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.368347:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c641 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.368353:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c641 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.368358:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c641 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.368364:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c641 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.368369:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aab600 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.368372:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c641 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.368377:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c641 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.368385:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c641 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.368390:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ea6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2273:3687:x1805522011770368:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1310us (1345us total) trans 4296020333 rc 0/0 00010000:00010000:3.0:1721880422.368390:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727c641 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.368394:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632362 00000004:00080000:0.0:1721880422.368458:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088dd5500/2, rc 0, transno 1053037 00000100:00100000:0.0:1721880422.368464:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011770368:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.368484:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2273:3686:x1805522011769344:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2048us (2076us total) trans 4296020334 rc 0/0 00000100:00100000:0.0:1721880422.368489:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1721880422.368489:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632358 00000100:00100000:0.0:1721880422.368497:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880091134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011772160:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1721880422.368518:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880125987100/2, rc 0, transno 1053038 00000100:00100000:0.0:1721880422.368522:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.368528:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880125987100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011769344:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.368538:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011772160 00000100:00100000:3.0:1721880422.368541:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011772160 00000100:00100000:0.0:1721880422.368553:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1721880422.368555:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632369 00000100:00100000:3.0:1721880422.368558:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087799880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2273:3688:x1805522011772160:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.368560:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880091135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011772288:0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.368567:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64650 count 1 00010000:00010000:3.0:1721880422.368575:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727c68e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.368584:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880072b14000/0x8a60d30f571d84ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1234ba expref: 984 pid: 16091 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.368586:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.368589:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.368590:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.368591:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727c68e lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.368597:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011772288 00000100:00100000:1.0:1721880422.368599:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011772288 00010000:00010000:3.0:1721880422.368607:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880072b14000/0x8a60d30f571d84ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1234ba expref: 984 pid: 16091 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.368609:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632370 00000100:00100000:1.0:1721880422.368611:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088aab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2274:3687:x1805522011772288:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.368615:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880072b14000/0x8a60d30f571d84ca lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1234ba expref: 984 pid: 16091 timeout: 887 lvb_type: 0 00002000:00080000:1.0:1721880422.368619:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64651 count 1 00000100:00100000:3.0:1721880422.368624:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d278e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011772416:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.368625:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727c695 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc8b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.368632:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800960edd40/0x8a60d30f571d878d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123585 expref: 984 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.368636:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.368637:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.368638:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727c695 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.368646:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec900 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.368647:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800960edd40/0x8a60d30f571d878d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123585 expref: 984 pid: 16113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.368653:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800960edd40/0x8a60d30f571d878d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123585 expref: 984 pid: 16113 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.368658:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880091135180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011772544:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.368672:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb000 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.368928:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.368936:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880087799c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011770880:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.368949:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.368951:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727c664 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.368953:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880091135880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011771136:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.368961:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.368961:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d278380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011771264:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.368966:0:7117:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257746688 00010000:00010000:1.0:1721880422.368968:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727c66b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.368968:0:7117:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257746688 00000100:00100000:0.0:1721880422.368972:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257746560 00000100:00100000:0.0:1721880422.368974:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257746560 00010000:00010000:3.0:1721880422.368977:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727c672 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.368981:0:7117:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c9c3a80/0x8a60d30f571d7d76 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1232d7 expref: 986 pid: 11675 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.368984:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095d89200/0x8a60d30f571d7c11 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123252 expref: 986 pid: 16078 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.368988:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880091136680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011771776:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.368996:0:7117:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257746816 00000100:00100000:2.0:1721880422.368998:0:7117:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257746816 00010000:00010000:1.0:1721880422.369001:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c679 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.369008:0:7117:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c3cd440/0x8a60d30f571d7ddf lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123324 expref: 987 pid: 9459 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.369009:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914556 00000100:00100000:3.0:1721880422.369025:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+987:2004:x1805522257746688:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.369032:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.369035:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914557 00010000:00010000:3.0:1721880422.369035:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c9c3a80/0x8a60d30f571d7d76 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc85:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1232d7 expref: 987 pid: 11675 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.369041:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+987:2004:x1805522257746560:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.369041:0:7117:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914558 00010000:00010000:3.0:1721880422.369041:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c9c3a80/0x8a60d30f571d7d76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc85:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1232d7 expref: 987 pid: 11675 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.369046:0:7117:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30425778-2709-4512-9d75-01ec53c4cfad+987:2004:x1805522257746816:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.369049:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.369050:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c9c3a80/0x8a60d30f571d7d76 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc85:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1232d7 expref: 987 pid: 11675 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.369052:0:7117:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.369053:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095d89200/0x8a60d30f571d7c11 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc84:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123252 expref: 987 pid: 16078 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.369055:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.369056:0:7117:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c3cd440/0x8a60d30f571d7ddf lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123324 expref: 986 pid: 9459 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.369056:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.369058:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727c66b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.369062:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727c66b lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.369065:0:7117:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c3cd440/0x8a60d30f571d7ddf lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123324 expref: 986 pid: 9459 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.369067:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095d89200/0x8a60d30f571d7c11 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc84:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123252 expref: 986 pid: 16078 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.369072:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.369077:0:7117:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c3cd440/0x8a60d30f571d7ddf lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123324 expref: 986 pid: 9459 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.369079:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095d89200/0x8a60d30f571d7c11 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc84:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123252 expref: 986 pid: 16078 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.369088:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+985:2004:x1805522257746688:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 63us (160us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.369091:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.369092:0:7117:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.369092:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914556 00010000:00010000:1.0:1721880422.369093:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.369094:0:7117:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.369095:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727c664 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.369097:0:7117:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727c672 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.369102:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727c664 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.369104:0:7117:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727c672 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.369104:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727c66b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.369109:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727c66b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.369112:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.369113:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727c66b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.369117:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727c66b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.369120:0:7117:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.369120:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727c66b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.369124:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.369124:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4900 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.369125:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727c66b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.369129:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727c66b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.369130:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+983:2004:x1805522257746560:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 89us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.369136:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914557 00000100:00100000:2.0:1721880422.369139:0:7117:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30425778-2709-4512-9d75-01ec53c4cfad+983:2004:x1805522257746816:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 92us (176us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.369139:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727c66b lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.369143:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727c66b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.369146:0:7117:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914558 00000100:00100000:1.0:1721880422.369151:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257746944 00000100:00100000:1.0:1721880422.369153:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257746944 00010000:00010000:3.0:1721880422.369159:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727c672 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.369162:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880070084000/0x8a60d30f571d7f59 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123363 expref: 982 pid: 11675 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.369163:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727c672 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.369164:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727c664 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.369167:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727c672 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.369170:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727c672 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.369171:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727c664 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.369174:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727c672 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.369175:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914559 00010000:00010000:3.0:1721880422.369177:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aab3c0 already unused, calling callback (ffffffffa084e330) 00000100:00100000:1.0:1721880422.369178:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e197450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+982:2004:x1805522257746944:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.369178:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727c664 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.369178:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727c672 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.369181:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727c672 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.369182:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.369184:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727c664 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.369185:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880070084000/0x8a60d30f571d7f59 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123363 expref: 982 pid: 11675 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.369186:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727c672 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.369189:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.369190:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727c672 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.369191:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880070084000/0x8a60d30f571d7f59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123363 expref: 982 pid: 11675 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.369191:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727c664 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.369197:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880070084000/0x8a60d30f571d7f59 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123363 expref: 982 pid: 11675 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.369200:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325c000 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.369203:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.369203:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727c664 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.369204:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.369205:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c679 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.369209:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727c664 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.369210:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c679 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.369216:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.369218:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727c664 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.369224:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727c664 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.369227:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e197450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+981:2004:x1805522257746944:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 49us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.369231:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914559 00000100:00100000:2.0:1721880422.369244:0:7117:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257747072 00000100:00100000:2.0:1721880422.369246:0:7117:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257747072 00010000:00010000:2.0:1721880422.369254:0:7117:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c4cba80/0x8a60d30f571d8151 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1233e1 expref: 981 pid: 16062 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.369262:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914560 00000100:00100000:1.0:1721880422.369265:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cc73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+981:2004:x1805522257747072:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.369265:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880091135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2275:3689:x1805522011771008:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1291us (1330us total) trans 4296020335 rc 0/0 00010000:00010000:1.0:1721880422.369269:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.369269:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632365 00010000:00010000:1.0:1721880422.369272:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c4cba80/0x8a60d30f571d8151 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1233e1 expref: 981 pid: 16062 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.369281:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c4cba80/0x8a60d30f571d8151 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1233e1 expref: 981 pid: 16062 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.369287:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.369288:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.369289:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727c680 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.369290:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d27b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011772032:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.369293:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727c680 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.369294:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.369298:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.369300:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727c687 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.369307:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cc73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+981:2004:x1805522257747072:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 42us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.369311:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914560 00000004:00080000:3.0:1721880422.369312:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880091137100/2, rc 0, transno 1053039 00000100:00100000:3.0:1721880422.369317:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880091137100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011771008:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.369318:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257747200 00000100:00100000:1.0:1721880422.369320:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257747200 00010000:00010000:1.0:1721880422.369325:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800918cba80/0x8a60d30f571d8311 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12344a expref: 981 pid: 16129 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.369342:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914561 00000100:00100000:1.0:1721880422.369346:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cc72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+981:2004:x1805522257747200:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.369349:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.369351:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800918cba80/0x8a60d30f571d8311 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12344a expref: 981 pid: 16129 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.369359:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800918cba80/0x8a60d30f571d8311 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12344a expref: 981 pid: 16129 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.369364:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c84b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2276:3687:x1805522011770624:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1590us (1712us total) trans 4296020336 rc 0/0 00010000:00010000:1.0:1721880422.369366:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800918cba80/0x8a60d30f571d8311 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12344a expref: 981 pid: 16129 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.369369:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632363 00010000:00010000:1.0:1721880422.369372:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.369373:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.369374:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727c687 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.369378:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727c687 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.369385:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.369386:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880091134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2275:3689:x1805522011770752:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1416us (1512us total) trans 4296020337 rc 0/0 00000100:00100000:3.0:1721880422.369390:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632364 00000100:00100000:1.0:1721880422.369399:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cc72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+980:2004:x1805522257747200:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 52us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.369402:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914561 00010000:00010000:3.0:1721880422.369403:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727c687 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.369407:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727c687 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.369412:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727c687 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.369416:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727c687 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.369420:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727c687 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.369423:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8d80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.369425:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727c687 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.369429:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c679 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.369429:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727c687 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.369433:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c679 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.369434:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727c687 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.369437:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c679 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.369438:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727c687 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.369444:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.369444:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c679 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.369448:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c679 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.369452:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b6d00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.369455:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c679 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.369459:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c679 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.369459:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880091136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011772672:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.369464:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c679 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.369468:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c679 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.369472:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1721880422.369485:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880125987800/2, rc 0, transno 1053040 00000100:00100000:1.0:1721880422.369487:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257747328 00000100:00100000:1.0:1721880422.369489:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257747328 00000100:00100000:2.0:1721880422.369491:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880125987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011770624:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.369494:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.369496:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880072b14000/0x8a60d30f571d84ca lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1234ba expref: 980 pid: 16091 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.369500:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d27ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2275:3689:x1805522011771648:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1255us (1303us total) trans 4296020338 rc 0/0 00000100:00100000:3.0:1721880422.369504:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632368 00000100:00100000:1.0:1721880422.369507:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257747456 00000100:00100000:1.0:1721880422.369508:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257747456 00000100:00100000:3.0:1721880422.369511:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011772672 00000100:00100000:2.0:1721880422.369512:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914562 00000100:00100000:3.0:1721880422.369513:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011772672 00010000:00010000:1.0:1721880422.369514:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800960edd40/0x8a60d30f571d878d lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123585 expref: 981 pid: 16113 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.369516:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cc70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+981:2004:x1805522257747328:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.369522:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c4cba80/0x8a60d30f571d8151 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1233e1 expref: 981 pid: 16062 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.369522:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632371 00000100:00100000:3.0:1721880422.369525:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801360cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2275:3687:x1805522011772672:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.369530:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914563 00000100:00100000:0.0:1721880422.369532:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008779b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011771904:192.168.201.24@tcp:104: 00002000:00080000:3.0:1721880422.369532:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64652 count 1 00000100:00100000:1.0:1721880422.369534:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123b91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+980:2004:x1805522257747456:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.369535:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.369538:0:15473:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.369539:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880072b14000/0x8a60d30f571d84ca lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1234ba expref: 980 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.369539:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727c69c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.369541:0:15473:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800960edd40/0x8a60d30f571d878d lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123585 expref: 980 pid: 16113 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.369545:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0fec480/0x8a60d30f571d89bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12362d expref: 980 pid: 16121 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.369546:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880072b14000/0x8a60d30f571d84ca lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1234ba expref: 980 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.369547:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727c680 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.369547:0:15473:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800960edd40/0x8a60d30f571d878d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123585 expref: 980 pid: 16113 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.369549:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.369550:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.369552:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727c69c lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.369553:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.369554:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.369555:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727c680 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.369555:0:15473:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727c695 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.369555:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.369556:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.369557:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727c68e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.369559:0:15473:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727c695 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.369561:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0fec480/0x8a60d30f571d89bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12362d expref: 980 pid: 16121 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.369562:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727c68e lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.369567:0:15473:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.369567:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0fec480/0x8a60d30f571d89bd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12362d expref: 980 pid: 16121 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.369569:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.369572:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d27b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011772800:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.369582:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cc70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+980:2004:x1805522257747328:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 66us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.369586:0:15473:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880123b91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+980:2004:x1805522257747456:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 50us (92us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.369586:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914562 00000100:00100000:3.0:1721880422.369587:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.369592:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914563 00000004:00080000:3.0:1721880422.369605:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880091136d80/2, rc 0, transno 1053042 00000100:00100000:3.0:1721880422.369609:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880091136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011771648:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1721880422.369616:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880091134a80/2, rc 0, transno 1053041 00000100:00100000:3.0:1721880422.369619:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880091134a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011770752:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.369623:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727c680 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.369624:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1721880422.369629:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880091135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011772928:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.369631:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727c680 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.369637:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727c680 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.369644:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727c680 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.369649:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.369651:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325db00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.369654:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727c680 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.369660:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727c680 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.369662:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d0c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011773056:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.369664:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1721880422.369669:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727c680 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.369670:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d0c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011773184:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.369674:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.369675:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727c680 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.369687:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.369694:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011772928 00000100:00100000:3.0:1721880422.369697:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011772928 00000100:00100000:2.0:1721880422.369703:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011773056 00000100:00100000:2.0:1721880422.369706:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011773056 00000100:00100000:3.0:1721880422.369710:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011773184 00000100:00100000:3.0:1721880422.369713:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011773184 00000100:00100000:2.0:1721880422.369720:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632372 00000100:00100000:1.0:1721880422.369721:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2279:3686:x1805522011771392:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1585us (1611us total) trans 4296020339 rc 0/0 00000100:00100000:2.0:1721880422.369724:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d278380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2280:3689:x1805522011772928:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.369725:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632366 00000100:00100000:3.0:1721880422.369749:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632373 00000100:00100000:1.0:1721880422.369752:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632374 00000100:00100000:3.0:1721880422.369753:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d27b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2279:3689:x1805522011773056:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.369755:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801360cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2279:3687:x1805522011773184:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.369771:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64653 count 1 00002000:00080000:1.0:1721880422.369772:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64655 count 1 00010000:00010000:1.0:1721880422.369780:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727c6aa lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.369780:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727c6a3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.369787:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a044a1c0/0x8a60d30f571d90d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1237ed expref: 978 pid: 16026 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.369788:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800981a2400/0x8a60d30f571d8c02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1236c7 expref: 978 pid: 16074 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.369791:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.369792:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.369793:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727c6aa lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.369793:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.369794:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.369796:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727c6a3 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.369803:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a044a1c0/0x8a60d30f571d90d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1237ed expref: 978 pid: 16026 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.369807:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800981a2400/0x8a60d30f571d8c02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1236c7 expref: 978 pid: 16074 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.369809:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a044a1c0/0x8a60d30f571d90d2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1237ed expref: 978 pid: 16026 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.369813:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800981a2400/0x8a60d30f571d8c02 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1236c7 expref: 978 pid: 16074 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.369815:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca4ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011773312:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.369819:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801360cf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011773440:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.369828:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb180 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.369835:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde3c0 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.369843:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800960edd40/0x8a60d30f571d878d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123585 expref: 978 pid: 16113 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.369851:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880091135180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011772544:192.168.201.24@tcp:104: 00000004:00080000:2.0:1721880422.369857:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880091134e00/2, rc 0, transno 1053043 00010000:00010000:1.0:1721880422.369860:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727c695 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.369869:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880091134e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011771392:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.369891:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727c695 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.369895:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727c695 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.369896:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011773568:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.369899:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727c695 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.369903:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727c695 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.369907:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727c695 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.369910:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b6f40 already unused, calling callback (ffffffffa084e330) 00000100:00100000:2.0:1721880422.369910:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.369911:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727c695 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.369915:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727c695 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.369921:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727c695 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.369924:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727c695 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.369929:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011773568 00000100:00100000:2.0:1721880422.369932:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011773568 00000100:00100000:2.0:1721880422.369941:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632375 00000100:00100000:2.0:1721880422.369944:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2280:3687:x1805522011773568:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.369948:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64654 count 1 00002000:00080000:2.0:1721880422.369952:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64656 count 1 00010000:00010000:3.0:1721880422.369956:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727c6b1 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.369959:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727c6b8 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc90:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.369963:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098b1b180/0x8a60d30f571d8eda lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123776 expref: 977 pid: 16048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.369967:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009beb2400/0x8a60d30f571d92f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123880 expref: 977 pid: 16042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.369967:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.369968:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1721880422.369969:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d27bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2281:3686:x1805522011771520:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1727us (1790us total) trans 4296020340 rc 0/0 00010000:00010000:3.0:1721880422.369969:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727c6b1 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.369971:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.369972:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.369974:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727c6b8 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.369976:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632367 00010000:00010000:3.0:1721880422.369980:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098b1b180/0x8a60d30f571d8eda lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123776 expref: 977 pid: 16048 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.369984:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009beb2400/0x8a60d30f571d92f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123880 expref: 977 pid: 16042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.369985:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098b1b180/0x8a60d30f571d8eda lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123776 expref: 977 pid: 16048 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.369989:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009beb2400/0x8a60d30f571d92f4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123880 expref: 977 pid: 16042 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.369991:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d27aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011773696:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.369996:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800887a9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011773824:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.370006:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec000 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.370007:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088aab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2280:3687:x1805522011772288:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1394us (1420us total) trans 4296020341 rc 0/0 00000100:00100000:2.0:1721880422.370025:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde000 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.370027:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632370 00000004:00080000:2.0:1721880422.370044:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880091137800/2, rc 0, transno 1053044 00010000:00010000:3.0:1721880422.370044:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880072b14000/0x8a60d30f571d84ca lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1234ba expref: 977 pid: 16091 timeout: 887 lvb_type: 0 00000004:00080000:1.0:1721880422.370051:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880091135500/2, rc 0, transno 1053045 00000100:00100000:3.0:1721880422.370051:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d278e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011772416:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.370055:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880091135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011772288:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.370055:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880091137800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011771520:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.370064:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727c68e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.370069:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727c68e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.370073:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727c68e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.370077:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727c68e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.370080:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727c68e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.370084:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727c68e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.370087:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880091135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011774080:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.370087:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aaaac0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.370089:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727c68e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.370100:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.370100:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727c68e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.370103:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011773952:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.370110:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727c68e lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.370111:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011774080 00000100:00100000:1.0:1721880422.370114:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011774080 00010000:00010000:3.0:1721880422.370116:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727c68e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.370123:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.370124:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632376 00000100:00100000:1.0:1721880422.370127:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800887a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2280:3689:x1805522011774080:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.370132:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011773952 00002000:00080000:1.0:1721880422.370135:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64658 count 1 00000100:00100000:2.0:1721880422.370135:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011773952 00010000:00010000:1.0:1721880422.370142:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727c6bf lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc92:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.370146:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632377 00010000:00010000:1.0:1721880422.370149:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c9cc000/0x8a60d30f571d9d6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123db2 expref: 976 pid: 16117 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.370149:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123b92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2281:3688:x1805522011773952:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.370153:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.370154:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.370155:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727c6bf lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.370156:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64657 count 1 00010000:00010000:2.0:1721880422.370164:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727c6c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc91:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.370165:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c9cc000/0x8a60d30f571d9d6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123db2 expref: 976 pid: 16117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.370170:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c9cc000/0x8a60d30f571d9d6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123db2 expref: 976 pid: 16117 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.370172:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009750ad00/0x8a60d30f571d96ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12392f expref: 976 pid: 16062 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.370176:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.370177:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.370178:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727c6c6 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.370180:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880131ea4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011774208:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.370188:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009750ad00/0x8a60d30f571d96ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12392f expref: 976 pid: 16062 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.370194:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009750ad00/0x8a60d30f571d96ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12392f expref: 976 pid: 16062 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.370197:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb000 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.370200:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800887aa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011774336:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.370213:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde600 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.370246:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087799880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2282:3688:x1805522011772160:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1686us (1723us total) trans 4296020342 rc 0/0 00000100:00100000:3.0:1721880422.370251:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632369 00000004:00080000:1.0:1721880422.370252:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880091134700/2, rc 0, transno 1053046 00000100:00100000:1.0:1721880422.370257:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880091134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011772160:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.370290:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1721880422.370299:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880131ea6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011774464:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.370319:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.370333:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011774464 00000100:00100000:3.0:1721880422.370336:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011774464 00000100:00100000:3.0:1721880422.370346:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632378 00000100:00100000:3.0:1721880422.370348:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123b93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2282:3687:x1805522011774464:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.370356:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64659 count 1 00010000:00010000:3.0:1721880422.370363:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727c6cd lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.370369:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f146400/0x8a60d30f571d9f49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123e1b expref: 976 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.370373:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.370374:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.370376:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727c6cd lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.370386:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f146400/0x8a60d30f571d9f49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123e1b expref: 976 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.370391:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f146400/0x8a60d30f571d9f49 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123e1b expref: 976 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.370397:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d278e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011774592:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.370414:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec900 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.370673:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007ca4ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011773312:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.370683:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727c6aa lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.370693:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d27b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011772800:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.370704:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727c69c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.370759:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801360cf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011773440:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.370772:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727c6a3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.370775:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d27aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011773696:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.370784:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727c6b1 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.370800:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.370813:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257747712 00000100:00100000:1.0:1721880422.370815:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257747712 00010000:00010000:1.0:1721880422.370823:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800981a2400/0x8a60d30f571d8c02 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1236c7 expref: 977 pid: 16074 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.370839:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914564 00000100:00100000:1.0:1721880422.370841:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123b90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+977:2007:x1805522257747712:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.370852:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.370855:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800981a2400/0x8a60d30f571d8c02 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1236c7 expref: 977 pid: 16074 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.370861:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800981a2400/0x8a60d30f571d8c02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1236c7 expref: 977 pid: 16074 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.370869:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800981a2400/0x8a60d30f571d8c02 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1236c7 expref: 977 pid: 16074 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.370877:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.370877:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.370879:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727c6a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.370883:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727c6a3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.370897:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.370913:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880123b90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+976:2007:x1805522257747712:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 71us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.370917:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914564 00010000:00010000:2.0:1721880422.370917:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727c6a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.370924:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727c6a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.370932:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727c6a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.370939:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727c6a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.370946:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727c6a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.370952:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136351200 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.370955:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727c6a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.370962:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727c6a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.370972:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727c6a3 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.370979:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727c6a3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.370985:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.370999:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257747584 00000100:00100000:1.0:1721880422.371002:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257747584 00010000:00010000:1.0:1721880422.371027:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a044a1c0/0x8a60d30f571d90d2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1237ed expref: 976 pid: 16026 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.371045:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.371053:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257747840 00000100:00100000:1.0:1721880422.371055:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257747840 00010000:00010000:1.0:1721880422.371062:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098b1b180/0x8a60d30f571d8eda lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123776 expref: 977 pid: 16048 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.371067:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914565 00000100:00100000:3.0:1721880422.371070:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+977:2005:x1805522257747584:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.371076:0:15473:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.371079:0:15473:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a044a1c0/0x8a60d30f571d90d2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1237ed expref: 977 pid: 16026 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.371080:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914566 00000100:00100000:1.0:1721880422.371083:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ab4d4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+977:2004:x1805522257747840:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.371085:0:15473:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a044a1c0/0x8a60d30f571d90d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1237ed expref: 977 pid: 16026 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.371088:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.371091:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098b1b180/0x8a60d30f571d8eda lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123776 expref: 977 pid: 16048 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.371093:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a044a1c0/0x8a60d30f571d90d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1237ed expref: 977 pid: 16026 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.371096:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098b1b180/0x8a60d30f571d8eda lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123776 expref: 977 pid: 16048 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.371099:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.371100:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.371102:0:15473:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727c6aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.371104:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098b1b180/0x8a60d30f571d8eda lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123776 expref: 976 pid: 16048 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.371106:0:15473:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727c6aa lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.371110:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.371111:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.371113:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727c6b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.371115:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d278380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2283:3689:x1805522011772928:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1388us (1464us total) trans 4296020343 rc 0/0 00010000:00010000:3.0:1721880422.371115:0:15473:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.371117:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727c6b1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.371120:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.371122:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632372 00010000:00010000:1.0:1721880422.371125:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.371131:0:15473:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+975:2005:x1805522257747584:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 60us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.371135:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914565 00000100:00100000:1.0:1721880422.371139:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ab4d4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+975:2004:x1805522257747840:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 55us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.371142:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257747968 00000100:00100000:1.0:1721880422.371142:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914566 00000100:00100000:0.0:1721880422.371146:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257747968 00010000:00010000:3.0:1721880422.371149:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727c6b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.371150:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880091135880/2, rc 0, transno 1053047 00010000:00010000:3.0:1721880422.371153:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727c6b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.371157:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727c6b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.371158:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880091135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011772928:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.371160:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0fec480/0x8a60d30f571d89bd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12362d expref: 974 pid: 16121 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.371161:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727c6b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.371168:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727c6b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.371172:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa9d40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.371174:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727c6b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.371179:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727c6b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.371182:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914567 00010000:00010000:3.0:1721880422.371184:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727c6b1 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.371188:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+974:2005:x1805522257747968:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.371188:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727c6b1 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.371194:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.371194:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801360cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011774720:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.371199:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0fec480/0x8a60d30f571d89bd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12362d expref: 974 pid: 16121 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.371212:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.371213:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0fec480/0x8a60d30f571d89bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12362d expref: 974 pid: 16121 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.371225:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0fec480/0x8a60d30f571d89bd lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12362d expref: 974 pid: 16121 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.371231:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011774720 00010000:00010000:1.0:1721880422.371234:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.371234:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011774720 00010000:00010000:1.0:1721880422.371235:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.371237:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727c69c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.371244:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727c69c lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.371249:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632379 00000100:00100000:2.0:1721880422.371253:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2284:3687:x1805522011774720:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.371259:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00080000:2.0:1721880422.371264:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64660 count 1 00010000:00010000:2.0:1721880422.371274:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727c6d4 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.371278:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d27b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2284:3689:x1805522011773056:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1524us (1603us total) trans 4296020344 rc 0/0 00000100:00100000:1.0:1721880422.371279:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+973:2005:x1805522257747968:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 91us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.371283:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632373 00000100:00100000:0.0:1721880422.371285:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.371285:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914567 00010000:00010000:2.0:1721880422.371285:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ee6a400/0x8a60d30f571da73e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123f33 expref: 973 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.371291:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.371292:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.371295:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727c6d4 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.371304:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257748224 00000100:00100000:1.0:1721880422.371307:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257748224 00010000:00010000:3.0:1721880422.371308:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727c69c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.371310:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ee6a400/0x8a60d30f571da73e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123f33 expref: 973 pid: 16120 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.371312:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727c69c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.371316:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009beb2400/0x8a60d30f571d92f4 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123880 expref: 973 pid: 16042 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.371316:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727c69c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.371321:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727c69c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.371323:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ee6a400/0x8a60d30f571da73e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123f33 expref: 973 pid: 16120 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.371324:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727c69c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.371328:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aaaf40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.371329:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727c69c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.371332:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011774848:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.371334:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727c69c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.371338:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914568 00010000:00010000:3.0:1721880422.371339:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727c69c lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.371342:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+973:2005:x1805522257748224:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.371343:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727c69c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.371348:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1721880422.371349:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.371349:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde3c0 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.371352:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009beb2400/0x8a60d30f571d92f4 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123880 expref: 973 pid: 16042 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.371360:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009beb2400/0x8a60d30f571d92f4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123880 expref: 973 pid: 16042 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.371360:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257748096 00000100:00100000:3.0:1721880422.371362:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257748096 00010000:00010000:1.0:1721880422.371370:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000004:00080000:2.0:1721880422.371370:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009d0c0700/2, rc 0, transno 1053048 00010000:00010000:3.0:1721880422.371370:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c9cc000/0x8a60d30f571d9d6d lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123db2 expref: 974 pid: 16117 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.371371:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.371373:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727c6b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.371376:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d0c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011773056:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.371377:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727c6b8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.371383:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.371389:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914569 00000100:00100000:3.0:1721880422.371392:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c4e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+974:2004:x1805522257748096:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.371397:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+974:2005:x1805522257748224:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 54us (114us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.371398:0:15473:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.371400:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1721880422.371400:0:15473:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c9cc000/0x8a60d30f571d9d6d lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc92:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123db2 expref: 974 pid: 16117 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.371401:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914568 00010000:00010000:3.0:1721880422.371406:0:15473:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c9cc000/0x8a60d30f571d9d6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc92:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123db2 expref: 974 pid: 16117 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.371407:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011774976:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.371412:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.371413:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.371414:0:15473:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727c6bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc92:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.371417:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.371418:0:15473:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727c6bf lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc92:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.371425:0:15473:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.371429:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.371436:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c9cc000/0x8a60d30f571d9d6d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123db2 expref: 973 pid: 16117 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.371437:0:15473:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c4e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+973:2004:x1805522257748096:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 44us (90us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.371441:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914569 00000100:00100000:1.0:1721880422.371442:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880131ea4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011774208:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.371448:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257748352 00000100:00100000:3.0:1721880422.371449:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257748352 00010000:00010000:1.0:1721880422.371453:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727c6bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.371455:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f146400/0x8a60d30f571d9f49 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123e1b expref: 972 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.371459:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800887aa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011774336:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.371462:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914570 00000100:00100000:0.0:1721880422.371463:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.371465:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009299d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+972:2004:x1805522257748352:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.371471:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727c6c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.371472:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.371475:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257748480 00010000:00010000:1.0:1721880422.371476:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f146400/0x8a60d30f571d9f49 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123e1b expref: 972 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.371477:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257748480 00010000:00010000:3.0:1721880422.371483:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009750ad00/0x8a60d30f571d96ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12392f expref: 973 pid: 16062 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.371484:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f146400/0x8a60d30f571d9f49 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123e1b expref: 973 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.371486:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011774976 00000100:00100000:0.0:1721880422.371489:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011774976 00010000:00010000:1.0:1721880422.371494:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.371495:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.371498:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727c6cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.371498:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009beb2400/0x8a60d30f571d92f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123880 expref: 973 pid: 16042 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.371500:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914571 00000100:00100000:0.0:1721880422.371502:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632380 00000100:00100000:3.0:1721880422.371503:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0bcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+973:2007:x1805522257748480:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.371504:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727c6cd lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.371506:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2284:3689:x1805522011774976:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.371507:0:15473:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.371508:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800887a9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011773824:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.371510:0:15473:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009750ad00/0x8a60d30f571d96ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc91:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12392f expref: 972 pid: 16062 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.371514:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00080000:0.0:1721880422.371515:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64661 count 1 00010000:00010000:2.0:1721880422.371515:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727c6b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.371515:0:15473:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009750ad00/0x8a60d30f571d96ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc91:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12392f expref: 972 pid: 16062 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.371521:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009750ad00/0x8a60d30f571d96ac lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc91:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12392f expref: 972 pid: 16062 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.371526:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727c6b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.371528:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.371529:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1721880422.371530:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009299d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+971:2004:x1805522257748352:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 64us (113us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.371531:0:15473:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727c6c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.371535:0:15473:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727c6c6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.371536:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914570 00010000:00010000:2.0:1721880422.371537:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727c6b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.371543:0:15473:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.371544:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727c6b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.371550:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727c6b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.371552:0:15473:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0bcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+970:2007:x1805522257748480:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 48us (90us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.371553:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727c6bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.371555:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727c6b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.371555:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914571 00010000:00010000:1.0:1721880422.371560:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727c6bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.371560:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350d80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.371563:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727c6b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.371566:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727c6bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.371568:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727c6b8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.371569:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c6db lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.371576:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727c6bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.371576:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727c6b8 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.371578:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c9ba400/0x8a60d30f571da8f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123f9c expref: 969 pid: 16053 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.371582:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.371582:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727c6bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.371582:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727c6b8 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.371583:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.371584:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c6db lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.371587:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b73c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.371590:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727c6bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.371595:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727c6bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.371597:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c9ba400/0x8a60d30f571da8f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123f9c expref: 969 pid: 16053 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.371602:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c9ba400/0x8a60d30f571da8f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123f9c expref: 969 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.371603:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727c6bf lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.371609:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727c6bf lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.371612:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0bcaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011775104:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.371628:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e300 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.371631:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801360cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2286:3687:x1805522011772672:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2104us (2157us total) trans 4296020345 rc 0/0 00000100:00100000:3.0:1721880422.371635:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632371 00010000:00010000:3.0:1721880422.371656:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f146400/0x8a60d30f571d9f49 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123e1b expref: 969 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.371663:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d278e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011774592:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.371674:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2286:3687:x1805522011773568:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1728us (1762us total) trans 4296020346 rc 0/0 00010000:00010000:3.0:1721880422.371677:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727c6cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.371679:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632375 00010000:00010000:3.0:1721880422.371681:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727c6cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.371685:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727c6cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.371689:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727c6cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.371692:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727c6cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.371696:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727c6cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.371698:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007ca4f480/2, rc 0, transno 1053050 00010000:00010000:3.0:1721880422.371699:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8480 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.371700:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727c6cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.371702:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007ca4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011773568:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.371706:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800887a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2285:3689:x1805522011774080:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1577us (1604us total) trans 4296020347 rc 0/0 00010000:00010000:3.0:1721880422.371708:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727c6cd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.371710:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632376 00010000:00010000:3.0:1721880422.371713:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727c6cd lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.371714:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880091135180/2, rc 0, transno 1053051 00010000:00010000:3.0:1721880422.371717:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727c6cd lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.371718:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880091135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011774080:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.371725:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011775232:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1721880422.371745:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880091136680/2, rc 0, transno 1053049 00000100:00100000:2.0:1721880422.371749:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880091136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011772672:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.371752:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1721880422.371755:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.371764:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011775360:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.371766:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011775232 00000100:00100000:1.0:1721880422.371769:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011775232 00000100:00100000:2.0:1721880422.371776:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.371779:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632381 00000100:00100000:1.0:1721880422.371782:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2286:3689:x1805522011775232:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.371786:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011775360 00000100:00100000:2.0:1721880422.371787:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011775488:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.371788:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011775360 00002000:00080000:1.0:1721880422.371790:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64662 count 1 00010000:00010000:1.0:1721880422.371797:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727c6e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.371801:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632382 00000100:00100000:2.0:1721880422.371801:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.371805:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800887a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2287:3687:x1805522011775360:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.371805:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d107600/0x8a60d30f571daaa9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123ffe expref: 968 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.371807:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880123b93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2287:3687:x1805522011774464:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1457us (1487us total) trans 4296020348 rc 0/0 00010000:00010000:1.0:1721880422.371809:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.371810:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.371811:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727c6e2 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.371812:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632378 00000004:00080000:2.0:1721880422.371813:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880131ea6300/2, rc 0, transno 1053052 00002000:00080000:0.0:1721880422.371814:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64663 count 1 00000100:00100000:2.0:1721880422.371817:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880131ea6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011774464:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.371820:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011775488 00010000:00010000:0.0:1721880422.371821:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c6e9 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.371821:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d107600/0x8a60d30f571daaa9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123ffe expref: 968 pid: 16120 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.371822:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011775488 00010000:00010000:1.0:1721880422.371826:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d107600/0x8a60d30f571daaa9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123ffe expref: 968 pid: 16120 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.371829:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801355f6d00/0x8a60d30f571dac7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12406e expref: 968 pid: 16114 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.371832:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880131ea4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011775616:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.371833:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632383 00010000:00010000:0.0:1721880422.371834:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1721880422.371835:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800887aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2287:3687:x1805522011775488:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.371836:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.371838:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c6e9 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.371838:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727c6c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.371843:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64664 count 1 00010000:00010000:2.0:1721880422.371844:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727c6c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.371849:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb000 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.371849:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727c6f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.371852:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727c6c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.371856:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801355f6d00/0x8a60d30f571dac7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12406e expref: 968 pid: 16114 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.371856:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ce1e880/0x8a60d30f571daedf lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b124108 expref: 968 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.371859:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727c6c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.371860:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800962aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011775744:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.371860:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.371861:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.371862:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727c6f0 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.371865:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727c6c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.371870:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801355f6d00/0x8a60d30f571dac7e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12406e expref: 968 pid: 16114 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.371872:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.371872:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350b40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.371873:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ce1e880/0x8a60d30f571daedf lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b124108 expref: 968 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.371875:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727c6c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.371879:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ce1e880/0x8a60d30f571daedf lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b124108 expref: 968 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.371880:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122fd1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011775872:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.371881:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727c6c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.371885:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d278e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011776000:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.371887:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011775744 00000100:00100000:1.0:1721880422.371889:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011775744 00010000:00010000:2.0:1721880422.371891:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727c6c6 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.371898:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727c6c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.371901:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632384 00000100:00100000:0.0:1721880422.371902:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.371903:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2288:3688:x1805522011775744:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.371904:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec900 going to sleep for 11 seconds 00002000:00080000:1.0:1721880422.371910:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64665 count 1 00010000:00010000:1.0:1721880422.371917:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727c6f7 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.371917:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727c6aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.371921:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727c6aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.371924:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135181b00/0x8a60d30f571db204 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b124300 expref: 968 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.371925:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727c6aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.371927:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.371928:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.371929:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727c6f7 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.371929:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727c6aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.371932:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727c6aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.371935:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b5b00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.371937:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727c6aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.371939:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135181b00/0x8a60d30f571db204 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b124300 expref: 968 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.371942:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727c6aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.371944:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135181b00/0x8a60d30f571db204 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b124300 expref: 968 pid: 16125 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.371948:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727c6aa lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.371949:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008cc73100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011776128:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.371951:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727c6aa lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.371961:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302ebf00 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.372029:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880123b92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2290:3688:x1805522011773952:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1877us (1903us total) trans 4296020349 rc 0/0 00000004:00080000:0.0:1721880422.372036:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007ca4c380/2, rc 0, transno 1053053 00000100:00100000:2.0:1721880422.372036:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632377 00000100:00100000:0.0:1721880422.372042:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007ca4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011773952:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.372053:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801360cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2289:3687:x1805522011773184:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2296us (2364us total) trans 4296020350 rc 0/0 00000100:00100000:3.0:1721880422.372057:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632374 00000100:00100000:0.0:1721880422.372061:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1721880422.372066:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122fd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011776256:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1721880422.372080:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009d0c3480/2, rc 0, transno 1053054 00000100:00100000:3.0:1721880422.372085:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d0c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011773184:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.372086:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.372108:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1721880422.372112:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008cc72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011776384:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.372119:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011776256 00000100:00100000:2.0:1721880422.372123:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011776256 00000100:00100000:3.0:1721880422.372126:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.372145:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011776384 00000100:00100000:2.0:1721880422.372148:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011776384 00000100:00100000:2.0:1721880422.372161:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632385 00000100:00100000:2.0:1721880422.372166:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2290:3688:x1805522011776256:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.372167:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632386 00000100:00100000:3.0:1721880422.372170:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d27aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2290:3687:x1805522011776384:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.372177:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64666 count 1 00002000:00080000:3.0:1721880422.372180:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64667 count 1 00010000:00010000:3.0:1721880422.372187:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727c6fe lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.372188:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727c705 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.372194:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097236ac0/0x8a60d30f571debc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b125eba expref: 968 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.372200:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f5f9440/0x8a60d30f571db80f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12464f expref: 968 pid: 15445 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.372201:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.372202:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.372204:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727c6fe lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.372208:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.372210:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.372212:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727c705 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.372213:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097236ac0/0x8a60d30f571debc4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b125eba expref: 968 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.372218:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097236ac0/0x8a60d30f571debc4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b125eba expref: 968 pid: 16110 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.372223:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d27b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011776512:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.372230:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f5f9440/0x8a60d30f571db80f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12464f expref: 968 pid: 15445 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.372239:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec000 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.372240:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f5f9440/0x8a60d30f571db80f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12464f expref: 968 pid: 15445 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.372250:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800962ac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011776640:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.372278:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde000 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.372290:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a0bcaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011775104:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.372299:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e3dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011774848:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.372300:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.372306:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c6db lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.372309:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257748608 00010000:00010000:2.0:1721880422.372311:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727c6d4 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.372311:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257748608 00010000:00010000:3.0:1721880422.372319:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee6a400/0x8a60d30f571da73e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123f33 expref: 969 pid: 16120 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.372329:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914572 00000100:00100000:3.0:1721880422.372332:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cc70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+969:2004:x1805522257748608:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.372336:0:15473:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.372338:0:15473:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ee6a400/0x8a60d30f571da73e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123f33 expref: 969 pid: 16120 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.372343:0:15473:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ee6a400/0x8a60d30f571da73e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123f33 expref: 969 pid: 16120 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.372351:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee6a400/0x8a60d30f571da73e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123f33 expref: 969 pid: 16120 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.372356:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.372357:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.372359:0:15473:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727c6d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.372363:0:15473:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727c6d4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.372378:0:15473:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.372390:0:15473:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cc70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+968:2004:x1805522257748608:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 57us (91us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.372393:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914572 00010000:00010000:2.0:1721880422.372398:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727c6d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.372406:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727c6d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.372414:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727c6d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.372426:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727c6d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.372433:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727c6d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.372439:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352f40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.372442:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727c6d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.372449:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727c6d4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.372459:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727c6d4 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.372467:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727c6d4 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.372586:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880130768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2291:3687:x1805522011774720:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1331us (1372us total) trans 4296020351 rc 0/0 00000004:00080000:3.0:1721880422.372590:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801360cf800/2, rc 0, transno 1053055 00000100:00100000:2.0:1721880422.372593:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632379 00000100:00100000:3.0:1721880422.372594:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801360cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011774720:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.372624:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880123b91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011776768:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.372637:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.372648:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011776768 00000100:00100000:2.0:1721880422.372651:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011776768 00000100:00100000:2.0:1721880422.372668:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632387 00000100:00100000:2.0:1721880422.372674:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d279500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2291:3687:x1805522011776768:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.372685:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64668 count 1 00010000:00010000:2.0:1721880422.372695:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727c70c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.372705:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097721d40/0x8a60d30f571dedd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b125f1c expref: 967 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.372711:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.372712:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.372715:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727c70c lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.372724:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.372750:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097721d40/0x8a60d30f571dedd8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b125f1c expref: 967 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.372758:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097721d40/0x8a60d30f571dedd8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b125f1c expref: 967 pid: 15506 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.372765:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011776896:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.372790:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.372800:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257748736 00000100:00100000:3.0:1721880422.372802:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257748736 00010000:00010000:3.0:1721880422.372810:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c9ba400/0x8a60d30f571da8f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123f9c expref: 968 pid: 16053 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.372821:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914573 00000100:00100000:3.0:1721880422.372823:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ab4d7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+968:2004:x1805522257748736:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.372828:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.372830:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c9ba400/0x8a60d30f571da8f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123f9c expref: 968 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.372835:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c9ba400/0x8a60d30f571da8f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123f9c expref: 968 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.372842:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c9ba400/0x8a60d30f571da8f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123f9c expref: 968 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.372848:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.372849:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.372851:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c6db lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.372855:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c6db lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.372863:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.372871:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880131ea4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011775616:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.372876:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d278e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011776000:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.372879:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ab4d7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+967:2004:x1805522257748736:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 55us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.372883:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914573 00000100:00100000:0.0:1721880422.372884:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.372885:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727c6e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.372898:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727c6f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.372905:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008cc73100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011776128:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.372908:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257749248 00000100:00100000:2.0:1721880422.372910:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257749248 00010000:00010000:1.0:1721880422.372914:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727c6f7 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.372919:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135181b00/0x8a60d30f571db204 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b124300 expref: 967 pid: 16125 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.372919:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c6db lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.372924:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c6db lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.372926:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.372934:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c6db lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.372936:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257748992 00000100:00100000:2.0:1721880422.372938:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257748992 00010000:00010000:3.0:1721880422.372938:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c6db lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.372942:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c6db lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.372944:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801355f6d00/0x8a60d30f571dac7e lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12406e expref: 968 pid: 16114 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.372945:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325c6c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.372947:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c6db lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.372950:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.372951:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c6db lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.372956:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257748864 00010000:00010000:3.0:1721880422.372956:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c6db lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.372958:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257748864 00010000:00010000:3.0:1721880422.372959:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c6db lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.372960:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.372965:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257749120 00010000:00010000:2.0:1721880422.372966:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d107600/0x8a60d30f571daaa9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123ffe expref: 969 pid: 16120 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.372969:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257749120 00000100:00100000:0.0:1721880422.372973:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914574 00000100:00100000:0.0:1721880422.372977:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+970:2007:x1805522257749248:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.372981:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ce1e880/0x8a60d30f571daedf lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b124108 expref: 970 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.372983:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.372987:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135181b00/0x8a60d30f571db204 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b124300 expref: 970 pid: 16125 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.372987:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914575 00000100:00100000:2.0:1721880422.372993:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+970:2004:x1805522257748992:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.372993:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914576 00010000:00010000:0.0:1721880422.372994:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135181b00/0x8a60d30f571db204 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b124300 expref: 970 pid: 16125 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.372997:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+970:2004:x1805522257748864:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.373000:0:15473:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.373002:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.373003:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914577 00010000:00010000:2.0:1721880422.373003:0:15473:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801355f6d00/0x8a60d30f571dac7e lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12406e expref: 970 pid: 16114 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.373004:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135181b00/0x8a60d30f571db204 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b124300 expref: 970 pid: 16125 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.373005:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d107600/0x8a60d30f571daaa9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123ffe expref: 970 pid: 16120 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.373008:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+970:2004:x1805522257749120:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.373025:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.373026:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d107600/0x8a60d30f571daaa9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123ffe expref: 969 pid: 16120 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.373027:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.373029:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727c6f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.373029:0:15473:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801355f6d00/0x8a60d30f571dac7e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12406e expref: 969 pid: 16114 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.373034:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727c6f7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.373035:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d107600/0x8a60d30f571daaa9 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b123ffe expref: 969 pid: 16120 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.373036:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.373040:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ce1e880/0x8a60d30f571daedf lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b124108 expref: 968 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.373041:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.373042:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.373042:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.373044:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.373044:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.373044:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727c6e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.373046:0:15473:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c6e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.373048:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727c6e2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.373050:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ce1e880/0x8a60d30f571daedf lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b124108 expref: 968 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.373054:0:15473:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c6e9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.373057:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+968:2007:x1805522257749248:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 80us (174us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.373058:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.373061:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914574 00010000:00010000:1.0:1721880422.373063:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ce1e880/0x8a60d30f571daedf lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b124108 expref: 968 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.373070:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+966:2004:x1805522257748864:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 73us (120us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.373071:0:15473:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.373073:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.373074:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.373074:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914576 00010000:00010000:1.0:1721880422.373077:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727c6f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.373083:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727c6f0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.373089:0:15473:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+965:2004:x1805522257748992:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 96us (161us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.373093:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.373095:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914575 00000100:00100000:3.0:1721880422.373097:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d27b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011776512:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.373101:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.373107:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727c6fe lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.373111:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+964:2004:x1805522257749120:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 102us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.373117:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914577 00000100:00100000:2.0:1721880422.373118:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257749376 00000100:00100000:2.0:1721880422.373121:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257749376 00010000:00010000:2.0:1721880422.373132:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097236ac0/0x8a60d30f571debc4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b125eba expref: 964 pid: 16110 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.373136:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727c6f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.373143:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727c6f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.373149:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914578 00010000:00010000:1.0:1721880422.373150:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727c6f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.373152:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+964:2005:x1805522257749376:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.373155:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.373157:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727c6f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.373158:0:15473:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.373162:0:15473:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097236ac0/0x8a60d30f571debc4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b125eba expref: 964 pid: 16110 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.373163:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727c6f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.373168:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b6400 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.373171:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727c6f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.373171:0:15473:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097236ac0/0x8a60d30f571debc4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b125eba expref: 964 pid: 16110 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.373171:0:8793:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257749504 00000100:00100000:3.0:1721880422.373173:0:8793:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257749504 00010000:00010000:1.0:1721880422.373177:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727c6f7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.373179:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097236ac0/0x8a60d30f571debc4 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b125eba expref: 965 pid: 16110 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.373182:0:8793:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f5f9440/0x8a60d30f571db80f lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12464f expref: 965 pid: 15445 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.373186:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727c6f7 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.373189:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.373190:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.373192:0:15473:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727c6fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.373193:0:8793:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914579 00010000:00010000:1.0:1721880422.373197:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727c6f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.373198:0:8793:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30425778-2709-4512-9d75-01ec53c4cfad+964:2005:x1805522257749504:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.373202:0:15473:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727c6fe lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.373204:0:8793:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.373207:0:8793:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f5f9440/0x8a60d30f571db80f lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12464f expref: 964 pid: 15445 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.373216:0:8793:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f5f9440/0x8a60d30f571db80f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12464f expref: 964 pid: 15445 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.373218:0:15473:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.373226:0:8793:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.373227:0:8793:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.373229:0:8793:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727c705 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.373235:0:8793:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727c705 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.373236:0:15473:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+964:2005:x1805522257749376:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 81us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.373242:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914578 00010000:00010000:3.0:1721880422.373244:0:8793:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.373262:0:8793:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30425778-2709-4512-9d75-01ec53c4cfad+963:2005:x1805522257749504:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 63us (105us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.373263:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727c6f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.373267:0:8793:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914579 00010000:00010000:2.0:1721880422.373270:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727c6f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.373277:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727c6f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.373283:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727c6f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.373284:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727c6e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.373285:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727c6fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.373289:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727c6f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.373292:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727c6e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.373292:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727c6fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.373294:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8fc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.373297:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727c6f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.373299:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727c6e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.373300:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727c6fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.373306:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727c6e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.373306:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727c6fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.373307:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727c6f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.373311:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727c6fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.373313:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727c6e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.373317:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727c6f0 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.373317:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa86c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.373318:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b7a80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.373319:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727c6fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.373321:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727c6e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.373323:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727c6f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.373326:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727c6fe lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.373328:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727c6e2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.373335:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727c6fe lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.373336:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727c6e2 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.373341:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727c6fe lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.373343:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727c6e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.373385:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801355f6d00/0x8a60d30f571dac7e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12406e expref: 962 pid: 16114 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.373397:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122fd1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011775872:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.373402:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f5f9440/0x8a60d30f571db80f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12464f expref: 961 pid: 15445 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.373409:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c6e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.373415:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800962ac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011776640:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.373416:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c6e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.373421:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c6e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.373425:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c6e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.373429:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c6e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.373429:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727c705 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.373433:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c6e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.373436:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727c705 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.373436:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2296:3689:x1805522011774976:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1928us (2006us total) trans 4296020352 rc 0/0 00010000:00010000:0.0:1721880422.373437:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325f600 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.373439:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c6e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.373440:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632380 00010000:00010000:2.0:1721880422.373442:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727c705 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.373443:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c6e9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.373449:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c6e9 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.373449:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727c705 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.373452:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727c6e9 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.373452:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2295:3689:x1805522011775232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1668us (1695us total) trans 4296020355 rc 0/0 00000100:00100000:1.0:1721880422.373459:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632381 00010000:00010000:2.0:1721880422.373461:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727c705 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.373463:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e3de680/2, rc 0, transno 1053059 00010000:00010000:2.0:1721880422.373467:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727c705 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.373469:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e3de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011775232:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.373473:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353cc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.373475:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727c705 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.373480:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727c705 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.373489:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727c705 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.373495:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727c705 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.373500:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e3ddf80/2, rc 0, transno 1053056 00000100:00100000:3.0:1721880422.373506:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e3ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011774976:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.373512:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1721880422.373523:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2295:3688:x1805522011775744:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1616us (1649us total) trans 4296020353 rc 0/0 00000100:00100000:1.0:1721880422.373528:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632384 00000100:00100000:3.0:1721880422.373531:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d27b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011777024:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.373552:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800887a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2295:3687:x1805522011775360:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1746us (1773us total) trans 4296020357 rc 0/0 00000100:00100000:3.0:1721880422.373554:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.373557:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632382 00000100:00100000:0.0:1721880422.373568:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011777024 00000100:00100000:3.0:1721880422.373569:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d278e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011777152:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.373571:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011777024 00000100:00100000:0.0:1721880422.373582:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632388 00000100:00100000:0.0:1721880422.373585:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d278700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2295:3689:x1805522011777024:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.373586:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.373588:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.373596:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2295:3688:x1805522011776256:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1429us (1509us total) trans 4296020358 rc 0/0 00000100:00100000:2.0:1721880422.373602:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632385 00000100:00100000:3.0:1721880422.373607:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257749632 00000100:00100000:3.0:1721880422.373609:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257749632 00000100:00100000:2.0:1721880422.373612:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011777152 00000100:00100000:2.0:1721880422.373615:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011777152 00010000:00010000:3.0:1721880422.373618:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097721d40/0x8a60d30f571dedd8 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b125f1c expref: 961 pid: 15506 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.373628:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914580 00000100:00100000:2.0:1721880422.373629:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632389 00000100:00100000:3.0:1721880422.373631:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8066c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+961:2004:x1805522257749632:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.373633:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2295:3689:x1805522011777152:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.373635:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.373637:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097721d40/0x8a60d30f571dedd8 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfc9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b125f1c expref: 961 pid: 15506 timeout: 887 lvb_type: 0 00002000:00080000:0.0:1721880422.373643:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64669 count 1 00002000:00080000:2.0:1721880422.373644:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64670 count 1 00010000:00010000:3.0:1721880422.373644:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097721d40/0x8a60d30f571dedd8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b125f1c expref: 961 pid: 15506 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.373651:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727c713 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc9d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.373651:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.373652:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727c71a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.373652:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.373654:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727c70c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.373659:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097630000/0x8a60d30f571defc9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc9d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b125f85 expref: 961 pid: 16118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.373661:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727c70c lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.373663:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098a9b180/0x8a60d30f571df1cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b125fe0 expref: 961 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.373664:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.373665:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.373667:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727c713 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc9d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.373667:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.373669:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.373670:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.373673:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727c71a lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.373677:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097630000/0x8a60d30f571defc9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc9d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b125f85 expref: 961 pid: 16118 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.373681:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8066c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+961:2004:x1805522257749632:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 49us (94us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.373684:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097630000/0x8a60d30f571defc9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc9d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b125f85 expref: 961 pid: 16118 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.373687:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098a9b180/0x8a60d30f571df1cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b125fe0 expref: 961 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.373687:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914580 00000100:00100000:0.0:1721880422.373690:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122fd1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011777280:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.373694:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098a9b180/0x8a60d30f571df1cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b125fe0 expref: 961 pid: 16017 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.373700:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800962ac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011777408:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.373706:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.373715:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde000 going to sleep for 11 seconds 00000004:00080000:0.0:1721880422.373723:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122fd1180/2, rc 0, transno 1053062 00000100:00100000:0.0:1721880422.373747:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122fd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011776256:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.373748:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097721d40/0x8a60d30f571dedd8 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b125f1c expref: 960 pid: 15506 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.373759:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e3dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011776896:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.373768:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727c70c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.373773:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e3de300/2, rc 0, transno 1053061 00000100:00100000:3.0:1721880422.373785:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e3de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011775360:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1721880422.373789:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800962aed80/2, rc 0, transno 1053057 00000100:00100000:3.0:1721880422.373790:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1721880422.373794:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800962aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011775744:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.373798:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727c70c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.373805:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727c70c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.373812:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727c70c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.373818:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727c70c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.373826:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727c70c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.373831:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122fd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011777792:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.373831:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801363506c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.373834:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727c70c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.373841:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727c70c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.373850:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.373851:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727c70c lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.373857:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727c70c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.373864:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011777536:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.373873:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1721880422.373878:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122fd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011777664:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.373879:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.373890:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011777792 00000100:00100000:1.0:1721880422.373894:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011777792 00000100:00100000:0.0:1721880422.373896:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.373907:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011777536 00000100:00100000:1.0:1721880422.373909:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011777536 00000100:00100000:0.0:1721880422.373915:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011777664 00000100:00100000:0.0:1721880422.373919:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011777664 00000100:00100000:1.0:1721880422.373919:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632390 00000100:00100000:1.0:1721880422.373921:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2299:3688:x1805522011777792:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.373931:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64673 count 1 00000100:00100000:0.0:1721880422.373940:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632391 00010000:00010000:1.0:1721880422.373940:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c721 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfca1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.373944:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d27aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2299:3687:x1805522011776384:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1773us (1817us total) trans 4296020356 rc 0/0 00000100:00100000:0.0:1721880422.373945:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2299:3687:x1805522011777536:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.373948:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a7bb180/0x8a60d30f571df6e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfca1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1260dc expref: 959 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.373949:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632386 00010000:00010000:1.0:1721880422.373952:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.373953:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.373955:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c721 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfca1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1721880422.373959:0:16088:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64671 count 1 00000100:00100000:3.0:1721880422.373961:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632392 00000100:00100000:3.0:1721880422.373964:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091282050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2298:3686:x1805522011777664:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.373970:0:16088:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727c728 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.373970:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a7bb180/0x8a60d30f571df6e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfca1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1260dc expref: 959 pid: 16130 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.373972:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64672 count 1 00000100:00100000:2.0:1721880422.373974:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d279500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2298:3687:x1805522011776768:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1298us (1333us total) trans 4296020359 rc 0/0 00010000:00010000:1.0:1721880422.373976:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a7bb180/0x8a60d30f571df6e5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfca1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1260dc expref: 959 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.373979:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c72f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfca0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.373981:0:16088:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b3de640/0x8a60d30f571df388 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126034 expref: 959 pid: 15515 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.373981:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632387 00000100:00100000:1.0:1721880422.373983:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880123b90000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011777920:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.373986:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099fe58c0/0x8a60d30f571df517 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfca0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126088 expref: 959 pid: 16131 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.373988:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.373990:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.373990:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.373991:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.373993:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c72f lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfca0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.374001:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302ebf00 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.374002:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099fe58c0/0x8a60d30f571df517 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfca0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126088 expref: 959 pid: 16131 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.374008:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099fe58c0/0x8a60d30f571df517 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfca0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126088 expref: 959 pid: 16131 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.374032:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008c4e7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011778048:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.374048:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec900 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.374059:0:16088:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727c728 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfc9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.374068:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800887aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2297:3687:x1805522011775488:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2230us (2264us total) trans 4296020354 rc 0/0 00000004:00080000:3.0:1721880422.374068:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880123b91c00/2, rc 0, transno 1053063 00000100:00100000:3.0:1721880422.374074:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880123b91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011776768:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.374075:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632383 00010000:00010000:0.0:1721880422.374078:0:16088:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b3de640/0x8a60d30f571df388 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126034 expref: 959 pid: 15515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.374088:0:16088:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b3de640/0x8a60d30f571df388 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126034 expref: 959 pid: 15515 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.374098:0:16088:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122fd2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011778176:192.168.201.24@tcp:104: 00000004:00080000:3.0:1721880422.374099:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008cc72d80/2, rc 0, transno 1053060 00000100:00100000:1.0:1721880422.374103:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009299d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011778304:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.374103:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008cc72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011776384:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1721880422.374111:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e3df480/2, rc 0, transno 1053058 00000100:00100000:3.0:1721880422.374113:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e3df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011775488:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.374123:0:16088:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e300 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.374128:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.374140:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011778304 00000100:00100000:3.0:1721880422.374140:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011778432:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.374143:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011778304 00000100:00100000:2.0:1721880422.374155:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880134e96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011778560:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.374155:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.374157:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632393 00000100:00100000:0.0:1721880422.374160:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ea4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2297:3689:x1805522011778304:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.374168:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64674 count 1 00000100:00100000:3.0:1721880422.374171:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011778432 00000100:00100000:3.0:1721880422.374173:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011778432 00010000:00010000:0.0:1721880422.374176:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c736 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfca2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.374178:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.374184:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a533e1c0/0x8a60d30f571df835 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfca2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126129 expref: 959 pid: 16108 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.374186:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011778560 00010000:00010000:0.0:1721880422.374188:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1721880422.374188:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011778560 00010000:00010000:0.0:1721880422.374189:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.374190:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c736 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfca2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.374194:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632394 00000100:00100000:1.0:1721880422.374198:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2299:3686:x1805522011778432:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.374198:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632395 00010000:00010000:0.0:1721880422.374200:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a533e1c0/0x8a60d30f571df835 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfca2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126129 expref: 959 pid: 16108 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.374201:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134e97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2299:3687:x1805522011778560:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.374207:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64675 count 1 00002000:00080000:3.0:1721880422.374210:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64676 count 1 00010000:00010000:1.0:1721880422.374215:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c73d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfca3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.374217:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727c744 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfca4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.374222:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011f83c000/0x8a60d30f571df9e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfca3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126184 expref: 959 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.374224:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099349b00/0x8a60d30f571dfb92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfca4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1261d1 expref: 959 pid: 16054 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.374226:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.374227:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.374228:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.374229:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c73d lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfca3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.374229:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.374230:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727c744 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfca4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.374239:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011f83c000/0x8a60d30f571df9e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfca3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126184 expref: 959 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.374240:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099349b00/0x8a60d30f571dfb92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfca4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1261d1 expref: 959 pid: 16054 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.374246:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099349b00/0x8a60d30f571dfb92 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfca4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1261d1 expref: 959 pid: 16054 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.374247:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011f83c000/0x8a60d30f571df9e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfca3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126184 expref: 959 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.374252:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099491500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011778944:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.374253:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca4ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011778816:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.374266:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec540 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.374269:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb000 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.374331:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122fd1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011777280:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.374339:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800962ac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011777408:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.374341:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727c713 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc9d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.374350:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727c71a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.374440:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a533e1c0/0x8a60d30f571df835 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfca2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126129 expref: 959 pid: 16108 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.374456:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.374460:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122fd0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011778688:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.374473:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.374474:0:8793:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257749888 00000100:00100000:3.0:1721880422.374477:0:8793:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257749888 00010000:00010000:3.0:1721880422.374486:0:8793:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098a9b180/0x8a60d30f571df1cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b125fe0 expref: 960 pid: 16017 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.374487:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.374497:0:8793:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257749760 00000100:00100000:3.0:1721880422.374498:0:8793:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257749760 00010000:00010000:3.0:1721880422.374503:0:8793:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097630000/0x8a60d30f571defc9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc9d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b125f85 expref: 961 pid: 16118 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.374512:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914581 00000100:00100000:2.0:1721880422.374518:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131eee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+961:2004:x1805522257749888:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.374526:0:8793:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914582 00010000:00010000:2.0:1721880422.374527:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.374530:0:8793:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30425778-2709-4512-9d75-01ec53c4cfad+961:2005:x1805522257749760:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.374532:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098a9b180/0x8a60d30f571df1cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b125fe0 expref: 961 pid: 16017 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.374538:0:8793:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.374543:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098a9b180/0x8a60d30f571df1cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b125fe0 expref: 961 pid: 16017 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.374543:0:8793:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097630000/0x8a60d30f571defc9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc9d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b125f85 expref: 961 pid: 16118 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.374551:0:8793:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097630000/0x8a60d30f571defc9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc9d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b125f85 expref: 961 pid: 16118 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.374557:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098a9b180/0x8a60d30f571df1cf lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b125fe0 expref: 961 pid: 16017 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.374564:0:8793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097630000/0x8a60d30f571defc9 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc9d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b125f85 expref: 961 pid: 16118 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.374573:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.374574:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.374575:0:8793:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.374576:0:8793:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.374577:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727c71a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.374579:0:8793:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727c713 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc9d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.374584:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727c71a lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.374586:0:8793:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727c713 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc9d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.374603:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.374605:0:8793:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.374615:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727c71a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.374624:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727c71a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.374625:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880131eee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+959:2004:x1805522257749888:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 106us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.374625:0:8793:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30425778-2709-4512-9d75-01ec53c4cfad+959:2005:x1805522257749760:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 94us (151us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.374631:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727c71a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.374632:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914581 00000100:00100000:3.0:1721880422.374636:0:8793:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914582 00010000:00010000:0.0:1721880422.374638:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727c71a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.374644:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727c71a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.374650:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801363518c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.374653:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727c71a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.374660:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727c71a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.374670:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727c71a lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.374676:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727c71a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.374994:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d278e00/2, rc 0, transno 1053064 00000100:00100000:0.0:1721880422.374995:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2300:3689:x1805522011777152:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1360us (1407us total) trans 4296020360 rc 0/0 00000100:00100000:2.0:1721880422.375002:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d278e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011777152:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.375003:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632389 00000100:00100000:3.0:1721880422.375027:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099491500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011778944:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.375030:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.375044:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880134e95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011779072:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.375044:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727c744 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfca4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.375046:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.375047:0:16088:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122fd2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011778176:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.375059:0:7117:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257750144 00000100:00100000:1.0:1721880422.375060:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.375061:0:16088:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727c728 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfc9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.375061:0:7117:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257750144 00000100:00100000:2.0:1721880422.375062:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257750400 00000100:00100000:2.0:1721880422.375064:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257750400 00000100:00100000:1.0:1721880422.375071:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.375074:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099349b00/0x8a60d30f571dfb92 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfca4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1261d1 expref: 959 pid: 16054 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.375074:0:7117:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099fe58c0/0x8a60d30f571df517 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfca0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126088 expref: 959 pid: 16131 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.375076:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727c713 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.375084:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727c713 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.375091:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727c713 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.375097:0:7117:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257750656 00010000:00010000:0.0:1721880422.375098:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727c713 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.375099:0:7117:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257750656 00000100:00100000:2.0:1721880422.375101:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257750016 00000100:00100000:2.0:1721880422.375102:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257750016 00010000:00010000:0.0:1721880422.375105:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727c713 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.375108:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a7bb180/0x8a60d30f571df6e5 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfca1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1260dc expref: 961 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.375108:0:7117:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a533e1c0/0x8a60d30f571df835 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfca2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126129 expref: 961 pid: 16108 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.375116:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325cfc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.375121:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727c713 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.375123:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914583 00010000:00010000:0.0:1721880422.375127:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727c713 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.375128:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+961:2004:x1805522257750144:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.375132:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.375132:0:7117:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914584 00010000:00010000:2.0:1721880422.375134:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.375137:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099fe58c0/0x8a60d30f571df517 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfca0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126088 expref: 961 pid: 16131 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.375137:0:7117:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30425778-2709-4512-9d75-01ec53c4cfad+961:2004:x1805522257750400:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.375138:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727c713 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.375143:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099fe58c0/0x8a60d30f571df517 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfca0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126088 expref: 961 pid: 16131 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.375144:0:7117:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.375145:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727c713 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.375149:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257750272 00010000:00010000:3.0:1721880422.375149:0:7117:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099349b00/0x8a60d30f571dfb92 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfca4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1261d1 expref: 961 pid: 16054 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.375152:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257750272 00010000:00010000:2.0:1721880422.375152:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.375153:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.375155:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c72f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfca0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.375157:0:7117:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099349b00/0x8a60d30f571dfb92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfca4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1261d1 expref: 962 pid: 16054 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.375160:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c72f lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfca0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.375165:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b3de640/0x8a60d30f571df388 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126034 expref: 962 pid: 15515 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.375167:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.375169:0:7117:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099349b00/0x8a60d30f571dfb92 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfca4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1261d1 expref: 962 pid: 16054 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.375173:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914585 00010000:00010000:3.0:1721880422.375179:0:7117:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1721880422.375180:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b0f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+961:2005:x1805522257750016:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.375181:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+961:2004:x1805522257750144:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 54us (152us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.375181:0:7117:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.375183:0:7117:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727c744 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfca4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.375185:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914583 00010000:00010000:3.0:1721880422.375189:0:7117:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727c744 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfca4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.375190:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914586 00000100:00100000:1.0:1721880422.375195:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+960:2004:x1805522257750656:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.375195:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914587 00010000:00010000:0.0:1721880422.375197:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.375198:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a70ef850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+960:2005:x1805522257750272:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.375199:0:7117:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.375202:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a7bb180/0x8a60d30f571df6e5 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfca1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1260dc expref: 960 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.375202:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.375204:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.375205:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b3de640/0x8a60d30f571df388 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126034 expref: 960 pid: 15515 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.375208:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a533e1c0/0x8a60d30f571df835 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfca2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126129 expref: 960 pid: 16108 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.375212:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a7bb180/0x8a60d30f571df6e5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfca1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1260dc expref: 960 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.375212:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b3de640/0x8a60d30f571df388 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126034 expref: 960 pid: 15515 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.375216:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a533e1c0/0x8a60d30f571df835 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfca2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126129 expref: 960 pid: 16108 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.375219:0:7117:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30425778-2709-4512-9d75-01ec53c4cfad+960:2004:x1805522257750400:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 80us (171us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.375220:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b3de640/0x8a60d30f571df388 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126034 expref: 960 pid: 15515 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.375223:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.375224:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.375225:0:7117:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914584 00010000:00010000:0.0:1721880422.375227:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c721 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfca1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.375228:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.375229:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.375230:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.375230:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.375232:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c736 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfca2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.375232:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727c728 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.375234:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c721 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfca1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.375236:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727c728 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfc9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.375237:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c736 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfca2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.375243:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.375245:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.375245:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.375246:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727c744 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfca4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.375253:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a70ef850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+958:2005:x1805522257750272:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 54us (126us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.375253:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727c744 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfca4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.375257:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914587 00010000:00010000:3.0:1721880422.375260:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727c744 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfca4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.375261:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+958:2004:x1805522257750656:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 66us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.375265:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914586 00010000:00010000:3.0:1721880422.375267:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727c744 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfca4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.375268:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b0f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+957:2005:x1805522257750016:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 88us (195us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.375273:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727c744 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfca4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.375274:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914585 00000100:00100000:2.0:1721880422.375280:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.375284:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aaa880 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.375287:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727c744 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfca4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.375289:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a7bb180/0x8a60d30f571df6e5 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfca1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1260dc expref: 955 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.375292:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727c744 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfca4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.375298:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880123b90000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011777920:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.375299:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727c744 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfca4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.375300:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011779072 00000100:00100000:2.0:1721880422.375302:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011779072 00010000:00010000:3.0:1721880422.375302:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727c744 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfca4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.375307:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c721 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfca1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.375312:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c721 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfca1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.375312:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632396 00000100:00100000:2.0:1721880422.375314:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134e95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2300:3688:x1805522011779072:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.375316:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c721 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfca1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.375317:0:16088:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727c728 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.375320:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c721 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfca1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.375322:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64677 count 1 00010000:00010000:0.0:1721880422.375324:0:16088:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727c728 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.375324:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c721 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfca1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.375328:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c721 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfca1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.375331:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727c74b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfca5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.375332:0:16088:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727c728 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfc9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.375332:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b61c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.375333:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c721 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfca1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.375337:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c721 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfca1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.375338:0:16088:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727c728 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfc9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.375338:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007c9933c0/0x8a60d30f571dfd13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfca5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126217 expref: 954 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.375342:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c721 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfca1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.375345:0:16088:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727c728 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.375346:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c721 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfca1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.375346:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.375347:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.375348:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727c74b lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfca5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.375351:0:16088:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325fa80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.375354:0:16088:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727c728 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfc9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.375358:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007c9933c0/0x8a60d30f571dfd13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfca5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126217 expref: 954 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.375363:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007c9933c0/0x8a60d30f571dfd13 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfca5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126217 expref: 954 pid: 15487 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.375369:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880134e96a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011779200:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.375383:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.375401:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880134e97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2302:3687:x1805522011778560:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1198us (1222us total) trans 4296020361 rc 0/0 00000100:00100000:3.0:1721880422.375406:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632395 00000004:00080000:2.0:1721880422.375412:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880134e96680/2, rc 0, transno 1053065 00010000:00010000:0.0:1721880422.375414:0:16088:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727c728 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfc9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.375416:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880134e96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011778560:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.375424:0:16088:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727c728 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfc9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.375426:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099fe58c0/0x8a60d30f571df517 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfca0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126088 expref: 954 pid: 16131 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.375430:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727c728 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfc9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.375433:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2301:3688:x1805522011777792:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1510us (1582us total) trans 4296020362 rc 0/0 00000100:00100000:3.0:1721880422.375435:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008c4e7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011778048:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.375437:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632390 00000004:00080000:2.0:1721880422.375440:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122fd0e00/2, rc 0, transno 1053066 00000100:00100000:2.0:1721880422.375443:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122fd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011777792:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.375446:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1721880422.375446:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c72f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfca0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.375451:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c72f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfca0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.375458:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007ca4ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011778816:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.375461:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c72f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfca0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.375468:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c73d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfca3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.375468:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880134e97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011779328:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.375468:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c72f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfca0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.375474:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c72f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfca0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.375480:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c72f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfca0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.375484:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.375486:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8000 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.375489:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c72f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfca0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.375496:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c72f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfca0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.375499:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.375500:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1721880422.375504:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880134e97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011779456:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.375505:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c72f lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfca0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.375510:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727c72f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfca0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.375513:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257750528 00000100:00100000:1.0:1721880422.375515:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257750528 00000100:00100000:2.0:1721880422.375515:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.375520:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2301:3687:x1805522011777536:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1575us (1640us total) trans 4296020363 rc 0/0 00010000:00010000:1.0:1721880422.375523:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011f83c000/0x8a60d30f571df9e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfca3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126184 expref: 954 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.375525:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632391 00000004:00080000:2.0:1721880422.375527:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122fd2300/2, rc 0, transno 1053067 00000100:00100000:2.0:1721880422.375531:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011777536:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.375534:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914588 00000100:00100000:0.0:1721880422.375536:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011779328 00000100:00100000:1.0:1721880422.375537:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b0f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+954:2005:x1805522257750528:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.375539:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011779328 00010000:00010000:1.0:1721880422.375542:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.375544:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011f83c000/0x8a60d30f571df9e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfca3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126184 expref: 954 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.375546:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011779456 00000100:00100000:2.0:1721880422.375548:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011779456 00000100:00100000:0.0:1721880422.375550:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632397 00010000:00010000:1.0:1721880422.375550:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011f83c000/0x8a60d30f571df9e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfca3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126184 expref: 954 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.375553:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134e94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2303:3688:x1805522011779328:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.375558:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011f83c000/0x8a60d30f571df9e7 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfca3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126184 expref: 954 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.375559:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632398 00002000:00080000:0.0:1721880422.375561:0:16088:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64678 count 1 00000100:00100000:2.0:1721880422.375562:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d33d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2303:3687:x1805522011779456:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.375566:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.375567:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00002000:00080000:2.0:1721880422.375569:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64679 count 1 00010000:00010000:0.0:1721880422.375570:0:16088:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c752 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfca6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.375570:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c73d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfca3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.375576:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c73d lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfca3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.375577:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727c759 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfca7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.375578:0:16088:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa1d680/0x8a60d30f571dfeda lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfca6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12626b expref: 953 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.375585:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.375585:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a1cfc0/0x8a60d30f571e0077 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfca7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1262bf expref: 953 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.375586:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.375589:0:16088:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c752 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfca6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.375589:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.375590:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.375592:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.375592:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727c759 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfca7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.375593:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880091282050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2303:3686:x1805522011777664:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1627us (1695us total) trans 4296020364 rc 0/0 00000100:00100000:3.0:1721880422.375599:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632392 00010000:00010000:2.0:1721880422.375601:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095a1cfc0/0x8a60d30f571e0077 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfca7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1262bf expref: 953 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.375605:0:16088:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fa1d680/0x8a60d30f571dfeda lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfca6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12626b expref: 953 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.375606:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095a1cfc0/0x8a60d30f571e0077 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfca7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1262bf expref: 953 pid: 15452 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.375611:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b0f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+953:2005:x1805522257750528:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 72us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.375612:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d33df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011779712:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.375614:0:16088:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fa1d680/0x8a60d30f571dfeda lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfca6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12626b expref: 953 pid: 16089 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.375617:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914588 00000100:00100000:0.0:1721880422.375624:0:16088:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122fd2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011779840:192.168.201.24@tcp:104: 00000004:00080000:3.0:1721880422.375629:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122fd1500/2, rc 0, transno 1053068 00000100:00100000:2.0:1721880422.375630:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde600 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.375637:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c73d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfca3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.375637:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122fd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011777664:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.375639:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d33ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011779584:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.375641:0:16088:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e840 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.375642:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c73d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfca3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.375649:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c73d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfca3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.375651:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.375655:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c73d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfca3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.375662:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c73d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfca3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.375667:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4000 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.375668:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a533e1c0/0x8a60d30f571df835 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfca2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126129 expref: 952 pid: 16108 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.375670:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c73d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfca3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.375672:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099491500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011779968:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.375676:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c73d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfca3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.375680:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122fd0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011778688:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.375681:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011779584 00000100:00100000:2.0:1721880422.375682:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.375685:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011779584 00010000:00010000:1.0:1721880422.375689:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c73d lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfca3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.375691:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c736 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfca2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.375696:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c73d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfca3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.375698:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c736 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfca2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.375703:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c736 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfca2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.375703:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011779968 00000100:00100000:3.0:1721880422.375705:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011779968 00000100:00100000:2.0:1721880422.375707:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632399 00010000:00010000:0.0:1721880422.375708:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c736 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfca2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.375710:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2304:3687:x1805522011779584:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.375711:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c736 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfca2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.375716:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c736 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfca2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.375716:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632400 00002000:00080000:2.0:1721880422.375719:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64680 count 1 00010000:00010000:0.0:1721880422.375720:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325e640 already unused, calling callback (ffffffffa084e330) 00000100:00100000:3.0:1721880422.375720:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2304:3688:x1805522011779968:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.375721:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c736 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfca2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.375725:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c736 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfca2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.375742:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727c760 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfca8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.375748:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c736 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfca2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.375750:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099930480/0x8a60d30f571e023e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfca8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12630c expref: 951 pid: 16076 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.375752:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c736 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfca2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.375752:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64681 count 1 00010000:00010000:2.0:1721880422.375754:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.375755:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.375757:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727c760 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfca8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.375762:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727c767 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfca9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.375766:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099930480/0x8a60d30f571e023e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfca8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12630c expref: 951 pid: 16076 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.375771:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099930480/0x8a60d30f571e023e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfca8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12630c expref: 951 pid: 16076 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.375771:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800970ded00/0x8a60d30f571e0604 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfca9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126367 expref: 951 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.375777:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd14e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011780096:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.375782:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.375783:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.375785:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727c767 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfca9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.375787:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.375802:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2306:3686:x1805522011778432:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1603us (1645us total) trans 4296020365 rc 0/0 00010000:00010000:3.0:1721880422.375802:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800970ded00/0x8a60d30f571e0604 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfca9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126367 expref: 951 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.375807:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632394 00010000:00010000:3.0:1721880422.375811:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800970ded00/0x8a60d30f571e0604 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfca9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126367 expref: 951 pid: 16075 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.375825:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099490a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011780224:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.375842:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec900 going to sleep for 11 seconds 00000004:00080000:2.0:1721880422.375849:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009299d880/2, rc 0, transno 1053070 00000100:00100000:0.0:1721880422.375854:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ea4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2305:3689:x1805522011778304:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1691us (1723us total) trans 4296020366 rc 0/0 00000100:00100000:2.0:1721880422.375854:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009299d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011778304:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.375860:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632393 00000004:00080000:3.0:1721880422.375866:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e3dc000/2, rc 0, transno 1053069 00000100:00100000:3.0:1721880422.375871:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e3dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011778432:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.375878:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1721880422.375882:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011780480:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.375883:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011780352:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.375899:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.375914:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.375937:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011780352 00000100:00100000:3.0:1721880422.375940:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011780352 00000100:00100000:3.0:1721880422.375956:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011780480 00000100:00100000:3.0:1721880422.375958:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011780480 00000100:00100000:1.0:1721880422.375964:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632401 00000100:00100000:1.0:1721880422.375969:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2307:3688:x1805522011780352:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.375972:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d278700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2307:3689:x1805522011777024:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2384us (2417us total) trans 4296020367 rc 0/0 00000004:00080000:2.0:1721880422.375973:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d27b800/2, rc 0, transno 1053071 00000100:00100000:3.0:1721880422.375974:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632402 00000100:00100000:2.0:1721880422.375978:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d27b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011777024:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.375979:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632388 00000100:00100000:3.0:1721880422.375979:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2307:3686:x1805522011780480:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.375981:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64682 count 1 00002000:00080000:3.0:1721880422.375990:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64683 count 1 00010000:00010000:1.0:1721880422.375991:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c76e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcaa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.375998:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011780608:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.376000:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c775 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcab:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.376001:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8e2640/0x8a60d30f571e08c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcaa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1263bb expref: 951 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.376007:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.376008:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.376009:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.376025:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c76e lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcaa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.376025:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a880240/0x8a60d30f571e0a80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126408 expref: 951 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.376031:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.376032:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.376035:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c775 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.376040:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011780608 00010000:00010000:1.0:1721880422.376042:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d8e2640/0x8a60d30f571e08c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcaa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1263bb expref: 951 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.376042:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011780608 00010000:00010000:3.0:1721880422.376051:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a880240/0x8a60d30f571e0a80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126408 expref: 951 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.376053:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632403 00010000:00010000:1.0:1721880422.376055:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d8e2640/0x8a60d30f571e08c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcaa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1263bb expref: 951 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.376056:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2307:3687:x1805522011780608:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.376060:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a880240/0x8a60d30f571e0a80 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126408 expref: 951 pid: 16111 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.376064:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca4ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011780736:192.168.201.24@tcp:104: 00002000:00080000:2.0:1721880422.376064:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64684 count 1 00000100:00100000:3.0:1721880422.376070:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099492a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011780864:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.376071:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727c77c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcac:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.376079:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009428cb40/0x8a60d30f571e0c5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12644e expref: 951 pid: 16074 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.376083:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.376084:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1721880422.376085:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb000 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.376086:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727c77c lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.376090:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec540 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.376096:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009428cb40/0x8a60d30f571e0c5c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12644e expref: 951 pid: 16074 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.376101:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009428cb40/0x8a60d30f571e0c5c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12644e expref: 951 pid: 16074 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.376111:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd17800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011780992:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.376125:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdee40 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.376759:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880134e96a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011779200:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.376772:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727c74b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfca5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.376844:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d33df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011779712:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.376863:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727c759 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfca7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.376875:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.376881:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fd14e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011780096:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.376890:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.376896:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257750784 00010000:00010000:2.0:1721880422.376897:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727c760 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfca8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.376900:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257750784 00000100:00100000:0.0:1721880422.376902:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257751040 00000100:00100000:0.0:1721880422.376905:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257751040 00010000:00010000:0.0:1721880422.376916:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa1d680/0x8a60d30f571dfeda lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfca6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12626b expref: 953 pid: 16089 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.376917:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007c9933c0/0x8a60d30f571dfd13 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfca5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126217 expref: 953 pid: 15487 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.376935:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914589 00000100:00100000:1.0:1721880422.376939:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+953:2005:x1805522257750784:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.376945:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.376948:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007c9933c0/0x8a60d30f571dfd13 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfca5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126217 expref: 953 pid: 15487 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.376955:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007c9933c0/0x8a60d30f571dfd13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfca5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126217 expref: 953 pid: 15487 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.376964:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007c9933c0/0x8a60d30f571dfd13 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfca5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126217 expref: 953 pid: 15487 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.376971:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.376972:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.376975:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727c74b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfca5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.376979:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727c74b lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfca5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.376997:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914590 00010000:00010000:1.0:1721880422.377001:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.377004:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+952:2005:x1805522257751040:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.377025:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.377030:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fa1d680/0x8a60d30f571dfeda lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfca6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12626b expref: 952 pid: 16089 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.377032:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727c74b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfca5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.377035:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+952:2005:x1805522257750784:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 94us (161us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.377038:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fa1d680/0x8a60d30f571dfeda lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfca6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12626b expref: 952 pid: 16089 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.377040:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914589 00010000:00010000:3.0:1721880422.377040:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727c74b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfca5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.377047:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.377047:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727c74b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfca5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.377048:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.377050:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c752 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfca6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.377053:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727c74b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfca5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.377055:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c752 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfca6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.377059:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727c74b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfca5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.377062:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.377064:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136351f80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.377068:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fa1d680/0x8a60d30f571dfeda lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfca6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12626b expref: 951 pid: 16089 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.377068:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727c74b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfca5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.377074:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727c74b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfca5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.377076:0:16088:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122fd2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011779840:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.377077:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+950:2005:x1805522257751040:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 74us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.377081:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914590 00010000:00010000:3.0:1721880422.377083:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727c74b lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfca5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.377087:0:16088:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c752 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfca6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.377089:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727c74b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfca5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.377092:0:16088:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c752 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfca6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.377095:0:16088:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c752 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfca6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.377099:0:16088:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c752 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfca6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.377103:0:16088:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c752 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfca6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.377104:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.377107:0:16088:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c752 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfca6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.377111:0:16088:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325dd40 already unused, calling callback (ffffffffa084e330) 00000100:00100000:0.0:1721880422.377113:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257750912 00010000:00010000:1.0:1721880422.377113:0:16088:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c752 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfca6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.377116:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257750912 00010000:00010000:1.0:1721880422.377116:0:16088:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c752 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfca6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.377122:0:16088:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c752 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfca6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.377123:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095a1cfc0/0x8a60d30f571e0077 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfca7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1262bf expref: 950 pid: 15452 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.377126:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c752 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfca6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.377141:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914591 00000100:00100000:0.0:1721880422.377144:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+950:2005:x1805522257750912:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.377149:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.377151:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095a1cfc0/0x8a60d30f571e0077 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfca7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1262bf expref: 950 pid: 15452 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.377157:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095a1cfc0/0x8a60d30f571e0077 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfca7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1262bf expref: 950 pid: 15452 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.377164:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a1cfc0/0x8a60d30f571e0077 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfca7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1262bf expref: 950 pid: 15452 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.377171:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.377172:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.377173:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727c759 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfca7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.377178:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727c759 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfca7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.377193:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.377207:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+949:2005:x1805522257750912:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 62us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.377209:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.377209:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727c759 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfca7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.377211:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914591 00010000:00010000:2.0:1721880422.377214:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727c759 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfca7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.377219:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257751168 00010000:00010000:2.0:1721880422.377219:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727c759 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfca7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.377221:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257751168 00010000:00010000:2.0:1721880422.377223:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727c759 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfca7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.377227:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099930480/0x8a60d30f571e023e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfca8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12630c expref: 949 pid: 16076 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.377228:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727c759 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfca7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.377238:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136351440 already unused, calling callback (ffffffffa084e330) 00000100:00100000:3.0:1721880422.377239:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880134e95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2309:3688:x1805522011779072:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1922us (1956us total) trans 4296020368 rc 0/0 00010000:00010000:2.0:1721880422.377242:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727c759 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfca7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.377243:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914592 00000100:00100000:0.0:1721880422.377246:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123b93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+949:2005:x1805522257751168:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.377246:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632396 00010000:00010000:2.0:1721880422.377248:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727c759 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfca7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.377250:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.377252:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099930480/0x8a60d30f571e023e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfca8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12630c expref: 949 pid: 16076 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.377258:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099930480/0x8a60d30f571e023e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfca8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12630c expref: 949 pid: 16076 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.377258:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727c759 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfca7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.377264:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099930480/0x8a60d30f571e023e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfca8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12630c expref: 949 pid: 16076 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.377265:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727c759 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfca7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.377270:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.377271:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.377273:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727c760 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfca8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.377275:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880134e94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2308:3688:x1805522011779328:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1721us (1790us total) trans 4296020369 rc 0/0 00010000:00010000:0.0:1721880422.377277:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727c760 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfca8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.377279:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632397 00010000:00010000:0.0:1721880422.377285:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.377293:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727c760 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfca8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.377297:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880123b93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+948:2005:x1805522257751168:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 51us (89us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.377298:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727c760 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfca8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.377301:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914592 00010000:00010000:3.0:1721880422.377302:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727c760 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfca8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.377306:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727c760 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfca8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.377310:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727c760 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfca8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.377313:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136351b00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.377315:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727c760 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfca8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.377319:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727c760 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfca8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.377321:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007ca4ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011780736:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.377325:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727c760 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfca8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.377329:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727c760 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfca8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.377331:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c76e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcaa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.377383:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d33d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2309:3687:x1805522011779456:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1818us (1864us total) trans 4296020370 rc 0/0 00000100:00100000:1.0:1721880422.377390:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.377390:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632398 00000100:00100000:0.0:1721880422.377403:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257751296 00000100:00100000:1.0:1721880422.377405:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.377406:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257751296 00000100:00100000:3.0:1721880422.377410:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2308:3687:x1805522011779584:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1699us (1758us total) trans 4296020371 rc 0/0 00000100:00100000:1.0:1721880422.377413:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257751424 00000100:00100000:3.0:1721880422.377414:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632399 00010000:00010000:0.0:1721880422.377415:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800970ded00/0x8a60d30f571e0604 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfca9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126367 expref: 948 pid: 16075 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.377415:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257751424 00000004:00080000:2.0:1721880422.377421:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880134e97b80/2, rc 0, transno 1053073 00010000:00010000:1.0:1721880422.377424:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8e2640/0x8a60d30f571e08c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcaa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1263bb expref: 949 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.377426:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914593 00000100:00100000:2.0:1721880422.377428:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880134e97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011779328:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.377429:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123b92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+949:2005:x1805522257751296:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.377434:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.377436:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914594 00010000:00010000:0.0:1721880422.377437:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800970ded00/0x8a60d30f571e0604 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfca9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126367 expref: 949 pid: 16075 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.377439:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8065c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+949:2004:x1805522257751424:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.377440:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099492a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011780864:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.377443:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800970ded00/0x8a60d30f571e0604 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfca9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126367 expref: 949 pid: 16075 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.377445:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.377448:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d8e2640/0x8a60d30f571e08c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcaa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1263bb expref: 949 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.377451:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.377451:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c775 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.377452:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.377453:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727c767 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfca9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.377454:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d8e2640/0x8a60d30f571e08c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcaa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1263bb expref: 949 pid: 16130 timeout: 887 lvb_type: 0 00000004:00080000:2.0:1721880422.377456:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880134e95c00/2, rc 0, transno 1053072 00010000:00010000:0.0:1721880422.377457:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727c767 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfca9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.377461:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880134e95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011779072:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.377462:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8e2640/0x8a60d30f571e08c0 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcaa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1263bb expref: 949 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.377464:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800970ded00/0x8a60d30f571e0604 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfca9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126367 expref: 949 pid: 16075 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.377465:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.377468:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.377469:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.377471:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c76e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcaa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.377471:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099490a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011780224:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.377475:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c76e lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcaa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.377477:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727c767 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfca9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.377479:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011781120:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.377482:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727c767 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfca9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.377484:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.377485:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727c767 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfca9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.377486:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880123b92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+947:2005:x1805522257751296:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 54us (95us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.377489:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727c767 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfca9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.377493:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727c767 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfca9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.377494:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914593 00000100:00100000:1.0:1721880422.377496:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8065c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+947:2004:x1805522257751424:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 56us (89us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.377496:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727c767 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfca9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.377500:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa9440 already unused, calling callback (ffffffffa084e330) 00000100:00100000:1.0:1721880422.377501:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914594 00010000:00010000:3.0:1721880422.377501:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727c767 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfca9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.377505:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727c767 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfca9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.377507:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.377510:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727c767 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfca9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.377514:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727c767 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfca9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.377528:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1721880422.377530:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.377532:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011781248:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.377549:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257751552 00000100:00100000:1.0:1721880422.377551:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257751552 00000100:00100000:2.0:1721880422.377551:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.377562:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a880240/0x8a60d30f571e0a80 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126408 expref: 946 pid: 16111 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.377573:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914595 00000100:00100000:1.0:1721880422.377576:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+946:2005:x1805522257751552:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.377576:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fd17800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011780992:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.377580:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.377582:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a880240/0x8a60d30f571e0a80 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126408 expref: 946 pid: 16111 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.377586:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.377587:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a880240/0x8a60d30f571e0a80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126408 expref: 946 pid: 16111 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.377590:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727c77c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.377593:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2308:3688:x1805522011779968:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1872us (1909us total) trans 4296020372 rc 0/0 00010000:00010000:1.0:1721880422.377594:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a880240/0x8a60d30f571e0a80 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126408 expref: 946 pid: 16111 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.377597:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257751680 00000100:00100000:3.0:1721880422.377597:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632400 00000100:00100000:0.0:1721880422.377600:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257751680 00010000:00010000:1.0:1721880422.377601:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.377602:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.377603:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c775 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.377607:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011781120 00010000:00010000:1.0:1721880422.377608:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c775 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.377609:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009428cb40/0x8a60d30f571e0c5c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12644e expref: 946 pid: 16074 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.377609:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011781120 00000004:00080000:2.0:1721880422.377614:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009d33ca80/2, rc 0, transno 1053075 00010000:00010000:1.0:1721880422.377616:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.377618:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011781248 00000100:00100000:3.0:1721880422.377619:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011781248 00000100:00100000:0.0:1721880422.377621:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914596 00000100:00100000:2.0:1721880422.377621:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d33ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011779584:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.377623:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+946:2004:x1805522257751680:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.377626:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632404 00010000:00010000:0.0:1721880422.377628:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.377629:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+946:2005:x1805522257751552:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 52us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.377629:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fd15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2309:3688:x1805522011781120:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.377631:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009428cb40/0x8a60d30f571e0c5c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12644e expref: 946 pid: 16074 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.377633:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914595 00010000:00010000:0.0:1721880422.377637:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009428cb40/0x8a60d30f571e0c5c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12644e expref: 946 pid: 16074 timeout: 887 lvb_type: 0 00002000:00080000:3.0:1721880422.377638:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64685 count 1 00000004:00080000:2.0:1721880422.377641:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880134e97480/2, rc 0, transno 1053074 00000100:00100000:2.0:1721880422.377644:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880134e97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011779456:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.377645:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009428cb40/0x8a60d30f571e0c5c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12644e expref: 945 pid: 16074 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.377646:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c76e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.377647:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1721880422.377648:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207faf40/0x8a60d30f5727c783 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcad:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.377650:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c76e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.377652:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.377653:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.377654:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c76e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.377655:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727c77c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.377656:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b5ead00/0x8a60d30f571e0ea1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1264a2 expref: 944 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.377658:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c76e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.377658:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fd17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011781376:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.377659:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727c77c lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.377660:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.377661:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.377662:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c76e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.377663:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207faf40/0x8a60d30f5727c783 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.377665:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4240 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.377666:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c76e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.377667:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.377670:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c76e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.377673:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.377674:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b5ead00/0x8a60d30f571e0ea1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1264a2 expref: 944 pid: 15487 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.377675:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c76e lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.377680:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+944:2004:x1805522257751680:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 55us (94us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.377681:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b5ead00/0x8a60d30f571e0ea1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1264a2 expref: 944 pid: 15487 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.377682:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c76e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.377682:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008bdfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011781504:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.377687:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914596 00000100:00100000:2.0:1721880422.377691:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.377691:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099490a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011781632:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.377702:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011781376 00000100:00100000:2.0:1721880422.377705:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011781376 00000100:00100000:3.0:1721880422.377707:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec900 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.377714:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011781504 00000100:00100000:2.0:1721880422.377716:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011781504 00000100:00100000:2.0:1721880422.377724:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632405 00000100:00100000:2.0:1721880422.377743:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134e96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2312:3688:x1805522011781248:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.377752:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64686 count 1 00000004:00080000:3.0:1721880422.377758:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099491500/2, rc 0, transno 1053076 00000100:00100000:0.0:1721880422.377759:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632406 00000100:00100000:0.0:1721880422.377762:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800876e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2312:3687:x1805522011781376:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.377764:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099491500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011779968:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.377780:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c78a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcae:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.377788:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880084f89200/0x8a60d30f571e108b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1264ef expref: 943 pid: 15515 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.377791:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2312:3688:x1805522011780352:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1821us (1889us total) trans 4296020373 rc 0/0 00000100:00100000:1.0:1721880422.377795:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632401 00010000:00010000:2.0:1721880422.377796:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.377797:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.377799:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c78a lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.377808:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632407 00010000:00010000:2.0:1721880422.377810:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880084f89200/0x8a60d30f571e108b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1264ef expref: 943 pid: 15515 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.377811:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2311:3687:x1805522011781504:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.377816:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880084f89200/0x8a60d30f571e108b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1264ef expref: 943 pid: 15515 timeout: 887 lvb_type: 0 00002000:00080000:1.0:1721880422.377820:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64688 count 1 00000100:00100000:2.0:1721880422.377822:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009f1b4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011781888:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.377827:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c791 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcb0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.377834:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c210b40/0x8a60d30f571e15f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126597 expref: 943 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.377838:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.377839:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.377840:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdee40 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.377841:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c791 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.377851:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c210b40/0x8a60d30f571e15f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126597 expref: 943 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.377851:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727c77c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.377856:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c210b40/0x8a60d30f571e15f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126597 expref: 943 pid: 16098 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.377856:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727c77c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.377860:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727c77c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.377864:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727c77c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.377866:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880123b93480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011782016:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.377868:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727c77c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.377872:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352880 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.377875:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727c77c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.377879:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727c77c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.377881:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302ebf00 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.377884:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727c77c lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.377888:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727c77c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.377929:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008fd16300/2, rc 0, transno 1053077 00000100:00100000:3.0:1721880422.377933:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fd16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011780352:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.377948:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099492a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011781760:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.377964:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.377975:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011781760 00000100:00100000:3.0:1721880422.377977:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1721880422.377978:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011781760 00002000:00080000:0.0:1721880422.377979:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64687 count 1 00000100:00100000:2.0:1721880422.377979:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2312:3687:x1805522011780608:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1921us (1968us total) trans 4296020374 rc 0/0 00000100:00100000:3.0:1721880422.377980:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099490700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011782144:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.377984:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632403 00010000:00010000:0.0:1721880422.377987:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c798 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcaf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.377991:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.377992:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632408 00010000:00010000:0.0:1721880422.377996:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c04bcc0/0x8a60d30f571e131d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12654a expref: 943 pid: 16123 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.377996:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d33df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2312:3688:x1805522011781760:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.377997:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011782144 00000100:00100000:2.0:1721880422.377999:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011782144 00010000:00010000:0.0:1721880422.378000:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.378001:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.378003:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c798 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.378004:0:16088:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64689 count 1 00010000:00010000:3.0:1721880422.378009:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c775 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.378032:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632409 00010000:00010000:3.0:1721880422.378032:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c775 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.378035:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c4e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2313:3688:x1805522011782144:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.378039:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c775 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.378040:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c04bcc0/0x8a60d30f571e131d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12654a expref: 943 pid: 16123 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.378040:0:16088:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c79f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcb1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.378043:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64690 count 1 00010000:00010000:0.0:1721880422.378045:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c04bcc0/0x8a60d30f571e131d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12654a expref: 943 pid: 16123 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.378046:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c775 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.378048:0:16088:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d6346c0/0x8a60d30f571e18b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1265eb expref: 943 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.378051:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.378051:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727c7a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcb2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.378052:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.378052:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c775 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.378054:0:16088:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c79f lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.378056:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa9680 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.378058:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c775 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.378059:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c9ef840/0x8a60d30f571e1cee lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126638 expref: 943 pid: 16110 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.378062:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c775 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.378065:0:16088:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d6346c0/0x8a60d30f571e18b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1265eb expref: 943 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.378068:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c775 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.378069:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.378070:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.378071:0:16088:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d6346c0/0x8a60d30f571e18b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1265eb expref: 943 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.378072:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727c775 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.378073:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727c7a6 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.378076:0:16088:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880123b92d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011782400:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.378089:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c9ef840/0x8a60d30f571e1cee lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126638 expref: 943 pid: 16110 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.378093:0:16088:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb0c0 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.378098:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c9ef840/0x8a60d30f571e1cee lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126638 expref: 943 pid: 16110 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.378102:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122fd0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011782272:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.378108:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009f1b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011782528:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.378119:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.378125:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde0c0 going to sleep for 11 seconds 00000004:00080000:2.0:1721880422.378145:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008fd17b80/2, rc 0, transno 1053078 00000100:00100000:2.0:1721880422.378159:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fd17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011780608:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.378180:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800962ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011782656:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.378190:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2314:3686:x1805522011780480:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2211us (2276us total) trans 4296020375 rc 0/0 00000100:00100000:3.0:1721880422.378194:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632402 00000100:00100000:2.0:1721880422.378199:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.378207:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011782656 00000100:00100000:3.0:1721880422.378209:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011782656 00000004:00080000:2.0:1721880422.378216:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008fd14000/2, rc 0, transno 1053079 00000100:00100000:3.0:1721880422.378219:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632410 00000100:00100000:2.0:1721880422.378222:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fd14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011780480:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.378223:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2314:3686:x1805522011782656:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.378230:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64691 count 1 00010000:00010000:3.0:1721880422.378237:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207fbcc0/0x8a60d30f5727c7ad lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcb3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.378244:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1721880422.378244:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c24eac0/0x8a60d30f571e1fcd lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126693 expref: 943 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.378247:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e34c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011782784:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.378252:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.378253:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.378254:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207fbcc0/0x8a60d30f5727c7ad lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.378258:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.378265:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c24eac0/0x8a60d30f571e1fcd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126693 expref: 943 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.378270:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c24eac0/0x8a60d30f571e1fcd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126693 expref: 943 pid: 16089 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.378273:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011782784 00000100:00100000:3.0:1721880422.378276:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009745d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011782912:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.378278:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011782784 00000100:00100000:3.0:1721880422.378294:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec540 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.378297:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632411 00000100:00100000:2.0:1721880422.378298:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099490a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011781632:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.378302:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007b984000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2315:3686:x1805522011782784:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.378310:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801207faf40/0x8a60d30f5727c783 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1721880422.378314:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64692 count 1 00010000:00010000:0.0:1721880422.378325:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c7b4 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcb4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.378336:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ca08b40/0x8a60d30f571e214e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1266ee expref: 943 pid: 16112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.378343:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.378344:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.378346:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c7b4 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.378363:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ca08b40/0x8a60d30f571e214e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1266ee expref: 943 pid: 16112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.378373:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ca08b40/0x8a60d30f571e214e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1266ee expref: 943 pid: 16112 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.378486:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122fd1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011783040:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.378547:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009f1b4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011781888:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.378561:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c78a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.378562:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e540 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.378570:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.378582:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.378589:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257751808 00000100:00100000:1.0:1721880422.378593:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.378594:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257751808 00000100:00100000:0.0:1721880422.378601:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257752064 00000100:00100000:1.0:1721880422.378601:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257751936 00000100:00100000:1.0:1721880422.378603:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257751936 00000100:00100000:0.0:1721880422.378605:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257752064 00010000:00010000:2.0:1721880422.378605:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b5ead00/0x8a60d30f571e0ea1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1264a2 expref: 944 pid: 15487 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.378613:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880084f89200/0x8a60d30f571e108b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1264ef expref: 946 pid: 15515 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.378619:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c210b40/0x8a60d30f571e15f5 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfcb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126597 expref: 946 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.378629:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914597 00000100:00100000:2.0:1721880422.378633:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123b90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+946:2005:x1805522257751808:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.378634:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914598 00000100:00100000:1.0:1721880422.378637:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+946:2005:x1805522257751936:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.378642:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.378644:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880084f89200/0x8a60d30f571e108b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1264ef expref: 946 pid: 15515 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.378646:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.378650:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b5ead00/0x8a60d30f571e0ea1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1264a2 expref: 946 pid: 15487 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.378651:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880084f89200/0x8a60d30f571e108b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1264ef expref: 946 pid: 15515 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.378656:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b5ead00/0x8a60d30f571e0ea1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1264a2 expref: 946 pid: 15487 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.378657:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914599 00010000:00010000:1.0:1721880422.378658:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880084f89200/0x8a60d30f571e108b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1264ef expref: 946 pid: 15515 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.378663:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b0f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+945:2005:x1805522257752064:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.378665:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.378666:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.378666:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b5ead00/0x8a60d30f571e0ea1 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1264a2 expref: 945 pid: 15487 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.378668:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c78a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.378671:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.378672:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c78a lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.378675:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c210b40/0x8a60d30f571e15f5 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfcb0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126597 expref: 944 pid: 16098 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.378676:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.378677:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.378679:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801207faf40/0x8a60d30f5727c783 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.378682:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.378683:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c210b40/0x8a60d30f571e15f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcb0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126597 expref: 944 pid: 16098 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.378688:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207faf40/0x8a60d30f5727c783 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.378692:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.378693:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.378695:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c791 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcb0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.378696:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+944:2005:x1805522257751936:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 58us (102us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.378698:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.378700:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914598 00010000:00010000:3.0:1721880422.378700:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c791 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcb0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.378709:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.378713:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880123b90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+943:2005:x1805522257751808:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 79us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.378717:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914597 00010000:00010000:1.0:1721880422.378719:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c210b40/0x8a60d30f571e15f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126597 expref: 943 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.378742:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880123b93480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011782016:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.378743:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b0f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+941:2005:x1805522257752064:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 63us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.378748:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914599 00010000:00010000:2.0:1721880422.378749:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c78a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.378752:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c791 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.378754:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c78a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.378759:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c78a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.378760:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c791 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.378763:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c78a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.378765:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c791 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.378767:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c78a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.378770:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350fc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.378772:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c791 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.378772:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c78a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.378777:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c791 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.378779:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c78a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.378783:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c791 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.378785:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c78a lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.378788:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c78a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.378794:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4d80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.378797:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c791 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.378804:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.378804:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c791 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.378813:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c791 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.378815:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257752192 00000100:00100000:3.0:1721880422.378817:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257752192 00010000:00010000:1.0:1721880422.378819:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c791 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.378826:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c04bcc0/0x8a60d30f571e131d lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfcaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12654a expref: 941 pid: 16123 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.378837:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914600 00000100:00100000:3.0:1721880422.378840:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+941:2004:x1805522257752192:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.378841:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.378854:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257752320 00010000:00010000:3.0:1721880422.378854:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.378857:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257752320 00010000:00010000:3.0:1721880422.378857:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c04bcc0/0x8a60d30f571e131d lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfcaf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12654a expref: 941 pid: 16123 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.378863:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c04bcc0/0x8a60d30f571e131d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcaf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12654a expref: 942 pid: 16123 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.378866:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d6346c0/0x8a60d30f571e18b1 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfcb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1265eb expref: 942 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.378870:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.378871:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.378873:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c798 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcaf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.378879:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914601 00010000:00010000:3.0:1721880422.378880:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c798 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcaf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.378882:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8066050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+942:2005:x1805522257752320:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.378886:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.378887:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.378887:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.378890:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d6346c0/0x8a60d30f571e18b1 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfcb1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1265eb expref: 942 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.378896:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257752448 00010000:00010000:2.0:1721880422.378896:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d6346c0/0x8a60d30f571e18b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcb1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1265eb expref: 942 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.378903:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.378904:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.378905:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+942:2004:x1805522257752192:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 64us (102us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.378906:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c79f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcb1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.378909:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914600 00010000:00010000:2.0:1721880422.378911:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c79f lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcb1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.378912:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2317:3687:x1805522011781504:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1100us (1219us total) trans 4296020377 rc 0/0 00000100:00100000:1.0:1721880422.378917:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632407 00010000:00010000:2.0:1721880422.378918:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.378932:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8066050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+941:2005:x1805522257752320:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 49us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.378934:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257752448 00000100:00100000:2.0:1721880422.378935:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914601 00000004:00080000:1.0:1721880422.378940:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008bdfad80/2, rc 0, transno 1053081 00010000:00010000:0.0:1721880422.378945:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c9ef840/0x8a60d30f571e1cee lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfcb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126638 expref: 941 pid: 16110 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.378946:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008bdfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011781504:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.378960:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914602 00000100:00100000:0.0:1721880422.378962:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+941:2004:x1805522257752448:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.378968:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.378970:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c9ef840/0x8a60d30f571e1cee lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfcb2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126638 expref: 941 pid: 16110 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.378976:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c9ef840/0x8a60d30f571e1cee lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcb2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126638 expref: 941 pid: 16110 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.378981:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d6346c0/0x8a60d30f571e18b1 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1265eb expref: 941 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.378989:0:16088:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880123b92d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011782400:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.378999:0:16088:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c79f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.379007:0:16088:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c79f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.379007:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880134e96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2316:3688:x1805522011781248:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1279us (1455us total) trans 4296020376 rc 0/0 00010000:00010000:1.0:1721880422.379029:0:16088:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c79f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.379030:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632405 00010000:00010000:1.0:1721880422.379033:0:16088:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c79f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.379037:0:16088:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c79f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.379039:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.379040:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.379041:0:16088:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c79f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.379042:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727c7a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcb2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.379043:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1721880422.379044:0:16088:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b5440 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.379046:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727c7a6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcb2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.379046:0:16088:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c79f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.379049:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011783168:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.379050:0:16088:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c79f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.379054:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.379056:0:16088:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c79f lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.379056:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.379059:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c79f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.379065:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.379075:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+940:2004:x1805522257752448:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 110us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.379080:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257752704 00000100:00100000:0.0:1721880422.379082:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914602 00000100:00100000:2.0:1721880422.379083:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257752704 00010000:00010000:2.0:1721880422.379091:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c24eac0/0x8a60d30f571e1fcd lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfcb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126693 expref: 941 pid: 16089 timeout: 887 lvb_type: 0 00000004:00080000:3.0:1721880422.379126:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008fd15880/2, rc 0, transno 1053080 00000100:00100000:1.0:1721880422.379138:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d33df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2316:3688:x1805522011781760:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1140us (1171us total) trans 4296020378 rc 0/0 00000100:00100000:3.0:1721880422.379141:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fd15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011781248:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.379143:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632408 00000004:00080000:3.0:1721880422.379157:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099492a00/2, rc 0, transno 1053082 00000100:00100000:3.0:1721880422.379161:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099492a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011781760:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.379181:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914603 00000100:00100000:0.0:1721880422.379184:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009745c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+940:2004:x1805522257752704:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.379190:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.379190:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011783168 00000100:00100000:2.0:1721880422.379193:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011783168 00010000:00010000:0.0:1721880422.379194:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c24eac0/0x8a60d30f571e1fcd lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfcb3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126693 expref: 940 pid: 16089 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.379195:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009745d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011782912:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.379200:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c24eac0/0x8a60d30f571e1fcd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcb3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126693 expref: 940 pid: 16089 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.379208:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c24eac0/0x8a60d30f571e1fcd lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcb3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126693 expref: 940 pid: 16089 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.379210:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801207fbcc0/0x8a60d30f5727c7ad lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcb3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.379211:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880123b92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011783296:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.379212:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632412 00010000:00010000:0.0:1721880422.379215:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.379216:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.379216:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b0f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2316:3689:x1805522011783168:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.379218:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801207fbcc0/0x8a60d30f5727c7ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.379222:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207fbcc0/0x8a60d30f5727c7ad lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.379227:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64693 count 1 00000100:00100000:1.0:1721880422.379231:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.379233:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.379238:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c7bb lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcb5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.379253:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009745c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+939:2004:x1805522257752704:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 66us (196us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.379254:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099952d00/0x8a60d30f571e2289 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126742 expref: 939 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.379254:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.379258:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914603 00010000:00010000:2.0:1721880422.379261:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1721880422.379262:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011783296 00010000:00010000:2.0:1721880422.379262:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.379264:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c7bb lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.379265:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011783296 00000100:00100000:3.0:1721880422.379267:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257752576 00000100:00100000:3.0:1721880422.379269:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257752576 00000100:00100000:1.0:1721880422.379278:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632413 00010000:00010000:2.0:1721880422.379278:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099952d00/0x8a60d30f571e2289 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126742 expref: 939 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.379279:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ca08b40/0x8a60d30f571e214e lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfcb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1266ee expref: 939 pid: 16112 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.379281:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123b93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2317:3689:x1805522011783296:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.379285:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099952d00/0x8a60d30f571e2289 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126742 expref: 939 pid: 16028 timeout: 887 lvb_type: 0 00002000:00080000:1.0:1721880422.379289:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64694 count 1 00000100:00100000:2.0:1721880422.379292:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009f1b4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011783552:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.379293:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914604 00010000:00010000:1.0:1721880422.379297:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727c7c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcb6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.379297:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009745d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+939:2005:x1805522257752576:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.379298:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122fd1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011783040:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.379304:0:15473:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.379305:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a9db00/0x8a60d30f571e23a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1267a4 expref: 939 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.379307:0:15473:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ca08b40/0x8a60d30f571e214e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcb4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1266ee expref: 939 pid: 16112 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.379309:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde3c0 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.379310:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.379311:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.379312:0:15473:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ca08b40/0x8a60d30f571e214e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcb4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1266ee expref: 939 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.379313:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727c7c2 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.379321:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ca08b40/0x8a60d30f571e214e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcb4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1266ee expref: 939 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.379325:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c9ef840/0x8a60d30f571e1cee lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126638 expref: 938 pid: 16110 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.379327:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.379328:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.379330:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130a9db00/0x8a60d30f571e23a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1267a4 expref: 938 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.379330:0:15473:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c7b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.379334:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009f1b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011782528:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.379334:0:15473:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c7b4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.379339:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130a9db00/0x8a60d30f571e23a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1267a4 expref: 937 pid: 15466 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.379341:0:15473:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.379344:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727c7a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.379349:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727c7a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.379353:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d3bb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011783680:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.379353:0:15473:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009745d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+937:2005:x1805522257752576:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 56us (102us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.379357:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727c7a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.379357:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914604 00010000:00010000:2.0:1721880422.379362:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727c7a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.379365:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727c7a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.379366:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c7b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.379369:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727c7a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.379369:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801207fbcc0/0x8a60d30f5727c7ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.379372:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c7b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.379372:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb0c0 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.379372:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353600 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.379373:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207fbcc0/0x8a60d30f5727c7ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.379374:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727c7a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.379377:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c7b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.379378:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727c7a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.379381:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c7b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.379381:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207fbcc0/0x8a60d30f5727c7ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.379382:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1721880422.379383:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727c7a6 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.379385:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c7b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.379386:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801207fbcc0/0x8a60d30f5727c7ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.379387:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727c7a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.379388:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880123b90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011783424:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.379389:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c7b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.379389:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801207fbcc0/0x8a60d30f5727c7ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.379392:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325cd80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.379393:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801207fbcc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.379394:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c7b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.379395:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207fbcc0/0x8a60d30f5727c7ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.379398:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c7b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.379399:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207fbcc0/0x8a60d30f5727c7ad lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.379404:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c7b4 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.379404:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801207fbcc0/0x8a60d30f5727c7ad lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.379405:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.379407:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c7b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.379408:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801207fbcc0/0x8a60d30f5727c7ad lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.379423:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011783424 00000100:00100000:1.0:1721880422.379425:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011783424 00000100:00100000:1.0:1721880422.379439:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632414 00000100:00100000:1.0:1721880422.379444:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d3bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2319:3687:x1805522011783424:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.379467:0:16088:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64695 count 1 00010000:00010000:0.0:1721880422.379471:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c04bcc0/0x8a60d30f571e131d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12654a expref: 936 pid: 16123 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.379478:0:16088:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727c7c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcb7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.379480:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122fd0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011782272:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.379481:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c4e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2321:3688:x1805522011782144:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1445us (1489us total) trans 4296020379 rc 0/0 00000100:00100000:2.0:1721880422.379487:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632409 00010000:00010000:0.0:1721880422.379488:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c798 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.379488:0:16088:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009636a640/0x8a60d30f571e2537 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1267ff expref: 935 pid: 16037 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.379492:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c798 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.379494:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.379495:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.379496:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c798 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.379498:0:16088:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727c7c9 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.379500:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c798 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.379503:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2320:3686:x1805522011782656:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1279us (1302us total) trans 4296020380 rc 0/0 00010000:00010000:0.0:1721880422.379504:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c798 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.379507:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c798 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.379507:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632410 00000004:00080000:2.0:1721880422.379508:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800962ac380/2, rc 0, transno 1053084 00010000:00010000:0.0:1721880422.379510:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325e400 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.379512:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c798 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.379512:0:16088:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009636a640/0x8a60d30f571e2537 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1267ff expref: 935 pid: 16037 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.379516:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c798 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.379521:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800962ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011782656:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.379523:0:16088:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009636a640/0x8a60d30f571e2537 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1267ff expref: 935 pid: 16037 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.379525:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c798 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.379529:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099490700/2, rc 0, transno 1053083 00010000:00010000:0.0:1721880422.379530:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c798 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.379530:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801207faf40/0x8a60d30f5727c783 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.379532:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099490700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011782144:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.379534:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207faf40/0x8a60d30f5727c783 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.379536:0:16088:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d3bb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011783808:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.379539:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207faf40/0x8a60d30f5727c783 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.379542:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801207faf40/0x8a60d30f5727c783 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.379546:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801207faf40/0x8a60d30f5727c783 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.379549:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801207faf40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.379551:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207faf40/0x8a60d30f5727c783 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.379554:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207faf40/0x8a60d30f5727c783 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.379564:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801207faf40/0x8a60d30f5727c783 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.379569:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801207faf40/0x8a60d30f5727c783 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.379570:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1721880422.379575:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d3b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011784064:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.379593:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.379607:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011784064 00000100:00100000:3.0:1721880422.379609:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011784064 00000100:00100000:0.0:1721880422.379614:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800876e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2322:3687:x1805522011781376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1850us (1939us total) trans 4296020382 rc 0/0 00000100:00100000:1.0:1721880422.379615:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d3ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011783936:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.379618:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632406 00000100:00100000:3.0:1721880422.379622:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632415 00000100:00100000:3.0:1721880422.379625:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2321:3689:x1805522011784064:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.379628:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1721880422.379635:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64697 count 1 00010000:00010000:3.0:1721880422.379643:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f9b00/0x8a60d30f5727c7d0 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcb9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.379645:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008fd17800/2, rc 0, transno 1053086 00000100:00100000:1.0:1721880422.379648:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fd17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011781376:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.379651:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134c50480/0x8a60d30f571e2759 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1268a7 expref: 935 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.379655:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.379656:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.379658:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f9b00/0x8a60d30f5727c7d0 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.379659:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fd15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2321:3688:x1805522011781120:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2028us (2151us total) trans 4296020383 rc 0/0 00000100:00100000:2.0:1721880422.379664:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632404 00010000:00010000:3.0:1721880422.379668:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134c50480/0x8a60d30f571e2759 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1268a7 expref: 935 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.379672:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007b984000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2320:3686:x1805522011782784:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1370us (1412us total) trans 4296020381 rc 0/0 00010000:00010000:3.0:1721880422.379673:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134c50480/0x8a60d30f571e2759 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1268a7 expref: 935 pid: 15506 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.379674:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011783936 00000100:00100000:1.0:1721880422.379675:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011784192:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.379676:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632411 00000100:00100000:2.0:1721880422.379676:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011783936 00000100:00100000:3.0:1721880422.379680:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009745f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011784320:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.379685:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632416 00000100:00100000:0.0:1721880422.379688:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2320:3687:x1805522011783936:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.379695:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1721880422.379697:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64696 count 1 00000100:00100000:3.0:1721880422.379697:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec540 going to sleep for 11 seconds 00000004:00080000:2.0:1721880422.379701:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e34c700/2, rc 0, transno 1053085 00010000:00010000:0.0:1721880422.379704:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c7d7 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcb8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.379707:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e34c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011782784:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.379712:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099859b00/0x8a60d30f571e263a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12684c expref: 935 pid: 16039 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.379712:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008fd14e00/2, rc 0, transno 1053087 00000100:00100000:3.0:1721880422.379715:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fd14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011781120:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.379716:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.379717:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.379718:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c7d7 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.379724:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011784192 00000100:00100000:3.0:1721880422.379742:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011784192 00010000:00010000:0.0:1721880422.379749:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099859b00/0x8a60d30f571e263a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12684c expref: 935 pid: 16039 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.379751:0:16088:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302ebf00 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.379754:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632417 00010000:00010000:0.0:1721880422.379755:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099859b00/0x8a60d30f571e263a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12684c expref: 935 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.379757:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085853480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2321:3689:x1805522011784192:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.379762:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122fd0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011784576:192.168.201.24@tcp:104: 00002000:00080000:3.0:1721880422.379764:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64698 count 1 00000100:00100000:0.0:1721880422.379778:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.379778:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009f1b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011784448:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.379794:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.379810:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011784448 00000100:00100000:2.0:1721880422.379812:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011784448 00000100:00100000:2.0:1721880422.379822:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632418 00000100:00100000:2.0:1721880422.379824:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2322:3686:x1805522011784448:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.379833:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64699 count 1 00010000:00010000:3.0:1721880422.379836:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f8480/0x8a60d30f5727c7de lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcba:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.379840:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c7e5 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcbb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.379843:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801312e8900/0x8a60d30f571e288d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1268f4 expref: 935 pid: 16123 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.379846:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.379847:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.379848:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fbb58c0/0x8a60d30f571e296d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12694f expref: 935 pid: 16019 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.379849:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f8480/0x8a60d30f5727c7de lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.379853:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.379854:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.379855:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c7e5 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.379859:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801312e8900/0x8a60d30f571e288d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1268f4 expref: 935 pid: 16123 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.379865:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801312e8900/0x8a60d30f571e288d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1268f4 expref: 935 pid: 16123 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.379867:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fbb58c0/0x8a60d30f571e296d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12694f expref: 935 pid: 16019 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.379872:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009745df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011784832:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.379873:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fbb58c0/0x8a60d30f571e296d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12694f expref: 935 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.379879:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012c887480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011784960:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.379895:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.379895:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec840 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.379901:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099490a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011784704:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.379923:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.379938:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011784704 00000100:00100000:2.0:1721880422.379940:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011784704 00000100:00100000:2.0:1721880422.379954:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632419 00000100:00100000:2.0:1721880422.379958:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087be1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2323:3687:x1805522011784704:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.379968:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64700 count 1 00010000:00010000:2.0:1721880422.379978:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727c7ec lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcbc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.379988:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c94cb40/0x8a60d30f571e2c06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1269b1 expref: 935 pid: 9459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.379994:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.379996:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.379998:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727c7ec lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.380029:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c94cb40/0x8a60d30f571e2c06 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1269b1 expref: 935 pid: 9459 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.380044:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c94cb40/0x8a60d30f571e2c06 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1269b1 expref: 935 pid: 9459 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.380051:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012c887100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011785088:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.380069:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde000 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.380163:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009f1b4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011783552:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.380172:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c7bb lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.380290:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.380313:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d3bb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011783680:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.380321:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257752960 00000100:00100000:2.0:1721880422.380324:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257752960 00010000:00010000:1.0:1721880422.380330:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727c7c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.380334:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130a9db00/0x8a60d30f571e23a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcb6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1267a4 expref: 936 pid: 15466 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.380346:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914605 00000100:00100000:2.0:1721880422.380349:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+936:2004:x1805522257752960:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.380351:0:16088:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d3bb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011783808:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.380354:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.380357:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130a9db00/0x8a60d30f571e23a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcb6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1267a4 expref: 936 pid: 15466 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.380359:0:16088:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727c7c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.380363:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130a9db00/0x8a60d30f571e23a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcb6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1267a4 expref: 936 pid: 15466 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.380368:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009745f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011784320:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.380371:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130a9db00/0x8a60d30f571e23a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcb6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1267a4 expref: 936 pid: 15466 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.380378:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.380379:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.380381:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727c7c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.380384:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801207f9b00/0x8a60d30f5727c7d0 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.380386:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727c7c2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.380395:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.380402:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727c7c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.380409:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+935:2004:x1805522257752960:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 59us (121us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.380410:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727c7c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.380413:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914605 00000100:00100000:3.0:1721880422.380414:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009745df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011784832:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.380417:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727c7c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.380424:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727c7c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.380427:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801207f8480/0x8a60d30f5727c7de lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.380430:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012c887480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011784960:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.380431:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727c7c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.380437:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b7840 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.380438:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c7e5 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.380440:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727c7c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.380446:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727c7c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.380449:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122fd0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011784576:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.380456:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c7d7 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.380456:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727c7c2 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.380463:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727c7c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.380548:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.380557:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257752832 00000100:00100000:2.0:1721880422.380559:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257752832 00010000:00010000:2.0:1721880422.380565:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099952d00/0x8a60d30f571e2289 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126742 expref: 935 pid: 16028 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.380580:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914606 00000100:00100000:2.0:1721880422.380583:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+935:2004:x1805522257752832:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.380587:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.380590:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099952d00/0x8a60d30f571e2289 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcb5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126742 expref: 935 pid: 16028 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.380596:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099952d00/0x8a60d30f571e2289 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcb5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126742 expref: 935 pid: 16028 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.380599:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.380603:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099952d00/0x8a60d30f571e2289 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcb5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126742 expref: 935 pid: 16028 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.380608:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880123b93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2324:3689:x1805522011783296:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1325us (1375us total) trans 4296020384 rc 0/0 00010000:00010000:2.0:1721880422.380609:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.380610:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.380611:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c7bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.380612:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257753088 00000100:00100000:1.0:1721880422.380615:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632413 00010000:00010000:2.0:1721880422.380615:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c7bb lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.380615:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257753088 00000100:00100000:0.0:1721880422.380616:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.380623:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.380624:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257753216 00010000:00010000:3.0:1721880422.380625:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134c50480/0x8a60d30f571e2759 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1268a7 expref: 935 pid: 15506 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.380627:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257753216 00010000:00010000:0.0:1721880422.380637:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009636a640/0x8a60d30f571e2537 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1267ff expref: 936 pid: 16037 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.380637:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+936:2004:x1805522257752832:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 53us (90us total) trans 0 rc 0/0 00000004:00080000:1.0:1721880422.380640:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880123b92d80/2, rc 0, transno 1053088 00000100:00100000:3.0:1721880422.380640:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914607 00000100:00100000:2.0:1721880422.380644:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914606 00000100:00100000:3.0:1721880422.380645:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+936:2005:x1805522257753088:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.380648:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880123b92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011783296:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.380650:0:15473:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.380652:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914608 00010000:00010000:3.0:1721880422.380653:0:15473:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134c50480/0x8a60d30f571e2759 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcb9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1268a7 expref: 935 pid: 15506 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.380655:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ab4d4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+935:2004:x1805522257753216:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.380659:0:15473:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134c50480/0x8a60d30f571e2759 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcb9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1268a7 expref: 935 pid: 15506 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.380660:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.380663:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009636a640/0x8a60d30f571e2537 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcb7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1267ff expref: 935 pid: 16037 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.380666:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.380667:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134c50480/0x8a60d30f571e2759 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcb9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1268a7 expref: 935 pid: 15506 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.380669:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009636a640/0x8a60d30f571e2537 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcb7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1267ff expref: 935 pid: 16037 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.380673:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.380674:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1721880422.380675:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257753344 00000100:00100000:1.0:1721880422.380676:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d3bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011785216:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.380676:0:15473:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801207f9b00/0x8a60d30f5727c7d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.380677:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257753344 00010000:00010000:2.0:1721880422.380678:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009636a640/0x8a60d30f571e2537 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcb7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1267ff expref: 934 pid: 16037 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.380683:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099859b00/0x8a60d30f571e263a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12684c expref: 934 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.380684:0:15473:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f9b00/0x8a60d30f5727c7d0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.380685:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.380686:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.380688:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727c7c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.380692:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914609 00010000:00010000:2.0:1721880422.380693:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727c7c9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.380693:0:15473:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.380696:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+934:2005:x1805522257753344:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.380696:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.380701:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.380701:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.380704:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099859b00/0x8a60d30f571e263a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcb8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12684c expref: 934 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.380706:0:15473:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+934:2005:x1805522257753088:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 60us (107us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.380710:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099859b00/0x8a60d30f571e263a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcb8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12684c expref: 934 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.380710:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914607 00000100:00100000:2.0:1721880422.380711:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ab4d4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+934:2004:x1805522257753216:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 55us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.380715:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914608 00010000:00010000:0.0:1721880422.380718:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099859b00/0x8a60d30f571e263a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcb8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12684c expref: 933 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.380722:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011785216 00010000:00010000:0.0:1721880422.380741:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.380742:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1721880422.380743:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011785216 00010000:00010000:0.0:1721880422.380744:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c7d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.380749:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c7d7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.380755:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.380757:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.380757:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632420 00000100:00100000:1.0:1721880422.380761:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d3bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2324:3688:x1805522011785216:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.380761:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257753472 00000100:00100000:2.0:1721880422.380764:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257753472 00010000:00010000:3.0:1721880422.380765:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801207f9b00/0x8a60d30f5727c7d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.380770:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801312e8900/0x8a60d30f571e288d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1268f4 expref: 932 pid: 16123 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.380770:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207f9b00/0x8a60d30f5727c7d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.380771:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+932:2005:x1805522257753344:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 75us (104us total) trans 0 rc 0/0 00002000:00080000:1.0:1721880422.380772:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64701 count 1 00010000:00010000:3.0:1721880422.380774:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f9b00/0x8a60d30f5727c7d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.380775:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914609 00010000:00010000:3.0:1721880422.380778:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f9b00/0x8a60d30f5727c7d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.380781:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727c7f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcbd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.380783:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801207f9b00/0x8a60d30f5727c7d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.380784:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914610 00010000:00010000:3.0:1721880422.380787:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801207f9b00 already unused, calling callback (ffffffffa084e330) 00000100:00100000:0.0:1721880422.380788:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009745df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+931:2004:x1805522257753472:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.380788:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f9b00/0x8a60d30f5727c7d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.380792:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.380792:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013633e1c0/0x8a60d30f571e2d95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126a13 expref: 931 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.380792:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c7bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.380795:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801312e8900/0x8a60d30f571e288d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1268f4 expref: 931 pid: 16123 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.380795:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f9b00/0x8a60d30f5727c7d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.380797:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.380797:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c7bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.380799:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.380801:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801312e8900/0x8a60d30f571e288d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1268f4 expref: 931 pid: 16123 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.380801:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727c7f3 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.380801:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c7bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.380801:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801207f9b00/0x8a60d30f5727c7d0 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.380805:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801207f9b00/0x8a60d30f5727c7d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.380807:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c7bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.380809:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801312e8900/0x8a60d30f571e288d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1268f4 expref: 931 pid: 16123 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.380811:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c7bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.380814:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352640 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.380817:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013633e1c0/0x8a60d30f571e2d95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126a13 expref: 930 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.380817:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c7bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.380819:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.380820:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.380822:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801207f8480/0x8a60d30f5727c7de lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.380823:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c7bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.380826:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f8480/0x8a60d30f5727c7de lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.380826:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013633e1c0/0x8a60d30f571e2d95 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126a13 expref: 930 pid: 16017 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.380832:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c7bb lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.380834:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.380839:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c7bb lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.380840:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800887f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011785344:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.380842:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009745df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+930:2004:x1805522257753472:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 53us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.380845:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914610 00010000:00010000:0.0:1721880422.380857:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c7d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.380857:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302ebf00 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.380861:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c7d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.380866:0:16088:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727c7c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.380867:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c7d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.380870:0:16088:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727c7c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.380871:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c7d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.380875:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c7d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.380875:0:16088:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727c7c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.380878:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325d8c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.380878:0:16088:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727c7c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.380880:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c7d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.380882:0:16088:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727c7c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.380883:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c7d7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.380885:0:16088:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b6640 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.380887:0:16088:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727c7c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.380888:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c7d7 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.380891:0:16088:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727c7c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.380892:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727c7d7 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.380893:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2326:3689:x1805522011784064:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1267us (1299us total) trans 4296020385 rc 0/0 00010000:00010000:1.0:1721880422.380897:0:16088:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727c7c9 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.380898:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632415 00010000:00010000:1.0:1721880422.380901:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727c7c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.380911:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801207f8480/0x8a60d30f5727c7de lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.380916:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207f8480/0x8a60d30f5727c7de lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.380920:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f8480/0x8a60d30f5727c7de lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.380924:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f8480/0x8a60d30f5727c7de lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.380927:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801207f8480/0x8a60d30f5727c7de lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.380934:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801207f8480 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.380935:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f8480/0x8a60d30f5727c7de lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.380939:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f8480/0x8a60d30f5727c7de lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.380945:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801207f8480/0x8a60d30f5727c7de lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.380948:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801207f8480/0x8a60d30f5727c7de lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.380960:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b0f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2327:3689:x1805522011783168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1742us (1894us total) trans 4296020386 rc 0/0 00000100:00100000:2.0:1721880422.380967:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632412 00000004:00080000:1.0:1721880422.380968:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009d3b8700/2, rc 0, transno 1053089 00000100:00100000:1.0:1721880422.380973:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d3b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011784064:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.380995:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1721880422.381002:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800887f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011785472:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.381003:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2327:3687:x1805522011783936:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1312us (1372us total) trans 4296020387 rc 0/0 00000100:00100000:0.0:1721880422.381007:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632416 00000100:00100000:1.0:1721880422.381043:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1721880422.381047:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009d3ba300/2, rc 0, transno 1053091 00000100:00100000:0.0:1721880422.381054:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d3ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011783936:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.381060:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880085853480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2326:3689:x1805522011784192:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1300us (1363us total) trans 4296020389 rc 0/0 00000100:00100000:3.0:1721880422.381065:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632417 00000004:00080000:1.0:1721880422.381071:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007ca4ed80/2, rc 0, transno 1053090 00000100:00100000:3.0:1721880422.381073:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011785472 00000100:00100000:0.0:1721880422.381074:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1721880422.381075:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011785472 00000100:00100000:1.0:1721880422.381086:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007ca4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011783168:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.381087:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632421 00000100:00100000:3.0:1721880422.381089:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096c9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2326:3688:x1805522011785472:12345-0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1721880422.381097:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880085850000/2, rc 0, transno 1053093 00002000:00080000:3.0:1721880422.381098:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64702 count 1 00000100:00100000:0.0:1721880422.381100:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122fd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011785600:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.381105:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1721880422.381105:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f8fc0/0x8a60d30f5727c7fa lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcbe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.381108:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085850000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011784192:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.381111:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122fd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011785728:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.381113:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013633f180/0x8a60d30f571e2f6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126a60 expref: 929 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.381123:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.381124:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.381126:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f8fc0/0x8a60d30f5727c7fa lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.381130:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.381141:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013633f180/0x8a60d30f571e2f6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126a60 expref: 929 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.381147:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.381150:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013633f180/0x8a60d30f571e2f6a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126a60 expref: 929 pid: 16125 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.381159:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009745f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011785984:192.168.201.24@tcp:104: 00000004:00080000:2.0:1721880422.381164:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880123b90000/2, rc 0, transno 1053092 00000100:00100000:1.0:1721880422.381165:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d3bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2326:3687:x1805522011783424:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1720us (1759us total) trans 4296020388 rc 0/0 00000100:00100000:1.0:1721880422.381170:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632414 00000100:00100000:2.0:1721880422.381175:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880123b90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011783424:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.381180:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011785728 00000100:00100000:3.0:1721880422.381180:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec840 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.381183:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011785728 00000100:00100000:2.0:1721880422.381188:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012c887100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011785088:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.381191:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011785600 00000100:00100000:0.0:1721880422.381194:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011785600 00000100:00100000:1.0:1721880422.381196:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632422 00010000:00010000:2.0:1721880422.381197:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727c7ec lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.381200:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c887480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2327:3686:x1805522011785728:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.381211:0:16088:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64704 count 1 00000100:00100000:2.0:1721880422.381212:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632423 00000100:00100000:2.0:1721880422.381215:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2327:3687:x1805522011785600:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.381221:0:16088:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727c801 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcc0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.381225:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64703 count 1 00010000:00010000:1.0:1721880422.381230:0:16088:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096c43a80/0x8a60d30f571e3392 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126b24 expref: 929 pid: 16042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.381232:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727c808 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcbf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.381236:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.381237:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.381239:0:16088:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727c801 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.381239:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b2b6400/0x8a60d30f571e31af lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126ad0 expref: 929 pid: 16129 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.381243:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.381244:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.381246:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727c808 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.381256:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b2b6400/0x8a60d30f571e31af lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126ad0 expref: 929 pid: 16129 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.381257:0:16088:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096c43a80/0x8a60d30f571e3392 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126b24 expref: 929 pid: 16042 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.381262:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b2b6400/0x8a60d30f571e31af lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126ad0 expref: 929 pid: 16129 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.381265:0:16088:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096c43a80/0x8a60d30f571e3392 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126b24 expref: 929 pid: 16042 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.381269:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012c887100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011786368:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.381272:0:16088:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800887f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011786240:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.381277:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.381287:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde000 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.381289:0:16088:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.381294:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257753600 00000100:00100000:0.0:1721880422.381297:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257753600 00000100:00100000:1.0:1721880422.381301:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122fd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011785856:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.381309:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fbb58c0/0x8a60d30f571e296d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12694f expref: 930 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.381313:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.381325:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914611 00000100:00100000:1.0:1721880422.381326:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1721880422.381328:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011785856 00000100:00100000:0.0:1721880422.381329:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+930:2006:x1805522257753600:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.381329:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122fd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011786112:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.381330:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011785856 00000100:00100000:3.0:1721880422.381330:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.381335:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.381337:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.381338:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fbb58c0/0x8a60d30f571e296d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcbb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12694f expref: 930 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.381344:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011786112 00000100:00100000:2.0:1721880422.381345:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011786112 00010000:00010000:0.0:1721880422.381347:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fbb58c0/0x8a60d30f571e296d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcbb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12694f expref: 930 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.381347:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257753728 00000100:00100000:3.0:1721880422.381350:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257753728 00000100:00100000:2.0:1721880422.381355:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632424 00010000:00010000:0.0:1721880422.381358:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fbb58c0/0x8a60d30f571e296d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcbb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12694f expref: 931 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.381359:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632425 00000100:00100000:2.0:1721880422.381359:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800887f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2329:3688:x1805522011785856:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.381362:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c94cb40/0x8a60d30f571e2c06 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1269b1 expref: 931 pid: 9459 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.381363:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800887f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2329:3688:x1805522011786112:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.381366:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64705 count 1 00010000:00010000:0.0:1721880422.381368:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.381370:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.381372:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c7e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.381374:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c80f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcc1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.381378:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914612 00002000:00080000:1.0:1721880422.381380:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64706 count 1 00010000:00010000:2.0:1721880422.381381:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099ce9d40/0x8a60d30f571e3583 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126b86 expref: 930 pid: 16112 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.381381:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009745c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+930:2005:x1805522257753728:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.381383:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c7e5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.381385:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.381386:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.381387:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727c816 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcc2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.381387:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c80f lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.381387:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.381389:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c94cb40/0x8a60d30f571e2c06 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcbc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1269b1 expref: 930 pid: 9459 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.381394:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009417fa80/0x8a60d30f571e376d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126be1 expref: 930 pid: 15497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.381396:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.381398:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099ce9d40/0x8a60d30f571e3583 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126b86 expref: 930 pid: 16112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.381398:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c94cb40/0x8a60d30f571e2c06 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcbc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1269b1 expref: 930 pid: 9459 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.381399:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.381399:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.381401:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727c816 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.381403:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099ce9d40/0x8a60d30f571e3583 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126b86 expref: 930 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.381407:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c94cb40/0x8a60d30f571e2c06 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcbc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1269b1 expref: 930 pid: 9459 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.381410:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012c887800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011786496:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.381413:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+929:2006:x1805522257753600:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 83us (136us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.381413:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009417fa80/0x8a60d30f571e376d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126be1 expref: 929 pid: 15497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.381414:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.381415:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.381417:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727c7ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.381419:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009417fa80/0x8a60d30f571e376d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126be1 expref: 929 pid: 15497 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.381420:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914611 00010000:00010000:3.0:1721880422.381421:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727c7ec lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.381423:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.381425:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800887f4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011786624:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.381430:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.381431:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c7e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.381436:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c7e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.381439:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb3c0 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.381440:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c7e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.381442:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009745c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+928:2005:x1805522257753728:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 61us (115us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.381444:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c7e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.381446:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914612 00010000:00010000:2.0:1721880422.381447:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c7e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.381451:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352ac0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.381452:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c7e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.381456:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c7e5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.381460:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727c7ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.381462:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c7e5 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.381464:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727c7ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.381465:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c7e5 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.381469:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727c7ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.381486:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727c7ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.381495:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727c7ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.381501:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352400 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.381504:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727c7ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.381509:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727c7ec lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.381518:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727c7ec lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.381524:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727c7ec lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.381548:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2330:3686:x1805522011784448:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1722us (1753us total) trans 4296020390 rc 0/0 00000100:00100000:2.0:1721880422.381553:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632418 00000004:00080000:0.0:1721880422.381563:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009f1b7800/2, rc 0, transno 1053094 00000100:00100000:3.0:1721880422.381637:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087be1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2330:3687:x1805522011784704:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1677us (1711us total) trans 4296020391 rc 0/0 00000100:00100000:0.0:1721880422.381643:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009f1b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011784448:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.381643:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632419 00000100:00100000:0.0:1721880422.381655:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085814e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011786752:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1721880422.381655:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099490a80/2, rc 0, transno 1053095 00000100:00100000:2.0:1721880422.381663:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099490a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011784704:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.381677:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.381688:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085817100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011786880:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.381694:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011786752 00000100:00100000:3.0:1721880422.381697:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011786752 00000100:00100000:2.0:1721880422.381705:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.381716:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011786880 00000100:00100000:3.0:1721880422.381718:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011786880 00000100:00100000:0.0:1721880422.381745:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632426 00000100:00100000:3.0:1721880422.381750:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632427 00000100:00100000:0.0:1721880422.381751:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2331:3686:x1805522011786752:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.381754:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c886680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2331:3687:x1805522011786880:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.381764:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64708 count 1 00002000:00080000:0.0:1721880422.381765:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64707 count 1 00010000:00010000:3.0:1721880422.381771:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207fb180/0x8a60d30f5727c81d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcc4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.381776:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c824 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcc3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.381778:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800842f2f40/0x8a60d30f571e39ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126c82 expref: 927 pid: 15515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.381782:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.381783:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.381784:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207fb180/0x8a60d30f5727c81d lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.381786:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013633c480/0x8a60d30f571e38a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126c35 expref: 927 pid: 16131 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.381792:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.381794:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.381795:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800842f2f40/0x8a60d30f571e39ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126c82 expref: 927 pid: 15515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.381797:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c824 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.381800:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800842f2f40/0x8a60d30f571e39ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126c82 expref: 927 pid: 15515 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.381806:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009745f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011787008:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.381820:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013633c480/0x8a60d30f571e38a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126c35 expref: 927 pid: 16131 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.381824:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec540 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.381830:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013633c480/0x8a60d30f571e38a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126c35 expref: 927 pid: 16131 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.381840:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880091134380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011787136:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.381859:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.382264:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800887f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011785344:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.382279:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727c7f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.382286:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009745f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011785984:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.382296:0:16088:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800887f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011786240:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.382296:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801207f8fc0/0x8a60d30f5727c7fa lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.382304:0:16088:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727c801 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.382324:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012c887100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011786368:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.382338:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727c808 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.382353:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012c887800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011786496:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.382356:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.382365:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c80f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.382374:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257753984 00000100:00100000:2.0:1721880422.382377:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257753984 00000100:00100000:0.0:1721880422.382390:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.382391:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013633f180/0x8a60d30f571e2f6a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126a60 expref: 928 pid: 16125 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.382402:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257754240 00000100:00100000:3.0:1721880422.382404:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257754240 00000100:00100000:0.0:1721880422.382410:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.382414:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800887f4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011786624:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.382414:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096c43a80/0x8a60d30f571e3392 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126b24 expref: 929 pid: 16042 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.382416:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257753856 00000100:00100000:2.0:1721880422.382419:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257753856 00000100:00100000:0.0:1721880422.382421:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914613 00000100:00100000:0.0:1721880422.382425:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088aab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+930:2005:x1805522257753984:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.382430:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013633e1c0/0x8a60d30f571e2d95 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126a13 expref: 930 pid: 16017 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.382431:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.382431:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914614 00010000:00010000:1.0:1721880422.382434:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727c816 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.382435:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013633f180/0x8a60d30f571e2f6a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcbe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126a60 expref: 930 pid: 16125 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.382435:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094691f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+930:2005:x1805522257754240:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.382440:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.382442:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013633f180/0x8a60d30f571e2f6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcbe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126a60 expref: 930 pid: 16125 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.382443:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096c43a80/0x8a60d30f571e3392 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcc0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126b24 expref: 930 pid: 16042 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.382449:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096c43a80/0x8a60d30f571e3392 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcc0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126b24 expref: 930 pid: 16042 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.382450:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013633f180/0x8a60d30f571e2f6a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcbe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126a60 expref: 930 pid: 16125 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.382452:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914615 00000100:00100000:2.0:1721880422.382457:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8064850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+929:2005:x1805522257753856:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.382457:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096c43a80/0x8a60d30f571e3392 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcc0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126b24 expref: 929 pid: 16042 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.382464:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.382465:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.382465:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.382467:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727c801 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.382470:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013633e1c0/0x8a60d30f571e2d95 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcbd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126a13 expref: 928 pid: 16017 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.382471:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727c801 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.382483:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.382485:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013633e1c0/0x8a60d30f571e2d95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcbd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126a13 expref: 928 pid: 16017 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.382489:0:16088:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727c801 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.382494:0:16088:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727c801 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.382499:0:16088:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727c801 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.382499:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013633e1c0/0x8a60d30f571e2d95 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcbd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126a13 expref: 928 pid: 16017 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.382499:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094691f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+928:2005:x1805522257754240:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 63us (109us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.382500:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.382501:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.382503:0:16088:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727c801 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.382503:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914614 00010000:00010000:0.0:1721880422.382504:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801207f8fc0/0x8a60d30f5727c7fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.382506:0:16088:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727c801 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.382509:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f8fc0/0x8a60d30f5727c7fa lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.382510:0:16088:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b6400 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.382511:0:16088:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727c801 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.382511:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.382513:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.382515:0:16088:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727c801 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.382516:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727c7f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.382520:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.382522:0:16088:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727c801 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.382523:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727c7f3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.382526:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727c801 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.382527:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.382535:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088aab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+926:2005:x1805522257753984:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 109us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.382538:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257754112 00000100:00100000:0.0:1721880422.382540:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914613 00010000:00010000:2.0:1721880422.382540:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.382540:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257754112 00010000:00010000:3.0:1721880422.382547:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b2b6400/0x8a60d30f571e31af lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126ad0 expref: 926 pid: 16129 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.382557:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914616 00000100:00100000:2.0:1721880422.382560:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8064850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+926:2005:x1805522257753856:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 101us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.382562:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009745f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+926:2005:x1805522257754112:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.382566:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914615 00010000:00010000:3.0:1721880422.382566:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801207f8fc0/0x8a60d30f5727c7fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.382567:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.382570:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207f8fc0/0x8a60d30f5727c7fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.382571:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b2b6400/0x8a60d30f571e31af lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcbf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126ad0 expref: 926 pid: 16129 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.382574:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f8fc0/0x8a60d30f5727c7fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.382577:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b2b6400/0x8a60d30f571e31af lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcbf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126ad0 expref: 925 pid: 16129 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.382578:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f8fc0/0x8a60d30f5727c7fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.382582:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801207f8fc0/0x8a60d30f5727c7fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.382584:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b2b6400/0x8a60d30f571e31af lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcbf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126ad0 expref: 925 pid: 16129 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.382585:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801207f8fc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.382587:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f8fc0/0x8a60d30f5727c7fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.382591:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f8fc0/0x8a60d30f5727c7fa lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.382597:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801207f8fc0/0x8a60d30f5727c7fa lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.382601:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801207f8fc0/0x8a60d30f5727c7fa lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.382607:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.382608:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.382610:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727c808 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.382618:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727c808 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.382626:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.382632:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727c808 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.382633:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c887480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2332:3686:x1805522011785728:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1430us (1500us total) trans 4296020392 rc 0/0 00000100:00100000:0.0:1721880422.382636:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009745f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+924:2005:x1805522257754112:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 74us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.382641:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914616 00010000:00010000:2.0:1721880422.382641:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727c808 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.382642:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632422 00010000:00010000:2.0:1721880422.382649:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727c808 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.382661:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727c808 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.382663:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727c7f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.382665:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.382669:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727c808 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.382670:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727c7f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.382673:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257754368 00000100:00100000:0.0:1721880422.382675:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257754368 00010000:00010000:2.0:1721880422.382675:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801363521c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.382677:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727c7f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.382678:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727c808 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.382682:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099ce9d40/0x8a60d30f571e3583 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126b86 expref: 924 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.382684:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727c7f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.382685:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727c808 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.382685:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880096c9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2332:3688:x1805522011785472:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1594us (1642us total) trans 4296020393 rc 0/0 00010000:00010000:1.0:1721880422.382689:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727c7f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.382690:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632421 00000100:00100000:0.0:1721880422.382692:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914617 00010000:00010000:1.0:1721880422.382693:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b7a80 already unused, calling callback (ffffffffa084e330) 00000100:00100000:0.0:1721880422.382694:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094691f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+924:2005:x1805522257754368:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.382695:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727c7f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.382696:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727c808 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.382698:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.382698:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727c7f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.382700:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099ce9d40/0x8a60d30f571e3583 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcc1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126b86 expref: 924 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.382703:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727c808 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.382705:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727c7f3 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.382706:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099ce9d40/0x8a60d30f571e3583 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcc1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126b86 expref: 924 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.382709:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727c7f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.382713:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099ce9d40/0x8a60d30f571e3583 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcc1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126b86 expref: 924 pid: 16112 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.382723:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.382725:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.382743:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.382745:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c80f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.382750:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c80f lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.382759:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.382771:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094691f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+923:2005:x1805522257754368:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 76us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.382775:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914617 00000100:00100000:0.0:1721880422.382783:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257754496 00000100:00100000:0.0:1721880422.382785:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257754496 00010000:00010000:0.0:1721880422.382790:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009417fa80/0x8a60d30f571e376d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126be1 expref: 923 pid: 15497 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.382799:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914618 00000100:00100000:0.0:1721880422.382801:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009745df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+923:2007:x1805522257754496:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.382805:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.382807:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009417fa80/0x8a60d30f571e376d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126be1 expref: 923 pid: 15497 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.382813:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009417fa80/0x8a60d30f571e376d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126be1 expref: 923 pid: 15497 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.382823:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009417fa80/0x8a60d30f571e376d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126be1 expref: 923 pid: 15497 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.382823:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d3bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2333:3688:x1805522011785216:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2060us (2127us total) trans 4296020394 rc 0/0 00000100:00100000:1.0:1721880422.382827:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632420 00010000:00010000:0.0:1721880422.382830:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.382831:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.382833:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727c816 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.382837:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727c816 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.382844:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.382854:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009745df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+922:2007:x1805522257754496:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 51us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.382857:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914618 00000100:00100000:3.0:1721880422.382876:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009745f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011787008:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.382885:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801207fb180/0x8a60d30f5727c81d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.382895:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2332:3687:x1805522011785600:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1677us (1745us total) trans 4296020395 rc 0/0 00000100:00100000:2.0:1721880422.382903:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632423 00000100:00100000:3.0:1721880422.382921:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000004:00080000:2.0:1721880422.382933:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122fd2680/2, rc 0, transno 1053099 00000100:00100000:2.0:1721880422.382943:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122fd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011785600:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1721880422.382956:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800887f7b80/2, rc 0, transno 1053097 00000100:00100000:1.0:1721880422.382961:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800887f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011785472:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1721880422.382971:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009d3bb100/2, rc 0, transno 1053098 00000100:00100000:1.0:1721880422.382975:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d3bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011785216:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.382981:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.382987:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012c887100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011787264:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.382996:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257754624 00000100:00100000:2.0:1721880422.382999:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257754624 00000100:00100000:1.0:1721880422.383008:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.383009:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257754752 00010000:00010000:3.0:1721880422.383009:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c80f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.383027:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257754752 00010000:00010000:2.0:1721880422.383029:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800842f2f40/0x8a60d30f571e39ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126c82 expref: 922 pid: 15515 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.383032:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c80f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.383037:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013633c480/0x8a60d30f571e38a8 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfcc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126c35 expref: 923 pid: 16131 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.383037:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1721880422.383041:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c80f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.383042:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012c884700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011787392:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.383045:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c80f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.383049:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c80f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.383050:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914619 00010000:00010000:3.0:1721880422.383052:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352d00 already unused, calling callback (ffffffffa084e330) 00000100:00100000:0.0:1721880422.383054:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009745f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+923:2004:x1805522257754624:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.383054:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.383054:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c80f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.383055:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914620 00010000:00010000:3.0:1721880422.383058:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c80f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.383061:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009745c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+923:2004:x1805522257754752:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.383064:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c80f lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.383065:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.383068:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727c80f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.383069:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800842f2f40/0x8a60d30f571e39ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126c82 expref: 923 pid: 15515 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.383069:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.383070:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011787264 00000100:00100000:1.0:1721880422.383073:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011787264 00010000:00010000:2.0:1721880422.383074:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013633c480/0x8a60d30f571e38a8 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfcc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126c35 expref: 923 pid: 16131 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.383078:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800842f2f40/0x8a60d30f571e39ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126c82 expref: 923 pid: 15515 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.383084:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011787392 00000100:00100000:1.0:1721880422.383085:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011787392 00010000:00010000:2.0:1721880422.383085:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013633c480/0x8a60d30f571e38a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126c35 expref: 923 pid: 16131 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.383086:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800842f2f40/0x8a60d30f571e39ea lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126c82 expref: 923 pid: 15515 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.383092:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1721880422.383092:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632428 00010000:00010000:0.0:1721880422.383093:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.383095:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801207fb180/0x8a60d30f5727c81d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.383095:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085817b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2333:3688:x1805522011787264:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.383096:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.383096:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632429 00010000:00010000:2.0:1721880422.383098:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.383099:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207fb180/0x8a60d30f5727c81d lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.383099:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085816d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2333:3688:x1805522011787392:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.383101:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c824 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.383105:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64709 count 1 00010000:00010000:0.0:1721880422.383108:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.383108:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c824 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.383108:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64710 count 1 00010000:00010000:1.0:1721880422.383113:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727c82b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcc5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.383114:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f8000/0x8a60d30f5727c832 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcc6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.383119:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.383121:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013130f180/0x8a60d30f571e3cc9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126d31 expref: 922 pid: 16050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.383124:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013633d200/0x8a60d30f571e3b79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126ce4 expref: 922 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.383125:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1721880422.383126:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009745f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+922:2004:x1805522257754624:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 71us (204us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.383126:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.383128:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f8000/0x8a60d30f5727c832 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.383129:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1721880422.383130:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914619 00010000:00010000:1.0:1721880422.383130:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.383132:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727c82b lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.383138:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009745c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+921:2004:x1805522257754752:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 76us (156us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.383139:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013130f180/0x8a60d30f571e3cc9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126d31 expref: 921 pid: 16050 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.383142:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013633d200/0x8a60d30f571e3b79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126ce4 expref: 921 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.383145:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914620 00010000:00010000:3.0:1721880422.383145:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013130f180/0x8a60d30f571e3cc9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126d31 expref: 921 pid: 16050 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.383148:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013633d200/0x8a60d30f571e3b79 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126ce4 expref: 921 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.383151:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009745c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011787648:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.383154:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013633c480/0x8a60d30f571e38a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126c35 expref: 920 pid: 16131 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.383154:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085815500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011787776:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.383161:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880091134380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011787136:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.383167:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec540 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.383168:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1721880422.383171:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c824 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.383171:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb3c0 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.383175:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c824 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.383176:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012c886300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011787520:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.383176:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801207fb180/0x8a60d30f5727c81d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.383181:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c824 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.383181:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207fb180/0x8a60d30f5727c81d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.383185:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c824 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.383185:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207fb180/0x8a60d30f5727c81d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.383187:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122fd1c00/2, rc 0, transno 1053096 00010000:00010000:0.0:1721880422.383189:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c824 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.383192:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801207fb180/0x8a60d30f5727c81d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.383193:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c824 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.383196:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325eac0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.383196:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801207fb180/0x8a60d30f5727c81d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.383198:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c824 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.383199:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801207fb180 already unused, calling callback (ffffffffa084e330) 00000100:00100000:1.0:1721880422.383200:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122fd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011785728:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.383200:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207fb180/0x8a60d30f5727c81d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.383204:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c824 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.383204:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207fb180/0x8a60d30f5727c81d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.383209:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801207fb180/0x8a60d30f5727c81d lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.383212:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727c816 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.383213:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c824 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.383213:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801207fb180/0x8a60d30f5727c81d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.383216:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727c816 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.383218:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727c824 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.383221:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727c816 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.383226:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727c816 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.383230:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727c816 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.383230:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.383233:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b73c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.383235:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727c816 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.383239:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727c816 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.383245:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727c816 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.383249:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727c816 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.383250:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012c887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011787904:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.383268:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.383288:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011787520 00000100:00100000:2.0:1721880422.383291:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011787520 00000100:00100000:3.0:1721880422.383301:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c886680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2337:3687:x1805522011786880:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1546us (1595us total) trans 4296020396 rc 0/0 00000100:00100000:3.0:1721880422.383306:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632427 00000100:00100000:2.0:1721880422.383308:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011787904 00000100:00100000:2.0:1721880422.383311:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011787904 00000100:00100000:3.0:1721880422.383316:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632430 00000100:00100000:3.0:1721880422.383319:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2337:3687:x1805522011787520:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.383326:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632431 00002000:00080000:3.0:1721880422.383327:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64711 count 1 00000100:00100000:0.0:1721880422.383329:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880091135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2337:3686:x1805522011786752:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1578us (1651us total) trans 4296020397 rc 0/0 00000100:00100000:2.0:1721880422.383331:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2337:3687:x1805522011787904:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.383334:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632426 00010000:00010000:3.0:1721880422.383336:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f9200/0x8a60d30f5727c839 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcc7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.383340:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800887f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2336:3688:x1805522011786112:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1976us (2002us total) trans 4296020398 rc 0/0 00002000:00080000:2.0:1721880422.383343:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64712 count 1 00000100:00100000:1.0:1721880422.383345:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632425 00010000:00010000:3.0:1721880422.383346:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c984d80/0x8a60d30f571e3e7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126d85 expref: 919 pid: 16091 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.383352:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.383353:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.383354:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c840 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcc8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.383355:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f9200/0x8a60d30f5727c839 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.383364:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122fd0380/2, rc 0, transno 1053102 00010000:00010000:2.0:1721880422.383365:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a59f0b40/0x8a60d30f571e4026 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126dd9 expref: 919 pid: 16129 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.383369:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122fd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011786112:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.383370:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c984d80/0x8a60d30f571e3e7b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126d85 expref: 919 pid: 16091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.383372:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.383374:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.383376:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c840 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.383379:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c984d80/0x8a60d30f571e3e7b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126d85 expref: 919 pid: 16091 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.383388:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009745d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011788032:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.383390:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085817480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011788160:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.383394:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a59f0b40/0x8a60d30f571e4026 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126dd9 expref: 919 pid: 16129 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.383404:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a59f0b40/0x8a60d30f571e4026 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126dd9 expref: 919 pid: 16129 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.383407:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.383413:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec840 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.383414:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088aab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011788288:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.383419:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011788160 00000100:00100000:0.0:1721880422.383422:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011788160 00000004:00080000:1.0:1721880422.383431:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880085814e00/2, rc 0, transno 1053101 00000100:00100000:0.0:1721880422.383436:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632432 00000100:00100000:1.0:1721880422.383437:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085814e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011786752:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.383439:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085814a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2336:3688:x1805522011788160:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.383446:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdea80 going to sleep for 11 seconds 00002000:00080000:0.0:1721880422.383448:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64713 count 1 00010000:00010000:0.0:1721880422.383456:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c847 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcc9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.383460:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1721880422.383464:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098a5d200/0x8a60d30f571e4279 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126e2d expref: 919 pid: 16085 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.383465:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099493480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011788416:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.383468:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.383469:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.383471:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c847 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.383473:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880085817100/2, rc 0, transno 1053100 00010000:00010000:0.0:1721880422.383481:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098a5d200/0x8a60d30f571e4279 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126e2d expref: 919 pid: 16085 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.383485:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.383487:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098a5d200/0x8a60d30f571e4279 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126e2d expref: 919 pid: 16085 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.383489:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085817100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011786880:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.383493:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880091134380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011788544:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.383504:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011788416 00000100:00100000:2.0:1721880422.383506:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011788416 00000100:00100000:0.0:1721880422.383507:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.383524:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632433 00000100:00100000:3.0:1721880422.383524:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800887f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2338:3688:x1805522011785856:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2162us (2208us total) trans 4296020399 rc 0/0 00000100:00100000:0.0:1721880422.383527:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2338:3688:x1805522011788416:12345-0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1721880422.383531:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122fd1880/2, rc 0, transno 1053103 00000100:00100000:3.0:1721880422.383531:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632424 00000100:00100000:2.0:1721880422.383533:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00002000:00080000:0.0:1721880422.383534:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64714 count 1 00000100:00100000:1.0:1721880422.383536:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122fd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011785856:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.383540:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880134e97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011788672:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.383541:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727c84e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcca:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.383548:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c4ee400/0x8a60d30f571e4512 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126e81 expref: 919 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.383552:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.383552:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.383553:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727c84e lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.383560:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1721880422.383561:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.383566:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880134e95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011788800:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.383568:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c4ee400/0x8a60d30f571e4512 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126e81 expref: 919 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.383576:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c4ee400/0x8a60d30f571e4512 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126e81 expref: 919 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.383586:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801360cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011788928:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.383587:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.383610:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011788672 00000100:00100000:2.0:1721880422.383613:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011788672 00000100:00100000:1.0:1721880422.383619:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011788800 00000100:00100000:1.0:1721880422.383623:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011788800 00000100:00100000:2.0:1721880422.383630:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632434 00000100:00100000:2.0:1721880422.383635:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2339:3687:x1805522011788672:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.383636:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632435 00000100:00100000:3.0:1721880422.383640:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134e94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2339:3686:x1805522011788800:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.383646:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64715 count 1 00002000:00080000:3.0:1721880422.383649:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64716 count 1 00010000:00010000:2.0:1721880422.383656:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c855 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfccb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.383656:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f98c0/0x8a60d30f5727c85c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfccc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.383667:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132e59d40/0x8a60d30f571e475e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfccb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126ece expref: 919 pid: 15497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.383667:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fb3e1c0/0x8a60d30f571e49e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfccc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126f22 expref: 919 pid: 16085 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.383671:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.383672:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.383673:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.383674:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f98c0/0x8a60d30f5727c85c lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfccc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.383675:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.383677:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c855 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfccb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.383686:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fb3e1c0/0x8a60d30f571e49e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfccc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126f22 expref: 919 pid: 16085 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.383691:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fb3e1c0/0x8a60d30f571e49e2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfccc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126f22 expref: 919 pid: 16085 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.383692:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132e59d40/0x8a60d30f571e475e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfccb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126ece expref: 919 pid: 15497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.383698:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008ffe3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011789056:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.383699:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132e59d40/0x8a60d30f571e475e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfccb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126ece expref: 919 pid: 15497 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.383705:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e540 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.383709:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009f1b6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011789184:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.383725:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.383725:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec180 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.384022:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009745c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011787648:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.384039:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801207f8000/0x8a60d30f5727c832 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.384045:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085815500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011787776:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.384059:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727c82b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.384064:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009745d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011788032:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.384079:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801207f9200/0x8a60d30f5727c839 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.384103:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880091134380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011788544:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.384111:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088aab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011788288:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.384118:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c847 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.384124:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c840 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.384294:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.384311:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.384324:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257755136 00000100:00100000:2.0:1721880422.384326:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801360cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011788928:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.384327:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.384328:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257755136 00010000:00010000:3.0:1721880422.384338:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a59f0b40/0x8a60d30f571e4026 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126dd9 expref: 920 pid: 16129 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.384340:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.384341:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727c84e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.384351:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257755264 00000100:00100000:0.0:1721880422.384354:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257755264 00000100:00100000:3.0:1721880422.384355:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257755008 00000100:00100000:2.0:1721880422.384357:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257754880 00000100:00100000:3.0:1721880422.384357:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257755008 00000100:00100000:2.0:1721880422.384360:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257754880 00010000:00010000:3.0:1721880422.384363:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013633d200/0x8a60d30f571e3b79 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126ce4 expref: 923 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.384364:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098a5d200/0x8a60d30f571e4279 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126e2d expref: 923 pid: 16085 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.384369:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914621 00010000:00010000:2.0:1721880422.384374:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013130f180/0x8a60d30f571e3cc9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126d31 expref: 923 pid: 16050 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.384376:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801360cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+923:2006:x1805522257755136:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.384379:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914622 00000100:00100000:3.0:1721880422.384383:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123b83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+923:2004:x1805522257755008:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.384385:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.384388:0:15473:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.384390:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a59f0b40/0x8a60d30f571e4026 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126dd9 expref: 923 pid: 16129 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.384390:0:15473:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013633d200/0x8a60d30f571e3b79 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126ce4 expref: 923 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.384393:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914623 00010000:00010000:3.0:1721880422.384397:0:15473:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013633d200/0x8a60d30f571e3b79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126ce4 expref: 923 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.384398:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bc86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+923:2005:x1805522257754880:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.384399:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a59f0b40/0x8a60d30f571e4026 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126dd9 expref: 923 pid: 16129 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.384405:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.384405:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013633d200/0x8a60d30f571e3b79 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126ce4 expref: 923 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.384410:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013130f180/0x8a60d30f571e3cc9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126d31 expref: 922 pid: 16050 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.384412:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a59f0b40/0x8a60d30f571e4026 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126dd9 expref: 922 pid: 16129 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.384412:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.384413:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.384414:0:15473:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727c82b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.384419:0:15473:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727c82b lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.384420:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013130f180/0x8a60d30f571e3cc9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126d31 expref: 921 pid: 16050 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.384424:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.384426:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.384428:0:15473:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.384429:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c840 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.384432:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013130f180/0x8a60d30f571e3cc9 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126d31 expref: 921 pid: 16050 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.384435:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c840 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.384440:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914624 00010000:00010000:2.0:1721880422.384441:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.384443:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1721880422.384444:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8066850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+920:2006:x1805522257755264:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.384444:0:15473:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880123b83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+920:2004:x1805522257755008:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 60us (116us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.384446:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801207f8000/0x8a60d30f5727c832 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.384448:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914622 00010000:00010000:0.0:1721880422.384450:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.384451:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.384452:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f8000/0x8a60d30f5727c832 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.384453:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098a5d200/0x8a60d30f571e4279 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126e2d expref: 920 pid: 16085 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.384460:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098a5d200/0x8a60d30f571e4279 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126e2d expref: 919 pid: 16085 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.384466:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.384468:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801360cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+919:2006:x1805522257755136:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 93us (175us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.384469:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098a5d200/0x8a60d30f571e4279 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126e2d expref: 919 pid: 16085 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.384472:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801207f8000/0x8a60d30f5727c832 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.384475:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914621 00010000:00010000:0.0:1721880422.384476:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.384477:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.384477:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207f8000/0x8a60d30f5727c832 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.384478:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c847 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.384482:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f8000/0x8a60d30f5727c832 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.384483:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c847 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.384486:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bc86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+917:2005:x1805522257754880:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 87us (143us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.384486:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f8000/0x8a60d30f5727c832 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.384489:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801207f8000/0x8a60d30f5727c832 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.384492:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914623 00010000:00010000:0.0:1721880422.384493:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.384493:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801207f8000 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.384494:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727c82b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.384494:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f8000/0x8a60d30f5727c832 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.384498:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f8000/0x8a60d30f5727c832 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.384500:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727c82b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.384503:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801207f8000/0x8a60d30f5727c832 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.384505:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8066850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+916:2006:x1805522257755264:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 60us (192us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.384507:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727c82b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.384507:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801207f8000/0x8a60d30f5727c832 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.384508:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914624 00010000:00010000:2.0:1721880422.384514:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c840 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.384518:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727c82b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.384521:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c840 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.384523:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727c82b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.384528:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b6f40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.384528:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c840 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.384531:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727c82b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.384538:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727c82b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.384540:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c840 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.384546:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c840 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.384547:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727c82b lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.384549:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353180 already unused, calling callback (ffffffffa084e330) 00000100:00100000:0.0:1721880422.384550:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.384551:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c840 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.384553:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727c82b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.384555:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c840 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.384561:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c840 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.384563:0:8793:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257755520 00010000:00010000:2.0:1721880422.384565:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727c840 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.384566:0:8793:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257755520 00010000:00010000:0.0:1721880422.384573:0:8793:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c984d80/0x8a60d30f571e3e7b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126d85 expref: 916 pid: 16091 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.384583:0:8793:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914625 00000100:00100000:0.0:1721880422.384586:0:8793:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bc84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30425778-2709-4512-9d75-01ec53c4cfad+916:2004:x1805522257755520:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.384589:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880085816d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2340:3688:x1805522011787392:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1489us (1534us total) trans 4296020400 rc 0/0 00010000:00010000:0.0:1721880422.384590:0:8793:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.384593:0:8793:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c984d80/0x8a60d30f571e3e7b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcc7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126d85 expref: 916 pid: 16091 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.384594:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632429 00010000:00010000:0.0:1721880422.384598:0:8793:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c984d80/0x8a60d30f571e3e7b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcc7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126d85 expref: 916 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.384606:0:8793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c984d80/0x8a60d30f571e3e7b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcc7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126d85 expref: 916 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.384613:0:8793:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000004:00080000:3.0:1721880422.384613:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012c884700/2, rc 0, transno 1053104 00010000:00010000:0.0:1721880422.384614:0:8793:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.384615:0:8793:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801207f9200/0x8a60d30f5727c839 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.384618:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012c884700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011787392:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.384620:0:8793:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f9200/0x8a60d30f5727c839 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.384627:0:8793:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.384636:0:8793:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bc84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30425778-2709-4512-9d75-01ec53c4cfad+915:2004:x1805522257755520:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 49us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.384643:0:8793:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914625 00000100:00100000:3.0:1721880422.384656:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008ffe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011789312:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.384663:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880085817b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2341:3688:x1805522011787264:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1565us (1653us total) trans 4296020401 rc 0/0 00000100:00100000:1.0:1721880422.384670:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632428 00000100:00100000:0.0:1721880422.384671:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.384674:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.384679:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257755392 00000100:00100000:0.0:1721880422.384681:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257755392 00000100:00100000:1.0:1721880422.384682:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011789312 00000100:00100000:1.0:1721880422.384685:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011789312 00010000:00010000:0.0:1721880422.384687:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c4ee400/0x8a60d30f571e4512 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126e81 expref: 915 pid: 16119 timeout: 887 lvb_type: 0 00000004:00080000:3.0:1721880422.384689:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012c887100/2, rc 0, transno 1053105 00000100:00100000:2.0:1721880422.384691:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2341:3687:x1805522011787904:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1358us (1421us total) trans 4296020402 rc 0/0 00000100:00100000:3.0:1721880422.384692:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012c887100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011787264:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.384696:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914626 00000100:00100000:2.0:1721880422.384698:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632431 00000100:00100000:0.0:1721880422.384699:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bc87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+915:2005:x1805522257755392:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.384702:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632436 00010000:00010000:0.0:1721880422.384704:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.384704:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1721880422.384706:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c4ee400/0x8a60d30f571e4512 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126e81 expref: 915 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.384707:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ffe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2340:3688:x1805522011789312:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.384707:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008ffe3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011789440:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.384711:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c4ee400/0x8a60d30f571e4512 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126e81 expref: 915 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.384715:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801207f9200/0x8a60d30f5727c839 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.384719:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c4ee400/0x8a60d30f571e4512 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126e81 expref: 915 pid: 16119 timeout: 887 lvb_type: 0 00002000:00080000:1.0:1721880422.384719:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64717 count 1 00000100:00100000:3.0:1721880422.384719:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.384723:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207f9200/0x8a60d30f5727c839 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.384725:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.384741:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.384743:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727c84e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.384748:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727c84e lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.384748:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011789440 00010000:00010000:1.0:1721880422.384749:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c863 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfccd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.384749:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f9200/0x8a60d30f5727c839 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.384750:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011789440 00010000:00010000:2.0:1721880422.384756:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f9200/0x8a60d30f5727c839 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.384759:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.384760:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135215d40/0x8a60d30f571e4cba lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfccd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126f92 expref: 914 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.384761:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632437 00010000:00010000:2.0:1721880422.384762:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801207f9200/0x8a60d30f5727c839 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.384763:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ffe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2341:3688:x1805522011789440:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.384766:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801207f9200 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.384767:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.384768:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1721880422.384769:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bc87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+914:2005:x1805522257755392:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 68us (97us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.384769:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f9200/0x8a60d30f5727c839 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.384770:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c863 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfccd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.384771:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64718 count 1 00000100:00100000:0.0:1721880422.384773:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914626 00010000:00010000:2.0:1721880422.384775:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f9200/0x8a60d30f5727c839 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.384778:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207fa1c0/0x8a60d30f5727c86a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcce:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.384784:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801207f9200/0x8a60d30f5727c839 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.384785:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007cb6c480/0x8a60d30f571e4f76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126fe6 expref: 913 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.384786:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135215d40/0x8a60d30f571e4cba lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfccd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126f92 expref: 913 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.384789:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801207f9200/0x8a60d30f5727c839 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.384789:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.384791:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.384792:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207fa1c0/0x8a60d30f5727c86a lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.384795:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135215d40/0x8a60d30f571e4cba lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfccd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126f92 expref: 913 pid: 16028 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.384802:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007cb6c480/0x8a60d30f571e4f76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126fe6 expref: 913 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.384805:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880134e96a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011789568:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.384808:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007cb6c480/0x8a60d30f571e4f76 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126fe6 expref: 913 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.384814:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008ffe2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011789696:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.384826:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.384830:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec540 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.384837:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.384844:0:8793:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257755648 00000100:00100000:0.0:1721880422.384846:0:8793:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257755648 00000100:00100000:3.0:1721880422.384848:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008ffe3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011789056:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.384853:0:8793:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fb3e1c0/0x8a60d30f571e49e2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfccc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126f22 expref: 914 pid: 16085 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.384859:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801207f98c0/0x8a60d30f5727c85c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfccc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.384862:0:8793:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914627 00000100:00100000:0.0:1721880422.384864:0:8793:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bc85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30425778-2709-4512-9d75-01ec53c4cfad+914:2005:x1805522257755648:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.384869:0:8793:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.384871:0:8793:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fb3e1c0/0x8a60d30f571e49e2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfccc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126f22 expref: 914 pid: 16085 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.384877:0:8793:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fb3e1c0/0x8a60d30f571e49e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfccc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126f22 expref: 914 pid: 16085 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.384884:0:8793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fb3e1c0/0x8a60d30f571e49e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfccc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126f22 expref: 914 pid: 16085 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.384890:0:8793:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.384891:0:8793:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.384893:0:8793:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801207f98c0/0x8a60d30f5727c85c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfccc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.384893:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.384896:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2342:3687:x1805522011787520:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1574us (1664us total) trans 4296020403 rc 0/0 00010000:00010000:0.0:1721880422.384901:0:8793:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f98c0/0x8a60d30f5727c85c lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfccc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.384902:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632430 00000100:00100000:3.0:1721880422.384908:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257755776 00010000:00010000:0.0:1721880422.384909:0:8793:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.384910:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257755776 00010000:00010000:3.0:1721880422.384919:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132e59d40/0x8a60d30f571e475e lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfccb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126ece expref: 914 pid: 15497 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.384920:0:8793:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bc85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30425778-2709-4512-9d75-01ec53c4cfad+914:2005:x1805522257755648:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 55us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.384924:0:8793:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914627 00000100:00100000:0.0:1721880422.384933:0:8793:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914628 00000004:00080000:2.0:1721880422.384933:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012c887800/2, rc 0, transno 1053106 00000100:00100000:0.0:1721880422.384937:0:8793:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091134380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30425778-2709-4512-9d75-01ec53c4cfad+913:2005:x1805522257755776:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.384941:0:8793:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.384943:0:8793:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132e59d40/0x8a60d30f571e475e lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfccb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126ece expref: 913 pid: 15497 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.384945:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012c887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011787904:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.384949:0:8793:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132e59d40/0x8a60d30f571e475e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfccb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126ece expref: 913 pid: 15497 timeout: 887 lvb_type: 0 00000004:00080000:2.0:1721880422.384954:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012c886300/2, rc 0, transno 1053107 00010000:00010000:0.0:1721880422.384955:0:8793:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.384956:0:8793:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.384957:0:8793:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c855 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfccb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.384958:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012c886300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011787520:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.384961:0:8793:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c855 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfccb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.384964:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1721880422.384966:0:8793:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.384971:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008ffe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011789952:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.384975:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801207f98c0/0x8a60d30f5727c85c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfccc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.384976:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c847 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.384977:0:8793:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880091134380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30425778-2709-4512-9d75-01ec53c4cfad+913:2005:x1805522257755776:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 40us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.384981:0:8793:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914628 00010000:00010000:3.0:1721880422.384982:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207f98c0/0x8a60d30f5727c85c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfccc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.384984:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c847 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.384988:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f98c0/0x8a60d30f5727c85c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfccc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.384991:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.384995:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c847 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.384995:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f98c0/0x8a60d30f5727c85c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfccc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.385000:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801207f98c0/0x8a60d30f5727c85c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfccc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.385002:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c847 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.385005:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008ffe3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011789824:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.385006:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801207f98c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.385008:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c847 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.385008:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f98c0/0x8a60d30f5727c85c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfccc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.385032:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325c6c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.385032:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f98c0/0x8a60d30f5727c85c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfccc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.385034:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.385035:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c847 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.385040:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801207f98c0/0x8a60d30f5727c85c lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfccc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.385041:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c847 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.385046:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801207f98c0/0x8a60d30f5727c85c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfccc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.385051:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c847 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.385052:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011789952 00000100:00100000:2.0:1721880422.385055:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011789952 00010000:00010000:1.0:1721880422.385057:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727c847 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.385067:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011789824 00000100:00100000:2.0:1721880422.385069:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011789824 00000100:00100000:2.0:1721880422.385078:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632438 00000100:00100000:2.0:1721880422.385082:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2343:3687:x1805522011789952:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.385089:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632439 00000100:00100000:0.0:1721880422.385093:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801360cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2343:3687:x1805522011789824:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.385097:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64720 count 1 00010000:00010000:2.0:1721880422.385111:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c871 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcd0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.385122:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b2b46c0/0x8a60d30f571e52fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1270b1 expref: 912 pid: 16039 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1721880422.385126:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64719 count 1 00010000:00010000:2.0:1721880422.385132:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.385134:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.385136:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c871 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.385139:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727c878 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfccf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.385146:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a50f0900/0x8a60d30f571e51bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfccf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12705d expref: 912 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.385151:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.385151:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b2b46c0/0x8a60d30f571e52fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1270b1 expref: 912 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.385152:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.385153:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727c878 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfccf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.385158:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b2b46c0/0x8a60d30f571e52fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1270b1 expref: 912 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.385163:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a50f0900/0x8a60d30f571e51bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfccf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12705d expref: 912 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.385164:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801360cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011790080:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.385167:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880134e94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2345:3686:x1805522011788800:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1525us (1579us total) trans 4296020404 rc 0/0 00010000:00010000:0.0:1721880422.385169:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a50f0900/0x8a60d30f571e51bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfccf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12705d expref: 912 pid: 15466 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.385172:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632435 00000100:00100000:0.0:1721880422.385175:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008bc86680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011790208:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.385182:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdea80 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.385195:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e6c0 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.385198:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132e59d40/0x8a60d30f571e475e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfccb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126ece expref: 912 pid: 15497 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.385206:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009f1b6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011789184:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.385209:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880085814a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2344:3688:x1805522011788160:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1768us (1800us total) trans 4296020405 rc 0/0 00000004:00080000:3.0:1721880422.385214:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880085817480/2, rc 0, transno 1053109 00000100:00100000:1.0:1721880422.385216:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632432 00010000:00010000:2.0:1721880422.385218:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c855 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfccb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.385219:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085817480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011788160:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.385222:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c855 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfccb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.385226:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c855 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfccb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.385230:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c855 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfccb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.385234:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c855 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfccb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.385238:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c855 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfccb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.385238:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008ffe0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011790336:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.385242:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136351680 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.385244:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c855 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfccb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.385248:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880134e95f80/2, rc 0, transno 1053108 00010000:00010000:2.0:1721880422.385248:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c855 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfccb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.385251:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.385254:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c855 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfccb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.385257:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727c855 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfccb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.385263:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880134e95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011788800:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.385271:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1721880422.385274:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008ffe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011790464:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.385283:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.385328:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011790336 00000100:00100000:0.0:1721880422.385332:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011790336 00000100:00100000:2.0:1721880422.385348:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2345:3687:x1805522011788672:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1712us (1785us total) trans 4296020406 rc 0/0 00000100:00100000:0.0:1721880422.385351:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011790464 00000004:00080000:3.0:1721880422.385353:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880134e97800/2, rc 0, transno 1053110 00000100:00100000:0.0:1721880422.385354:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011790464 00000100:00100000:2.0:1721880422.385354:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632434 00000100:00100000:3.0:1721880422.385358:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880134e97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011788672:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.385366:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632440 00000100:00100000:0.0:1721880422.385371:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ffe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2345:3688:x1805522011790336:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.385371:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632441 00000100:00100000:2.0:1721880422.385376:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009745f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2345:3688:x1805522011790464:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.385382:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00002000:00080000:0.0:1721880422.385383:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64721 count 1 00000100:00100000:3.0:1721880422.385386:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009745df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011790592:0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.385387:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64722 count 1 00010000:00010000:0.0:1721880422.385394:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727c87f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcd1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.385397:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c886 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcd2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.385399:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.385404:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009291dd40/0x8a60d30f571e53eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12710c expref: 911 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.385408:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099b0e880/0x8a60d30f571e5557 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127167 expref: 911 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.385409:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011790592 00010000:00010000:0.0:1721880422.385410:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.385412:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1721880422.385412:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011790592 00010000:00010000:0.0:1721880422.385414:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727c87f lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.385415:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.385417:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.385419:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c886 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.385426:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632442 00000100:00100000:1.0:1721880422.385429:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009745f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2346:3687:x1805522011790592:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.385431:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009291dd40/0x8a60d30f571e53eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12710c expref: 911 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.385434:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099b0e880/0x8a60d30f571e5557 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127167 expref: 911 pid: 16101 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.385438:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64723 count 1 00010000:00010000:0.0:1721880422.385440:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009291dd40/0x8a60d30f571e53eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12710c expref: 911 pid: 16075 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.385443:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099b0e880/0x8a60d30f571e5557 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127167 expref: 911 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.385445:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c88d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcd3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.385449:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008bc84380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011790720:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.385453:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134f6eac0/0x8a60d30f571e566f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1271d0 expref: 911 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.385453:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009f1b6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011790848:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.385457:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.385458:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.385460:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c88d lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.385471:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e780 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.385471:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134f6eac0/0x8a60d30f571e566f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1271d0 expref: 911 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.385473:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdeb40 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.385476:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134f6eac0/0x8a60d30f571e566f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1271d0 expref: 911 pid: 16017 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.385483:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085815500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011790976:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.385486:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727c84e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.385493:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727c84e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.385500:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb0c0 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.385500:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727c84e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.385508:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727c84e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.385514:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727c84e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.385520:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325f3c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.385524:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727c84e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.385531:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727c84e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.385540:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727c84e lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.385547:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727c84e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.385657:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2347:3688:x1805522011788416:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2128us (2173us total) trans 4296020407 rc 0/0 00000100:00100000:2.0:1721880422.385664:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632433 00000004:00080000:3.0:1721880422.385679:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099493480/2, rc 0, transno 1053111 00000100:00100000:3.0:1721880422.385688:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099493480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011788416:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.385834:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.385849:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.385883:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.385892:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257755904 00000100:00100000:2.0:1721880422.385895:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257755904 00000100:00100000:3.0:1721880422.385907:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008bc84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011791104:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.385908:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007cb6c480/0x8a60d30f571e4f76 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfcce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126fe6 expref: 912 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.385926:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257756032 00000100:00100000:2.0:1721880422.385927:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257756032 00000100:00100000:0.0:1721880422.385928:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257756160 00000100:00100000:3.0:1721880422.385932:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914629 00000100:00100000:0.0:1721880422.385933:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257756160 00010000:00010000:2.0:1721880422.385933:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135215d40/0x8a60d30f571e4cba lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfccd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126f92 expref: 913 pid: 16028 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.385935:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880134e96a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011789568:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.385936:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e194450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+914:2006:x1805522257755904:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.385942:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.385945:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b2b46c0/0x8a60d30f571e52fd lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfcd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1270b1 expref: 914 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.385946:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007cb6c480/0x8a60d30f571e4f76 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfcce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126fe6 expref: 914 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.385947:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914630 00000100:00100000:2.0:1721880422.385951:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088aab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+914:2005:x1805522257756032:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.385952:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c863 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfccd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.385953:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007cb6c480/0x8a60d30f571e4f76 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126fe6 expref: 914 pid: 16098 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.385956:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.385958:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135215d40/0x8a60d30f571e4cba lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfccd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126f92 expref: 914 pid: 16028 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.385961:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.385962:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.385964:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801207fa1c0/0x8a60d30f5727c86a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.385965:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135215d40/0x8a60d30f571e4cba lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfccd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126f92 expref: 914 pid: 16028 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.385970:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914631 00010000:00010000:3.0:1721880422.385972:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207fa1c0/0x8a60d30f5727c86a lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.385973:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135215d40/0x8a60d30f571e4cba lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfccd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126f92 expref: 914 pid: 16028 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.385976:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007294ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+914:2006:x1805522257756160:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.385979:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.385981:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.385984:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b2b46c0/0x8a60d30f571e52fd lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfcd0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1270b1 expref: 913 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.385984:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.385985:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.385987:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c863 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfccd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.385990:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b2b46c0/0x8a60d30f571e52fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcd0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1270b1 expref: 913 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.385992:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c863 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfccd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.385993:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e194450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+913:2006:x1805522257755904:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 57us (161us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.385998:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.385998:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914629 00010000:00010000:0.0:1721880422.385999:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.386001:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c871 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcd0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.386002:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.386005:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c871 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcd0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.386026:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.386033:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088aab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+912:2005:x1805522257756032:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 80us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.386037:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914630 00000100:00100000:0.0:1721880422.386042:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007294ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+912:2006:x1805522257756160:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 66us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.386045:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914631 00010000:00010000:2.0:1721880422.386058:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b2b46c0/0x8a60d30f571e52fd lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcd0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1270b1 expref: 910 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.386078:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008bc86680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011790208:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.386078:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.386079:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801360cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011790080:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.386088:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727c878 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfccf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.386088:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c871 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.386093:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c871 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.386097:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c871 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.386101:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c871 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.386104:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c871 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.386108:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008bc84380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011790720:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.386108:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c871 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.386111:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353a80 already unused, calling callback (ffffffffa084e330) 00000100:00100000:1.0:1721880422.386112:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.386112:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007cb6c480/0x8a60d30f571e4f76 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b126fe6 expref: 909 pid: 16098 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.386113:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c871 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.386116:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727c87f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.386116:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c871 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.386122:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c871 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.386125:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008ffe2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011789696:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.386129:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.386129:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727c871 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcd0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.386138:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801207fa1c0/0x8a60d30f5727c86a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.386139:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.386143:0:8793:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257756416 00000100:00100000:0.0:1721880422.386146:0:8793:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257756416 00000100:00100000:3.0:1721880422.386148:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257756672 00000100:00100000:3.0:1721880422.386150:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257756672 00010000:00010000:0.0:1721880422.386153:0:8793:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009291dd40/0x8a60d30f571e53eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12710c expref: 910 pid: 16075 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.386158:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099b0e880/0x8a60d30f571e5557 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfcd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127167 expref: 910 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.386164:0:8793:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257756544 00000100:00100000:0.0:1721880422.386166:0:8793:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257756544 00010000:00010000:0.0:1721880422.386172:0:8793:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134f6eac0/0x8a60d30f571e566f lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfcd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1271d0 expref: 911 pid: 16017 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.386180:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914632 00000100:00100000:3.0:1721880422.386183:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134e96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+911:2005:x1805522257756416:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.386189:0:8793:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914633 00010000:00010000:3.0:1721880422.386189:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.386192:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009291dd40/0x8a60d30f571e53eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcd1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12710c expref: 911 pid: 16075 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.386193:0:8793:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d33d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30425778-2709-4512-9d75-01ec53c4cfad+911:2005:x1805522257756672:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.386193:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914634 00000100:00100000:2.0:1721880422.386197:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d33df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+911:2005:x1805522257756544:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.386198:0:8793:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.386202:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.386202:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009291dd40/0x8a60d30f571e53eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcd1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12710c expref: 911 pid: 16075 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.386203:0:8793:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099b0e880/0x8a60d30f571e5557 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfcd2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127167 expref: 911 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.386204:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.386206:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134f6eac0/0x8a60d30f571e566f lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfcd3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1271d0 expref: 911 pid: 16017 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.386212:0:8793:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099b0e880/0x8a60d30f571e5557 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcd2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127167 expref: 911 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.386212:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134f6eac0/0x8a60d30f571e566f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcd3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1271d0 expref: 911 pid: 16017 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.386212:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009291dd40/0x8a60d30f571e53eb lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcd1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12710c expref: 911 pid: 16075 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.386218:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.386219:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.386219:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1721880422.386220:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257756288 00010000:00010000:2.0:1721880422.386220:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.386221:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727c87f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.386222:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c88d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcd3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.386223:0:8793:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1721880422.386223:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257756288 00010000:00010000:0.0:1721880422.386224:0:8793:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.386225:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727c87f lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcd1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.386226:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c88d lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcd3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.386228:0:8793:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c886 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcd2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.386233:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.386234:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a50f0900/0x8a60d30f571e51bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfccf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12705d expref: 911 pid: 15466 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.386235:0:8793:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c886 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcd2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.386239:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.386246:0:8793:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.386248:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914635 00000100:00100000:2.0:1721880422.386250:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d33df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+911:2005:x1805522257756544:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 52us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.386252:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c4e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+911:2004:x1805522257756288:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.386254:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914634 00010000:00010000:1.0:1721880422.386258:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.386260:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a50f0900/0x8a60d30f571e51bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfccf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12705d expref: 911 pid: 15466 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.386263:0:8793:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d33d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30425778-2709-4512-9d75-01ec53c4cfad+910:2005:x1805522257756672:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 68us (131us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.386267:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a50f0900/0x8a60d30f571e51bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfccf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12705d expref: 910 pid: 15466 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.386269:0:8793:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914633 00000100:00100000:3.0:1721880422.386269:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880134e96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+910:2005:x1805522257756416:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 83us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.386275:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914632 00010000:00010000:1.0:1721880422.386276:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a50f0900/0x8a60d30f571e51bb lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfccf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12705d expref: 910 pid: 15466 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.386285:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.386286:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.386288:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727c878 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfccf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.386291:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801207fa1c0/0x8a60d30f5727c86a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.386295:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727c878 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfccf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.386298:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207fa1c0/0x8a60d30f5727c86a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.386306:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.386306:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207fa1c0/0x8a60d30f5727c86a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.386317:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801207fa1c0/0x8a60d30f5727c86a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.386318:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2347:3687:x1805522011789952:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1236us (1327us total) trans 4296020408 rc 0/0 00000100:00100000:1.0:1721880422.386319:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c4e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+907:2004:x1805522257756288:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 67us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.386323:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914635 00000100:00100000:2.0:1721880422.386323:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632438 00010000:00010000:3.0:1721880422.386324:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801207fa1c0/0x8a60d30f5727c86a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.386330:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801207fa1c0 already unused, calling callback (ffffffffa084e330) 00000100:00100000:2.0:1721880422.386331:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011791104 00010000:00010000:3.0:1721880422.386332:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207fa1c0/0x8a60d30f5727c86a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.386333:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011791104 00010000:00010000:1.0:1721880422.386336:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c863 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfccd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.386337:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207fa1c0/0x8a60d30f5727c86a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.386340:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c863 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfccd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.386341:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632443 00010000:00010000:3.0:1721880422.386343:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801207fa1c0/0x8a60d30f5727c86a lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.386344:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009745c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2347:3687:x1805522011791104:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.386346:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c863 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfccd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.386346:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801207fa1c0/0x8a60d30f5727c86a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.386351:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c863 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfccd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.386352:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64724 count 1 00010000:00010000:0.0:1721880422.386355:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727c878 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfccf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.386357:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c863 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfccd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.386359:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727c894 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcd4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.386360:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727c878 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfccf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.386363:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b6d00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.386365:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727c878 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfccf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.386365:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c863 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfccd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.386366:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b039680/0x8a60d30f571e5764 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127224 expref: 906 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.386369:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727c878 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfccf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.386370:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.386371:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.386372:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727c894 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.386373:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727c878 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfccf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.386376:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325cb40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.386376:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c863 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfccd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.386377:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727c878 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfccf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.386383:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b039680/0x8a60d30f571e5764 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127224 expref: 906 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.386385:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727c878 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfccf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.386385:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c863 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfccd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.386390:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b039680/0x8a60d30f571e5764 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127224 expref: 906 pid: 16098 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.386391:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727c863 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfccd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.386392:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727c878 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfccf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.386395:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727c878 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfccf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.386397:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007294f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011791232:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.386412:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdea80 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.386444:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ffe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2350:3688:x1805522011789440:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1679us (1725us total) trans 4296020409 rc 0/0 00000100:00100000:3.0:1721880422.386449:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632437 00010000:00010000:2.0:1721880422.386463:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099b0e880/0x8a60d30f571e5557 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcd2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127167 expref: 906 pid: 16101 timeout: 887 lvb_type: 0 00000004:00080000:3.0:1721880422.386469:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008ffe3b80/2, rc 0, transno 1053113 00000100:00100000:2.0:1721880422.386475:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009f1b6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011790848:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.386484:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c886 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.386487:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008ffe3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011789440:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.386488:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c886 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.386492:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c886 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.386496:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c886 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.386500:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c886 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.386503:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c886 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.386506:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801363533c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.386508:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c886 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.386509:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008ffe0000/2, rc 0, transno 1053112 00010000:00010000:2.0:1721880422.386512:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c886 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.386516:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ffe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2349:3688:x1805522011789312:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1808us (1840us total) trans 4296020411 rc 0/0 00000100:00100000:1.0:1721880422.386520:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632436 00010000:00010000:2.0:1721880422.386521:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c886 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.386525:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727c886 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcd2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.386525:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008ffe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011789952:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.386526:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801360cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2349:3687:x1805522011789824:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1431us (1490us total) trans 4296020410 rc 0/0 00000100:00100000:0.0:1721880422.386532:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632439 00000004:00080000:3.0:1721880422.386537:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008ffe3100/2, rc 0, transno 1053114 00000100:00100000:3.0:1721880422.386541:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008ffe3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011789824:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.386544:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134f6eac0/0x8a60d30f571e566f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcd3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1271d0 expref: 905 pid: 16017 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.386552:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085815500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011790976:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.386552:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008bc84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011791360:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.386564:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c88d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.386567:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727c87f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.386568:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.386569:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c88d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.386572:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727c87f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.386573:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c88d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.386577:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727c87f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.386580:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727c87f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.386580:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c88d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.386581:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008ffe1500/2, rc 0, transno 1053115 00010000:00010000:0.0:1721880422.386584:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727c87f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.386584:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c88d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.386588:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c88d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.386591:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b46c0 already unused, calling callback (ffffffffa084e330) 00000100:00100000:3.0:1721880422.386591:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008ffe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011789312:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.386593:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325c480 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.386593:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c88d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.386595:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727c87f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.386596:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c88d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.386596:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1721880422.386599:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727c87f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.386599:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008bc86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011791488:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.386605:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c88d lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.386605:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009745f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2348:3688:x1805522011790464:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1228us (1320us total) trans 4296020412 rc 0/0 00000100:00100000:2.0:1721880422.386609:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632441 00000100:00100000:3.0:1721880422.386610:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.386611:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727c88d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcd3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.386619:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011791360 00000004:00080000:3.0:1721880422.386620:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008ffe0700/2, rc 0, transno 1053116 00000100:00100000:2.0:1721880422.386621:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011791360 00000100:00100000:3.0:1721880422.386623:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008ffe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011790464:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.386630:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011791488 00000100:00100000:2.0:1721880422.386631:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011791488 00000100:00100000:3.0:1721880422.386632:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1721880422.386635:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008bc86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011791616:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.386638:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632444 00000100:00100000:2.0:1721880422.386640:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009745d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2349:3688:x1805522011791360:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.386644:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:2.0:1721880422.386648:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64725 count 1 00000100:00100000:3.0:1721880422.386653:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011791616 00000100:00100000:3.0:1721880422.386655:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011791616 00010000:00010000:2.0:1721880422.386656:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c89b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcd5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.386657:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727c87f lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.386662:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727c87f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcd1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.386663:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134f6e880/0x8a60d30f571e58a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127286 expref: 904 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.386667:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1721880422.386667:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632445 00010000:00010000:2.0:1721880422.386668:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.386670:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c89b lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.386670:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009745c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2351:3688:x1805522011791488:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.386679:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64726 count 1 00010000:00010000:2.0:1721880422.386683:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134f6e880/0x8a60d30f571e58a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127286 expref: 904 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.386687:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f9440/0x8a60d30f5727c8a2 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcd6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.386688:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134f6e880/0x8a60d30f571e58a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127286 expref: 904 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.386695:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009f1b6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011791744:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.386696:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096167cc0/0x8a60d30f571e59be lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1272e1 expref: 904 pid: 16128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.386704:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.386704:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.386706:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f9440/0x8a60d30f5727c8a2 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.386710:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008bc84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011792000:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.386710:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdeb40 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.386716:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096167cc0/0x8a60d30f571e59be lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1272e1 expref: 904 pid: 16128 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.386718:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009745f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2351:3687:x1805522011790592:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1286us (1316us total) trans 4296020413 rc 0/0 00000100:00100000:2.0:1721880422.386720:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632446 00010000:00010000:3.0:1721880422.386722:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096167cc0/0x8a60d30f571e59be lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1272e1 expref: 904 pid: 16128 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.386724:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632442 00000100:00100000:2.0:1721880422.386724:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ffe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2351:3687:x1805522011791616:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.386746:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:2.0:1721880422.386746:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64727 count 1 00000100:00100000:3.0:1721880422.386746:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880123b83100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011792128:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.386754:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727c8a9 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcd7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.386760:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011792000 00010000:00010000:2.0:1721880422.386761:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb3180/0x8a60d30f571e5aa5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127343 expref: 904 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.386763:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011792000 00010000:00010000:2.0:1721880422.386764:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.386765:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.386766:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727c8a9 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.386766:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec540 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.386776:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632447 00010000:00010000:2.0:1721880422.386778:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fcb3180/0x8a60d30f571e5aa5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127343 expref: 904 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.386779:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bc87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2351:3688:x1805522011792000:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.386787:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fcb3180/0x8a60d30f571e5aa5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127343 expref: 904 pid: 16089 timeout: 887 lvb_type: 0 00002000:00080000:1.0:1721880422.386788:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64729 count 1 00000100:00100000:3.0:1721880422.386792:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008bc86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011791872:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.386793:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880092a95180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011792256:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.386796:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c8b0 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcd9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.386803:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096db2ac0/0x8a60d30f571e5c65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcd9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1273f2 expref: 904 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.386806:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.386807:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.386807:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde3c0 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.386809:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c8b0 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcd9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.386814:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.386823:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096db2ac0/0x8a60d30f571e5c65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcd9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1273f2 expref: 904 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.386829:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011791872 00010000:00010000:1.0:1721880422.386831:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096db2ac0/0x8a60d30f571e5c65 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcd9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1273f2 expref: 904 pid: 16089 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.386832:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011791872 00000004:00080000:3.0:1721880422.386832:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009745df80/2, rc 0, transno 1053117 00000100:00100000:1.0:1721880422.386841:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085815500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011792384:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.386847:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009745df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011790592:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.386864:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.386865:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632448 00000100:00100000:3.0:1721880422.386869:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2352:3687:x1805522011791872:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.386880:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64728 count 1 00010000:00010000:3.0:1721880422.386889:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f8900/0x8a60d30f5727c8b7 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcd8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.386898:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136677a80/0x8a60d30f571e5ba1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcd8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12739e expref: 904 pid: 16019 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.386905:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.386906:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.386908:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f8900/0x8a60d30f5727c8b7 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcd8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.386912:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.386916:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1721880422.386925:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136677a80/0x8a60d30f571e5ba1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcd8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12739e expref: 904 pid: 16019 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.386930:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257756800 00000100:00100000:1.0:1721880422.386934:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257756800 00010000:00010000:3.0:1721880422.386934:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136677a80/0x8a60d30f571e5ba1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcd8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12739e expref: 904 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.386936:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007294f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011791232:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.386943:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009affad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011792640:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.386944:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727c894 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.386946:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b039680/0x8a60d30f571e5764 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127224 expref: 905 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.386967:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914636 00000100:00100000:3.0:1721880422.386968:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec180 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.386978:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e195450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+905:2005:x1805522257756800:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.386986:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1721880422.386989:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ffe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2353:3688:x1805522011790336:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1617us (1736us total) trans 4296020414 rc 0/0 00010000:00010000:1.0:1721880422.386990:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b039680/0x8a60d30f571e5764 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127224 expref: 905 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.386994:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632440 00010000:00010000:1.0:1721880422.386998:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b039680/0x8a60d30f571e5764 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127224 expref: 905 pid: 16098 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.387027:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b039680/0x8a60d30f571e5764 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcd4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127224 expref: 905 pid: 16098 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.387039:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.387040:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.387043:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727c894 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.387050:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727c894 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcd4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.387073:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.387090:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e195450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+904:2005:x1805522257756800:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 117us (178us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.387091:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727c894 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.387096:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914636 00010000:00010000:2.0:1721880422.387097:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727c894 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.387102:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727c894 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.387105:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727c894 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.387109:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727c894 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.387115:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353840 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.387117:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727c894 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.387121:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727c894 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.387127:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727c894 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.387130:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727c894 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcd4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.387143:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008bc85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011792512:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.387162:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.387186:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011792512 00000004:00080000:1.0:1721880422.387186:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008ffe0e00/2, rc 0, transno 1053118 00000100:00100000:0.0:1721880422.387190:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011792512 00000100:00100000:1.0:1721880422.387202:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008ffe0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011790336:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.387223:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009745c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2354:3687:x1805522011791104:12345-0@lo:6:osp-syn-1-0.0 Request processed in 877us (1145us total) trans 4296020415 rc 0/0 00000100:00100000:2.0:1721880422.387227:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632443 00000100:00100000:2.0:1721880422.387236:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632449 00000100:00100000:2.0:1721880422.387239:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088aab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2353:3688:x1805522011792512:12345-0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1721880422.387245:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008bc84000/2, rc 0, transno 1053119 00002000:00080000:2.0:1721880422.387247:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64730 count 1 00010000:00010000:2.0:1721880422.387254:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c8be lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcda:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.387257:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008bc84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011791104:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.387260:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1721880422.387261:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130657a80/0x8a60d30f571e5dae lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcda:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127462 expref: 903 pid: 16119 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.387265:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094691f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011792768:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.387266:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.387267:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.387269:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c8be lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcda:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.387280:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130657a80/0x8a60d30f571e5dae lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcda:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127462 expref: 903 pid: 16119 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.387283:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.387286:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130657a80/0x8a60d30f571e5dae lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcda:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127462 expref: 903 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.387289:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1721880422.387292:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007294ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011793024:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.387298:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011792768 00000100:00100000:1.0:1721880422.387298:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011792896:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.387302:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011792768 00000100:00100000:2.0:1721880422.387308:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdea80 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.387318:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632450 00000100:00100000:1.0:1721880422.387319:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.387323:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f5e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2354:3687:x1805522011792768:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.387326:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011792896 00000100:00100000:3.0:1721880422.387329:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011792896 00002000:00080000:0.0:1721880422.387338:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64731 count 1 00000100:00100000:3.0:1721880422.387342:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632451 00000100:00100000:3.0:1721880422.387345:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d33df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2355:3686:x1805522011792896:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.387347:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c8c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcdb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.387354:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64732 count 1 00010000:00010000:0.0:1721880422.387355:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009709ed00/0x8a60d30f571e5ee9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcdb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1274bd expref: 903 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.387360:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.387361:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.387361:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f8b40/0x8a60d30f5727c8cc lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcdc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.387363:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c8c5 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcdb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.387372:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136674240/0x8a60d30f571e5ffa lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcdc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127518 expref: 903 pid: 16087 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.387374:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009709ed00/0x8a60d30f571e5ee9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcdb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1274bd expref: 903 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.387377:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.387378:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.387379:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f8b40/0x8a60d30f5727c8cc lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcdc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.387380:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009709ed00/0x8a60d30f571e5ee9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcdb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1274bd expref: 903 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.387386:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf5c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011793152:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.387391:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136674240/0x8a60d30f571e5ffa lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcdc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127518 expref: 903 pid: 16087 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.387396:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136674240/0x8a60d30f571e5ffa lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcdc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127518 expref: 903 pid: 16087 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.387401:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e780 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.387402:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880125a68a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011793280:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.387417:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec900 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.387537:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009f1b6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011791744:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.387543:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880123b83100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011792128:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.387552:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c89b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.387552:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801207f9440/0x8a60d30f5727c8a2 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.387557:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.387569:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085815500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011792384:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.387580:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.387582:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c8b0 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcd9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.387594:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.387595:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257756928 00000100:00100000:1.0:1721880422.387598:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257756928 00000100:00100000:0.0:1721880422.387600:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257757056 00000100:00100000:0.0:1721880422.387604:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257757056 00010000:00010000:1.0:1721880422.387610:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134f6e880/0x8a60d30f571e58a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127286 expref: 905 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.387617:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096167cc0/0x8a60d30f571e59be lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1272e1 expref: 905 pid: 16128 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.387626:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257757184 00000100:00100000:1.0:1721880422.387629:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257757184 00010000:00010000:1.0:1721880422.387636:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096db2ac0/0x8a60d30f571e5c65 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcd9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1273f2 expref: 906 pid: 16089 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.387645:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.387670:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880092a95180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011792256:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.387680:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727c8a9 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.387700:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257757312 00000100:00100000:0.0:1721880422.387704:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257757312 00000100:00100000:1.0:1721880422.387705:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914637 00000100:00100000:1.0:1721880422.387709:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007294f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+907:2006:x1805522257756928:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.387710:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914638 00010000:00010000:0.0:1721880422.387715:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcb3180/0x8a60d30f571e5aa5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127343 expref: 907 pid: 16089 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.387715:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b46fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+907:2005:x1805522257757056:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.387717:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.387717:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914639 00010000:00010000:3.0:1721880422.387721:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.387722:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134f6e880/0x8a60d30f571e58a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127286 expref: 907 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.387723:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b46c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+907:2006:x1805522257757184:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.387724:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096167cc0/0x8a60d30f571e59be lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1272e1 expref: 907 pid: 16128 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.387749:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096167cc0/0x8a60d30f571e59be lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1272e1 expref: 907 pid: 16128 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.387756:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1721880422.387757:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914640 00010000:00010000:1.0:1721880422.387757:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134f6e880/0x8a60d30f571e58a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127286 expref: 907 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.387758:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096167cc0/0x8a60d30f571e59be lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcd6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1272e1 expref: 907 pid: 16128 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.387763:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b46f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+906:2005:x1805522257757312:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.387763:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096db2ac0/0x8a60d30f571e5c65 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcd9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1273f2 expref: 907 pid: 16089 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.387765:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.387766:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.387768:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801207f9440/0x8a60d30f5727c8a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.387771:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.387771:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134f6e880/0x8a60d30f571e58a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcd5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127286 expref: 906 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.387772:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f9440/0x8a60d30f5727c8a2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcd6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.387775:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fcb3180/0x8a60d30f571e5aa5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcd7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127343 expref: 906 pid: 16089 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.387777:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096db2ac0/0x8a60d30f571e5c65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcd9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1273f2 expref: 906 pid: 16089 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.387780:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.387781:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.387782:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.387784:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fcb3180/0x8a60d30f571e5aa5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcd7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127343 expref: 905 pid: 16089 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.387785:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c89b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.387790:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096db2ac0/0x8a60d30f571e5c65 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcd9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1273f2 expref: 905 pid: 16089 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.387791:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c89b lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcd5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.387797:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b46fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+904:2005:x1805522257757056:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 82us (217us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.387801:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.387801:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914638 00010000:00010000:2.0:1721880422.387803:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.387805:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c8b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcd9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.387806:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.387812:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c8b0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcd9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.387823:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007294f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+903:2006:x1805522257756928:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 112us (266us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.387824:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.387829:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914637 00000100:00100000:2.0:1721880422.387844:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b46c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+902:2006:x1805522257757184:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 120us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.387851:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914639 00010000:00010000:0.0:1721880422.387857:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb3180/0x8a60d30f571e5aa5 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcd7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127343 expref: 902 pid: 16089 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.387888:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.387903:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257757440 00000100:00100000:3.0:1721880422.387905:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009affad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011792640:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.387906:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257757440 00010000:00010000:3.0:1721880422.387917:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801207f8900/0x8a60d30f5727c8b7 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcd8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.387919:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.387919:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136677a80/0x8a60d30f571e5ba1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcd8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12739e expref: 901 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.387921:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.387923:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727c8a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.387930:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727c8a9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcd7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.387930:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801207f9440/0x8a60d30f5727c8a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.387936:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914641 00010000:00010000:3.0:1721880422.387937:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207f9440/0x8a60d30f5727c8a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.387941:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d33d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+901:2005:x1805522257757440:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.387943:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.387945:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f9440/0x8a60d30f5727c8a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.387947:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.387951:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f9440/0x8a60d30f5727c8a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.387952:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136677a80/0x8a60d30f571e5ba1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcd8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12739e expref: 901 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.387958:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801207f9440/0x8a60d30f5727c8a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.387960:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136677a80/0x8a60d30f571e5ba1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcd8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12739e expref: 901 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.387963:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801207f9440 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.387966:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f9440/0x8a60d30f5727c8a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.387968:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b46f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+901:2005:x1805522257757312:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 205us (324us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.387972:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136677a80/0x8a60d30f571e5ba1 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcd8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12739e expref: 901 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.387973:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f9440/0x8a60d30f5727c8a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.387975:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914640 00010000:00010000:3.0:1721880422.387982:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801207f9440/0x8a60d30f5727c8a2 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.387983:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.387985:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.387987:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801207f8900/0x8a60d30f5727c8b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcd8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.387988:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801207f9440/0x8a60d30f5727c8a2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcd6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.387994:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f8900/0x8a60d30f5727c8b7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcd8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.388009:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.388038:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.388051:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d33d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+899:2005:x1805522257757440:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 108us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.388058:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914641 00000100:00100000:2.0:1721880422.388070:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257757696 00000100:00100000:2.0:1721880422.388073:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257757696 00010000:00010000:2.0:1721880422.388083:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009709ed00/0x8a60d30f571e5ee9 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfcdb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1274bd expref: 899 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.388086:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.388107:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257757568 00000100:00100000:2.0:1721880422.388110:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257757568 00000100:00100000:0.0:1721880422.388116:0:8793:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914642 00000100:00100000:0.0:1721880422.388120:0:8793:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085815500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30425778-2709-4512-9d75-01ec53c4cfad+900:2005:x1805522257757696:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.388121:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130657a80/0x8a60d30f571e5dae lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfcda:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127462 expref: 900 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.388126:0:8793:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.388129:0:8793:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009709ed00/0x8a60d30f571e5ee9 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfcdb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1274bd expref: 900 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.388132:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801207f8900/0x8a60d30f5727c8b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.388135:0:8793:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009709ed00/0x8a60d30f571e5ee9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcdb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1274bd expref: 900 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.388137:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914643 00000100:00100000:1.0:1721880422.388138:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.388139:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207f8900/0x8a60d30f5727c8b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.388142:0:8793:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.388143:0:8793:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.388143:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5276850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+900:2004:x1805522257757568:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.388145:0:8793:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c8c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcdb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.388147:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f8900/0x8a60d30f5727c8b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.388149:0:8793:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c8c5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcdb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.388149:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257757824 00010000:00010000:2.0:1721880422.388150:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.388151:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257757824 00010000:00010000:3.0:1721880422.388153:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f8900/0x8a60d30f5727c8b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.388154:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130657a80/0x8a60d30f571e5dae lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfcda:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127462 expref: 901 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.388156:0:8793:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.388159:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801207f8900/0x8a60d30f5727c8b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.388160:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136674240/0x8a60d30f571e5ffa lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfcdc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127518 expref: 901 pid: 16087 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.388164:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130657a80/0x8a60d30f571e5dae lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcda:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127462 expref: 901 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.388164:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801207f8900 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.388165:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f8900/0x8a60d30f5727c8b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.388169:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f8900/0x8a60d30f5727c8b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.388170:0:8793:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880085815500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30425778-2709-4512-9d75-01ec53c4cfad+901:2005:x1805522257757696:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 49us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.388173:0:8793:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914642 00010000:00010000:2.0:1721880422.388175:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.388175:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801207f8900/0x8a60d30f5727c8b7 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.388176:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1721880422.388177:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914644 00010000:00010000:2.0:1721880422.388179:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c8be lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcda:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.388179:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801207f8900/0x8a60d30f5727c8b7 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcd8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.388180:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134e96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+900:2004:x1805522257757824:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.388185:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.388187:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136674240/0x8a60d30f571e5ffa lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfcdc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127518 expref: 900 pid: 16087 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.388187:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c8be lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcda:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.388194:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136674240/0x8a60d30f571e5ffa lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcdc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127518 expref: 900 pid: 16087 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.388197:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.388204:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.388206:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.388208:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801207f8b40/0x8a60d30f5727c8cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcdc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.388214:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5276850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+900:2004:x1805522257757568:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 71us (127us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.388215:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f8b40/0x8a60d30f5727c8cc lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcdc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.388221:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914643 00010000:00010000:1.0:1721880422.388225:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.388249:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880134e96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+899:2004:x1805522257757824:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 67us (110us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.388252:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009709ed00/0x8a60d30f571e5ee9 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcdb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1274bd expref: 899 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.388256:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914644 00000100:00100000:0.0:1721880422.388264:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008bf5c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011793152:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.388265:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880091134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2357:3687:x1805522011791872:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1395us (1450us total) trans 4296020417 rc 0/0 00000100:00100000:3.0:1721880422.388272:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632448 00010000:00010000:0.0:1721880422.388274:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c8c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.388279:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c8c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.388283:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c8c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.388287:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c8c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.388291:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c8c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.388291:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130657a80/0x8a60d30f571e5dae lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcda:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127462 expref: 897 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.388303:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007294ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011793024:192.168.201.24@tcp:104: 00000004:00080000:3.0:1721880422.388304:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008bc86d80/2, rc 0, transno 1053121 00010000:00010000:1.0:1721880422.388311:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c8b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.388315:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c8be lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.388316:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c8b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.388321:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c8b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.388321:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008bc86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011791872:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.388323:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c8be lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.388325:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c8b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.388329:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c8b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.388330:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c8be lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.388332:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b5440 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.388334:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c8b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.388337:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c8be lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.388338:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c8b0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.388343:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c8c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.388344:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c8b0 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.388345:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c8be lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.388347:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325ed00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.388347:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727c8b0 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcd9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.388348:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009745c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2356:3688:x1805522011791488:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1676us (1737us total) trans 4296020416 rc 0/0 00010000:00010000:0.0:1721880422.388349:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c8c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.388351:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c8be lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.388353:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c8c5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.388354:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632445 00010000:00010000:2.0:1721880422.388357:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350240 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.388360:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c8be lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.388364:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c8c5 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.388367:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c8be lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.388368:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727c8c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcdb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.388376:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c8be lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.388381:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136674240/0x8a60d30f571e5ffa lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcdc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127518 expref: 896 pid: 16087 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.388388:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727c8be lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcda:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.388394:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880125a68a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011793280:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.388409:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801207f8b40/0x8a60d30f5727c8cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.388416:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801207f8b40/0x8a60d30f5727c8cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.388419:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207f8b40/0x8a60d30f5727c8cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.388423:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f8b40/0x8a60d30f5727c8cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.388426:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bc87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2356:3688:x1805522011792000:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1646us (1699us total) trans 4296020418 rc 0/0 00010000:00010000:3.0:1721880422.388428:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f8b40/0x8a60d30f5727c8cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.388431:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632447 00010000:00010000:3.0:1721880422.388432:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801207f8b40/0x8a60d30f5727c8cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.388435:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801207f8b40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.388438:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f8b40/0x8a60d30f5727c8cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.388440:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727c8a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.388442:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f8b40/0x8a60d30f5727c8cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.388448:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727c8a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.388448:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801207f8b40/0x8a60d30f5727c8cc lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.388450:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011793408:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.388452:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801207f8b40/0x8a60d30f5727c8cc lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcdc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.388455:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727c8a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.388462:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727c8a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.388467:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.388469:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727c8a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.388475:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350000 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.388478:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727c8a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.388484:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727c8a9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.388486:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008bc84700/2, rc 0, transno 1053122 00010000:00010000:2.0:1721880422.388494:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727c8a9 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.388501:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727c8a9 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcd7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.388502:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008bc84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011792000:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1721880422.388515:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008bc86680/2, rc 0, transno 1053120 00000100:00100000:1.0:1721880422.388518:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008bc86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011791488:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.388532:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c89b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.388536:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c89b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.388541:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c89b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.388545:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c89b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.388549:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c89b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.388552:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350480 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.388553:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c89b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.388557:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c89b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.388558:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d33df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2359:3686:x1805522011792896:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1210us (1238us total) trans 4296020421 rc 0/0 00000100:00100000:3.0:1721880422.388564:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632451 00010000:00010000:1.0:1721880422.388567:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c89b lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.388571:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727c89b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcd5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.388576:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011793408 00000100:00100000:3.0:1721880422.388579:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011793408 00000100:00100000:3.0:1721880422.388594:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632452 00000100:00100000:3.0:1721880422.388597:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c4e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2359:3688:x1805522011793408:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.388605:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ffe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2359:3687:x1805522011791616:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1879us (1958us total) trans 4296020422 rc 0/0 00002000:00080000:3.0:1721880422.388606:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64733 count 1 00000100:00100000:0.0:1721880422.388609:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088aab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2359:3688:x1805522011792512:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1368us (1445us total) trans 4296020420 rc 0/0 00000100:00100000:2.0:1721880422.388612:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632446 00010000:00010000:3.0:1721880422.388613:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207faf40/0x8a60d30f5727c8d3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcdd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.388615:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632449 00010000:00010000:3.0:1721880422.388621:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800973fb840/0x8a60d30f571e60be lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcdd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127565 expref: 895 pid: 15515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.388624:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.388625:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.388627:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207faf40/0x8a60d30f5727c8d3 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcdd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.388637:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800973fb840/0x8a60d30f571e60be lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcdd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127565 expref: 895 pid: 15515 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.388644:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f5e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2358:3687:x1805522011792768:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1321us (1360us total) trans 4296020419 rc 0/0 00010000:00010000:3.0:1721880422.388644:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800973fb840/0x8a60d30f571e60be lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcdd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127565 expref: 895 pid: 15515 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.388648:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632450 00000100:00100000:3.0:1721880422.388649:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880125a68a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011793792:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.388668:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec900 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.388676:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011793536:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.388679:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009745d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2357:3688:x1805522011791360:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2036us (2108us total) trans 4296020423 rc 0/0 00000100:00100000:1.0:1721880422.388686:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632444 00000100:00100000:3.0:1721880422.388689:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.388707:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011793536 00000100:00100000:0.0:1721880422.388710:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011793536 00000004:00080000:3.0:1721880422.388714:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880094691f80/2, rc 0, transno 1053123 00000100:00100000:3.0:1721880422.388744:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094691f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011792768:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1721880422.388751:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008bc86a00/2, rc 0, transno 1053126 00000100:00100000:3.0:1721880422.388754:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008bc86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011791616:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.388760:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011793920:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.388772:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.388777:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011793920 00000100:00100000:0.0:1721880422.388779:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011793920 00000100:00100000:3.0:1721880422.388780:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1721880422.388783:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011793664:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.388790:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632453 00000100:00100000:3.0:1721880422.388791:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.388793:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880125a6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2358:3689:x1805522011793536:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.388802:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64734 count 1 00000100:00100000:2.0:1721880422.388804:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1721880422.388809:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011793664 00010000:00010000:0.0:1721880422.388810:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727c8da lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcde:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.388811:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011793664 00000100:00100000:2.0:1721880422.388813:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011794048:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.388814:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632454 00010000:00010000:0.0:1721880422.388817:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b2361c0/0x8a60d30f571e6190 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcde:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1275b9 expref: 895 pid: 16091 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.388818:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880125a69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2359:3687:x1805522011793920:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.388822:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.388823:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1721880422.388823:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632455 00010000:00010000:0.0:1721880422.388825:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727c8da lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcde:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.388826:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009affad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2359:3687:x1805522011793664:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.388828:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64736 count 1 00002000:00080000:3.0:1721880422.388833:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64735 count 1 00010000:00010000:0.0:1721880422.388835:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b2361c0/0x8a60d30f571e6190 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcde:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1275b9 expref: 895 pid: 16091 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.388835:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c8e1 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfce0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.388835:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.388840:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207fba80/0x8a60d30f5727c8e8 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcdf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.388841:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b2361c0/0x8a60d30f571e6190 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcde:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1275b9 expref: 895 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.388842:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009caed440/0x8a60d30f571e631f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfce0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12768b expref: 895 pid: 16131 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.388847:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.388848:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.388848:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e8e2400/0x8a60d30f571e624d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcdf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127614 expref: 895 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.388849:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf5d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011794176:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.388849:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c8e1 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfce0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.388851:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.388852:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.388854:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207fba80/0x8a60d30f5727c8e8 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcdf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.388858:0:9458:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011794048 00000100:00100000:0.0:1721880422.388860:0:9458:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011794048 00010000:00010000:1.0:1721880422.388860:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009caed440/0x8a60d30f571e631f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfce0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12768b expref: 895 pid: 16131 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.388863:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e8e2400/0x8a60d30f571e624d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcdf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127614 expref: 895 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.388868:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e8e2400/0x8a60d30f571e624d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcdf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127614 expref: 895 pid: 16111 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.388869:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009caed440/0x8a60d30f571e631f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfce0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12768b expref: 895 pid: 16131 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.388873:0:9458:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632456 00000100:00100000:3.0:1721880422.388874:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880123b83100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011794432:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.388875:0:9458:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b46fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2360:3689:x1805522011794048:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.388876:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012c887480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011794304:192.168.201.24@tcp:104: 00002000:00080000:0.0:1721880422.388882:0:9458:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64737 count 1 00010000:00010000:0.0:1721880422.388888:0:9458:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727c8ef lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfce1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.388890:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.388890:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec180 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.388895:0:9458:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a6b7840/0x8a60d30f571e647d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfce1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1276fb expref: 895 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.388899:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.388899:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.388901:0:9458:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727c8ef lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfce1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.388906:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008bc85500/2, rc 0, transno 1053124 00010000:00010000:0.0:1721880422.388910:0:9458:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a6b7840/0x8a60d30f571e647d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfce1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1276fb expref: 895 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.388913:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008bc85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011792512:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.388919:0:9458:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a6b7840/0x8a60d30f571e647d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfce1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1276fb expref: 895 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.388928:0:9458:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf5ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011794560:192.168.201.24@tcp:104: 00000004:00080000:1.0:1721880422.388937:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008bc84380/2, rc 0, transno 1053127 00000100:00100000:1.0:1721880422.388940:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008bc84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011791360:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.388940:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012c886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011794688:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.388948:0:9458:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.388956:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.388957:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012c886680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011794816:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.388963:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011794688 00000100:00100000:0.0:1721880422.388966:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011794688 00000100:00100000:1.0:1721880422.388972:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.388982:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011794816 00000004:00080000:1.0:1721880422.388984:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008bf5c380/2, rc 0, transno 1053125 00000100:00100000:3.0:1721880422.388984:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011794816 00000100:00100000:0.0:1721880422.388987:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632457 00000100:00100000:1.0:1721880422.388987:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008bf5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011792896:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.388992:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a05fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2362:3689:x1805522011794688:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.388997:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632458 00002000:00080000:0.0:1721880422.389000:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64738 count 1 00000100:00100000:1.0:1721880422.389000:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1721880422.389003:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011794944:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.389003:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2362:3686:x1805522011794816:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.389008:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c8f6 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfce2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.389030:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:2.0:1721880422.389030:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64739 count 1 00010000:00010000:2.0:1721880422.389041:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727c8fd lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfce3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.389043:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011794944 00000100:00100000:3.0:1721880422.389046:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011794944 00010000:00010000:2.0:1721880422.389052:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0945f80/0x8a60d30f571e66f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfce3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127795 expref: 895 pid: 16128 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.389056:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632459 00010000:00010000:2.0:1721880422.389059:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1721880422.389059:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134e94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2363:3686:x1805522011794944:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.389060:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.389062:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727c8fd lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfce3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.389066:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64740 count 1 00010000:00010000:3.0:1721880422.389073:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f9f80/0x8a60d30f5727c904 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfce4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.389077:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880070085b00/0x8a60d30f571e65cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfce2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127741 expref: 895 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.389078:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0945f80/0x8a60d30f571e66f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfce3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127795 expref: 895 pid: 16128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.389080:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a6b4900/0x8a60d30f571e67ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfce4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1277e9 expref: 895 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.389081:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.389082:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.389084:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c8f6 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfce2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.389085:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.389086:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.389087:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f9f80/0x8a60d30f5727c904 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfce4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.389093:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0945f80/0x8a60d30f571e66f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfce3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127795 expref: 895 pid: 16128 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.389095:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880070085b00/0x8a60d30f571e65cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfce2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127741 expref: 895 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.389098:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a6b4900/0x8a60d30f571e67ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfce4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1277e9 expref: 895 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.389101:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880070085b00/0x8a60d30f571e65cd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfce2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127741 expref: 895 pid: 16089 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.389103:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b46c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011795072:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.389103:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a6b4900/0x8a60d30f571e67ef lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfce4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1277e9 expref: 895 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.389109:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e47b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011795328:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.389111:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf5e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011795200:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.389126:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec540 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.389128:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdea80 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.389130:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.389141:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e780 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.389244:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880125a68a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011793792:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.389253:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801207faf40/0x8a60d30f5727c8d3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcdd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.390047:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.390062:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.390079:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880123b83100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011794432:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.390085:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257757952 00000100:00100000:0.0:1721880422.390088:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.390092:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257757952 00010000:00010000:3.0:1721880422.390093:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801207fba80/0x8a60d30f5727c8e8 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcdf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.390102:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257758080 00000100:00100000:2.0:1721880422.390104:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257758080 00000100:00100000:0.0:1721880422.390112:0:9458:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008bf5ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011794560:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.390116:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e8e2400/0x8a60d30f571e624d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcdf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127614 expref: 897 pid: 16111 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.390122:0:9458:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727c8ef lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfce1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.390127:0:16188:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257758208 00000100:00100000:1.0:1721880422.390133:0:16188:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257758208 00000100:00100000:2.0:1721880422.390137:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914645 00000100:00100000:2.0:1721880422.390142:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bf5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+898:2006:x1805522257758080:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.390148:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.390149:0:16188:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009caed440/0x8a60d30f571e631f lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfce0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12768b expref: 898 pid: 16131 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.390152:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e8e2400/0x8a60d30f571e624d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcdf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127614 expref: 898 pid: 16111 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.390155:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b46c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011795072:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.390162:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e8e2400/0x8a60d30f571e624d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcdf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127614 expref: 898 pid: 16111 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.390167:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.390175:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e8e2400/0x8a60d30f571e624d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcdf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127614 expref: 898 pid: 16111 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.390179:0:16188:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257758336 00010000:00010000:3.0:1721880422.390179:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727c8fd lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfce3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.390181:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914646 00000100:00100000:1.0:1721880422.390181:0:16188:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257758336 00000100:00100000:0.0:1721880422.390185:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+898:2004:x1805522257758208:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.390187:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.390190:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.390192:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.390192:0:16188:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a6b7840/0x8a60d30f571e647d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfce1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1276fb expref: 898 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.390192:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801207fba80/0x8a60d30f5727c8e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcdf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.390196:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009caed440/0x8a60d30f571e631f lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfce0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12768b expref: 898 pid: 16131 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.390199:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207fba80/0x8a60d30f5727c8e8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcdf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.390202:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009caed440/0x8a60d30f571e631f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfce0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12768b expref: 898 pid: 16131 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.390211:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.390212:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1721880422.390213:0:16188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914647 00010000:00010000:0.0:1721880422.390214:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c8e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfce0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.390215:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.390219:0:16188:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+898:2005:x1805522257758336:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.390221:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c8e1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfce0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.390225:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801207fba80/0x8a60d30f5727c8e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.390227:0:16188:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.390228:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.390231:0:16188:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a6b7840/0x8a60d30f571e647d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfce1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1276fb expref: 898 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.390232:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207fba80/0x8a60d30f5727c8e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.390236:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bf5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+898:2006:x1805522257758080:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 93us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.390238:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+898:2004:x1805522257758208:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 53us (150us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.390239:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207fba80/0x8a60d30f5727c8e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.390241:0:16188:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a6b7840/0x8a60d30f571e647d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfce1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1276fb expref: 898 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.390242:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914646 00010000:00010000:3.0:1721880422.390245:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801207fba80/0x8a60d30f5727c8e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.390252:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914645 00010000:00010000:3.0:1721880422.390252:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801207fba80/0x8a60d30f5727c8e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.390254:0:16188:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a6b7840/0x8a60d30f571e647d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfce1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1276fb expref: 897 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.390257:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801207fba80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.390260:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207fba80/0x8a60d30f5727c8e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.390261:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008bf5e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011795200:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.390266:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.390267:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.390267:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207fba80/0x8a60d30f5727c8e8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.390268:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c8f6 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfce2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.390270:0:16188:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727c8ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfce1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.390276:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800973fb840/0x8a60d30f571e60be lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcdd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127565 expref: 895 pid: 15515 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.390277:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008bf5d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011794176:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.390278:0:16188:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727c8ef lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfce1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.390281:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801207fba80/0x8a60d30f5727c8e8 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.390284:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727c8da lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcde:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.390287:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801207fba80/0x8a60d30f5727c8e8 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcdf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.390295:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914648 00000100:00100000:2.0:1721880422.390299:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bf5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+895:2005:x1805522257757952:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.390302:0:16188:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.390306:0:9458:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727c8ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfce1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.390307:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.390311:0:9458:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727c8ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfce1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.390311:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800973fb840/0x8a60d30f571e60be lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcdd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127565 expref: 895 pid: 15515 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.390316:0:9458:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727c8ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfce1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.390320:0:9458:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727c8ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfce1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.390320:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800973fb840/0x8a60d30f571e60be lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcdd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127565 expref: 895 pid: 15515 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.390324:0:9458:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727c8ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfce1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.390326:0:16188:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+895:2005:x1805522257758336:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 106us (157us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.390328:0:9458:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325d200 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.390330:0:9458:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727c8ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfce1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.390333:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800973fb840/0x8a60d30f571e60be lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcdd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127565 expref: 895 pid: 15515 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.390334:0:9458:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727c8ef lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfce1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.390334:0:16188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914647 00010000:00010000:0.0:1721880422.390339:0:9458:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727c8ef lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfce1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.390343:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727c8ef lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfce1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.390344:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.390345:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.390348:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801207faf40/0x8a60d30f5727c8d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcdd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.390355:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207faf40/0x8a60d30f5727c8d3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcdd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.390370:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.390371:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009caed440/0x8a60d30f571e631f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfce0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12768b expref: 893 pid: 16131 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.390383:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012c887480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011794304:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.390388:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bf5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+892:2005:x1805522257757952:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 87us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.390394:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914648 00010000:00010000:1.0:1721880422.390395:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c8e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfce0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.390400:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009affad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2365:3687:x1805522011793664:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1571us (1605us total) trans 4296020424 rc 0/0 00010000:00010000:1.0:1721880422.390402:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c8e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfce0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.390407:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632455 00010000:00010000:1.0:1721880422.390408:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c8e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfce0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.390415:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c8e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfce0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.390421:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c8e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfce0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.390426:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c8e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfce0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.390428:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.390432:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4d80 already unused, calling callback (ffffffffa084e330) 00000004:00080000:3.0:1721880422.390433:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008bf5f480/2, rc 0, transno 1053128 00010000:00010000:1.0:1721880422.390435:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c8e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfce0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.390440:0:9458:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b46fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2364:3689:x1805522011794048:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1563us (1605us total) trans 4296020425 rc 0/0 00010000:00010000:1.0:1721880422.390441:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c8e1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfce0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.390445:0:9458:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632456 00000100:00100000:3.0:1721880422.390451:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008bf5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011793664:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.390457:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c8e1 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfce0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.390463:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c8e1 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfce0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.390467:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008bf5e300/2, rc 0, transno 1053129 00000100:00100000:2.0:1721880422.390467:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.390470:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008bf5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011794048:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.390473:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e47b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011795328:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.390479:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257758592 00000100:00100000:2.0:1721880422.390482:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257758592 00000100:00100000:0.0:1721880422.390488:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.390488:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801207f9f80/0x8a60d30f5727c904 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfce4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.390494:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a6b4900/0x8a60d30f571e67ef lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfce4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1277e9 expref: 892 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.390498:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257758720 00000100:00100000:0.0:1721880422.390501:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257758720 00010000:00010000:3.0:1721880422.390502:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801207faf40/0x8a60d30f5727c8d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.390508:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880070085b00/0x8a60d30f571e65cd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfce2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127741 expref: 893 pid: 16089 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.390508:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207faf40/0x8a60d30f5727c8d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.390510:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257758848 00000100:00100000:2.0:1721880422.390512:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257758848 00010000:00010000:3.0:1721880422.390516:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207faf40/0x8a60d30f5727c8d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.390521:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b2361c0/0x8a60d30f571e6190 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcde:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1275b9 expref: 894 pid: 16091 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.390522:0:16188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914649 00010000:00010000:3.0:1721880422.390523:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801207faf40/0x8a60d30f5727c8d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.390527:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914650 00000100:00100000:1.0:1721880422.390529:0:16188:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b46f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+894:2005:x1805522257758592:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.390529:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801207faf40/0x8a60d30f5727c8d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.390530:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8065850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+894:2005:x1805522257758720:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.390535:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801207faf40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.390537:0:16188:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.390538:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.390540:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880070085b00/0x8a60d30f571e65cd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfce2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127741 expref: 894 pid: 16089 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.390540:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207faf40/0x8a60d30f5727c8d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.390543:0:16188:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a6b4900/0x8a60d30f571e67ef lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfce4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1277e9 expref: 894 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.390546:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880070085b00/0x8a60d30f571e65cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfce2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127741 expref: 894 pid: 16089 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.390546:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207faf40/0x8a60d30f5727c8d3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.390548:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914651 00010000:00010000:1.0:1721880422.390551:0:16188:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a6b4900/0x8a60d30f571e67ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfce4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1277e9 expref: 894 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.390553:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880070085b00/0x8a60d30f571e65cd lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfce2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127741 expref: 894 pid: 16089 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.390553:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+894:2005:x1805522257758848:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.390555:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801207faf40/0x8a60d30f5727c8d3 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.390561:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.390561:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.390561:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.390562:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801207faf40/0x8a60d30f5727c8d3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcdd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.390563:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c8f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfce2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.390563:0:16188:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a6b4900/0x8a60d30f571e67ef lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfce4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1277e9 expref: 893 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.390565:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b2361c0/0x8a60d30f571e6190 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcde:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1275b9 expref: 893 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.390568:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c8f6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfce2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.390573:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.390575:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.390576:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.390577:0:16188:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801207f9f80/0x8a60d30f5727c904 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfce4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.390579:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b2361c0/0x8a60d30f571e6190 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcde:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1275b9 expref: 892 pid: 16091 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.390585:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8065850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+892:2005:x1805522257758720:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 54us (119us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.390585:0:16188:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f9f80/0x8a60d30f5727c904 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfce4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.390589:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914650 00010000:00010000:2.0:1721880422.390592:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b2361c0/0x8a60d30f571e6190 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcde:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1275b9 expref: 892 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.390603:0:16188:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.390605:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099492300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011795584:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.390605:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.390607:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.390610:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727c8da lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcde:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.390617:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727c8da lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcde:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.390624:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.390625:0:16188:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b46f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+890:2005:x1805522257758592:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 96us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.390632:0:16188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914649 00010000:00010000:2.0:1721880422.390632:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.390634:0:9458:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011795584 00000100:00100000:0.0:1721880422.390636:0:9458:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011795584 00000100:00100000:0.0:1721880422.390646:0:9458:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632460 00000100:00100000:0.0:1721880422.390649:0:9458:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bf5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2365:3689:x1805522011795584:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.390650:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+889:2005:x1805522257758848:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 96us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.390657:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914651 00002000:00080000:0.0:1721880422.390658:0:9458:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64742 count 1 00010000:00010000:0.0:1721880422.390665:0:9458:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727c90b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfce6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.390672:0:9458:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d6158c0/0x8a60d30f571e6946 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfce6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12787c expref: 888 pid: 15515 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.390672:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c4e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2365:3688:x1805522011793408:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2072us (2203us total) trans 4296020426 rc 0/0 00010000:00010000:0.0:1721880422.390677:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.390678:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.390679:0:9458:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727c90b lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfce6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.390679:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727c8da lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.390679:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632452 00000100:00100000:1.0:1721880422.390684:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012c887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011795456:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.390686:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727c8da lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.390688:0:9458:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d6158c0/0x8a60d30f571e6946 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfce6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12787c expref: 888 pid: 15515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.390693:0:9458:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d6158c0/0x8a60d30f571e6946 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfce6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12787c expref: 888 pid: 15515 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.390694:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727c8da lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.390698:0:9458:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf5e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011795712:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.390700:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801207f9f80/0x8a60d30f5727c904 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfce4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.390705:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.390706:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727c8da lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.390707:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207f9f80/0x8a60d30f5727c904 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfce4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.390713:0:9458:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e780 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.390713:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727c8da lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.390714:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f9f80/0x8a60d30f5727c904 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfce4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.390719:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325d680 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.390721:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f9f80/0x8a60d30f5727c904 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfce4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.390722:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727c8da lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.390725:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c8f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfce2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.390725:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008bf5c000/2, rc 0, transno 1053130 00010000:00010000:3.0:1721880422.390749:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801207f9f80/0x8a60d30f5727c904 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfce4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.390750:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727c8da lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.390751:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008bf5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011793408:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.390752:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c8f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfce2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.390756:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801207f9f80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.390757:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c8f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfce2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.390759:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f9f80/0x8a60d30f5727c904 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfce4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.390760:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727c8da lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.390761:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c8f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfce2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.390764:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c8f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfce2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.390766:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f9f80/0x8a60d30f5727c904 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfce4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.390767:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325e880 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.390767:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727c8da lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcde:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.390769:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c8f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfce2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.390773:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c8f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfce2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.390776:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801207f9f80/0x8a60d30f5727c904 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfce4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.390779:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c8f6 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfce2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.390782:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801207f9f80/0x8a60d30f5727c904 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfce4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.390783:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727c8f6 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfce2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.390787:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009f1b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011795840:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.390803:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.390814:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011795456 00000100:00100000:3.0:1721880422.390817:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011795456 00000100:00100000:3.0:1721880422.390832:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011795840 00000100:00100000:3.0:1721880422.390835:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011795840 00000100:00100000:3.0:1721880422.390846:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632461 00000100:00100000:3.0:1721880422.390851:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134e96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2369:3688:x1805522011795456:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.390863:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64741 count 1 00000100:00100000:0.0:1721880422.390867:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a05fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2369:3689:x1805522011794688:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1875us (1909us total) trans 4296020427 rc 0/0 00000100:00100000:0.0:1721880422.390872:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632457 00010000:00010000:3.0:1721880422.390873:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207fb600/0x8a60d30f5727c912 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfce5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.390883:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632462 00010000:00010000:3.0:1721880422.390884:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0b78fc0/0x8a60d30f571e68ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfce5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12782f expref: 888 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.390885:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2368:3686:x1805522011795840:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.390890:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880125a6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2368:3689:x1805522011793536:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2094us (2198us total) trans 4296020428 rc 0/0 00010000:00010000:3.0:1721880422.390891:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.390892:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00002000:00080000:0.0:1721880422.390894:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64743 count 1 00010000:00010000:3.0:1721880422.390895:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207fb600/0x8a60d30f5727c912 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfce5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.390897:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632453 00010000:00010000:0.0:1721880422.390901:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727c919 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfce7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.390909:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009732ba80/0x8a60d30f571e69e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfce7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1278d0 expref: 888 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.390911:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0b78fc0/0x8a60d30f571e68ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfce5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12782f expref: 888 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.390913:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.390914:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.390916:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727c919 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfce7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.390917:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880125a69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2367:3687:x1805522011793920:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2098us (2142us total) trans 4296020429 rc 0/0 00010000:00010000:3.0:1721880422.390921:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0b78fc0/0x8a60d30f571e68ba lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfce5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12782f expref: 888 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.390924:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632454 00010000:00010000:0.0:1721880422.390925:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009732ba80/0x8a60d30f571e69e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfce7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1278d0 expref: 888 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.390931:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009732ba80/0x8a60d30f571e69e0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfce7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1278d0 expref: 888 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.390931:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e47b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011795968:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.390938:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf5ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011796096:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.390952:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec540 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.390954:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.390957:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000004:00080000:0.0:1721880422.390970:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012c886d80/2, rc 0, transno 1053131 00000100:00100000:1.0:1721880422.390974:0:16188:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257758464 00000100:00100000:0.0:1721880422.390975:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012c886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011794688:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.390977:0:16188:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257758464 00000004:00080000:3.0:1721880422.390977:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008bf5ca80/2, rc 0, transno 1053133 00000100:00100000:3.0:1721880422.390982:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008bf5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011793920:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1721880422.390983:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008bf5d500/2, rc 0, transno 1053132 00000100:00100000:0.0:1721880422.390987:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008bf5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011793536:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.390989:0:16188:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0945f80/0x8a60d30f571e66f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfce3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127795 expref: 889 pid: 16128 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.391006:0:16188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914652 00000100:00100000:1.0:1721880422.391029:0:16188:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b46f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+889:2004:x1805522257758464:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.391037:0:16188:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.391041:0:16188:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0945f80/0x8a60d30f571e66f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfce3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127795 expref: 889 pid: 16128 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.391055:0:16188:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0945f80/0x8a60d30f571e66f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfce3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127795 expref: 889 pid: 16128 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.391068:0:16188:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0945f80/0x8a60d30f571e66f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfce3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127795 expref: 889 pid: 16128 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.391076:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.391078:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.391081:0:16188:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727c8fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfce3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.391087:0:16188:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727c8fd lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfce3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.391101:0:16188:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.391104:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880134e94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2367:3686:x1805522011794944:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2042us (2072us total) trans 4296020430 rc 0/0 00000100:00100000:3.0:1721880422.391111:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632459 00000004:00080000:2.0:1721880422.391120:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880122fd0000/2, rc 0, transno 1053134 00000100:00100000:1.0:1721880422.391121:0:16188:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b46f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+888:2004:x1805522257758464:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 109us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.391126:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011794944:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.391127:0:16188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914652 00010000:00010000:3.0:1721880422.391130:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727c8fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfce3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.391137:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727c8fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfce3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.391145:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727c8fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfce3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.391151:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727c8fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfce3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.391158:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727c8fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfce3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.391163:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352400 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.391166:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727c8fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfce3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.391172:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727c8fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfce3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.391174:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1721880422.391181:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727c8fd lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfce3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.391184:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880091135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011796224:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.391188:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727c8fd lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfce3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.391197:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880091134380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011796352:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.391205:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.391217:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007b8c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011796480:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.391228:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.391228:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007b8c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011796608:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.391248:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.391257:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011796224 00000100:00100000:2.0:1721880422.391260:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011796224 00000100:00100000:0.0:1721880422.391268:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011796352 00000100:00100000:0.0:1721880422.391270:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011796352 00000100:00100000:2.0:1721880422.391275:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011796480 00000100:00100000:2.0:1721880422.391278:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011796480 00000100:00100000:0.0:1721880422.391282:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632463 00000100:00100000:0.0:1721880422.391286:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b46c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2370:3686:x1805522011796224:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.391288:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632464 00000100:00100000:1.0:1721880422.391293:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009528b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2370:3688:x1805522011796352:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.391293:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2370:3686:x1805522011794816:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2288us (2318us total) trans 4296020431 rc 0/0 00002000:00080000:0.0:1721880422.391294:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64744 count 1 00000100:00100000:3.0:1721880422.391299:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632458 00010000:00010000:0.0:1721880422.391302:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c920 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfce8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.391306:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632465 00010000:00010000:0.0:1721880422.391309:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801360c98c0/0x8a60d30f571e6ad5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfce8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12791d expref: 887 pid: 16126 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.391311:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bf5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2369:3689:x1805522011796480:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.391314:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.391315:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.391316:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c920 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfce8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.391316:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64745 count 1 00002000:00080000:2.0:1721880422.391323:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64746 count 1 00010000:00010000:1.0:1721880422.391326:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c927 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfce9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.391327:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801360c98c0/0x8a60d30f571e6ad5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfce8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12791d expref: 887 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.391334:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727c92e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.391335:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801360c98c0/0x8a60d30f571e6ad5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfce8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12791d expref: 887 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.391336:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d859200/0x8a60d30f571e6b99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfce9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127971 expref: 887 pid: 15515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.391343:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1721880422.391344:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011796736:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.391345:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.391346:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0945d40/0x8a60d30f571e6ce9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1279be expref: 887 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.391347:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c927 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfce9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.391352:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.391354:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.391356:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727c92e lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.391362:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d859200/0x8a60d30f571e6b99 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfce9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127971 expref: 887 pid: 15515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.391371:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d859200/0x8a60d30f571e6b99 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfce9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127971 expref: 887 pid: 15515 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.391374:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0945d40/0x8a60d30f571e6ce9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1279be expref: 887 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.391380:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009528a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011796864:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.391384:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0945d40/0x8a60d30f571e6ce9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1279be expref: 887 pid: 16111 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.391394:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b46ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011796992:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.391430:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.391431:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302ebf00 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.391437:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfded80 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.391450:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.391465:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011796608 00000100:00100000:1.0:1721880422.391468:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011796608 00000004:00080000:2.0:1721880422.391474:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012c886680/2, rc 0, transno 1053135 00000100:00100000:2.0:1721880422.391491:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012c886680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011794816:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.391511:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632466 00000100:00100000:3.0:1721880422.391514:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009528b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011797120:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.391517:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b46d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2370:3686:x1805522011796608:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.391530:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64747 count 1 00000100:00100000:3.0:1721880422.391538:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.391540:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c935 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfceb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.391551:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011797120 00010000:00010000:2.0:1721880422.391551:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b35440/0x8a60d30f571e6e1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfceb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127a0b expref: 887 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.391553:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011797120 00010000:00010000:2.0:1721880422.391557:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.391559:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.391561:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c935 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfceb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.391566:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632467 00000100:00100000:1.0:1721880422.391571:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e479880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2371:3687:x1805522011797120:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.391578:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092b35440/0x8a60d30f571e6e1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfceb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127a0b expref: 887 pid: 16111 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.391580:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64748 count 1 00010000:00010000:2.0:1721880422.391588:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092b35440/0x8a60d30f571e6e1d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfceb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127a0b expref: 887 pid: 16111 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.391589:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c93c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.391597:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b46f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011797248:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.391599:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132d89f80/0x8a60d30f571e6f19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127a6d expref: 887 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.391610:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.391611:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.391614:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c93c lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.391621:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde600 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.391628:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132d89f80/0x8a60d30f571e6f19 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127a6d expref: 887 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.391637:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132d89f80/0x8a60d30f571e6f19 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127a6d expref: 887 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.391646:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880095288a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011797376:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.391663:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eba80 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.391892:0:9458:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008bf5e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011795712:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.391898:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.391906:0:9458:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727c90b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfce6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.391924:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008bf5ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011796096:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.391925:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.391925:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e47b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011795968:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.391940:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257758976 00010000:00010000:3.0:1721880422.391940:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801207fb600/0x8a60d30f5727c912 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfce5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.391942:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727c919 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfce7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.391943:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257758976 00010000:00010000:2.0:1721880422.391954:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009732ba80/0x8a60d30f571e69e0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfce7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1278d0 expref: 888 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.391957:0:16188:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257759104 00000100:00100000:1.0:1721880422.391960:0:16188:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257759104 00010000:00010000:1.0:1721880422.391973:0:16188:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d6158c0/0x8a60d30f571e6946 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfce6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12787c expref: 889 pid: 15515 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.391973:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914653 00000100:00100000:2.0:1721880422.391979:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800962ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+889:2005:x1805522257758976:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.391986:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.391990:0:16188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914654 00010000:00010000:2.0:1721880422.391991:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009732ba80/0x8a60d30f571e69e0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfce7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1278d0 expref: 889 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.391995:0:16188:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800962a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+889:2006:x1805522257759104:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.392001:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009732ba80/0x8a60d30f571e69e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfce7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1278d0 expref: 889 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.392002:0:16188:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.392007:0:16188:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d6158c0/0x8a60d30f571e6946 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfce6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12787c expref: 889 pid: 15515 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.392030:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009732ba80/0x8a60d30f571e69e0 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfce7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1278d0 expref: 889 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.392035:0:16188:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d6158c0/0x8a60d30f571e6946 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfce6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12787c expref: 889 pid: 15515 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.392043:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.392044:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1721880422.392045:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.392047:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727c919 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfce7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.392048:0:16188:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d6158c0/0x8a60d30f571e6946 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfce6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12787c expref: 888 pid: 15515 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.392054:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727c919 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfce7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.392062:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.392064:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.392065:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257759232 00010000:00010000:1.0:1721880422.392066:0:16188:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727c90b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfce6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.392069:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257759232 00010000:00010000:2.0:1721880422.392070:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.392073:0:16188:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727c90b lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfce6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.392081:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0b78fc0/0x8a60d30f571e68ba lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfce5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12782f expref: 888 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.392098:0:16188:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.392099:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914655 00000100:00100000:2.0:1721880422.392104:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800962ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+888:2005:x1805522257758976:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 124us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.392104:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013514c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+888:2004:x1805522257759232:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.392111:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914653 00010000:00010000:3.0:1721880422.392111:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.392115:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0b78fc0/0x8a60d30f571e68ba lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfce5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12782f expref: 888 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.392119:0:16188:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800962a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+888:2006:x1805522257759104:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 122us (193us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.392124:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0b78fc0/0x8a60d30f571e68ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfce5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12782f expref: 887 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.392125:0:16188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914654 00010000:00010000:2.0:1721880422.392129:0:9458:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727c90b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfce6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.392136:0:9458:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727c90b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfce6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.392137:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0b78fc0/0x8a60d30f571e68ba lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfce5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12782f expref: 886 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.392143:0:9458:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727c90b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfce6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.392144:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727c919 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfce7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.392145:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.392147:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.392150:0:9458:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727c90b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfce6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.392150:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801207fb600/0x8a60d30f5727c912 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfce5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.392151:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727c919 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfce7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.392157:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727c919 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfce7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.392157:0:9458:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727c90b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfce6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.392161:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207fb600/0x8a60d30f5727c912 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfce5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.392162:0:9458:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325d440 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.392164:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727c919 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfce7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.392165:0:9458:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727c90b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfce6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.392170:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727c919 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfce7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.392171:0:9458:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727c90b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfce6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.392175:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.392176:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325c240 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.392179:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727c919 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfce7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.392184:0:9458:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727c90b lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfce6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.392185:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727c919 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfce7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.392191:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727c90b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfce6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.392194:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88013514c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+885:2004:x1805522257759232:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 90us (149us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.392195:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727c919 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfce7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.392200:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727c919 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfce7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.392200:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914655 00010000:00010000:3.0:1721880422.392218:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801207fb600/0x8a60d30f5727c912 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfce5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.392225:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207fb600/0x8a60d30f5727c912 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfce5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.392232:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207fb600/0x8a60d30f5727c912 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfce5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.392238:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801207fb600/0x8a60d30f5727c912 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfce5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.392245:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801207fb600/0x8a60d30f5727c912 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfce5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.392251:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801207fb600 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.392253:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207fb600/0x8a60d30f5727c912 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfce5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.392264:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207fb600/0x8a60d30f5727c912 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfce5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.392273:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801207fb600/0x8a60d30f5727c912 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfce5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.392276:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.392279:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801207fb600/0x8a60d30f5727c912 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfce5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.392306:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257759360 00000100:00100000:3.0:1721880422.392310:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257759360 00000100:00100000:2.0:1721880422.392315:0:9458:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bf5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2373:3689:x1805522011795584:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1664us (1690us total) trans 4296020432 rc 0/0 00000100:00100000:2.0:1721880422.392321:0:9458:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632460 00010000:00010000:3.0:1721880422.392321:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801360c98c0/0x8a60d30f571e6ad5 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfce8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12791d expref: 885 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.392330:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2372:3686:x1805522011795840:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1441us (1524us total) trans 4296020433 rc 0/0 00000100:00100000:1.0:1721880422.392337:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632462 00000100:00100000:3.0:1721880422.392337:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914656 00000004:00080000:0.0:1721880422.392339:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099492300/2, rc 0, transno 1053136 00000100:00100000:3.0:1721880422.392342:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013514fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+885:2004:x1805522257759360:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.392348:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.392352:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801360c98c0/0x8a60d30f571e6ad5 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfce8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12791d expref: 885 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.392354:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099492300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011795584:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.392361:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801360c98c0/0x8a60d30f571e6ad5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfce8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12791d expref: 885 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.392362:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.392369:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008bf5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011796736:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.392373:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.392373:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801360c98c0/0x8a60d30f571e6ad5 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfce8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12791d expref: 885 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.392381:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c920 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfce8:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.392385:0:16188:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257759488 00010000:00010000:3.0:1721880422.392387:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1721880422.392388:0:16188:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257759488 00010000:00010000:3.0:1721880422.392388:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.392391:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c920 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfce8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.392398:0:16188:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0945d40/0x8a60d30f571e6ce9 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfcea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1279be expref: 885 pid: 16111 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.392398:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c920 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfce8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.392410:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257759616 00000100:00100000:2.0:1721880422.392413:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257759616 00010000:00010000:2.0:1721880422.392422:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d859200/0x8a60d30f571e6b99 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfce9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127971 expref: 886 pid: 15515 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.392429:0:16188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914657 00000100:00100000:1.0:1721880422.392435:0:16188:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e197050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+886:2005:x1805522257759488:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.392442:0:16188:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.392444:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914658 00010000:00010000:1.0:1721880422.392446:0:16188:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0945d40/0x8a60d30f571e6ce9 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfcea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1279be expref: 886 pid: 16111 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.392448:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b46f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+886:2004:x1805522257759616:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.392449:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c920 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfce8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.392450:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.392454:0:15473:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.392455:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c920 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfce8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.392456:0:16188:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0945d40/0x8a60d30f571e6ce9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1279be expref: 886 pid: 16111 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.392457:0:15473:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d859200/0x8a60d30f571e6b99 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfce9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127971 expref: 886 pid: 15515 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.392460:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c920 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfce8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.392464:0:15473:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d859200/0x8a60d30f571e6b99 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfce9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127971 expref: 886 pid: 15515 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.392466:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c920 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfce8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.392467:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.392468:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.392470:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88013514fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+886:2004:x1805522257759360:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 127us (195us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.392471:0:16188:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727c92e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.392473:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c920 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfce8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.392476:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.392477:0:16188:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727c92e lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.392477:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.392477:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914656 00010000:00010000:0.0:1721880422.392478:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325e400 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.392479:0:15473:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c927 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfce9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.392482:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c920 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfce8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.392483:0:15473:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c927 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfce9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.392488:0:16188:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.392489:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c920 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfce8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.392490:0:15473:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.392504:0:15473:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b46f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+885:2004:x1805522257759616:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 56us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.392508:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914658 00000100:00100000:1.0:1721880422.392512:0:16188:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e197050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+885:2005:x1805522257759488:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 76us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.392518:0:16188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914657 00000100:00100000:2.0:1721880422.392536:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.392550:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c920 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfce8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.392557:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727c920 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfce8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.392563:0:16188:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257759872 00000100:00100000:1.0:1721880422.392566:0:16188:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257759872 00010000:00010000:1.0:1721880422.392576:0:16188:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132d89f80/0x8a60d30f571e6f19 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfcec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127a6d expref: 884 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.392584:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880134e96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2372:3688:x1805522011795456:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1731us (1877us total) trans 4296020434 rc 0/0 00000100:00100000:2.0:1721880422.392585:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.392586:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1721880422.392590:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632461 00000100:00100000:0.0:1721880422.392595:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880095289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011797504:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.392614:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257759744 00000100:00100000:0.0:1721880422.392616:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257759744 00000100:00100000:1.0:1721880422.392619:0:16188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914659 00000100:00100000:1.0:1721880422.392625:0:16188:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b46c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+885:2004:x1805522257759872:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.392627:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092b35440/0x8a60d30f571e6e1d lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfceb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127a0b expref: 885 pid: 16111 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.392631:0:16188:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.392636:0:16188:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132d89f80/0x8a60d30f571e6f19 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfcec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127a6d expref: 885 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.392644:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914660 00010000:00010000:1.0:1721880422.392645:0:16188:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132d89f80/0x8a60d30f571e6f19 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127a6d expref: 885 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.392648:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b46f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+885:2005:x1805522257759744:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.392651:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0945d40/0x8a60d30f571e6ce9 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1279be expref: 885 pid: 16111 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.392654:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.392657:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092b35440/0x8a60d30f571e6e1d lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfceb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127a0b expref: 884 pid: 16111 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.392657:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.392658:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.392658:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b46ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011796992:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.392661:0:16188:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c93c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.392664:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092b35440/0x8a60d30f571e6e1d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfceb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127a0b expref: 884 pid: 16111 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.392668:0:16188:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c93c lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.392672:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727c92e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.392676:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.392677:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.392677:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727c92e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.392679:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c935 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfceb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.392679:0:16188:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.392680:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727c92e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.392683:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c935 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfceb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.392689:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727c92e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.392690:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.392693:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727c92e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.392697:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727c92e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.392699:0:16188:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b46c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+884:2004:x1805522257759872:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 74us (162us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.392700:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801363521c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.392701:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727c92e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.392704:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b46f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+884:2005:x1805522257759744:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 55us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.392705:0:16188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914659 00010000:00010000:2.0:1721880422.392705:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727c92e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.392709:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914660 00010000:00010000:2.0:1721880422.392711:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727c92e lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.392714:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727c92e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.392750:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1721880422.392751:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012c887480/2, rc 0, transno 1053138 00000100:00100000:1.0:1721880422.392758:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012c887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011795456:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.392782:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1721880422.392788:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880095288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011797632:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.392808:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.392822:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bf5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2373:3689:x1805522011796480:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1510us (1573us total) trans 4296020435 rc 0/0 00000100:00100000:2.0:1721880422.392826:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632465 00000100:00100000:1.0:1721880422.392836:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011797504 00000100:00100000:1.0:1721880422.392839:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011797504 00000100:00100000:2.0:1721880422.392840:0:9458:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011797632 00000100:00100000:2.0:1721880422.392842:0:9458:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011797632 00000100:00100000:1.0:1721880422.392857:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632468 00000100:00100000:0.0:1721880422.392859:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b46c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2374:3686:x1805522011796224:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1570us (1653us total) trans 4296020436 rc 0/0 00000100:00100000:2.0:1721880422.392861:0:9458:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632469 00000100:00100000:1.0:1721880422.392863:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013514f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2374:3689:x1805522011797504:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.392864:0:9458:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2374:3688:x1805522011797632:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.392865:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632463 00002000:00080000:2.0:1721880422.392874:0:9458:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64750 count 1 00002000:00080000:1.0:1721880422.392876:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64749 count 1 00010000:00010000:2.0:1721880422.392881:0:9458:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c943 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.392887:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c94a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfced:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.392889:0:9458:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f8133c0/0x8a60d30f571e709a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127b1c expref: 882 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.392893:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.392894:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.392896:0:9458:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c943 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.392898:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800923b5b00/0x8a60d30f571e6fdd lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfced:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127ac8 expref: 882 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.392903:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.392904:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.392905:0:9458:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f8133c0/0x8a60d30f571e709a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127b1c expref: 882 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.392906:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c94a lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfced:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.392911:0:9458:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f8133c0/0x8a60d30f571e709a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127b1c expref: 882 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.392917:0:9458:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b46ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011797760:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.392923:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800923b5b00/0x8a60d30f571e6fdd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfced:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127ac8 expref: 882 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.392932:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800923b5b00/0x8a60d30f571e6fdd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfced:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127ac8 expref: 882 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.392933:0:9458:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfded80 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.392942:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880095289c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011797888:192.168.201.24@tcp:104: 00000004:00080000:0.0:1721880422.392951:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b8c4000/2, rc 0, transno 1053139 00000100:00100000:0.0:1721880422.392959:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007b8c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011796480:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.392962:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302ebe40 going to sleep for 11 seconds 00000004:00080000:1.0:1721880422.392985:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880091135f80/2, rc 0, transno 1053140 00000100:00100000:1.0:1721880422.392989:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880091135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011796224:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.392998:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b35440/0x8a60d30f571e6e1d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfceb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127a0b expref: 882 pid: 16111 timeout: 887 lvb_type: 0 00000004:00080000:1.0:1721880422.393003:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009f1b7100/2, rc 0, transno 1053137 00000100:00100000:3.0:1721880422.393005:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1721880422.393006:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b46f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011797248:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.393007:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009f1b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011795840:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.393030:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c935 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfceb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.393032:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013514fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011798144:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.393035:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c935 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfceb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.393037:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1721880422.393038:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c935 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfceb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.393043:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c935 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfceb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.393045:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800941e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011798272:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.393046:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c935 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfceb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.393050:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c935 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfceb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.393053:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352ac0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.393054:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c935 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfceb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.393056:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d859200/0x8a60d30f571e6b99 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfce9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127971 expref: 881 pid: 15515 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.393056:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.393058:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c935 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfceb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.393064:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c935 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfceb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.393068:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009528a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011796864:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.393072:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727c935 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfceb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.393079:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013514c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011798016:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.393081:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c927 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfce9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.393086:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.393089:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c927 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfce9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.393095:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c927 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfce9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.393099:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.393102:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c927 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfce9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.393108:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c927 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfce9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.393115:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c927 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfce9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.393121:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4240 already unused, calling callback (ffffffffa084e330) 00000100:00100000:3.0:1721880422.393123:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011798144 00010000:00010000:1.0:1721880422.393124:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c927 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfce9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.393126:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011798144 00010000:00010000:1.0:1721880422.393131:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c927 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfce9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.393140:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c927 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfce9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.393142:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011798272 00000100:00100000:3.0:1721880422.393144:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011798272 00010000:00010000:1.0:1721880422.393147:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727c927 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfce9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.393154:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011798016 00000100:00100000:2.0:1721880422.393155:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b46d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2376:3686:x1805522011796608:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1638us (1704us total) trans 4296020437 rc 0/0 00000100:00100000:3.0:1721880422.393156:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011798016 00000100:00100000:2.0:1721880422.393159:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632466 00000004:00080000:0.0:1721880422.393166:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007b8c5180/2, rc 0, transno 1053141 00000100:00100000:3.0:1721880422.393169:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632470 00000100:00100000:0.0:1721880422.393171:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007b8c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011796608:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.393175:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632471 00000100:00100000:3.0:1721880422.393176:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e47b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2376:3687:x1805522011798144:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.393178:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800941e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2376:3689:x1805522011798272:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.393191:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632472 00000100:00100000:2.0:1721880422.393193:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e478700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2376:3687:x1805522011798016:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.393197:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64752 count 1 00002000:00080000:2.0:1721880422.393202:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64751 count 1 00000100:00100000:0.0:1721880422.393203:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088e00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011798400:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.393208:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207fa640/0x8a60d30f5727c951 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcf0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.393210:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727c958 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.393218:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007bb518c0/0x8a60d30f571e7165 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127b70 expref: 880 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.393219:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095b86640/0x8a60d30f571e72a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcf0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127bc4 expref: 880 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.393222:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.393222:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.393223:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.393225:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727c958 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.393225:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.393227:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.393230:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207fa640/0x8a60d30f5727c951 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcf0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.393231:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132d89f80/0x8a60d30f571e6f19 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127a6d expref: 880 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.393234:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007bb518c0/0x8a60d30f571e7165 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127b70 expref: 880 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.393241:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880095288a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011797376:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.393242:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011798400 00010000:00010000:2.0:1721880422.393243:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007bb518c0/0x8a60d30f571e7165 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127b70 expref: 879 pid: 16028 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.393245:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011798400 00010000:00010000:3.0:1721880422.393248:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095b86640/0x8a60d30f571e72a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcf0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127bc4 expref: 879 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.393250:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012b46f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011798528:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.393254:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c93c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.393256:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632473 00010000:00010000:3.0:1721880422.393257:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095b86640/0x8a60d30f571e72a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcf0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127bc4 expref: 879 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.393259:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134e84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2377:3689:x1805522011798400:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.393260:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c93c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.393265:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde600 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.393266:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c93c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.393267:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e47a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011798656:192.168.201.24@tcp:104: 00002000:00080000:0.0:1721880422.393268:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64754 count 1 00010000:00010000:1.0:1721880422.393273:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c93c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.393278:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64753 count 1 00010000:00010000:1.0:1721880422.393282:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c93c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.393284:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c95f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcf1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.393288:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c93c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.393288:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec540 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.393291:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134aff600/0x8a60d30f571e7413 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcf1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127c18 expref: 879 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.393293:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4000 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.393295:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.393296:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c93c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.393296:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.393297:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c95f lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcf1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.393302:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c93c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.393307:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134aff600/0x8a60d30f571e7413 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcf1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127c18 expref: 879 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.393310:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c93c lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.393312:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134aff600/0x8a60d30f571e7413 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcf1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127c18 expref: 879 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.393316:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727c93c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.393318:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011798784:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.393328:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdea80 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.393370:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c966 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcf2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.393382:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800977306c0/0x8a60d30f571e7571 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcf2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127c6c expref: 879 pid: 9459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.393388:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.393390:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.393392:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c966 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcf2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.393435:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e479880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2378:3687:x1805522011797120:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1862us (1895us total) trans 4296020439 rc 0/0 00000100:00100000:1.0:1721880422.393442:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632467 00000004:00080000:3.0:1721880422.393449:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009528b480/2, rc 0, transno 1053143 00000100:00100000:3.0:1721880422.393459:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009528b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011797120:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.393468:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800977306c0/0x8a60d30f571e7571 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcf2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127c6c expref: 879 pid: 9459 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.393477:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800977306c0/0x8a60d30f571e7571 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcf2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127c6c expref: 879 pid: 9459 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.393486:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011798912:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.393488:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1721880422.393495:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880123b83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011799040:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.393509:0:9458:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b46ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011797760:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.393520:0:9458:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c943 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.393526:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009528b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2378:3688:x1805522011796352:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2231us (2297us total) trans 4296020438 rc 0/0 00000100:00100000:3.0:1721880422.393526:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.393532:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632464 00000100:00100000:0.0:1721880422.393548:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.393555:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011799040 00000004:00080000:1.0:1721880422.393557:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880091134380/2, rc 0, transno 1053142 00000100:00100000:3.0:1721880422.393558:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011799040 00000100:00100000:1.0:1721880422.393573:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880091134380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011796352:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.393593:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.393595:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880095289c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011797888:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.393603:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f4a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011799168:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.393605:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257760000 00000100:00100000:0.0:1721880422.393607:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257760000 00010000:00010000:1.0:1721880422.393608:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c94a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfced:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.393611:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632474 00000100:00100000:3.0:1721880422.393616:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880125a68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2378:3687:x1805522011799040:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.393619:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.393620:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8133c0/0x8a60d30f571e709a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127b1c expref: 880 pid: 16119 timeout: 887 lvb_type: 0 00002000:00080000:3.0:1721880422.393626:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64755 count 1 00000100:00100000:0.0:1721880422.393635:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914661 00010000:00010000:3.0:1721880422.393636:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207fad00/0x8a60d30f5727c96d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcf3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.393639:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+880:2005:x1805522257760000:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.393645:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011799168 00010000:00010000:3.0:1721880422.393647:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095cc1440/0x8a60d30f571e76ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcf3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127cdc expref: 880 pid: 16128 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.393648:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011799168 00010000:00010000:3.0:1721880422.393652:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.393654:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.393656:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207fad00/0x8a60d30f5727c96d lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcf3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.393666:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632475 00000100:00100000:1.0:1721880422.393670:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bf5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2379:3687:x1805522011799168:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.393673:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095cc1440/0x8a60d30f571e76ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcf3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127cdc expref: 880 pid: 16128 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.393682:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64756 count 1 00010000:00010000:3.0:1721880422.393682:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095cc1440/0x8a60d30f571e76ba lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcf3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127cdc expref: 880 pid: 16128 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.393692:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c974 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcf4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.393692:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011799296:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.393703:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c51f3c0/0x8a60d30f571e782d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcf4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127d29 expref: 880 pid: 16131 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.393706:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.393709:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.393710:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.393711:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f8133c0/0x8a60d30f571e709a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127b1c expref: 880 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.393712:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c974 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcf4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.393716:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec180 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.393720:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f8133c0/0x8a60d30f571e709a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127b1c expref: 880 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.393749:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c51f3c0/0x8a60d30f571e782d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcf4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127d29 expref: 880 pid: 16131 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.393752:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f8133c0/0x8a60d30f571e709a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127b1c expref: 880 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.393754:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.393759:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c51f3c0/0x8a60d30f571e782d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcf4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127d29 expref: 880 pid: 16131 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.393763:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.393764:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.393767:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c943 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.393774:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c943 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.393775:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880095289c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011799424:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.393788:0:16188:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257760128 00010000:00010000:0.0:1721880422.393790:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.393791:0:16188:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257760128 00010000:00010000:3.0:1721880422.393801:0:9458:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c943 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.393804:0:16188:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800923b5b00/0x8a60d30f571e6fdd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfced:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127ac8 expref: 880 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.393809:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+880:2005:x1805522257760000:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 168us (216us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.393809:0:9458:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c943 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.393816:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914661 00010000:00010000:3.0:1721880422.393821:0:9458:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c943 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.393822:0:16188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914662 00000100:00100000:1.0:1721880422.393825:0:16188:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bf5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+880:2005:x1805522257760128:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.393827:0:9458:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c943 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.393832:0:16188:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.393833:0:9458:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c943 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.393836:0:16188:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800923b5b00/0x8a60d30f571e6fdd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfced:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127ac8 expref: 879 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.393839:0:9458:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352640 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.393842:0:9458:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c943 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.393845:0:16188:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800923b5b00/0x8a60d30f571e6fdd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfced:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127ac8 expref: 879 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.393848:0:9458:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c943 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.393857:0:16188:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800923b5b00/0x8a60d30f571e6fdd lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfced:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127ac8 expref: 879 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.393858:0:9458:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c943 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.393864:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727c943 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.393866:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.393868:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.393871:0:16188:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c94a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfced:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.393878:0:16188:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c94a lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfced:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.393897:0:16188:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.393920:0:16188:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bf5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+878:2005:x1805522257760128:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 92us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.393926:0:16188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914662 00010000:00010000:0.0:1721880422.393948:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c94a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfced:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.393957:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c94a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfced:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.393963:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302ebe40 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.393965:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c94a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfced:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.393972:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c94a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfced:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.393979:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c94a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfced:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.393985:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b61c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.393988:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c94a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfced:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.393988:0:9458:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880095289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2380:3688:x1805522011797632:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1121us (1177us total) trans 4296020440 rc 0/0 00000004:00080000:1.0:1721880422.393991:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880095288380/2, rc 0, transno 1053144 00000100:00100000:3.0:1721880422.393994:0:9458:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632469 00000100:00100000:1.0:1721880422.393998:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880095288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011797632:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.394001:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.394032:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257760256 00000100:00100000:3.0:1721880422.394036:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257760256 00010000:00010000:3.0:1721880422.394047:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007bb518c0/0x8a60d30f571e7165 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfcef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127b70 expref: 878 pid: 16028 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.394053:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880095288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011799552:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.394055:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.394075:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257760512 00000100:00100000:3.0:1721880422.394078:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257760512 00000100:00100000:1.0:1721880422.394082:0:16188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914663 00000100:00100000:1.0:1721880422.394087:0:16188:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b46ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+879:2005:x1805522257760256:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.394087:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134aff600/0x8a60d30f571e7413 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfcf1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127c18 expref: 879 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.394093:0:16188:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.394096:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c94a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfced:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.394096:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012b46f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011798528:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.394099:0:16188:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007bb518c0/0x8a60d30f571e7165 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127b70 expref: 879 pid: 16028 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.394107:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914664 00010000:00010000:1.0:1721880422.394109:0:16188:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007bb518c0/0x8a60d30f571e7165 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127b70 expref: 879 pid: 16028 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.394111:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8065050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+879:2005:x1805522257760512:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.394117:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727c958 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.394117:0:15473:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.394121:0:16188:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007bb518c0/0x8a60d30f571e7165 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127b70 expref: 879 pid: 16028 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.394121:0:15473:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134aff600/0x8a60d30f571e7413 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfcf1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127c18 expref: 879 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.394129:0:15473:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134aff600/0x8a60d30f571e7413 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcf1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127c18 expref: 878 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.394131:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.394133:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.394136:0:16188:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727c958 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.394141:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.394141:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.394142:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.394145:0:15473:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c95f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcf1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.394147:0:16188:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727c958 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.394151:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c94a lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfced:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.394152:0:15473:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c95f lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcf1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.394157:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727c94a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfced:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.394160:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.394161:0:16188:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.394163:0:15473:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.394181:0:16188:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b46ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+878:2005:x1805522257760256:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 94us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.394185:0:15473:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8065050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+878:2005:x1805522257760512:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 72us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.394187:0:16188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914663 00000100:00100000:3.0:1721880422.394192:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914664 00000100:00100000:1.0:1721880422.394201:0:16188:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257760384 00000100:00100000:1.0:1721880422.394205:0:16188:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257760384 00010000:00010000:1.0:1721880422.394214:0:16188:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095b86640/0x8a60d30f571e72a0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfcf0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127bc4 expref: 877 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.394227:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257760640 00000100:00100000:1.0:1721880422.394230:0:16188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914665 00000100:00100000:3.0:1721880422.394230:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257760640 00000100:00100000:1.0:1721880422.394234:0:16188:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b46f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+878:2005:x1805522257760384:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.394240:0:16188:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.394240:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800977306c0/0x8a60d30f571e7571 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfcf2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127c6c expref: 878 pid: 9459 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.394244:0:16188:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095b86640/0x8a60d30f571e72a0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfcf0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127bc4 expref: 878 pid: 16098 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.394252:0:16188:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095b86640/0x8a60d30f571e72a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcf0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127bc4 expref: 878 pid: 16098 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.394262:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.394263:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.394266:0:16188:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801207fa640/0x8a60d30f5727c951 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcf0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.394266:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914666 00000100:00100000:2.0:1721880422.394267:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.394272:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007294ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+878:2005:x1805522257760640:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.394277:0:16188:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207fa640/0x8a60d30f5727c951 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcf0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.394279:0:15473:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.394282:0:15473:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800977306c0/0x8a60d30f571e7571 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfcf2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127c6c expref: 878 pid: 9459 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.394286:0:16188:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.394290:0:15473:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800977306c0/0x8a60d30f571e7571 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcf2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127c6c expref: 878 pid: 9459 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.394301:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.394302:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1721880422.394303:0:16188:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b46f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+878:2005:x1805522257760384:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 69us (163us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.394305:0:15473:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c966 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcf2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.394310:0:16188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914665 00010000:00010000:3.0:1721880422.394311:0:15473:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c966 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcf2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.394318:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257760768 00010000:00010000:3.0:1721880422.394320:0:15473:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.394322:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257760768 00010000:00010000:0.0:1721880422.394334:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095cc1440/0x8a60d30f571e76ba lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfcf3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127cdc expref: 878 pid: 16128 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.394338:0:15473:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007294ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+878:2005:x1805522257760640:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 65us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.394345:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.394345:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914666 00000100:00100000:0.0:1721880422.394359:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914667 00000100:00100000:0.0:1721880422.394364:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007294f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+877:2005:x1805522257760768:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.394371:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.394375:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095cc1440/0x8a60d30f571e76ba lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfcf3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127cdc expref: 877 pid: 16128 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.394376:0:9458:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011799552 00000100:00100000:1.0:1721880422.394379:0:9458:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011799552 00010000:00010000:0.0:1721880422.394383:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095cc1440/0x8a60d30f571e76ba lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcf3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127cdc expref: 877 pid: 16128 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.394389:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095b86640/0x8a60d30f571e72a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcf0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127bc4 expref: 877 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.394393:0:9458:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632476 00000100:00100000:1.0:1721880422.394397:0:9458:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009528a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2380:3688:x1805522011799552:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.394400:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e47a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011798656:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.394406:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134aff600/0x8a60d30f571e7413 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcf1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127c18 expref: 876 pid: 16119 timeout: 887 lvb_type: 0 00002000:00080000:1.0:1721880422.394408:0:9458:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64757 count 1 00010000:00010000:3.0:1721880422.394415:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801207fa640/0x8a60d30f5727c951 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.394417:0:9458:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727c97b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcf5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.394417:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008bf5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011798784:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.394422:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801207fa640/0x8a60d30f5727c951 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.394427:0:9458:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013620a1c0/0x8a60d30f571e7914 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcf5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127d76 expref: 875 pid: 16087 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.394428:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207fa640/0x8a60d30f5727c951 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.394430:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c95f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.394433:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.394434:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.394435:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207fa640/0x8a60d30f5727c951 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.394437:0:9458:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727c97b lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcf5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.394438:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.394438:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c95f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.394439:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.394442:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801207fad00/0x8a60d30f5727c96d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcf3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.394442:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801207fa640/0x8a60d30f5727c951 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.394448:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207fad00/0x8a60d30f5727c96d lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcf3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.394449:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c95f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.394449:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801207fa640/0x8a60d30f5727c951 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.394452:0:9458:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013620a1c0/0x8a60d30f571e7914 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcf5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127d76 expref: 875 pid: 16087 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.394454:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801207fa640 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.394456:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207fa640/0x8a60d30f5727c951 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.394457:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.394457:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c95f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.394463:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c95f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.394463:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207fa640/0x8a60d30f5727c951 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.394465:0:9458:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013620a1c0/0x8a60d30f571e7914 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcf5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127d76 expref: 875 pid: 16087 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.394469:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c95f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.394473:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007294f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+875:2005:x1805522257760768:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 108us (206us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.394473:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801207fa640/0x8a60d30f5727c951 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.394475:0:9458:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880095289500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011799680:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.394475:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350fc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.394478:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c95f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.394479:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914667 00010000:00010000:3.0:1721880422.394479:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801207fa640/0x8a60d30f5727c951 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcf0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.394483:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c95f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.394490:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c95f lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.394494:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727c95f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcf1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.394495:0:9458:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eba80 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.394514:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727c958 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.394521:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727c958 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.394528:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727c958 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.394535:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727c958 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.394541:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095cc1440/0x8a60d30f571e76ba lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcf3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127cdc expref: 874 pid: 16128 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.394542:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727c958 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.394548:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353600 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.394551:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727c958 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.394552:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011799296:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.394558:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727c958 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.394565:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801207fad00/0x8a60d30f5727c96d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.394567:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727c958 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.394572:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801207fad00/0x8a60d30f5727c96d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.394573:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727c958 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.394573:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.394578:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207fad00/0x8a60d30f5727c96d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.394585:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207fad00/0x8a60d30f5727c96d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.394592:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801207fad00/0x8a60d30f5727c96d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.394603:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801207fad00/0x8a60d30f5727c96d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.394609:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801207fad00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.394612:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207fad00/0x8a60d30f5727c96d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.394618:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207fad00/0x8a60d30f5727c96d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.394628:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801207fad00/0x8a60d30f5727c96d lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.394634:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801207fad00/0x8a60d30f5727c96d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcf3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.394642:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88013514f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2384:3689:x1805522011797504:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1778us (1889us total) trans 4296020441 rc 0/0 00000100:00100000:0.0:1721880422.394647:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632468 00000100:00100000:0.0:1721880422.394662:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257760896 00000100:00100000:2.0:1721880422.394663:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800941e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2383:3689:x1805522011798272:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1483us (1576us total) trans 4296020443 rc 0/0 00000100:00100000:0.0:1721880422.394664:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257760896 00000100:00100000:2.0:1721880422.394667:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632471 00010000:00010000:0.0:1721880422.394673:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c51f3c0/0x8a60d30f571e782d lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfcf4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127d29 expref: 874 pid: 16131 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.394684:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914668 00000100:00100000:0.0:1721880422.394686:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d33d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+874:2004:x1805522257760896:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.394692:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.394694:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c51f3c0/0x8a60d30f571e782d lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfcf4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127d29 expref: 874 pid: 16131 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.394700:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c51f3c0/0x8a60d30f571e782d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcf4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127d29 expref: 874 pid: 16131 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.394705:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e478700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2383:3687:x1805522011798016:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1508us (1604us total) trans 4296020444 rc 0/0 00010000:00010000:0.0:1721880422.394707:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.394708:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.394710:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c974 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcf4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.394711:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632472 00010000:00010000:0.0:1721880422.394714:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c974 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcf4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.394714:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88013514c000/2, rc 0, transno 1053148 00010000:00010000:0.0:1721880422.394721:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.394722:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013514c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011798016:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.394752:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d33d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+874:2004:x1805522257760896:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 64us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.394756:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914668 00000100:00100000:3.0:1721880422.394760:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880125a68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2382:3687:x1805522011799040:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1142us (1232us total) trans 4296020445 rc 0/0 00000100:00100000:3.0:1721880422.394766:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632474 00000100:00100000:0.0:1721880422.394771:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011799808:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.394780:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c51f3c0/0x8a60d30f571e782d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcf4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127d29 expref: 873 pid: 16131 timeout: 887 lvb_type: 0 00000004:00080000:2.0:1721880422.394787:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880123b83100/2, rc 0, transno 1053149 00000100:00100000:1.0:1721880422.394789:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880095289c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011799424:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.394794:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880123b83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011799040:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.394799:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c974 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.394810:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c974 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.394812:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085817b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011799936:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.394814:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c974 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.394819:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c974 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.394825:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c974 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.394827:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.394829:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c974 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.394833:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b7cc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.394834:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c974 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.394838:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c974 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.394844:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c974 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.394848:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727c974 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcf4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.394870:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1721880422.394884:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800941e8380/2, rc 0, transno 1053147 00000100:00100000:0.0:1721880422.394889:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800941e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011798272:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1721880422.394894:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880095289f80/2, rc 0, transno 1053145 00000100:00100000:0.0:1721880422.394896:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880095289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011797504:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.394907:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011799936 00000100:00100000:0.0:1721880422.394909:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011799936 00000100:00100000:0.0:1721880422.394919:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011799808 00000100:00100000:2.0:1721880422.394920:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1721880422.394921:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011799808 00000100:00100000:1.0:1721880422.394924:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880092a95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011800192:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.394926:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085815500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011800064:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.394932:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632477 00000100:00100000:0.0:1721880422.394936:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085814a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2384:3686:x1805522011799936:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.394945:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1721880422.394947:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64759 count 1 00000100:00100000:2.0:1721880422.394947:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.394959:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c982 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcf7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.394967:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011800192 00010000:00010000:0.0:1721880422.394969:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fb998c0/0x8a60d30f571e7b36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcf7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127e25 expref: 872 pid: 16126 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.394969:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011800192 00000100:00100000:2.0:1721880422.394970:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011800064 00000100:00100000:3.0:1721880422.394971:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e47b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2384:3687:x1805522011798144:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1795us (1914us total) trans 4296020442 rc 0/0 00000100:00100000:2.0:1721880422.394973:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011800064 00010000:00010000:0.0:1721880422.394975:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.394976:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.394978:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c982 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcf7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.394978:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632470 00000100:00100000:1.0:1721880422.394981:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632478 00000100:00100000:1.0:1721880422.394984:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2386:3689:x1805522011799808:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.394993:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64758 count 1 00000100:00100000:3.0:1721880422.394993:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632479 00010000:00010000:0.0:1721880422.394995:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fb998c0/0x8a60d30f571e7b36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcf7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127e25 expref: 872 pid: 16126 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.394997:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c849c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2385:3688:x1805522011800192:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.395000:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727c989 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcf6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.395001:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632480 00010000:00010000:0.0:1721880422.395004:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fb998c0/0x8a60d30f571e7b36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcf7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127e25 expref: 872 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.395006:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d132300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2385:3686:x1805522011800064:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.395008:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800946e61c0/0x8a60d30f571e7a25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcf6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127dd8 expref: 872 pid: 16111 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.395008:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64761 count 1 00000100:00100000:0.0:1721880422.395028:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011800320:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.395028:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.395030:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.395032:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727c989 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcf6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.395033:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64760 count 1 00010000:00010000:3.0:1721880422.395034:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f9200/0x8a60d30f5727c990 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcf9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.395043:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727c997 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcf8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.395044:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096dc7a80/0x8a60d30f571e7d4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcf9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127ecd expref: 872 pid: 16091 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.395047:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800946e61c0/0x8a60d30f571e7a25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcf6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127dd8 expref: 872 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.395050:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3ecc0 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.395050:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.395051:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.395054:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f9200/0x8a60d30f5727c990 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcf9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.395055:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880123bed8c0/0x8a60d30f571e7c86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcf8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127e80 expref: 872 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.395056:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800946e61c0/0x8a60d30f571e7a25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcf6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127dd8 expref: 872 pid: 16111 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.395062:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.395063:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.395065:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727c997 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcf8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.395066:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880095289c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011800448:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.395069:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096dc7a80/0x8a60d30f571e7d4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcf9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127ecd expref: 872 pid: 16091 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.395077:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096dc7a80/0x8a60d30f571e7d4a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcf9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127ecd expref: 872 pid: 16091 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.395086:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302ebe40 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.395086:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011800576:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.395088:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880123bed8c0/0x8a60d30f571e7c86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcf8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127e80 expref: 872 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.395098:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880123bed8c0/0x8a60d30f571e7c86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcf8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127e80 expref: 872 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.395106:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec180 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.395108:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d130a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011800704:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.395169:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdea80 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.395175:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bf5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2385:3687:x1805522011799168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1505us (1556us total) trans 4296020446 rc 0/0 00000100:00100000:1.0:1721880422.395179:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632475 00000004:00080000:2.0:1721880422.395192:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012f4a1500/2, rc 0, transno 1053150 00000100:00100000:2.0:1721880422.395200:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f4a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011799168:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1721880422.395213:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88013514fb80/2, rc 0, transno 1053146 00000100:00100000:2.0:1721880422.395217:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013514fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011798144:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.395243:0:9458:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880095289500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011799680:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.395253:0:9458:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727c97b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcf5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.395253:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011800832:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.395262:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800977306c0/0x8a60d30f571e7571 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcf2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127c6c expref: 872 pid: 9459 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.395276:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800929cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011798912:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.395278:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.395288:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c966 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.395289:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011800832 00000100:00100000:1.0:1721880422.395291:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011800832 00010000:00010000:0.0:1721880422.395296:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c966 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.395299:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1721880422.395302:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c966 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.395303:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632481 00000100:00100000:1.0:1721880422.395305:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800878d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2385:3689:x1805522011800832:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.395305:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011800960:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.395307:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c966 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.395311:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c966 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.395313:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64762 count 1 00010000:00010000:0.0:1721880422.395315:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c966 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.395318:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325cd80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.395320:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727c99e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcfa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.395321:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c966 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.395321:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.395327:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011f856d00/0x8a60d30f571e7df2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcfa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127f1a expref: 871 pid: 16128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.395328:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c966 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.395330:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.395331:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.395333:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727c99e lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcfa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.395337:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c966 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.395338:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011800960 00010000:00010000:1.0:1721880422.395342:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011f856d00/0x8a60d30f571e7df2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcfa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127f1a expref: 871 pid: 16128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.395343:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727c966 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcf2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.395343:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011800960 00010000:00010000:1.0:1721880422.395347:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011f856d00/0x8a60d30f571e7df2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcfa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127f1a expref: 871 pid: 16128 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.395353:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880095289500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011801088:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.395361:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632482 00000100:00100000:2.0:1721880422.395365:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800878d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2386:3687:x1805522011800960:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.395371:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eba80 going to sleep for 11 seconds 00002000:00080000:2.0:1721880422.395376:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64763 count 1 00010000:00010000:2.0:1721880422.395386:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727c9a5 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcfb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.395397:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098b18b40/0x8a60d30f571e7ebd lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcfb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127f75 expref: 871 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.395404:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.395406:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.395408:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727c9a5 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcfb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.395425:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098b18b40/0x8a60d30f571e7ebd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcfb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127f75 expref: 871 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.395434:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098b18b40/0x8a60d30f571e7ebd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcfb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127f75 expref: 871 pid: 16111 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.395444:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d132d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011801216:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.395457:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880134e84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2387:3689:x1805522011798400:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2195us (2233us total) trans 4296020447 rc 0/0 00000100:00100000:0.0:1721880422.395464:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632473 00000100:00100000:2.0:1721880422.395465:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde600 going to sleep for 11 seconds 00000004:00080000:3.0:1721880422.395473:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088e00000/2, rc 0, transno 1053151 00000100:00100000:3.0:1721880422.395481:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088e00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011798400:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.395517:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1721880422.395524:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d131180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011801344:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.395543:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.395562:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011801344 00000100:00100000:3.0:1721880422.395566:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011801344 00000100:00100000:3.0:1721880422.395583:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632483 00000100:00100000:3.0:1721880422.395588:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d130380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2387:3686:x1805522011801344:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.395599:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64764 count 1 00000100:00100000:0.0:1721880422.395604:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.395609:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f86c0/0x8a60d30f5727c9ac lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcfc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.395617:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257761024 00000100:00100000:1.0:1721880422.395619:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257761024 00010000:00010000:3.0:1721880422.395620:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801348d58c0/0x8a60d30f571e7fb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcfc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127fc2 expref: 871 pid: 16087 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.395626:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.395627:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013620a1c0/0x8a60d30f571e7914 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcf5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127d76 expref: 872 pid: 16087 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.395627:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.395629:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f86c0/0x8a60d30f5727c9ac lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcfc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.395644:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800929cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011800320:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.395646:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801348d58c0/0x8a60d30f571e7fb9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcfc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127fc2 expref: 872 pid: 16087 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.395647:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914669 00000100:00100000:1.0:1721880422.395650:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+872:2005:x1805522257761024:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.395653:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c982 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcf7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.395655:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.395655:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801348d58c0/0x8a60d30f571e7fb9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcfc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127fc2 expref: 872 pid: 16087 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.395657:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013620a1c0/0x8a60d30f571e7914 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcf5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127d76 expref: 872 pid: 16087 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.395662:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013620a1c0/0x8a60d30f571e7914 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcf5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127d76 expref: 872 pid: 16087 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.395664:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011801472:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.395670:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013620a1c0/0x8a60d30f571e7914 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcf5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127d76 expref: 872 pid: 16087 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.395676:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.395677:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.395679:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727c97b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcf5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.395683:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727c97b lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcf5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.395691:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.395700:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec540 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.395703:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+871:2005:x1805522257761024:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 51us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.395706:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914669 00010000:00010000:0.0:1721880422.395797:0:9458:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727c97b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.395805:0:9458:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727c97b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.395812:0:9458:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727c97b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.395820:0:9458:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727c97b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.395826:0:9458:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727c97b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.395831:0:9458:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4fc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.395833:0:9458:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727c97b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.395837:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.395837:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880095289c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011800448:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.395838:0:9458:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727c97b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.395847:0:9458:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727c97b lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.395847:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257761152 00000100:00100000:1.0:1721880422.395849:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257761152 00000100:00100000:3.0:1721880422.395851:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011800576:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.395853:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727c97b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcf5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.395853:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727c989 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcf6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.395857:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fb998c0/0x8a60d30f571e7b36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcf7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127e25 expref: 871 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.395863:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801207f9200/0x8a60d30f5727c990 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcf9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.395873:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914670 00000100:00100000:1.0:1721880422.395877:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009528bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+871:2005:x1805522257761152:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.395883:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.395887:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fb998c0/0x8a60d30f571e7b36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcf7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127e25 expref: 871 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.395895:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fb998c0/0x8a60d30f571e7b36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcf7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127e25 expref: 871 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.395907:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fb998c0/0x8a60d30f571e7b36 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcf7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127e25 expref: 871 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.395918:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.395919:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.395922:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c982 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcf7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.395928:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c982 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcf7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.395944:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.395950:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c982 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.395956:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c982 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.395960:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c982 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.395964:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009528bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+870:2005:x1805522257761152:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 85us (126us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.395968:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c982 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.395972:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c982 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.395974:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914670 00010000:00010000:2.0:1721880422.395975:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325dd40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.395977:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c982 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.395981:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c982 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.395987:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c982 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.395992:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727c982 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcf7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.396003:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.396027:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257761280 00000100:00100000:1.0:1721880422.396030:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257761280 00000100:00100000:0.0:1721880422.396036:0:9458:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009528a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2388:3688:x1805522011799552:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1637us (1690us total) trans 4296020448 rc 0/0 00010000:00010000:1.0:1721880422.396038:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800946e61c0/0x8a60d30f571e7a25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcf6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127dd8 expref: 870 pid: 16111 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.396041:0:9458:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632476 00000100:00100000:1.0:1721880422.396054:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914671 00000100:00100000:1.0:1721880422.396057:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5276050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+870:2005:x1805522257761280:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.396069:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.396072:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800946e61c0/0x8a60d30f571e7a25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcf6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127dd8 expref: 870 pid: 16111 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.396078:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800946e61c0/0x8a60d30f571e7a25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcf6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127dd8 expref: 870 pid: 16111 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.396090:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800946e61c0/0x8a60d30f571e7a25 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcf6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127dd8 expref: 870 pid: 16111 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.396099:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.396100:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.396103:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727c989 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcf6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.396109:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727c989 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcf6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.396109:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880085814a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2388:3686:x1805522011799936:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1171us (1280us total) trans 4296020449 rc 0/0 00000100:00100000:2.0:1721880422.396113:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632477 00000004:00080000:3.0:1721880422.396127:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880085817b80/2, rc 0, transno 1053153 00010000:00010000:1.0:1721880422.396131:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.396132:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.396136:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d130a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011800704:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.396137:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085817b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011799936:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.396140:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257761408 00000100:00100000:0.0:1721880422.396142:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257761408 00010000:00010000:2.0:1721880422.396146:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727c997 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcf8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.396151:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096dc7a80/0x8a60d30f571e7d4a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcf9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127ecd expref: 870 pid: 16091 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.396152:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5276050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+870:2005:x1805522257761280:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 92us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.396159:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914671 00010000:00010000:2.0:1721880422.396160:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727c989 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.396162:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1721880422.396164:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727c989 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.396168:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914672 00010000:00010000:2.0:1721880422.396169:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727c989 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.396169:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011801600:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.396172:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+869:2004:x1805522257761408:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.396172:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727c989 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.396176:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727c989 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.396177:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.396179:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b5d40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.396180:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096dc7a80/0x8a60d30f571e7d4a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcf9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127ecd expref: 869 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.396181:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727c989 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.396184:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727c989 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.396185:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096dc7a80/0x8a60d30f571e7d4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcf9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127ecd expref: 869 pid: 16091 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.396188:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.396190:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727c989 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.396194:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096dc7a80/0x8a60d30f571e7d4a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcf9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127ecd expref: 869 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.396194:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727c989 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcf6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.396200:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.396201:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.396203:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801207f9200/0x8a60d30f5727c990 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcf9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.396205:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880095288a80/2, rc 0, transno 1053152 00010000:00010000:0.0:1721880422.396208:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f9200/0x8a60d30f5727c990 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcf9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.396217:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880095288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011799552:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.396226:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.396238:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+868:2004:x1805522257761408:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 66us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.396242:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914672 00000100:00100000:1.0:1721880422.396250:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1721880422.396255:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011801728:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.396260:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801207f9200/0x8a60d30f5727c990 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.396268:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207f9200/0x8a60d30f5727c990 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.396274:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.396275:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f9200/0x8a60d30f5727c990 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.396282:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f9200/0x8a60d30f5727c990 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.396283:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2388:3689:x1805522011799808:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1297us (1412us total) trans 4296020450 rc 0/0 00000100:00100000:0.0:1721880422.396287:0:9458:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011801600 00000100:00100000:2.0:1721880422.396287:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632478 00010000:00010000:3.0:1721880422.396288:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801207f9200/0x8a60d30f5727c990 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.396290:0:9458:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011801600 00010000:00010000:3.0:1721880422.396293:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801207f9200 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.396296:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f9200/0x8a60d30f5727c990 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.396298:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011801728 00000100:00100000:1.0:1721880422.396299:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.396300:0:9458:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632484 00000100:00100000:2.0:1721880422.396300:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011801728 00010000:00010000:3.0:1721880422.396302:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f9200/0x8a60d30f5727c990 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.396303:0:9458:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800878d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2389:3689:x1805522011801600:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.396311:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632485 00002000:00080000:0.0:1721880422.396312:0:9458:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64765 count 1 00010000:00010000:3.0:1721880422.396312:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801207f9200/0x8a60d30f5727c990 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.396314:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009528bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2389:3688:x1805522011801728:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.396318:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801207f9200/0x8a60d30f5727c990 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.396320:0:9458:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c9b3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcfd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.396323:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00002000:00080000:2.0:1721880422.396323:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64766 count 1 00010000:00010000:0.0:1721880422.396328:0:9458:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d5b86c0/0x8a60d30f571e80d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcfd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128016 expref: 867 pid: 16091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.396330:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727c9ba lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcfe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.396332:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.396333:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1721880422.396333:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.396334:0:9458:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c9b3 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcfd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.396338:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880122cd2ac0/0x8a60d30f571e8187 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcfe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128063 expref: 867 pid: 16039 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.396340:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257761536 00000100:00100000:1.0:1721880422.396342:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257761536 00010000:00010000:2.0:1721880422.396342:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.396343:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.396344:0:9458:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d5b86c0/0x8a60d30f571e80d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcfd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128016 expref: 868 pid: 16091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.396345:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727c9ba lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcfe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.396350:0:9458:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d5b86c0/0x8a60d30f571e80d1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcfd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128016 expref: 868 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.396350:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880123bed8c0/0x8a60d30f571e7c86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcf8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127e80 expref: 868 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.396356:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880122cd2ac0/0x8a60d30f571e8187 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcfe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128063 expref: 868 pid: 16039 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.396357:0:9458:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800929ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011801856:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.396364:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880122cd2ac0/0x8a60d30f571e8187 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcfe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128063 expref: 868 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.396365:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257761664 00000100:00100000:1.0:1721880422.396367:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257761664 00000100:00100000:3.0:1721880422.396371:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257761792 00000100:00100000:0.0:1721880422.396372:0:9458:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3ecc0 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.396372:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011f856d00/0x8a60d30f571e7df2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfcfa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127f1a expref: 869 pid: 16128 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.396373:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d130a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011801984:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.396375:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257761792 00000100:00100000:1.0:1721880422.396381:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914673 00000100:00100000:1.0:1721880422.396384:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009528ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+870:2005:x1805522257761536:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.396385:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914674 00010000:00010000:3.0:1721880422.396387:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098b18b40/0x8a60d30f571e7ebd lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfcfb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127f75 expref: 870 pid: 16111 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.396388:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095288000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+870:2004:x1805522257761664:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.396389:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.396392:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880123bed8c0/0x8a60d30f571e7c86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcf8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127e80 expref: 870 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.396393:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.396393:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdea80 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.396397:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011f856d00/0x8a60d30f571e7df2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfcfa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127f1a expref: 870 pid: 16128 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.396398:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880123bed8c0/0x8a60d30f571e7c86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcf8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127e80 expref: 870 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.396403:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011f856d00/0x8a60d30f571e7df2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcfa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127f1a expref: 870 pid: 16128 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.396403:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914675 00010000:00010000:1.0:1721880422.396406:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123bed8c0/0x8a60d30f571e7c86 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcf8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127e80 expref: 870 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.396409:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095289c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+870:2004:x1805522257761792:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.396410:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.396411:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.396412:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727c99e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcfa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.396413:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.396414:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.396416:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727c99e lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcfa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.396416:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727c997 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcf8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.396416:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d132d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011801216:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.396416:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.396420:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727c997 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcf8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.396420:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098b18b40/0x8a60d30f571e7ebd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcfb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127f75 expref: 869 pid: 16111 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.396423:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.396429:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098b18b40/0x8a60d30f571e7ebd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcfb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127f75 expref: 869 pid: 16111 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.396431:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880095288000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+869:2004:x1805522257761664:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 43us (107us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.396434:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.396436:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914674 00010000:00010000:2.0:1721880422.396438:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727c9a5 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcfb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.396442:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098b18b40/0x8a60d30f571e7ebd lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcfb:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127f75 expref: 869 pid: 16111 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.396447:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009528ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+868:2005:x1805522257761536:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 62us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.396451:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914673 00010000:00010000:2.0:1721880422.396451:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727c997 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.396451:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.396453:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.396456:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727c9a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcfb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.396458:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727c997 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.396462:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727c9a5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcfb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.396465:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727c997 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.396472:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727c997 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.396472:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.396477:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011f856d00/0x8a60d30f571e7df2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcfa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127f1a expref: 866 pid: 16128 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.396479:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727c997 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.396484:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880095289500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011801088:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.396485:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801363518c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.396488:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727c997 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.396490:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880095289c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+865:2004:x1805522257761792:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 81us (155us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.396493:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727c99e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.396495:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727c997 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.396496:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914675 00010000:00010000:1.0:1721880422.396500:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727c99e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.396504:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727c99e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.396508:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727c99e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.396511:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727c997 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.396512:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727c99e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.396516:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727c99e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.396517:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727c997 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcf8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.396520:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b6ac0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.396522:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727c99e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.396524:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880085816d80/2, rc 0, transno 1053154 00010000:00010000:1.0:1721880422.396525:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727c99e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.396531:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727c99e lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.396532:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011799808:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.396535:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727c99e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcfa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.396560:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011802112:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.396579:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.396599:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011802112 00000100:00100000:0.0:1721880422.396604:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011802112 00000100:00100000:0.0:1721880422.396622:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632486 00000100:00100000:0.0:1721880422.396627:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800878d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2393:3686:x1805522011802112:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.396638:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64767 count 1 00000100:00100000:2.0:1721880422.396644:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d132300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2393:3686:x1805522011800064:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1636us (1694us total) trans 4296020451 rc 0/0 00010000:00010000:0.0:1721880422.396650:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727c9c1 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.396650:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632480 00010000:00010000:0.0:1721880422.396660:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880085755680/0x8a60d30f571e82ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1280c5 expref: 864 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.396669:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.396670:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.396672:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727c9c1 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfcff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.396679:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880085815500/2, rc 0, transno 1053155 00000100:00100000:3.0:1721880422.396679:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c849c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2392:3688:x1805522011800192:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1679us (1731us total) trans 4296020453 rc 0/0 00000004:00080000:1.0:1721880422.396681:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880092a95180/2, rc 0, transno 1053157 00010000:00010000:0.0:1721880422.396684:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880085755680/0x8a60d30f571e82ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1280c5 expref: 864 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.396685:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632479 00000100:00100000:1.0:1721880422.396687:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880092a95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011800192:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.396687:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085815500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011800064:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.396690:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880085755680/0x8a60d30f571e82ad lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1280c5 expref: 864 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.396696:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800929ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011802240:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.396716:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.396753:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800878d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2391:3689:x1805522011800832:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1445us (1474us total) trans 4296020452 rc 0/0 00000100:00100000:2.0:1721880422.396753:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1721880422.396757:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632481 00000100:00100000:2.0:1721880422.396762:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d132d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011802368:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.396772:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d131880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011802496:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.396786:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1721880422.396796:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800878d9f80/2, rc 0, transno 1053156 00000100:00100000:1.0:1721880422.396808:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011800832:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.396818:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.396820:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011802368 00000100:00100000:3.0:1721880422.396823:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011802368 00000100:00100000:1.0:1721880422.396828:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1721880422.396832:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d130700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011802624:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.396837:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011802496 00010000:00010000:2.0:1721880422.396838:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727c9a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.396838:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011802496 00000100:00100000:1.0:1721880422.396841:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.396845:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727c9a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.396846:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011802624 00000100:00100000:3.0:1721880422.396848:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011802624 00010000:00010000:2.0:1721880422.396853:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727c9a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.396856:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632487 00000100:00100000:1.0:1721880422.396859:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d133800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2393:3686:x1805522011802368:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.396860:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727c9a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.396860:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632488 00000100:00100000:3.0:1721880422.396864:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2393:3688:x1805522011802496:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.396869:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64768 count 1 00010000:00010000:2.0:1721880422.396871:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727c9a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.396875:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64769 count 1 00010000:00010000:1.0:1721880422.396877:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727c9c8 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd00:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.396878:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136351b00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.396881:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727c9a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.396884:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012335c6c0/0x8a60d30f571e840b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12810b expref: 864 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.396884:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f8d80/0x8a60d30f5727c9cf lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd01:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.396888:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.396888:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727c9a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.396889:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.396890:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727c9c8 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.396899:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727c9a5 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.396899:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011f9ed680/0x8a60d30f571e84dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128166 expref: 864 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.396900:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012335c6c0/0x8a60d30f571e840b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12810b expref: 864 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.396901:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632489 00010000:00010000:2.0:1721880422.396905:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727c9a5 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcfb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.396905:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1721880422.396906:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009528b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2393:3688:x1805522011802624:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.396907:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012335c6c0/0x8a60d30f571e840b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12810b expref: 864 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.396907:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.396909:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f8d80/0x8a60d30f5727c9cf lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.396913:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880095289880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011802752:192.168.201.24@tcp:104: 00002000:00080000:0.0:1721880422.396918:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64770 count 1 00010000:00010000:3.0:1721880422.396923:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011f9ed680/0x8a60d30f571e84dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128166 expref: 864 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.396928:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727c9d6 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd02:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.396929:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eba80 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.396931:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011f9ed680/0x8a60d30f571e84dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128166 expref: 864 pid: 16098 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.396939:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801202a06c0/0x8a60d30f571e85a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1281ba expref: 864 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.396941:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009affad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011802880:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.396945:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.396946:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.396948:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727c9d6 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.396959:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec180 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.396961:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.396970:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801202a06c0/0x8a60d30f571e85a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1281ba expref: 864 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.396980:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801202a06c0/0x8a60d30f571e85a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1281ba expref: 864 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.396987:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011803008:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.396991:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011801472:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.397003:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801207f86c0/0x8a60d30f5727c9ac lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcfc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.397004:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e780 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.397033:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257761920 00000100:00100000:1.0:1721880422.397036:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257761920 00010000:00010000:1.0:1721880422.397045:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801348d58c0/0x8a60d30f571e7fb9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcfc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127fc2 expref: 865 pid: 16087 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.397048:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800878d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2394:3687:x1805522011800960:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1681us (1724us total) trans 4296020454 rc 0/0 00000004:00080000:3.0:1721880422.397052:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800878d8380/2, rc 0, transno 1053158 00000100:00100000:2.0:1721880422.397054:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632482 00000100:00100000:1.0:1721880422.397062:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914676 00000100:00100000:1.0:1721880422.397065:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009528a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+865:2005:x1805522257761920:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.397069:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011800960:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.397070:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.397073:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801348d58c0/0x8a60d30f571e7fb9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcfc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127fc2 expref: 865 pid: 16087 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.397078:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801348d58c0/0x8a60d30f571e7fb9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcfc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127fc2 expref: 865 pid: 16087 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.397086:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801348d58c0/0x8a60d30f571e7fb9 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcfc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b127fc2 expref: 865 pid: 16087 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.397096:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.397097:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.397097:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d131f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011803136:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.397099:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801207f86c0/0x8a60d30f5727c9ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcfc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.397103:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f86c0/0x8a60d30f5727c9ac lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcfc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.397116:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.397117:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.397127:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801207f86c0/0x8a60d30f5727c9ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.397132:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009528a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+864:2005:x1805522257761920:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 65us (170us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.397135:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207f86c0/0x8a60d30f5727c9ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.397137:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914676 00010000:00010000:2.0:1721880422.397142:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f86c0/0x8a60d30f5727c9ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.397150:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f86c0/0x8a60d30f5727c9ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.397157:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011803136 00010000:00010000:2.0:1721880422.397157:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801207f86c0/0x8a60d30f5727c9ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.397160:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011803136 00010000:00010000:2.0:1721880422.397163:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801207f86c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.397166:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f86c0/0x8a60d30f5727c9ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.397172:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f86c0/0x8a60d30f5727c9ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.397173:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632490 00000100:00100000:1.0:1721880422.397177:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800878da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2394:3686:x1805522011803136:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.397181:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801207f86c0/0x8a60d30f5727c9ac lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.397187:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64771 count 1 00010000:00010000:2.0:1721880422.397187:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801207f86c0/0x8a60d30f5727c9ac lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcfc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.397197:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727c9dd lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd03:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.397207:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800965da400/0x8a60d30f571e866c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128215 expref: 863 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.397213:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.397214:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.397216:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727c9dd lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.397237:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800965da400/0x8a60d30f571e866c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128215 expref: 863 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.397245:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800965da400/0x8a60d30f571e866c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128215 expref: 863 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.397254:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007294ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011803264:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.397280:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb780 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.397283:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d130380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2395:3686:x1805522011801344:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1694us (1739us total) trans 4296020455 rc 0/0 00000100:00100000:2.0:1721880422.397288:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632483 00000004:00080000:3.0:1721880422.397293:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d131180/2, rc 0, transno 1053159 00000100:00100000:3.0:1721880422.397301:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d131180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011801344:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.397326:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1721880422.397329:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800929ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011802240:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.397333:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008c4e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011803392:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.397339:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727c9c1 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.397352:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.397364:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011803392 00000100:00100000:2.0:1721880422.397367:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011803392 00000100:00100000:2.0:1721880422.397377:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632491 00000100:00100000:2.0:1721880422.397380:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a05fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2395:3686:x1805522011803392:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.397389:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64772 count 1 00010000:00010000:2.0:1721880422.397397:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727c9e4 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd04:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.397405:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0819200/0x8a60d30f571e873e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd04:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128270 expref: 863 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.397409:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.397410:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.397412:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727c9e4 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd04:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.397422:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0819200/0x8a60d30f571e873e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd04:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128270 expref: 863 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.397425:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d130a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011801984:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.397428:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0819200/0x8a60d30f571e873e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd04:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128270 expref: 863 pid: 16028 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.397436:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d133480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011803520:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.397440:0:9458:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800929ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011801856:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.397441:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727c9ba lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcfe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.397448:0:9458:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c9b3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfcfd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.397458:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde600 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.397705:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009affad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011802880:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.397716:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801207f8d80/0x8a60d30f5727c9cf lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.397720:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800929cd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011803008:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.397745:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727c9d6 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.397827:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880095289880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011802752:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.397830:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.397835:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727c9c8 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.397850:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.397850:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257762432 00000100:00100000:1.0:1721880422.397852:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257762432 00010000:00010000:1.0:1721880422.397861:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801202a06c0/0x8a60d30f571e85a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1281ba expref: 864 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.397865:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.397875:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257762048 00000100:00100000:0.0:1721880422.397880:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257762048 00000100:00100000:1.0:1721880422.397886:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257762304 00000100:00100000:1.0:1721880422.397888:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257762304 00010000:00010000:0.0:1721880422.397893:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880122cd2ac0/0x8a60d30f571e8187 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcfe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128063 expref: 866 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.397896:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011f9ed680/0x8a60d30f571e84dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128166 expref: 866 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.397906:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914677 00000100:00100000:1.0:1721880422.397909:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+866:2007:x1805522257762432:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.397912:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914678 00010000:00010000:1.0:1721880422.397914:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.397917:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801202a06c0/0x8a60d30f571e85a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd02:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1281ba expref: 866 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.397918:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+866:2005:x1805522257762304:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.397922:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801202a06c0/0x8a60d30f571e85a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd02:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1281ba expref: 866 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.397926:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.397930:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801202a06c0/0x8a60d30f571e85a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd02:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1281ba expref: 866 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.397932:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011f9ed680/0x8a60d30f571e84dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd01:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128166 expref: 866 pid: 16098 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.397937:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.397938:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.397940:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727c9d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.397941:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011f9ed680/0x8a60d30f571e84dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd01:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128166 expref: 865 pid: 16098 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.397948:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727c9d6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd02:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.397956:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.397960:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011f9ed680/0x8a60d30f571e84dd lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd01:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128166 expref: 865 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.397963:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914679 00000100:00100000:3.0:1721880422.397968:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ab4d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+864:2005:x1805522257762048:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.397972:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1721880422.397972:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+864:2007:x1805522257762432:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 62us (144us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.397974:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1721880422.397976:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914677 00010000:00010000:3.0:1721880422.397976:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.397977:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801207f8d80/0x8a60d30f5727c9cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.397981:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880122cd2ac0/0x8a60d30f571e8187 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcfe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128063 expref: 864 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.397983:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f8d80/0x8a60d30f5727c9cf lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd01:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.397990:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880122cd2ac0/0x8a60d30f571e8187 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcfe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128063 expref: 863 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.397991:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727c9d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.397995:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727c9d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.398000:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727c9d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.398003:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880122cd2ac0/0x8a60d30f571e8187 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcfe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128063 expref: 863 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.398004:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727c9d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.398007:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727c9d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.398025:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.398026:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325cfc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.398028:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727c9d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.398034:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.398035:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727c9d6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.398035:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.398038:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727c9ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcfe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.398042:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727c9d6 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.398043:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801207f8d80/0x8a60d30f5727c9cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.398044:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727c9ba lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcfe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.398045:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727c9d6 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.398046:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+862:2005:x1805522257762304:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 127us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.398052:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914678 00010000:00010000:2.0:1721880422.398052:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207f8d80/0x8a60d30f5727c9cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.398058:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f8d80/0x8a60d30f5727c9cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.398059:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.398065:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f8d80/0x8a60d30f5727c9cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.398071:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801207f8d80/0x8a60d30f5727c9cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.398075:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801207f8d80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.398077:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f8d80/0x8a60d30f5727c9cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.398080:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ab4d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+861:2005:x1805522257762048:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 110us (228us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.398083:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f8d80/0x8a60d30f5727c9cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.398086:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914679 00010000:00010000:2.0:1721880422.398092:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801207f8d80/0x8a60d30f5727c9cf lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.398093:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.398097:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801207f8d80/0x8a60d30f5727c9cf lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.398107:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257762688 00000100:00100000:0.0:1721880422.398110:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257762688 00010000:00010000:0.0:1721880422.398122:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880085755680/0x8a60d30f571e82ad lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1280c5 expref: 861 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.398130:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727c9ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.398136:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009528b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2396:3688:x1805522011802624:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1230us (1293us total) trans 4296020456 rc 0/0 00010000:00010000:3.0:1721880422.398136:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727c9ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.398138:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914680 00000100:00100000:0.0:1721880422.398141:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+861:2005:x1805522257762688:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.398141:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632489 00010000:00010000:3.0:1721880422.398143:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727c9ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.398147:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.398148:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727c9ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.398149:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880085755680/0x8a60d30f571e82ad lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1280c5 expref: 861 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.398154:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727c9ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.398159:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880085755680/0x8a60d30f571e82ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1280c5 expref: 861 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.398163:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136351f80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.398166:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727c9ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.398167:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880085755680/0x8a60d30f571e82ad lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1280c5 expref: 861 pid: 16101 timeout: 887 lvb_type: 0 00000004:00080000:1.0:1721880422.398169:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d130700/2, rc 0, transno 1053160 00010000:00010000:3.0:1721880422.398172:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727c9ba lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.398174:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d130700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011802624:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.398177:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.398178:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.398180:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727c9c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.398183:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727c9ba lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.398184:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727c9c1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.398189:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727c9ba lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcfe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.398193:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007294f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011803648:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.398194:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.398207:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+860:2005:x1805522257762688:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 66us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.398211:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914680 00000100:00100000:1.0:1721880422.398215:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.398217:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880095289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2396:3688:x1805522011802496:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1350us (1395us total) trans 4296020457 rc 0/0 00000100:00100000:2.0:1721880422.398224:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632488 00000004:00080000:1.0:1721880422.398227:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d131880/2, rc 0, transno 1053161 00000100:00100000:1.0:1721880422.398231:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d131880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011802496:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.398232:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.398238:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011803648 00000100:00100000:0.0:1721880422.398240:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257762176 00000100:00100000:2.0:1721880422.398241:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011803648 00000100:00100000:0.0:1721880422.398242:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257762176 00000100:00100000:1.0:1721880422.398242:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1721880422.398245:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009528ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011803776:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.398249:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d5b86c0/0x8a60d30f571e80d1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcfd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128016 expref: 860 pid: 16091 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.398253:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.398257:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011803776 00000100:00100000:2.0:1721880422.398259:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011803776 00000100:00100000:0.0:1721880422.398267:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914681 00000100:00100000:1.0:1721880422.398269:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632492 00000100:00100000:0.0:1721880422.398271:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+860:2005:x1805522257762176:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.398273:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2398:3688:x1805522011803648:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.398275:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632493 00010000:00010000:0.0:1721880422.398276:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.398278:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d5b86c0/0x8a60d30f571e80d1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcfd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128016 expref: 860 pid: 16091 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.398280:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095289c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2398:3688:x1805522011803776:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.398281:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64773 count 1 00010000:00010000:0.0:1721880422.398284:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d5b86c0/0x8a60d30f571e80d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcfd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128016 expref: 860 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.398290:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c9eb lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd05:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.398292:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d5b86c0/0x8a60d30f571e80d1 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcfd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128016 expref: 860 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.398297:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801348d6ac0/0x8a60d30f571e88cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1282d9 expref: 860 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.398301:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00002000:00080000:2.0:1721880422.398301:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64774 count 1 00010000:00010000:0.0:1721880422.398302:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.398302:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.398303:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c9eb lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.398304:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.398306:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c9b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcfd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.398311:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727c9f2 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd06:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.398313:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801348d6ac0/0x8a60d30f571e88cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1282d9 expref: 859 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.398314:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c9b3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfcfd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.398318:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801348d6ac0/0x8a60d30f571e88cd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1282d9 expref: 859 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.398323:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c60f840/0x8a60d30f571e89c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd06:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128326 expref: 859 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.398324:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009528a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011803904:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.398330:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.398331:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1721880422.398331:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009528bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2398:3688:x1805522011801728:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2013us (2053us total) trans 4296020458 rc 0/0 00010000:00010000:2.0:1721880422.398333:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727c9f2 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd06:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.398334:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.398337:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632485 00010000:00010000:1.0:1721880422.398338:0:9458:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c9b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.398342:0:9458:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c9b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.398346:0:9458:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c9b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.398349:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+859:2005:x1805522257762176:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 76us (115us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.398350:0:9458:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c9b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.398352:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008c60f840/0x8a60d30f571e89c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd06:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128326 expref: 859 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.398354:0:9458:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c9b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.398355:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914681 00010000:00010000:1.0:1721880422.398358:0:9458:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325e640 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.398359:0:9458:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c9b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.398362:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008c60f840/0x8a60d30f571e89c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd06:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128326 expref: 858 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.398363:0:9458:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c9b3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.398367:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800878d8e00/2, rc 0, transno 1053162 00010000:00010000:1.0:1721880422.398369:0:9458:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c9b3 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.398372:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727c9b3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcfd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.398372:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d130a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011804032:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.398374:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011801728:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.398380:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.398393:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfded80 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.398394:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257762560 00000100:00100000:0.0:1721880422.398398:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257762560 00010000:00010000:0.0:1721880422.398406:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012335c6c0/0x8a60d30f571e840b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12810b expref: 859 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.398406:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009affad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011804160:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.398420:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914682 00000100:00100000:0.0:1721880422.398423:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+859:2005:x1805522257762560:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.398425:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.398428:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.398430:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012335c6c0/0x8a60d30f571e840b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd00:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12810b expref: 859 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.398435:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012335c6c0/0x8a60d30f571e840b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd00:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12810b expref: 859 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.398442:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011804160 00010000:00010000:0.0:1721880422.398443:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012335c6c0/0x8a60d30f571e840b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd00:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12810b expref: 859 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.398445:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011804160 00000100:00100000:1.0:1721880422.398450:0:9458:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800878d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2399:3689:x1805522011801600:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2145us (2261us total) trans 4296020459 rc 0/0 00010000:00010000:0.0:1721880422.398451:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.398452:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.398454:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727c9c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.398454:0:9458:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632484 00010000:00010000:0.0:1721880422.398458:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727c9c8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.398466:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632494 00010000:00010000:0.0:1721880422.398467:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.398471:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2398:3686:x1805522011804160:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.398477:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+858:2005:x1805522257762560:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 53us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.398481:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914682 00002000:00080000:2.0:1721880422.398483:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64775 count 1 00000004:00080000:1.0:1721880422.398491:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800878dbb80/2, rc 0, transno 1053163 00010000:00010000:0.0:1721880422.398492:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727c9c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.398493:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727c9f9 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd07:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.398496:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011801600:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.398498:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727c9c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.398502:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727c9c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.398504:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bb5ad00/0x8a60d30f571e8a71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12838f expref: 857 pid: 16053 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.398506:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727c9c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.398509:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727c9c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.398510:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.398512:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.398513:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b5680 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.398514:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727c9c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.398514:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eba80 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.398514:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727c9f9 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.398518:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727c9c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.398521:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727c9c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.398523:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727c9c8 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.398523:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1721880422.398526:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727c9c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.398527:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727c9c8 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.398529:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880134e94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011804288:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.398531:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727c9c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfcff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.398532:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bb5ad00/0x8a60d30f571e8a71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12838f expref: 857 pid: 16053 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.398535:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727c9c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfcff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.398539:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727c9c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.398541:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bb5ad00/0x8a60d30f571e8a71 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12838f expref: 857 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.398542:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325fa80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.398543:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727c9c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfcff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.398547:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727c9c1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfcff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.398547:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.398551:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009993a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011804416:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.398553:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727c9c1 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfcff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.398557:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727c9c1 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfcff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.398563:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011804288 00000100:00100000:3.0:1721880422.398566:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011804288 00000100:00100000:2.0:1721880422.398568:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.398585:0:9458:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632495 00000100:00100000:3.0:1721880422.398589:0:9458:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134e96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2400:3686:x1805522011804288:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.398599:0:9458:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64776 count 1 00010000:00010000:3.0:1721880422.398609:0:9458:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f8240/0x8a60d30f5727ca00 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd08:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.398619:0:9458:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013572c6c0/0x8a60d30f571e8b51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd08:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1283ce expref: 857 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.398623:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d133800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2401:3686:x1805522011802368:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1762us (1836us total) trans 4296020460 rc 0/0 00010000:00010000:3.0:1721880422.398625:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.398627:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1721880422.398628:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632487 00010000:00010000:3.0:1721880422.398629:0:9458:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f8240/0x8a60d30f5727ca00 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd08:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.398636:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d132d80/2, rc 0, transno 1053164 00000100:00100000:1.0:1721880422.398644:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800878d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2400:3686:x1805522011802112:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2016us (2064us total) trans 4296020461 rc 0/0 00000100:00100000:2.0:1721880422.398644:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d132d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011802368:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.398644:0:9458:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013572c6c0/0x8a60d30f571e8b51 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd08:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1283ce expref: 857 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.398648:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632486 00010000:00010000:3.0:1721880422.398652:0:9458:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013572c6c0/0x8a60d30f571e8b51 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd08:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1283ce expref: 857 pid: 15506 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.398660:0:9458:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013514f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011804544:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.398676:0:9458:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec540 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.398677:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1721880422.398683:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009993a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011804672:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1721880422.398686:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800878daa00/2, rc 0, transno 1053165 00000100:00100000:2.0:1721880422.398693:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011802112:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.398695:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.398712:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011804672 00000100:00100000:3.0:1721880422.398715:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011804672 00000100:00100000:1.0:1721880422.398720:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011804800:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.398743:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.398760:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011804800 00000100:00100000:3.0:1721880422.398763:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011804800 00000100:00100000:1.0:1721880422.398764:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007294ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011803264:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.398773:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632496 00000100:00100000:2.0:1721880422.398779:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2401:3689:x1805522011804672:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.398781:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632497 00010000:00010000:1.0:1721880422.398782:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727c9dd lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.398785:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d33df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2401:3689:x1805522011804800:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.398791:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64777 count 1 00002000:00080000:3.0:1721880422.398796:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64778 count 1 00010000:00010000:2.0:1721880422.398799:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727ca07 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd09:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.398807:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d746400/0x8a60d30f571e8cc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128422 expref: 857 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.398807:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f9680/0x8a60d30f5727ca0e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd0a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.398812:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.398813:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.398814:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727ca07 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.398817:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ed29b00/0x8a60d30f571e8dff lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd0a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128476 expref: 857 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.398824:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.398825:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.398826:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d746400/0x8a60d30f571e8cc4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128422 expref: 857 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.398827:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f9680/0x8a60d30f5727ca0e lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd0a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.398831:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d746400/0x8a60d30f571e8cc4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128422 expref: 857 pid: 16075 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.398838:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099938a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011804928:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.398843:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ed29b00/0x8a60d30f571e8dff lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd0a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128476 expref: 857 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.398852:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ed29b00/0x8a60d30f571e8dff lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd0a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128476 expref: 857 pid: 16075 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.398857:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdea80 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.398860:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800941e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011805056:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.398881:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec300 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.399159:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.399181:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.399194:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257762816 00000100:00100000:1.0:1721880422.399198:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257762816 00000100:00100000:2.0:1721880422.399200:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d133480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011803520:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.399207:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800965da400/0x8a60d30f571e866c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128215 expref: 858 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.399215:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727c9e4 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd04:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.399218:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257762944 00000100:00100000:1.0:1721880422.399219:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257762944 00010000:00010000:1.0:1721880422.399224:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0819200/0x8a60d30f571e873e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd04:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128270 expref: 859 pid: 16028 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.399225:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914683 00000100:00100000:3.0:1721880422.399231:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+859:2004:x1805522257762816:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.399235:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914684 00010000:00010000:3.0:1721880422.399239:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1721880422.399241:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+859:2004:x1805522257762944:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.399244:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800965da400/0x8a60d30f571e866c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd03:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128215 expref: 859 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.399251:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.399256:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0819200/0x8a60d30f571e873e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd04:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128270 expref: 859 pid: 16028 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.399256:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800965da400/0x8a60d30f571e866c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd03:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128215 expref: 859 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.399265:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0819200/0x8a60d30f571e873e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd04:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128270 expref: 859 pid: 16028 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.399268:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800965da400/0x8a60d30f571e866c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd03:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128215 expref: 859 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.399278:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.399279:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0819200/0x8a60d30f571e873e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd04:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128270 expref: 858 pid: 16028 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.399280:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.399282:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727c9dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.399288:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727c9dd lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd03:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.399289:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.399291:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.399293:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727c9e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd04:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.399300:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727c9e4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd04:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.399303:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.399307:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727c9dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.399312:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727c9dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.399320:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727c9dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.399323:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.399325:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+857:2004:x1805522257762816:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 94us (166us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.399327:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727c9dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.399331:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914683 00010000:00010000:1.0:1721880422.399334:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727c9dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.399340:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+857:2004:x1805522257762944:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 98us (157us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.399340:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b5f80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.399342:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727c9dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.399349:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914684 00010000:00010000:1.0:1721880422.399349:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727c9dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.399352:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727c9e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.399358:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727c9dd lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.399359:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727c9e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.399365:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727c9dd lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.399366:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727c9e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.399370:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727c9e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.399374:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727c9e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.399377:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352880 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.399379:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727c9e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.399383:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727c9e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.399390:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727c9e4 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.399393:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727c9e4 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.399451:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800878da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2403:3686:x1805522011803136:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2273us (2334us total) trans 4296020462 rc 0/0 00000100:00100000:1.0:1721880422.399455:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632490 00000004:00080000:3.0:1721880422.399472:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d131f80/2, rc 0, transno 1053166 00000100:00100000:3.0:1721880422.399481:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d131f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011803136:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.399512:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a05fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2402:3686:x1805522011803392:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2128us (2157us total) trans 4296020463 rc 0/0 00000100:00100000:3.0:1721880422.399512:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880123844a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011805184:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.399519:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632491 00000100:00100000:3.0:1721880422.399534:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.399551:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011805184 00000100:00100000:0.0:1721880422.399555:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011805184 00000004:00080000:3.0:1721880422.399555:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008c4e7800/2, rc 0, transno 1053167 00000100:00100000:3.0:1721880422.399563:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008c4e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011803392:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.399573:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632498 00000100:00100000:0.0:1721880422.399577:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880125a6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2402:3686:x1805522011805184:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.399587:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64779 count 1 00000100:00100000:3.0:1721880422.399589:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1721880422.399596:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d33d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011805312:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.399598:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727ca15 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd0b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.399614:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.399629:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011805312 00000100:00100000:1.0:1721880422.399633:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011805312 00000100:00100000:3.0:1721880422.399659:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632499 00000100:00100000:3.0:1721880422.399664:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880125a69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2403:3686:x1805522011805312:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.399676:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64780 count 1 00010000:00010000:0.0:1721880422.399680:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800965c6880/0x8a60d30f571e8ed8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1284d8 expref: 855 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.399684:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.399685:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.399687:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727ca15 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.399687:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f9440/0x8a60d30f5727ca1c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd0c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.399698:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b233c0/0x8a60d30f571e8fa3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd0c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12853a expref: 855 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.399699:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800965c6880/0x8a60d30f571e8ed8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1284d8 expref: 855 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.399705:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800965c6880/0x8a60d30f571e8ed8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1284d8 expref: 855 pid: 16075 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.399705:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.399706:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.399708:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f9440/0x8a60d30f5727ca1c lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd0c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.399712:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099aace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011805440:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.399725:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092b233c0/0x8a60d30f571e8fa3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd0c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12853a expref: 855 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.399747:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3ea80 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.399754:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092b233c0/0x8a60d30f571e8fa3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd0c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12853a expref: 855 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.399763:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880125a68a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011805568:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.399783:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.400124:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009528a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011803904:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.400138:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c9eb lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.400143:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d130a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011804032:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.400148:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.400151:0:9458:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013514f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011804544:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.400159:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.400159:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727c9f2 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd06:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.400160:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257763072 00000100:00100000:0.0:1721880422.400162:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257763072 00010000:00010000:3.0:1721880422.400164:0:9458:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801207f8240/0x8a60d30f5727ca00 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd08:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.400168:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.400172:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008c60f840/0x8a60d30f571e89c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd06:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128326 expref: 856 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.400175:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257763328 00000100:00100000:1.0:1721880422.400177:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257763328 00000100:00100000:0.0:1721880422.400184:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257763200 00000100:00100000:0.0:1721880422.400186:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257763200 00000100:00100000:2.0:1721880422.400186:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099938a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011804928:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.400187:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb5ad00/0x8a60d30f571e8a71 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12838f expref: 857 pid: 16053 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.400189:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914685 00010000:00010000:0.0:1721880422.400192:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801348d6ac0/0x8a60d30f571e88cd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1282d9 expref: 858 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.400194:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8067050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+858:2004:x1805522257763072:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.400198:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727ca07 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.400202:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.400203:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914686 00000100:00100000:1.0:1721880422.400205:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007294ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+858:2004:x1805522257763328:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.400207:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008c60f840/0x8a60d30f571e89c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd06:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128326 expref: 858 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.400211:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.400213:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bb5ad00/0x8a60d30f571e8a71 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd07:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12838f expref: 858 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.400216:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008c60f840/0x8a60d30f571e89c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd06:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128326 expref: 858 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.400219:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bb5ad00/0x8a60d30f571e8a71 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd07:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12838f expref: 858 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.400227:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.400228:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.400228:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c60f840/0x8a60d30f571e89c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd06:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128326 expref: 858 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.400230:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727c9f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd07:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.400234:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727c9f9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd07:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.400238:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.400239:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.400241:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.400242:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727c9f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd06:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.400248:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727c9f2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd06:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.400253:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914687 00000100:00100000:0.0:1721880422.400256:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+857:2004:x1805522257763200:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.400256:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007294ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+857:2004:x1805522257763328:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 50us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.400260:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914686 00010000:00010000:0.0:1721880422.400268:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.400270:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.400272:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801348d6ac0/0x8a60d30f571e88cd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd05:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1282d9 expref: 856 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.400278:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801348d6ac0/0x8a60d30f571e88cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd05:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1282d9 expref: 856 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.400284:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.400287:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801348d6ac0/0x8a60d30f571e88cd lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd05:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1282d9 expref: 856 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.400288:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8067050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+856:2004:x1805522257763072:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 93us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.400292:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257763456 00000100:00100000:1.0:1721880422.400293:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257763456 00010000:00010000:0.0:1721880422.400294:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.400294:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914685 00010000:00010000:0.0:1721880422.400295:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.400295:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727c9f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.400297:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c9eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.400299:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013572c6c0/0x8a60d30f571e8b51 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd08:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1283ce expref: 856 pid: 15506 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.400302:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c9eb lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd05:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.400303:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727c9f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.400310:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914688 00010000:00010000:0.0:1721880422.400311:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.400311:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727c9f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.400312:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+855:2007:x1805522257763456:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.400316:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.400318:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013572c6c0/0x8a60d30f571e8b51 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd08:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1283ce expref: 855 pid: 15506 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.400318:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727c9f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.400323:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013572c6c0/0x8a60d30f571e8b51 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd08:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1283ce expref: 855 pid: 15506 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.400325:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727c9f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.400326:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+855:2004:x1805522257763200:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 69us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.400330:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914687 00010000:00010000:1.0:1721880422.400331:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013572c6c0/0x8a60d30f571e8b51 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd08:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1283ce expref: 855 pid: 15506 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.400331:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136351440 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.400334:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727c9f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.400337:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bb5ad00/0x8a60d30f571e8a71 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd07:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12838f expref: 854 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.400340:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.400341:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.400341:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727c9f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.400342:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801207f8240/0x8a60d30f5727ca00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd08:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.400347:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f8240/0x8a60d30f5727ca00 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd08:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.400348:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c9eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.400350:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009993a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011804416:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.400352:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727c9f2 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.400353:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c9eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.400357:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c9eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.400359:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727c9f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.400361:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c9eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.400362:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.400365:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c9eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.400366:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727c9f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.400368:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4d80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.400369:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c9eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.400373:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+852:2007:x1805522257763456:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 60us (89us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.400376:0:9458:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801207f8240/0x8a60d30f5727ca00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.400377:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c9eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.400377:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914688 00010000:00010000:0.0:1721880422.400383:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c9eb lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.400383:0:9458:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207f8240/0x8a60d30f5727ca00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.400386:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727c9eb lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.400390:0:9458:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f8240/0x8a60d30f5727ca00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.400396:0:9458:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f8240/0x8a60d30f5727ca00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.400402:0:9458:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801207f8240/0x8a60d30f5727ca00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.400408:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.400408:0:9458:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801207f8240 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.400411:0:9458:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f8240/0x8a60d30f5727ca00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.400415:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257763584 00000100:00100000:1.0:1721880422.400417:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257763584 00010000:00010000:3.0:1721880422.400417:0:9458:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f8240/0x8a60d30f5727ca00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.400423:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d746400/0x8a60d30f571e8cc4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128422 expref: 852 pid: 16075 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.400431:0:9458:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801207f8240/0x8a60d30f5727ca00 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.400433:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914689 00000100:00100000:1.0:1721880422.400435:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800962ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+852:2004:x1805522257763584:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.400437:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801207f8240/0x8a60d30f5727ca00 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.400439:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.400441:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d746400/0x8a60d30f571e8cc4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd09:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128422 expref: 852 pid: 16075 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.400446:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d746400/0x8a60d30f571e8cc4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd09:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128422 expref: 852 pid: 16075 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.400453:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d746400/0x8a60d30f571e8cc4 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd09:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128422 expref: 852 pid: 16075 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.400461:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.400462:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.400463:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727ca07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.400467:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727ca07 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd09:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.400476:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.400481:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880095289c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2404:3688:x1805522011803776:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2199us (2225us total) trans 4296020464 rc 0/0 00000100:00100000:1.0:1721880422.400485:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800962ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+851:2004:x1805522257763584:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 48us (76us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.400489:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632493 00000100:00100000:1.0:1721880422.400490:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914689 00000004:00080000:2.0:1721880422.400520:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009528ad80/2, rc 0, transno 1053168 00000100:00100000:2.0:1721880422.400538:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009528ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011803776:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.400555:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727ca07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.400563:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727ca07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.400564:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1721880422.400569:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800962a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011805696:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.400571:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727ca07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.400578:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727ca07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.400584:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727ca07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.400594:0:9458:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880134e96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2405:3686:x1805522011804288:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2003us (2045us total) trans 4296020466 rc 0/0 00010000:00010000:2.0:1721880422.400595:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353cc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.400598:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727ca07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.400599:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.400600:0:9458:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632495 00000100:00100000:0.0:1721880422.400602:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880095288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2405:3688:x1805522011803648:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2327us (2385us total) trans 4296020465 rc 0/0 00010000:00010000:2.0:1721880422.400605:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727ca07 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.400609:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632492 00000100:00100000:3.0:1721880422.400612:0:9458:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011805696 00000100:00100000:3.0:1721880422.400614:0:9458:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011805696 00010000:00010000:2.0:1721880422.400616:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727ca07 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.400619:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.400623:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727ca07 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.400626:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632500 00000100:00100000:1.0:1721880422.400626:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257763712 00000100:00100000:1.0:1721880422.400628:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257763712 00000100:00100000:0.0:1721880422.400631:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2404:3689:x1805522011805696:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.400634:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ed29b00/0x8a60d30f571e8dff lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd0a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128476 expref: 851 pid: 16075 timeout: 887 lvb_type: 0 00002000:00080000:0.0:1721880422.400644:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64781 count 1 00000100:00100000:3.0:1721880422.400644:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800941e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011805056:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.400645:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914690 00000100:00100000:1.0:1721880422.400648:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+851:2004:x1805522257763712:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.400652:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.400654:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ed29b00/0x8a60d30f571e8dff lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd0a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128476 expref: 851 pid: 16075 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.400654:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801207f9680/0x8a60d30f5727ca0e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd0a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.400655:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727ca23 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd0d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.400659:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ed29b00/0x8a60d30f571e8dff lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd0a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128476 expref: 851 pid: 16075 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.400666:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801348d4fc0/0x8a60d30f571e903d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd0d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128587 expref: 851 pid: 16053 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.400667:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ed29b00/0x8a60d30f571e8dff lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd0a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128476 expref: 851 pid: 16075 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.400672:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.400673:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.400674:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.400675:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.400676:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727ca23 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd0d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.400676:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801207f9680/0x8a60d30f5727ca0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd0a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.400677:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880134e94a80/2, rc 0, transno 1053170 00000100:00100000:3.0:1721880422.400683:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880134e94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011804288:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.400684:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f9680/0x8a60d30f5727ca0e lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd0a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.400693:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.400699:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801348d4fc0/0x8a60d30f571e903d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd0d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128587 expref: 850 pid: 16053 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.400703:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880134eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+850:2004:x1805522257763712:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 53us (82us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.400706:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914690 00010000:00010000:3.0:1721880422.400708:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801207f9680/0x8a60d30f5727ca0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.400709:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801348d4fc0/0x8a60d30f571e903d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd0d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128587 expref: 850 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.400715:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207f9680/0x8a60d30f5727ca0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.400718:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099aaed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011805824:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.400720:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800941e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011805952:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.400722:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f9680/0x8a60d30f5727ca0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.400755:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f9680/0x8a60d30f5727ca0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.400761:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e540 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.400761:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801207f9680/0x8a60d30f5727ca0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.400765:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880095289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2405:3689:x1805522011804672:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1984us (2067us total) trans 4296020467 rc 0/0 00000100:00100000:1.0:1721880422.400766:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.400766:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801207f9680 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.400769:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f9680/0x8a60d30f5727ca0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.400773:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632496 00010000:00010000:3.0:1721880422.400775:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f9680/0x8a60d30f5727ca0e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.400781:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009993a300/2, rc 0, transno 1053171 00010000:00010000:3.0:1721880422.400784:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801207f9680/0x8a60d30f5727ca0e lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.400786:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009993a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011804672:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.400787:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011805952 00000100:00100000:2.0:1721880422.400790:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011805952 00010000:00010000:3.0:1721880422.400791:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801207f9680/0x8a60d30f5727ca0e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.400802:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.400809:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632501 00000100:00100000:2.0:1721880422.400813:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134eb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2405:3689:x1805522011805952:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.400822:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257763840 00000100:00100000:0.0:1721880422.400826:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257763840 00002000:00080000:2.0:1721880422.400826:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64782 count 1 00010000:00010000:0.0:1721880422.400836:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800965c6880/0x8a60d30f571e8ed8 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1284d8 expref: 850 pid: 16075 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.400837:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727ca2a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd0e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.400848:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880123ae6d00/0x8a60d30f571e90d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd0e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1285db expref: 850 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.400858:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914691 00010000:00010000:2.0:1721880422.400860:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.400862:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1721880422.400863:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099aad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+850:2005:x1805522257763840:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.400864:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727ca2a lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd0e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.400871:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.400875:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800965c6880/0x8a60d30f571e8ed8 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd0b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1284d8 expref: 850 pid: 16075 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.400882:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880123ae6d00/0x8a60d30f571e90d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd0e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1285db expref: 850 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.400884:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800965c6880/0x8a60d30f571e8ed8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd0b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1284d8 expref: 850 pid: 16075 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.400891:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880123ae6d00/0x8a60d30f571e90d7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd0e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1285db expref: 850 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.400895:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.400897:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.400899:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727ca15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd0b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.400901:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099938a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011806208:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.400905:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d33df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2406:3689:x1805522011804800:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2117us (2159us total) trans 4296020468 rc 0/0 00010000:00010000:0.0:1721880422.400906:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727ca15 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd0b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.400910:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632497 00010000:00010000:0.0:1721880422.400915:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.400925:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.400929:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdea80 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.400929:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880134944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011806080:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.400932:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099aad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+850:2005:x1805522257763840:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 67us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.400936:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257763968 00000100:00100000:0.0:1721880422.400937:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914691 00000100:00100000:1.0:1721880422.400939:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257763968 00010000:00010000:1.0:1721880422.400948:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092b233c0/0x8a60d30f571e8fa3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd0c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12853a expref: 850 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.400949:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1721880422.400952:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007294f480/2, rc 0, transno 1053169 00000100:00100000:2.0:1721880422.400961:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007294f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011803648:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.400962:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914692 00000100:00100000:1.0:1721880422.400966:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e194850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+850:2004:x1805522257763968:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.400967:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011806080 00010000:00010000:1.0:1721880422.400970:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.400970:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011806080 00010000:00010000:1.0:1721880422.400972:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092b233c0/0x8a60d30f571e8fa3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd0c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12853a expref: 850 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.400977:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800965c6880/0x8a60d30f571e8ed8 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd0b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1284d8 expref: 850 pid: 16075 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.400978:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092b233c0/0x8a60d30f571e8fa3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd0c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12853a expref: 850 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.400984:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632502 00000100:00100000:0.0:1721880422.400985:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099aace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011805440:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.400987:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.400988:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.400989:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2406:3686:x1805522011806080:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.400990:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801207f9440/0x8a60d30f5727ca1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd0c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.400994:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f9440/0x8a60d30f5727ca1c lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd0c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.400995:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727ca15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.400999:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64783 count 1 00010000:00010000:0.0:1721880422.401000:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727ca15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.401001:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.401004:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727ca15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.401008:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727ca15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.401008:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207fa1c0/0x8a60d30f5727ca31 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd0f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.401031:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727ca15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.401031:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e194850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+849:2004:x1805522257763968:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 63us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.401034:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914692 00010000:00010000:3.0:1721880422.401035:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d7d5680/0x8a60d30f571e9178 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128628 expref: 849 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.401036:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727ca15 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.401039:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325f600 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.401041:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727ca15 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.401041:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.401043:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.401045:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727ca15 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.401045:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207fa1c0/0x8a60d30f5727ca31 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.401051:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727ca15 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.401054:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727ca15 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.401061:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d7d5680/0x8a60d30f571e9178 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128628 expref: 848 pid: 15506 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.401069:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d7d5680/0x8a60d30f571e9178 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128628 expref: 848 pid: 15506 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.401079:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011806336:192.168.201.24@tcp:104: 00000004:00080000:1.0:1721880422.401095:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099939880/2, rc 0, transno 1053172 00000100:00100000:3.0:1721880422.401096:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec300 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.401099:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011804800:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.401105:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1721880422.401111:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007294ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011806464:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.401112:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1721880422.401116:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009f1b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011806592:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.401127:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.401144:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011806464 00010000:00010000:3.0:1721880422.401146:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727c9f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.401149:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011806464 00010000:00010000:3.0:1721880422.401157:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727c9f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.401164:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727c9f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.401166:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632503 00000100:00100000:0.0:1721880422.401167:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880125a6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2408:3686:x1805522011805184:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1589us (1632us total) trans 4296020469 rc 0/0 00010000:00010000:3.0:1721880422.401170:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727c9f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.401171:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2408:3686:x1805522011806464:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.401173:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632498 00010000:00010000:3.0:1721880422.401177:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727c9f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.401181:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:2.0:1721880422.401182:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64784 count 1 00010000:00010000:3.0:1721880422.401183:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801363506c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.401186:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727c9f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.401189:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011806592 00000100:00100000:0.0:1721880422.401192:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011806592 00010000:00010000:2.0:1721880422.401194:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727ca38 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd10:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.401194:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727c9f9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.401203:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727c9f9 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.401205:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008cf35f80/0x8a60d30f571e91f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128667 expref: 848 pid: 16037 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.401206:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632504 00000100:00100000:0.0:1721880422.401209:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f1b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2408:3689:x1805522011806592:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.401209:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727c9f9 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.401217:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.401218:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.401220:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727ca38 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.401236:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008cf35f80/0x8a60d30f571e91f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128667 expref: 848 pid: 16037 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.401245:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008cf35f80/0x8a60d30f571e91f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128667 expref: 848 pid: 16037 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.401254:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099938700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011806720:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.401278:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfded80 going to sleep for 11 seconds 00002000:00080000:0.0:1721880422.401283:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64785 count 1 00010000:00010000:0.0:1721880422.401293:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727ca3f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.401304:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800963e8480/0x8a60d30f571e9289 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1286b4 expref: 848 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.401313:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2409:3686:x1805522011804160:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2840us (2886us total) trans 4296020470 rc 0/0 00000100:00100000:3.0:1721880422.401319:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632494 00010000:00010000:3.0:1721880422.401346:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b233c0/0x8a60d30f571e8fa3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd0c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12853a expref: 848 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.401348:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.401349:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.401351:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727ca3f lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.401354:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880125a68a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011805568:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.401364:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800963e8480/0x8a60d30f571e9289 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1286b4 expref: 847 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.401366:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801207f9440/0x8a60d30f5727ca1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.401370:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800963e8480/0x8a60d30f571e9289 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1286b4 expref: 847 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.401372:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801207f9440/0x8a60d30f5727ca1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.401377:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099aace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011806848:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.401378:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207f9440/0x8a60d30f5727ca1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.401384:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f9440/0x8a60d30f5727ca1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.401390:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f9440/0x8a60d30f5727ca1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.401396:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801207f9440/0x8a60d30f5727ca1c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.401401:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3ea80 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.401401:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801207f9440 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.401404:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f9440/0x8a60d30f5727ca1c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.401415:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f9440/0x8a60d30f5727ca1c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.401424:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801207f9440/0x8a60d30f5727ca1c lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.401427:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880123844a80/2, rc 0, transno 1053173 00010000:00010000:3.0:1721880422.401430:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801207f9440/0x8a60d30f5727ca1c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.401434:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880123844a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011805184:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1721880422.401443:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009affad80/2, rc 0, transno 1053174 00000100:00100000:0.0:1721880422.401446:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009affad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011804160:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.401471:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800962ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011806976:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.401481:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1721880422.401486:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.401489:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880134eb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011807104:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.401509:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.401523:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880125a69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2409:3686:x1805522011805312:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1857us (1907us total) trans 4296020471 rc 0/0 00000100:00100000:3.0:1721880422.401529:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632499 00000100:00100000:2.0:1721880422.401531:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011806976 00000100:00100000:2.0:1721880422.401533:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011806976 00000100:00100000:3.0:1721880422.401541:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011807104 00000100:00100000:3.0:1721880422.401544:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011807104 00000100:00100000:2.0:1721880422.401550:0:9458:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632505 00000100:00100000:2.0:1721880422.401554:0:9458:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d287800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2410:3689:x1805522011806976:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.401561:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632506 00002000:00080000:2.0:1721880422.401564:0:9458:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64786 count 1 00000100:00100000:3.0:1721880422.401565:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009993ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2410:3687:x1805522011807104:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.401572:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099aaed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011805824:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.401572:0:9458:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727ca46 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.401576:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64787 count 1 00010000:00010000:2.0:1721880422.401580:0:9458:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fc1d200/0x8a60d30f571e9369 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128708 expref: 847 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.401582:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.401585:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f98c0/0x8a60d30f5727ca4d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.401587:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727ca23 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd0d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.401588:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.401589:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.401591:0:9458:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727ca46 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.401595:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257764096 00010000:00010000:3.0:1721880422.401595:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fc1cb40/0x8a60d30f571e941f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12876a expref: 847 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.401598:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257764096 00010000:00010000:3.0:1721880422.401601:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.401602:0:9458:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fc1d200/0x8a60d30f571e9369 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128708 expref: 848 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.401602:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.401605:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f98c0/0x8a60d30f5727ca4d lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.401607:0:9458:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fc1d200/0x8a60d30f571e9369 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128708 expref: 848 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.401610:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801348d4fc0/0x8a60d30f571e903d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd0d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128587 expref: 848 pid: 16053 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.401615:0:9458:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009993bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011807232:192.168.201.24@tcp:104: 00000004:00080000:0.0:1721880422.401616:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009d33d180/2, rc 0, transno 1053175 00010000:00010000:3.0:1721880422.401620:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fc1cb40/0x8a60d30f571e941f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12876a expref: 848 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.401628:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d33d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011805312:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.401628:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fc1cb40/0x8a60d30f571e941f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12876a expref: 848 pid: 16028 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.401629:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914693 00000100:00100000:1.0:1721880422.401634:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135300000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+848:2004:x1805522257764096:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.401638:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800929ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011807360:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.401640:0:9458:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde600 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.401641:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.401644:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801348d4fc0/0x8a60d30f571e903d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd0d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128587 expref: 848 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.401653:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801348d4fc0/0x8a60d30f571e903d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd0d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128587 expref: 848 pid: 16053 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.401658:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.401659:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1721880422.401666:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801348d4fc0/0x8a60d30f571e903d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd0d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128587 expref: 848 pid: 16053 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.401667:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099aaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011807488:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.401676:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.401677:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.401679:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727ca23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd0d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.401684:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727ca23 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd0d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.401688:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.401694:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.401706:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011807488 00000100:00100000:3.0:1721880422.401708:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011807488 00000100:00100000:1.0:1721880422.401711:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135300000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+847:2004:x1805522257764096:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 77us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.401715:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914693 00000100:00100000:3.0:1721880422.401723:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632507 00000100:00100000:3.0:1721880422.401744:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099aad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2411:3686:x1805522011807488:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.401829:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727ca23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.401838:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727ca23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.401846:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727ca23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.401852:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727ca23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.401859:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727ca23 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.401865:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325db00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.401868:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727ca23 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.401874:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727ca23 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.401876:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64788 count 1 00010000:00010000:0.0:1721880422.401884:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727ca23 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.401885:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f8000/0x8a60d30f5727ca54 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.401886:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.401890:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727ca23 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.401893:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257764224 00000100:00100000:1.0:1721880422.401895:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257764224 00010000:00010000:3.0:1721880422.401895:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fc1e640/0x8a60d30f571e94e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1287d3 expref: 846 pid: 16042 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.401901:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.401902:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880123ae6d00/0x8a60d30f571e90d7 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd0e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1285db expref: 847 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.401902:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.401904:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f8000/0x8a60d30f5727ca54 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.401906:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099938a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011806208:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.401917:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914694 00000100:00100000:1.0:1721880422.401920:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135302d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+847:2005:x1805522257764224:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.401921:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727ca2a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd0e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.401921:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fc1e640/0x8a60d30f571e94e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1287d3 expref: 847 pid: 16042 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.401924:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.401926:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880123ae6d00/0x8a60d30f571e90d7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd0e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1285db expref: 847 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.401932:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880123ae6d00/0x8a60d30f571e90d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd0e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1285db expref: 847 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.401934:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fc1e640/0x8a60d30f571e94e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1287d3 expref: 847 pid: 16042 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.401940:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123ae6d00/0x8a60d30f571e90d7 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd0e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1285db expref: 847 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.401943:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011807616:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.401948:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.401948:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.401949:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099938700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011806720:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.401950:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727ca2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd0e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.401955:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727ca2a lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd0e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.401960:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727ca38 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.401964:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.401964:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec840 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.401974:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135302d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+846:2005:x1805522257764224:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 54us (88us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.401975:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727ca2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.401978:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914694 00010000:00010000:2.0:1721880422.401982:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727ca2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.401982:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800929cd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011806336:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.401990:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727ca2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.401991:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801207fa1c0/0x8a60d30f5727ca31 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.401995:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.401997:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727ca2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.402002:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257764352 00000100:00100000:1.0:1721880422.402004:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257764352 00010000:00010000:2.0:1721880422.402004:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727ca2a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.402022:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d7d5680/0x8a60d30f571e9178 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128628 expref: 846 pid: 15506 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.402022:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352f40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.402025:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727ca2a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.402032:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727ca2a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.402038:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914695 00000100:00100000:1.0:1721880422.402041:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135301c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+846:2007:x1805522257764352:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.402042:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727ca2a lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.402049:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727ca2a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.402054:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.402057:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d7d5680/0x8a60d30f571e9178 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd0f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128628 expref: 846 pid: 15506 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.402063:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d7d5680/0x8a60d30f571e9178 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd0f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128628 expref: 846 pid: 15506 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.402072:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d7d5680/0x8a60d30f571e9178 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd0f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128628 expref: 846 pid: 15506 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.402082:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.402083:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.402084:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801207fa1c0/0x8a60d30f5727ca31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.402089:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207fa1c0/0x8a60d30f5727ca31 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd0f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.402097:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.402107:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801207fa1c0/0x8a60d30f5727ca31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.402109:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135301c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+845:2007:x1805522257764352:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 67us (113us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.402114:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207fa1c0/0x8a60d30f5727ca31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.402115:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914695 00010000:00010000:3.0:1721880422.402121:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207fa1c0/0x8a60d30f5727ca31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.402128:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801207fa1c0/0x8a60d30f5727ca31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.402134:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801207fa1c0/0x8a60d30f5727ca31 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.402140:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801207fa1c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.402143:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207fa1c0/0x8a60d30f5727ca31 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.402146:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880134eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2413:3689:x1805522011805696:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1464us (1495us total) trans 4296020472 rc 0/0 00010000:00010000:3.0:1721880422.402149:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207fa1c0/0x8a60d30f5727ca31 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.402153:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632500 00000100:00100000:1.0:1721880422.402153:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.402159:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801207fa1c0/0x8a60d30f5727ca31 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.402160:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880134eb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2413:3689:x1805522011805952:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1344us (1391us total) trans 4296020473 rc 0/0 00000100:00100000:1.0:1721880422.402161:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257764480 00000100:00100000:1.0:1721880422.402163:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257764480 00010000:00010000:3.0:1721880422.402165:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801207fa1c0/0x8a60d30f5727ca31 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.402166:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632501 00010000:00010000:1.0:1721880422.402170:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008cf35f80/0x8a60d30f571e91f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128667 expref: 845 pid: 16037 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.402181:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914696 00000004:00080000:0.0:1721880422.402183:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800941e8000/2, rc 0, transno 1053177 00000100:00100000:1.0:1721880422.402183:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135303480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+845:2005:x1805522257764480:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.402188:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.402190:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008cf35f80/0x8a60d30f571e91f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128667 expref: 845 pid: 16037 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.402191:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800941e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011805952:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.402196:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008cf35f80/0x8a60d30f571e91f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128667 expref: 845 pid: 16037 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.402203:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008cf35f80/0x8a60d30f571e91f6 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128667 expref: 845 pid: 16037 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.402209:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.402210:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.402211:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727ca38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.402216:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727ca38 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.402227:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.402236:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135303480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+844:2005:x1805522257764480:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 52us (83us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.402239:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914696 00010000:00010000:2.0:1721880422.402240:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727ca38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.402249:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727ca38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.402256:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727ca38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.402263:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727ca38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.402263:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2412:3686:x1805522011806080:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1273us (1313us total) trans 4296020474 rc 0/0 00000100:00100000:3.0:1721880422.402269:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632502 00010000:00010000:2.0:1721880422.402272:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727ca38 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.402275:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.402279:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350b40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.402282:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727ca38 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.402286:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800962a8a80/2, rc 0, transno 1053176 00010000:00010000:2.0:1721880422.402289:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727ca38 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.402294:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800962a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011805696:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1721880422.402296:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880134944e00/2, rc 0, transno 1053178 00000100:00100000:0.0:1721880422.402299:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1721880422.402300:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727ca38 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.402300:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880134944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011806080:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.402318:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727ca38 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.402334:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257764608 00000100:00100000:1.0:1721880422.402334:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.402337:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257764608 00000100:00100000:1.0:1721880422.402341:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257764864 00000100:00100000:3.0:1721880422.402342:0:9458:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009993bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011807232:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.402343:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257764864 00000100:00100000:2.0:1721880422.402346:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1721880422.402348:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800963e8480/0x8a60d30f571e9289 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1286b4 expref: 845 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.402352:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fc1cb40/0x8a60d30f571e941f lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12876a expref: 845 pid: 16028 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.402355:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099aac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011807872:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.402357:0:9458:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727ca46 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.402366:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914697 00000100:00100000:1.0:1721880422.402370:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135303800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+845:2004:x1805522257764608:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.402372:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914698 00000100:00100000:3.0:1721880422.402372:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099aad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011808000:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.402374:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1721880422.402378:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135301f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+845:2004:x1805522257764864:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.402378:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800963e8480/0x8a60d30f571e9289 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1286b4 expref: 845 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.402383:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800963e8480/0x8a60d30f571e9289 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1286b4 expref: 845 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.402384:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.402385:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.402389:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fc1cb40/0x8a60d30f571e941f lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12876a expref: 845 pid: 16028 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.402391:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.402392:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.402394:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727ca3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.402395:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.402398:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727ca3f lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.402402:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fc1cb40/0x8a60d30f571e941f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12876a expref: 845 pid: 16028 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.402406:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.402414:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.402414:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011807872 00010000:00010000:0.0:1721880422.402416:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.402418:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801207f98c0/0x8a60d30f5727ca4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.402418:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135303800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+845:2004:x1805522257764608:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 47us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.402418:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011807872 00000100:00100000:3.0:1721880422.402420:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011808000 00000100:00100000:1.0:1721880422.402421:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914697 00000100:00100000:3.0:1721880422.402423:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011808000 00010000:00010000:0.0:1721880422.402425:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f98c0/0x8a60d30f5727ca4d lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.402436:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.402438:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632508 00000100:00100000:2.0:1721880422.402442:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096c9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2413:3688:x1805522011807872:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.402443:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632509 00000100:00100000:3.0:1721880422.402447:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2413:3686:x1805522011808000:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.402454:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64790 count 1 00000100:00100000:0.0:1721880422.402455:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135301f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+844:2004:x1805522257764864:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 76us (119us total) trans 0 rc 0/0 00002000:00080000:3.0:1721880422.402459:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64791 count 1 00000100:00100000:0.0:1721880422.402461:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914698 00010000:00010000:2.0:1721880422.402464:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727ca5b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.402469:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.402469:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207fb180/0x8a60d30f5727ca62 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.402474:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257764736 00010000:00010000:2.0:1721880422.402474:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801313f1200/0x8a60d30f571e9641 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128889 expref: 843 pid: 16019 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.402476:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257764736 00010000:00010000:2.0:1721880422.402480:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.402480:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134d286c0/0x8a60d30f571e9721 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1288eb expref: 844 pid: 16091 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.402482:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.402484:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727ca5b lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.402486:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fc1d200/0x8a60d30f571e9369 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128708 expref: 844 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.402486:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.402487:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.402489:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207fb180/0x8a60d30f5727ca62 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.402500:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801313f1200/0x8a60d30f571e9641 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128889 expref: 844 pid: 16019 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.402505:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134d286c0/0x8a60d30f571e9721 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1288eb expref: 844 pid: 16091 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.402507:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914699 00010000:00010000:2.0:1721880422.402509:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801313f1200/0x8a60d30f571e9641 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128889 expref: 844 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.402512:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e197c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+844:2005:x1805522257764736:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.402515:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134d286c0/0x8a60d30f571e9721 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1288eb expref: 844 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.402518:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.402519:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099938700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011808128:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.402522:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fc1d200/0x8a60d30f571e9369 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128708 expref: 844 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.402525:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011808256:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.402535:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fc1d200/0x8a60d30f571e9369 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128708 expref: 844 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.402545:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fc1d200/0x8a60d30f571e9369 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128708 expref: 844 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.402545:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfded80 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.402546:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec300 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.402556:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.402557:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.402560:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727ca46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.402567:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727ca46 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.402569:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fc1cb40/0x8a60d30f571e941f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12876a expref: 843 pid: 16028 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.402583:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800929ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011807360:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.402585:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.402594:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801207f98c0/0x8a60d30f5727ca4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.402602:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e197c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+842:2005:x1805522257764736:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 89us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.402606:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914699 00010000:00010000:3.0:1721880422.402609:0:9458:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727ca46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.402615:0:9458:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727ca46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.402622:0:9458:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727ca46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.402628:0:9458:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727ca46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.402633:0:9458:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727ca46 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.402638:0:9458:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350d80 already unused, calling callback (ffffffffa084e330) 00000100:00100000:0.0:1721880422.402641:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099aaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011807744:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.402641:0:9458:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727ca46 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.402648:0:9458:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727ca46 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.402655:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.402656:0:9458:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727ca46 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.402662:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727ca46 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.402667:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2414:3686:x1805522011806464:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1495us (1538us total) trans 4296020475 rc 0/0 00000100:00100000:2.0:1721880422.402677:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632503 00000100:00100000:2.0:1721880422.402724:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011807744 00000100:00100000:2.0:1721880422.402750:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011807744 00000100:00100000:2.0:1721880422.402766:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632510 00010000:00010000:1.0:1721880422.402768:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800963e8480/0x8a60d30f571e9289 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1286b4 expref: 841 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.402771:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099aadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2415:3689:x1805522011807744:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.402777:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099aace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011806848:192.168.201.24@tcp:104: 00002000:00080000:2.0:1721880422.402782:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64789 count 1 00010000:00010000:1.0:1721880422.402788:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727ca3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.402793:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727ca3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.402793:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727ca69 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.402796:0:9458:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d287800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2415:3689:x1805522011806976:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1238us (1307us total) trans 4296020476 rc 0/0 00010000:00010000:1.0:1721880422.402797:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727ca3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.402801:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727ca3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.402802:0:9458:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632505 00010000:00010000:2.0:1721880422.402804:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880123a69200/0x8a60d30f571e957d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128812 expref: 840 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.402805:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727ca3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.402808:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727ca3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.402811:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.402812:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.402813:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325df80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.402815:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727ca3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.402815:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727ca69 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.402819:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727ca3f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.402823:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800962ab100/2, rc 0, transno 1053180 00010000:00010000:3.0:1721880422.402823:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801207f98c0/0x8a60d30f5727ca4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.402825:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727ca3f lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.402828:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727ca3f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.402830:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880123a69200/0x8a60d30f571e957d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128812 expref: 840 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.402830:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207f98c0/0x8a60d30f5727ca4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.402831:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800962ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011806976:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.402838:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f98c0/0x8a60d30f5727ca4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.402839:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880123a69200/0x8a60d30f571e957d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128812 expref: 840 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.402844:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f98c0/0x8a60d30f5727ca4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.402849:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099938a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011808384:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.402850:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801207f98c0/0x8a60d30f5727ca4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.402855:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801207f98c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.402858:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f98c0/0x8a60d30f5727ca4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.402864:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f98c0/0x8a60d30f5727ca4d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.402871:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdea80 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.402874:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801207f98c0/0x8a60d30f5727ca4d lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.402881:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801207f98c0/0x8a60d30f5727ca4d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.402892:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88007294ce00/2, rc 0, transno 1053179 00000100:00100000:2.0:1721880422.402905:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007294ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011806464:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.402910:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1721880422.402917:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011808512:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.402927:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f1b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2416:3689:x1805522011806592:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1715us (1744us total) trans 4296020477 rc 0/0 00000100:00100000:1.0:1721880422.402934:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632504 00000100:00100000:2.0:1721880422.402937:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1721880422.402949:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009f1b4380/2, rc 0, transno 1053181 00000100:00100000:1.0:1721880422.402950:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011808512 00000100:00100000:1.0:1721880422.402953:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011808512 00000100:00100000:0.0:1721880422.402955:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009f1b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011806592:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.402959:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099aaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011808640:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.402975:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099aac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011808768:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.402976:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.402979:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632511 00000100:00100000:1.0:1721880422.402983:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2416:3686:x1805522011808512:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.402983:0:9458:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011808640 00000100:00100000:3.0:1721880422.402987:0:9458:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011808640 00000100:00100000:0.0:1721880422.402995:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:1.0:1721880422.402995:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64792 count 1 00010000:00010000:1.0:1721880422.403004:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727ca70 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.403006:0:9458:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011808768 00000100:00100000:3.0:1721880422.403008:0:9458:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011808768 00010000:00010000:1.0:1721880422.403025:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880123a686c0/0x8a60d30f571e97de lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128946 expref: 840 pid: 16087 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.403033:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.403034:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.403036:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727ca70 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.403040:0:9458:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632512 00000100:00100000:3.0:1721880422.403045:0:9458:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2418:3688:x1805522011808640:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.403046:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632513 00010000:00010000:1.0:1721880422.403048:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880123a686c0/0x8a60d30f571e97de lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128946 expref: 840 pid: 16087 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.403053:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099aaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2418:3689:x1805522011808768:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.403054:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880123a686c0/0x8a60d30f571e97de lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128946 expref: 840 pid: 16087 timeout: 887 lvb_type: 0 00002000:00080000:3.0:1721880422.403056:0:9458:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64793 count 1 00000100:00100000:1.0:1721880422.403060:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135300000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011808896:192.168.201.24@tcp:104: 00002000:00080000:0.0:1721880422.403066:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64794 count 1 00010000:00010000:3.0:1721880422.403067:0:9458:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f8fc0/0x8a60d30f5727ca77 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.403077:0:9458:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134d29b00/0x8a60d30f571e9894 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128993 expref: 840 pid: 16050 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.403078:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727ca7e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.403079:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302ebc00 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.403083:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.403084:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.403086:0:9458:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f8fc0/0x8a60d30f5727ca77 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.403089:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134d2bcc0/0x8a60d30f571e992e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1289ee expref: 840 pid: 16128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.403095:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.403097:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.403100:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727ca7e lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.403102:0:9458:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134d29b00/0x8a60d30f571e9894 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128993 expref: 840 pid: 16050 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.403111:0:9458:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134d29b00/0x8a60d30f571e9894 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128993 expref: 840 pid: 16050 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.403116:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134d2bcc0/0x8a60d30f571e992e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1289ee expref: 840 pid: 16128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.403126:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134d2bcc0/0x8a60d30f571e992e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1289ee expref: 840 pid: 16128 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.403126:0:9458:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800929ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011809024:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.403133:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099938700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011808128:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.403136:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099aace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011809152:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.403149:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727ca5b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.403150:0:9458:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.403157:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.403175:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800929cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011808256:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.403188:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801207fb180/0x8a60d30f5727ca62 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.403204:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.403210:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800929cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011807616:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.403219:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257764992 00010000:00010000:3.0:1721880422.403220:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801207f8000/0x8a60d30f5727ca54 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.403222:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.403223:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257764992 00010000:00010000:0.0:1721880422.403235:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fc1e640/0x8a60d30f571e94e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1287d3 expref: 841 pid: 16042 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.403237:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257765248 00000100:00100000:1.0:1721880422.403240:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257765248 00010000:00010000:1.0:1721880422.403249:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801313f1200/0x8a60d30f571e9641 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128889 expref: 842 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.403250:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009993ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2418:3687:x1805522011807104:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1683us (1739us total) trans 4296020478 rc 0/0 00000100:00100000:2.0:1721880422.403256:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.403256:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632506 00000100:00100000:0.0:1721880422.403260:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914700 00000100:00100000:1.0:1721880422.403263:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257765120 00000100:00100000:1.0:1721880422.403264:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257765120 00000100:00100000:0.0:1721880422.403265:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099938700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+842:2004:x1805522257764992:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.403270:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134d286c0/0x8a60d30f571e9721 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1288eb expref: 843 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.403272:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.403274:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914701 00010000:00010000:0.0:1721880422.403275:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fc1e640/0x8a60d30f571e94e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1287d3 expref: 843 pid: 16042 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.403281:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009993b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+843:2004:x1805522257765248:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.403285:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fc1e640/0x8a60d30f571e94e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1287d3 expref: 843 pid: 16042 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.403288:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914702 00000100:00100000:1.0:1721880422.403290:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099939180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+843:2006:x1805522257765120:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.403291:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.403296:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801313f1200/0x8a60d30f571e9641 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128889 expref: 843 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.403297:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fc1e640/0x8a60d30f571e94e3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1287d3 expref: 843 pid: 16042 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.403297:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.403299:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134d286c0/0x8a60d30f571e9721 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1288eb expref: 843 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.403306:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134d286c0/0x8a60d30f571e9721 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1288eb expref: 842 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.403306:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801313f1200/0x8a60d30f571e9641 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128889 expref: 842 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.403310:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.403312:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.403314:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134d286c0/0x8a60d30f571e9721 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1288eb expref: 842 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.403315:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801207f8000/0x8a60d30f5727ca54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.403319:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801313f1200/0x8a60d30f571e9641 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128889 expref: 841 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.403320:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.403321:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.403322:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f8000/0x8a60d30f5727ca54 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.403323:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801207fb180/0x8a60d30f5727ca62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.403327:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207fb180/0x8a60d30f5727ca62 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.403330:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.403332:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.403335:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727ca5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.403337:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.403338:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.403342:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727ca5b lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.403346:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801207fb180/0x8a60d30f5727ca62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.403352:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099939180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+840:2006:x1805522257765120:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 61us (97us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.403353:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207fb180/0x8a60d30f5727ca62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.403355:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914702 00000100:00100000:0.0:1721880422.403357:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099938700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+840:2004:x1805522257764992:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 90us (153us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.403357:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.403360:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207fb180/0x8a60d30f5727ca62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.403364:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914700 00010000:00010000:3.0:1721880422.403365:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801207fb180/0x8a60d30f5727ca62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.403375:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801207fb180/0x8a60d30f5727ca62 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.403376:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009993b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+838:2004:x1805522257765248:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 95us (153us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.403380:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801207fb180 already unused, calling callback (ffffffffa084e330) 00000100:00100000:2.0:1721880422.403383:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914701 00010000:00010000:3.0:1721880422.403383:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207fb180/0x8a60d30f5727ca62 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.403388:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207fb180/0x8a60d30f5727ca62 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.403392:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880134eb1c00/2, rc 0, transno 1053182 00010000:00010000:3.0:1721880422.403397:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801207fb180/0x8a60d30f5727ca62 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.403399:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880134eb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011807104:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.403402:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801207fb180/0x8a60d30f5727ca62 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.403404:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727ca5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.403412:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727ca5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.403419:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727ca5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.403426:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727ca5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.403427:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1721880422.403433:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727ca5b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.403434:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099aad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011809280:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.403439:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136351200 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.403442:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727ca5b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.403449:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.403450:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727ca5b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.403460:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727ca5b lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.403467:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727ca5b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.403468:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011809280 00000100:00100000:0.0:1721880422.403472:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011809280 00000100:00100000:0.0:1721880422.403490:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632514 00000100:00100000:0.0:1721880422.403495:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135302d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2419:3687:x1805522011809280:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.403503:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2419:3686:x1805522011808000:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1054us (1106us total) trans 4296020479 rc 0/0 00002000:00080000:0.0:1721880422.403506:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64795 count 1 00000100:00100000:3.0:1721880422.403510:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632509 00010000:00010000:0.0:1721880422.403516:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727ca85 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.403527:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c2fd8c0/0x8a60d30f571e99d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128a42 expref: 837 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.403528:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801207f8000/0x8a60d30f5727ca54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.403534:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.403535:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.403535:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207f8000/0x8a60d30f5727ca54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.403537:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727ca85 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.403540:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f8000/0x8a60d30f5727ca54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.403544:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f8000/0x8a60d30f5727ca54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.403548:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801207f8000/0x8a60d30f5727ca54 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.403551:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801207f8000 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.403553:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c2fd8c0/0x8a60d30f571e99d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128a42 expref: 837 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.403553:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f8000/0x8a60d30f5727ca54 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.403557:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f8000/0x8a60d30f5727ca54 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.403561:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c2fd8c0/0x8a60d30f571e99d6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128a42 expref: 837 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.403563:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801207f8000/0x8a60d30f5727ca54 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.403566:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801207f8000/0x8a60d30f5727ca54 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.403571:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009528a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011809408:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.403587:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880096c9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2419:3688:x1805522011807872:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1142us (1201us total) trans 4296020480 rc 0/0 00000100:00100000:2.0:1721880422.403594:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632508 00000004:00080000:2.0:1721880422.403617:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099aac700/2, rc 0, transno 1053184 00000100:00100000:2.0:1721880422.403633:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099aac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011807872:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.403645:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e840 going to sleep for 11 seconds 00000004:00080000:2.0:1721880422.403654:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099aad500/2, rc 0, transno 1053183 00000100:00100000:2.0:1721880422.403658:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099aad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011808000:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.403665:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099aad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2419:3686:x1805522011807488:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1936us (1975us total) trans 4296020481 rc 0/0 00000004:00080000:2.0:1721880422.403669:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099aaed80/2, rc 0, transno 1053185 00000100:00100000:3.0:1721880422.403670:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632507 00000100:00100000:2.0:1721880422.403673:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099aaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011807488:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.403677:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1721880422.403684:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800981e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011809536:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.403705:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.403746:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800981e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011809664:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.403764:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.403789:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011809536 00000100:00100000:1.0:1721880422.403793:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011809536 00000100:00100000:3.0:1721880422.403798:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011809664 00000100:00100000:3.0:1721880422.403802:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011809664 00000100:00100000:2.0:1721880422.403807:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1721880422.403814:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800981e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011809792:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.403815:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632515 00000100:00100000:1.0:1721880422.403819:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2420:3686:x1805522011809536:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.403820:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632516 00000100:00100000:3.0:1721880422.403825:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009993b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2420:3688:x1805522011809664:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.403831:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64796 count 1 00000100:00100000:2.0:1721880422.403832:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1721880422.403836:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64797 count 1 00010000:00010000:1.0:1721880422.403841:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727ca8c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.403846:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f8480/0x8a60d30f5727ca93 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.403851:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011809792 00010000:00010000:1.0:1721880422.403853:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c335b00/0x8a60d30f571e9a7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128a8f expref: 837 pid: 16128 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.403854:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011809792 00010000:00010000:3.0:1721880422.403856:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c337600/0x8a60d30f571e9b1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128aea expref: 837 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.403858:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.403860:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.403861:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.403862:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727ca8c lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.403862:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.403865:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f8480/0x8a60d30f5727ca93 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.403872:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632517 00000100:00100000:2.0:1721880422.403876:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009993b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2421:3688:x1805522011809792:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.403879:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c337600/0x8a60d30f571e9b1f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128aea expref: 837 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.403880:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c335b00/0x8a60d30f571e9a7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128a8f expref: 837 pid: 16128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.403886:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c337600/0x8a60d30f571e9b1f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128aea expref: 837 pid: 16111 timeout: 887 lvb_type: 0 00002000:00080000:2.0:1721880422.403887:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64798 count 1 00010000:00010000:1.0:1721880422.403888:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c335b00/0x8a60d30f571e9a7e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128a8f expref: 837 pid: 16128 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.403895:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011810048:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.403897:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135301c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011809920:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.403897:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727ca9a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.403907:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800976e4d80/0x8a60d30f571e9bb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128b37 expref: 837 pid: 16128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.403913:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.403914:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.403917:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727ca9a lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.403921:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec840 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.403922:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb240 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.403932:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800976e4d80/0x8a60d30f571e9bb9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128b37 expref: 837 pid: 16128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.403940:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800976e4d80/0x8a60d30f571e9bb9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128b37 expref: 837 pid: 16128 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.403946:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135300000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011808896:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.403950:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009993aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011810176:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.403956:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727ca70 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.403966:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099938a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011808384:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.403971:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfded80 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.403982:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727ca69 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.404090:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.404107:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257765504 00000100:00100000:2.0:1721880422.404110:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257765504 00000100:00100000:3.0:1721880422.404114:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.404122:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880123a686c0/0x8a60d30f571e97de lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128946 expref: 838 pid: 16087 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.404131:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257765376 00000100:00100000:2.0:1721880422.404134:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914703 00000100:00100000:0.0:1721880422.404135:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257765376 00000100:00100000:2.0:1721880422.404138:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+838:2004:x1805522257765504:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.404141:0:9458:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800929ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011809024:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.404143:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.404146:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880123a686c0/0x8a60d30f571e97de lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128946 expref: 839 pid: 16087 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.404149:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880123a69200/0x8a60d30f571e957d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128812 expref: 839 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.404150:0:9458:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801207f8fc0/0x8a60d30f5727ca77 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.404152:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880123a686c0/0x8a60d30f571e97de lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128946 expref: 839 pid: 16087 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.404160:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123a686c0/0x8a60d30f571e97de lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128946 expref: 839 pid: 16087 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.404170:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.404171:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.404174:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727ca70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.404177:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.404178:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914704 00010000:00010000:2.0:1721880422.404181:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727ca70 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.404184:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+838:2004:x1805522257765376:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.404193:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.404194:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.404198:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880123a69200/0x8a60d30f571e957d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128812 expref: 838 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.404199:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.404207:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880123a69200/0x8a60d30f571e957d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128812 expref: 838 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.404214:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257765632 00000100:00100000:0.0:1721880422.404218:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257765632 00010000:00010000:1.0:1721880422.404219:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123a69200/0x8a60d30f571e957d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128812 expref: 838 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.404223:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+839:2004:x1805522257765504:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 83us (132us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.404229:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.404229:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914703 00010000:00010000:1.0:1721880422.404230:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.404231:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134d29b00/0x8a60d30f571e9894 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128993 expref: 838 pid: 16050 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.404232:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727ca69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.404239:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727ca69 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.404241:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257765760 00000100:00100000:2.0:1721880422.404245:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257765760 00000100:00100000:0.0:1721880422.404251:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914705 00010000:00010000:1.0:1721880422.404253:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.404253:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134d2bcc0/0x8a60d30f571e992e lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1289ee expref: 838 pid: 16128 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.404255:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+838:2005:x1805522257765632:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.404261:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.404264:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134d29b00/0x8a60d30f571e9894 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128993 expref: 838 pid: 16050 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.404266:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727ca69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.404271:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134d29b00/0x8a60d30f571e9894 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128993 expref: 838 pid: 16050 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.404271:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+838:2004:x1805522257765376:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 86us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.404275:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914706 00010000:00010000:3.0:1721880422.404275:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727ca69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.404280:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134d29b00/0x8a60d30f571e9894 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128993 expref: 838 pid: 16050 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.404280:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914704 00000100:00100000:2.0:1721880422.404280:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a70ed850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+838:2004:x1805522257765760:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.404282:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727ca69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.404286:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.404288:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727ca69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.404289:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.404290:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.404290:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134d2bcc0/0x8a60d30f571e992e lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1289ee expref: 836 pid: 16128 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.404292:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801207f8fc0/0x8a60d30f5727ca77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.404294:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727ca69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.404296:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f8fc0/0x8a60d30f5727ca77 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.404300:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134d2bcc0/0x8a60d30f571e992e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1289ee expref: 836 pid: 16128 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.404300:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350fc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.404303:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727ca69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.404309:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727ca69 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.404310:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.404311:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.404312:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.404315:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727ca7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.404321:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727ca7e lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.404322:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727ca69 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.404328:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+836:2005:x1805522257765632:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 71us (149us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.404329:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727ca69 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.404332:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.404334:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914705 00000100:00100000:2.0:1721880422.404349:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a70ed850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+835:2004:x1805522257765760:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 68us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.404355:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914706 00010000:00010000:3.0:1721880422.404356:0:9458:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801207f8fc0/0x8a60d30f5727ca77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.404363:0:9458:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207f8fc0/0x8a60d30f5727ca77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.404364:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134d2bcc0/0x8a60d30f571e992e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1289ee expref: 834 pid: 16128 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.404367:0:9458:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f8fc0/0x8a60d30f5727ca77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.404370:0:9458:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f8fc0/0x8a60d30f5727ca77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.404374:0:9458:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801207f8fc0/0x8a60d30f5727ca77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.404376:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099aace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011809152:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.404378:0:9458:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801207f8fc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.404379:0:9458:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f8fc0/0x8a60d30f5727ca77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.404383:0:9458:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f8fc0/0x8a60d30f5727ca77 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.404388:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727ca7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.404389:0:9458:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801207f8fc0/0x8a60d30f5727ca77 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.404393:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801207f8fc0/0x8a60d30f5727ca77 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.404395:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727ca7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.404402:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727ca7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.404410:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727ca7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.404417:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727ca7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.404419:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.404425:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727ca7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.404433:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257765888 00010000:00010000:0.0:1721880422.404436:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325e1c0 already unused, calling callback (ffffffffa084e330) 00000100:00100000:2.0:1721880422.404436:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257765888 00010000:00010000:0.0:1721880422.404440:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727ca7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.404446:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727ca7e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.404447:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c2fd8c0/0x8a60d30f571e99d6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128a42 expref: 834 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.404463:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914707 00000100:00100000:2.0:1721880422.404467:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099939180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+834:2005:x1805522257765888:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.404473:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.404477:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c2fd8c0/0x8a60d30f571e99d6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128a42 expref: 834 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.404486:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c2fd8c0/0x8a60d30f571e99d6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128a42 expref: 834 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.404492:0:9458:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2422:3688:x1805522011808640:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1446us (1514us total) trans 4296020482 rc 0/0 00000100:00100000:3.0:1721880422.404496:0:9458:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632512 00010000:00010000:2.0:1721880422.404497:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.404499:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.404501:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727ca85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.404508:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727ca85 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.404520:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.404536:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099939180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+834:2005:x1805522257765888:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 67us (117us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.404542:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727ca7e lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.404542:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914707 00010000:00010000:0.0:1721880422.404547:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727ca7e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.404570:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099aaca80/2, rc 0, transno 1053186 00000100:00100000:3.0:1721880422.404571:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099aadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2422:3689:x1805522011807744:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1800us (1914us total) trans 4296020483 rc 0/0 00000100:00100000:3.0:1721880422.404575:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632510 00000100:00100000:2.0:1721880422.404587:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099aaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011808640:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1721880422.404608:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099aaf800/2, rc 0, transno 1053187 00000100:00100000:1.0:1721880422.404622:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099aaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011807744:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.404632:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1721880422.404638:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800981e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011810304:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.404656:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.404670:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800929cf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011810048:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.404673:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800981e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011810432:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.404682:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801207f8480/0x8a60d30f5727ca93 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.404684:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.404693:0:9458:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011810304 00000100:00100000:1.0:1721880422.404695:0:9458:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011810304 00000100:00100000:3.0:1721880422.404696:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011810432 00000100:00100000:3.0:1721880422.404699:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011810432 00000100:00100000:2.0:1721880422.404704:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009993aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011810176:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.404707:0:9458:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632518 00000100:00100000:1.0:1721880422.404710:0:9458:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135300000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2424:3687:x1805522011810304:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.404717:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632519 00002000:00080000:1.0:1721880422.404719:0:9458:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64799 count 1 00000100:00100000:3.0:1721880422.404721:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135303480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2424:3687:x1805522011810432:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.404722:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727ca9a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.404742:0:9458:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727caa1 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.404750:0:9458:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c2b2d00/0x8a60d30f571e9c30 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128b7d expref: 833 pid: 16053 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.404754:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.404755:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.404757:0:9458:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727caa1 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.404757:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727ca70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.404765:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727ca70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.404768:0:9458:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c2b2d00/0x8a60d30f571e9c30 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128b7d expref: 833 pid: 16053 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.404772:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727ca70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.404773:0:9458:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c2b2d00/0x8a60d30f571e9c30 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128b7d expref: 833 pid: 16053 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.404777:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.404779:0:9458:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135303800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011810560:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.404779:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727ca70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.404786:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727ca70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.404794:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b5440 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.404797:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727ca70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.404799:0:9458:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302ebc00 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.404804:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099aaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2424:3689:x1805522011808768:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1750us (1807us total) trans 4296020484 rc 0/0 00010000:00010000:2.0:1721880422.404804:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727ca70 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.404811:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632513 00010000:00010000:2.0:1721880422.404814:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727ca70 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.404816:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135301c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011809920:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.404822:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727ca70 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.404824:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727ca8c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.404840:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099aac000/2, rc 0, transno 1053188 00000100:00100000:3.0:1721880422.404846:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.404848:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099aac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011808768:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.404856:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257766144 00000100:00100000:3.0:1721880422.404858:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257766272 00000100:00100000:2.0:1721880422.404860:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257766144 00000100:00100000:3.0:1721880422.404861:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257766272 00010000:00010000:2.0:1721880422.404872:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c335b00/0x8a60d30f571e9a7e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128a8f expref: 835 pid: 16128 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.404873:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800976e4d80/0x8a60d30f571e9bb9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128b37 expref: 835 pid: 16128 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.404876:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135301c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011810688:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.404888:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914708 00000100:00100000:3.0:1721880422.404891:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+835:2005:x1805522257766272:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.404896:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.404898:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800976e4d80/0x8a60d30f571e9bb9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128b37 expref: 835 pid: 16128 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.404903:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914709 00010000:00010000:3.0:1721880422.404904:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800976e4d80/0x8a60d30f571e9bb9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128b37 expref: 835 pid: 16128 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.404909:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+835:2005:x1805522257766144:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.404912:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800976e4d80/0x8a60d30f571e9bb9 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128b37 expref: 835 pid: 16128 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.404913:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.404917:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.404921:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c335b00/0x8a60d30f571e9a7e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128a8f expref: 834 pid: 16128 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.404921:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.404922:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.404924:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727ca9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.404928:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727ca9a lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.404930:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011810688 00010000:00010000:2.0:1721880422.404930:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c335b00/0x8a60d30f571e9a7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128a8f expref: 834 pid: 16128 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.404932:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011810688 00010000:00010000:3.0:1721880422.404938:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.404942:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c335b00/0x8a60d30f571e9a7e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128a8f expref: 834 pid: 16128 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.404943:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632520 00000100:00100000:1.0:1721880422.404945:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135301f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2424:3688:x1805522011810688:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.404952:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64801 count 1 00010000:00010000:2.0:1721880422.404952:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.404952:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+833:2005:x1805522257766272:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 60us (108us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.404953:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.404956:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727ca8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.404956:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914708 00010000:00010000:1.0:1721880422.404959:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727caa8 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.404963:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727ca8c lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.404967:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.404967:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c2fdd40/0x8a60d30f571e9d79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128c17 expref: 832 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.404971:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.404972:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.404973:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727caa8 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.404978:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.404983:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c2fdd40/0x8a60d30f571e9d79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128c17 expref: 832 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.404988:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c2fdd40/0x8a60d30f571e9d79 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128c17 expref: 832 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.404995:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257766016 00000100:00100000:2.0:1721880422.404996:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+832:2005:x1805522257766144:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 86us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.404998:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f41ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011810816:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.404999:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257766016 00000100:00100000:2.0:1721880422.405002:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914709 00010000:00010000:0.0:1721880422.405025:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c337600/0x8a60d30f571e9b1f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128aea expref: 832 pid: 16111 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.405028:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb240 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.405037:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727ca9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.405040:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727ca8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.405044:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727ca8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.405047:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727ca9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.405049:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727ca8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.405051:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914710 00010000:00010000:1.0:1721880422.405052:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727ca8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.405054:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727ca9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.405056:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+832:2004:x1805522257766016:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.405056:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727ca8c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.405056:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64800 count 1 00010000:00010000:1.0:1721880422.405059:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b46c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.405061:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727ca8c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.405061:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727ca9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.405064:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.405064:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f9b00/0x8a60d30f5727caaf lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.405065:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727ca8c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.405068:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c337600/0x8a60d30f571e9b1f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128aea expref: 832 pid: 16111 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.405068:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727ca9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.405071:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727ca8c lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.405072:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801352fe640/0x8a60d30f571e9cd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128bca expref: 832 pid: 16053 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.405074:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352ac0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.405075:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727ca8c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.405076:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727ca9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.405076:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.405077:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.405078:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c337600/0x8a60d30f571e9b1f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128aea expref: 832 pid: 16111 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.405078:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f9b00/0x8a60d30f5727caaf lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.405084:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727ca9a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.405089:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c337600/0x8a60d30f571e9b1f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128aea expref: 832 pid: 16111 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.405090:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801352fe640/0x8a60d30f571e9cd1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128bca expref: 832 pid: 16053 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.405095:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801352fe640/0x8a60d30f571e9cd1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128bca expref: 832 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.405099:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727ca9a lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.405100:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.405101:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800929ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011810944:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.405102:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.405105:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801207f8480/0x8a60d30f5727ca93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.405106:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727ca9a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.405112:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f8480/0x8a60d30f5727ca93 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.405115:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec840 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.405127:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.405145:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+831:2004:x1805522257766016:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 88us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.405152:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914710 00010000:00010000:3.0:1721880422.405163:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801207f8480/0x8a60d30f5727ca93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.405168:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2426:3686:x1805522011809536:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1348us (1462us total) trans 4296020485 rc 0/0 00010000:00010000:3.0:1721880422.405168:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207f8480/0x8a60d30f5727ca93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.405172:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632515 00010000:00010000:3.0:1721880422.405172:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f8480/0x8a60d30f5727ca93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.405179:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f8480/0x8a60d30f5727ca93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.405183:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801207f8480/0x8a60d30f5727ca93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.405186:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801207f8480 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.405188:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f8480/0x8a60d30f5727ca93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.405191:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f8480/0x8a60d30f5727ca93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.405192:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800981e3800/2, rc 0, transno 1053189 00000100:00100000:1.0:1721880422.405195:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800981e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011809536:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.405197:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801207f8480/0x8a60d30f5727ca93 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.405201:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801207f8480/0x8a60d30f5727ca93 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.405212:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1721880422.405216:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076e08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011811072:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.405230:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.405232:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009993b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2425:3688:x1805522011809792:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1354us (1398us total) trans 4296020486 rc 0/0 00000100:00100000:2.0:1721880422.405239:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632517 00000004:00080000:1.0:1721880422.405244:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800981e1880/2, rc 0, transno 1053190 00000100:00100000:1.0:1721880422.405250:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800981e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011809792:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.405251:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011811072 00000100:00100000:2.0:1721880422.405254:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011811072 00000100:00100000:2.0:1721880422.405269:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632521 00000100:00100000:2.0:1721880422.405273:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076e08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2426:3688:x1805522011811072:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.405275:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1721880422.405281:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880096e58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011811200:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.405281:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009993b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2426:3688:x1805522011809664:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1456us (1516us total) trans 4296020487 rc 0/0 00002000:00080000:2.0:1721880422.405285:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64802 count 1 00000100:00100000:3.0:1721880422.405285:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632516 00010000:00010000:2.0:1721880422.405295:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727cab6 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.405301:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.405305:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c4d98c0/0x8a60d30f571e9e4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128c72 expref: 830 pid: 16087 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.405305:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800981e0700/2, rc 0, transno 1053191 00010000:00010000:2.0:1721880422.405311:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.405312:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.405314:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727cab6 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.405317:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800981e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011809664:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.405326:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011811200 00000100:00100000:3.0:1721880422.405328:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011811200 00010000:00010000:2.0:1721880422.405330:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c4d98c0/0x8a60d30f571e9e4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128c72 expref: 830 pid: 16087 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.405338:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632522 00000100:00100000:3.0:1721880422.405340:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2426:3687:x1805522011811200:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.405343:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c2fd8c0/0x8a60d30f571e99d6 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128a42 expref: 830 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.405344:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c4d98c0/0x8a60d30f571e9e4b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128c72 expref: 830 pid: 16087 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.405349:0:9458:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135303800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011810560:192.168.201.24@tcp:104: 00002000:00080000:3.0:1721880422.405349:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64803 count 1 00000100:00100000:0.0:1721880422.405355:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009528a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011809408:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.405355:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009993aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011811328:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.405356:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207fbcc0/0x8a60d30f5727cabd lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.405361:0:9458:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727caa1 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.405363:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095ee8fc0/0x8a60d30f571e9ef3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128cbf expref: 829 pid: 16112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.405366:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.405367:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.405368:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727ca85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.405369:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207fbcc0/0x8a60d30f5727cabd lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.405375:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880096e5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011811456:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.405377:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfded80 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.405379:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095ee8fc0/0x8a60d30f571e9ef3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128cbf expref: 829 pid: 16112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.405384:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095ee8fc0/0x8a60d30f571e9ef3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128cbf expref: 829 pid: 16112 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.405390:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.405390:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011811584:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.405404:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.405412:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011811456 00000100:00100000:1.0:1721880422.405414:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011811456 00000100:00100000:1.0:1721880422.405425:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632523 00000100:00100000:1.0:1721880422.405428:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2428:3687:x1805522011811456:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.405435:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64804 count 1 00010000:00010000:0.0:1721880422.405437:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727ca85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.405438:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.405442:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727cac4 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd24:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.405443:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727ca85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.405449:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962b58c0/0x8a60d30f571e9f5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128d0c expref: 829 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.405450:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727ca85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.405452:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.405453:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.405455:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727cac4 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.405456:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727ca85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.405464:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800962b58c0/0x8a60d30f571e9f5c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128d0c expref: 829 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.405470:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800962b58c0/0x8a60d30f571e9f5c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128d0c expref: 829 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.405475:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135303800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011811712:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.405490:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302ebc00 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.405499:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2428:3686:x1805522011808512:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2513us (2559us total) trans 4296020488 rc 0/0 00010000:00010000:0.0:1721880422.405505:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727ca85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.405506:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099aafb80/2, rc 0, transno 1053192 00000100:00100000:2.0:1721880422.405506:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632511 00000100:00100000:1.0:1721880422.405510:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011808512:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.405512:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325f840 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.405515:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727ca85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.405544:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.405552:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e89b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011811840:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.405560:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f41ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011810816:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.405561:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257766400 00000100:00100000:1.0:1721880422.405565:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.405565:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257766400 00010000:00010000:3.0:1721880422.405572:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727caa8 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.405575:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727ca85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.405577:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c2b2d00/0x8a60d30f571e9c30 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128b7d expref: 830 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.405586:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727ca85 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.405592:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727ca85 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.405597:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.405598:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257766528 00000100:00100000:2.0:1721880422.405601:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257766528 00000100:00100000:1.0:1721880422.405608:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257766656 00000100:00100000:1.0:1721880422.405610:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257766656 00010000:00010000:2.0:1721880422.405611:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c2fdd40/0x8a60d30f571e9d79 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128c17 expref: 831 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.405611:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800929ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011810944:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.405617:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801207f9b00/0x8a60d30f5727caaf lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.405619:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801352fe640/0x8a60d30f571e9cd1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128bca expref: 832 pid: 16053 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.405630:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914711 00000100:00100000:1.0:1721880422.405635:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914712 00000100:00100000:2.0:1721880422.405635:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+832:2004:x1805522257766400:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.405638:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800878d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+832:2004:x1805522257766528:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.405642:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.405643:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.405646:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c2fdd40/0x8a60d30f571e9d79 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128c17 expref: 832 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.405646:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c2b2d00/0x8a60d30f571e9c30 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128b7d expref: 832 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.405652:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c2fdd40/0x8a60d30f571e9d79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128c17 expref: 832 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.405656:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c2b2d00/0x8a60d30f571e9c30 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128b7d expref: 832 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.405661:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c2fdd40/0x8a60d30f571e9d79 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128c17 expref: 832 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.405667:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.405668:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.405668:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c2b2d00/0x8a60d30f571e9c30 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128b7d expref: 831 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.405670:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727caa8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.405675:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727caa8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.405679:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.405681:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.405683:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.405684:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727caa1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.405689:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727caa8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.405690:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727caa1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.405693:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727caa8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.405697:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800878d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+830:2004:x1805522257766528:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 59us (154us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.405698:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727caa8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.405701:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914712 00010000:00010000:3.0:1721880422.405701:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727caa8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.405702:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135302d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2428:3687:x1805522011809280:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2206us (2251us total) trans 4296020489 rc 0/0 00010000:00010000:3.0:1721880422.405705:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727caa8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.405706:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.405707:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632514 00010000:00010000:3.0:1721880422.405708:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b6f40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.405710:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727caa8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.405712:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914713 00010000:00010000:3.0:1721880422.405713:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727caa8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.405714:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129d23050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+829:2005:x1805522257766656:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.405717:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011811840 00010000:00010000:1.0:1721880422.405718:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1721880422.405720:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011811840 00010000:00010000:3.0:1721880422.405720:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727caa8 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.405721:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801352fe640/0x8a60d30f571e9cd1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128bca expref: 829 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.405724:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727caa8 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.405743:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+829:2004:x1805522257766400:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 90us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.405744:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632524 00000100:00100000:0.0:1721880422.405747:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2428:3688:x1805522011811840:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.405748:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801352fe640/0x8a60d30f571e9cd1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128bca expref: 829 pid: 16053 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.405750:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914711 00002000:00080000:0.0:1721880422.405756:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64805 count 1 00010000:00010000:1.0:1721880422.405756:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801352fe640/0x8a60d30f571e9cd1 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128bca expref: 829 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.405763:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.405763:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.405764:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727cacb lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd25:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.405765:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801207f9b00/0x8a60d30f5727caaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.405769:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f9b00/0x8a60d30f5727caaf lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.405772:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092963840/0x8a60d30f571ea02e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128d6e expref: 827 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.405776:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.405777:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.405777:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.405779:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727cacb lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.405788:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880129d23050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+827:2005:x1805522257766656:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 73us (191us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.405790:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092963840/0x8a60d30f571ea02e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128d6e expref: 827 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.405792:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914713 00010000:00010000:0.0:1721880422.405796:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092963840/0x8a60d30f571ea02e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128d6e expref: 827 pid: 16111 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.405803:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012fd0ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011811968:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.405820:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e840 going to sleep for 11 seconds 00000004:00080000:1.0:1721880422.405828:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099aad880/2, rc 0, transno 1053193 00000100:00100000:1.0:1721880422.405832:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099aad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011809280:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.405832:0:9458:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727caa1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.405840:0:9458:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727caa1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.405848:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1721880422.405848:0:9458:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727caa1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.405852:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e898380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011812096:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.405855:0:9458:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727caa1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.405865:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.405867:0:9458:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727caa1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.405874:0:9458:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b6d00 already unused, calling callback (ffffffffa084e330) 00000100:00100000:1.0:1721880422.405877:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011812096 00010000:00010000:2.0:1721880422.405877:0:9458:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727caa1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.405879:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011812096 00010000:00010000:2.0:1721880422.405884:0:9458:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727caa1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.405891:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632525 00000100:00100000:1.0:1721880422.405894:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e898000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2430:3688:x1805522011812096:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.405894:0:9458:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727caa1 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.405900:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727caa1 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.405902:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64806 count 1 00010000:00010000:1.0:1721880422.405909:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727cad2 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd26:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.405916:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c2c3840/0x8a60d30f571ea0cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128dc9 expref: 826 pid: 16128 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.405920:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.405921:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1721880422.405921:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135301f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2430:3688:x1805522011810688:12345-0@lo:6:osp-syn-1-0.0 Request processed in 974us (1006us total) trans 4296020490 rc 0/0 00010000:00010000:1.0:1721880422.405922:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727cad2 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.405925:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632520 00010000:00010000:1.0:1721880422.405936:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c2c3840/0x8a60d30f571ea0cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128dc9 expref: 826 pid: 16128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.405939:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801207f9b00/0x8a60d30f5727caaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.405941:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880135301c00/2, rc 0, transno 1053194 00010000:00010000:3.0:1721880422.405944:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207f9b00/0x8a60d30f5727caaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.405945:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c2c3840/0x8a60d30f571ea0cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128dc9 expref: 826 pid: 16128 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.405948:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f9b00/0x8a60d30f5727caaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.405950:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135301c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011810688:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.405952:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f9b00/0x8a60d30f5727caaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.405954:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e898a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011812224:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.405955:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801207f9b00/0x8a60d30f5727caaf lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.405958:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801207f9b00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.405960:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f9b00/0x8a60d30f5727caaf lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.405964:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f9b00/0x8a60d30f5727caaf lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.405971:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801207f9b00/0x8a60d30f5727caaf lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.405974:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801207f9b00/0x8a60d30f5727caaf lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.405979:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb300 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.406042:0:9458:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135300000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2431:3687:x1805522011810304:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1328us (1383us total) trans 4296020491 rc 0/0 00000100:00100000:2.0:1721880422.406050:0:9458:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632518 00000004:00080000:1.0:1721880422.406054:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800981e2300/2, rc 0, transno 1053195 00000100:00100000:1.0:1721880422.406059:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800981e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011810304:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.406066:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135303480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2430:3687:x1805522011810432:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1344us (1380us total) trans 4296020492 rc 0/0 00000004:00080000:1.0:1721880422.406069:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800981e3480/2, rc 0, transno 1053196 00000100:00100000:3.0:1721880422.406071:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632519 00000100:00100000:1.0:1721880422.406072:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800981e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011810432:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.406077:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1721880422.406084:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880123912300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011812352:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.406104:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880123913100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011812608:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.406105:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.406120:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009993aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011811328:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.406122:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880123911500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011812480:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.406134:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727cab6 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.406204:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.406227:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.406228:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.406229:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800929cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011811584:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.406244:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801207fbcc0/0x8a60d30f5727cabd lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.406246:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.406260:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257766912 00000100:00100000:1.0:1721880422.406261:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135303800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011811712:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.406263:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257766912 00000100:00100000:0.0:1721880422.406264:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257766784 00000100:00100000:0.0:1721880422.406268:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257766784 00010000:00010000:1.0:1721880422.406273:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727cac4 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.406274:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095ee8fc0/0x8a60d30f571e9ef3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128cbf expref: 828 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.406281:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c4d98c0/0x8a60d30f571e9e4b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128c72 expref: 828 pid: 16087 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.406289:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.406290:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914714 00000100:00100000:2.0:1721880422.406295:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800878d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+828:2005:x1805522257766912:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.406300:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011812352 00010000:00010000:2.0:1721880422.406302:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.406302:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011812352 00000100:00100000:1.0:1721880422.406305:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257767040 00010000:00010000:2.0:1721880422.406306:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095ee8fc0/0x8a60d30f571e9ef3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128cbf expref: 828 pid: 16112 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.406308:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257767040 00010000:00010000:2.0:1721880422.406315:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095ee8fc0/0x8a60d30f571e9ef3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128cbf expref: 829 pid: 16112 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.406316:0:9458:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011812608 00000100:00100000:3.0:1721880422.406317:0:9458:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011812608 00010000:00010000:1.0:1721880422.406319:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800962b58c0/0x8a60d30f571e9f5c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128d0c expref: 829 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.406322:0:9458:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011812480 00000100:00100000:3.0:1721880422.406324:0:9458:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011812480 00010000:00010000:2.0:1721880422.406327:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095ee8fc0/0x8a60d30f571e9ef3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128cbf expref: 829 pid: 16112 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.406331:0:9458:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632526 00000100:00100000:3.0:1721880422.406334:0:9458:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e89a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2432:3687:x1805522011812352:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.406337:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.406339:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.406341:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801207fbcc0/0x8a60d30f5727cabd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.406342:0:9458:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64807 count 1 00010000:00010000:2.0:1721880422.406348:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207fbcc0/0x8a60d30f5727cabd lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.406350:0:9458:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207fad00/0x8a60d30f5727cad9 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd27:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.406358:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.406360:0:9458:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095ee9b00/0x8a60d30f571ea1c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128e32 expref: 828 pid: 15497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.406364:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.406365:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.406367:0:9458:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207fad00/0x8a60d30f5727cad9 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.406377:0:9458:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095ee9b00/0x8a60d30f571ea1c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128e32 expref: 828 pid: 15497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.406379:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800878d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+828:2005:x1805522257766912:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 83us (152us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.406382:0:9458:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095ee9b00/0x8a60d30f571ea1c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128e32 expref: 828 pid: 15497 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.406388:0:9458:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011812736:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.406398:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914715 00000100:00100000:3.0:1721880422.406403:0:9458:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec840 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.406406:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800878d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+828:2004:x1805522257766784:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.406407:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914714 00000100:00100000:3.0:1721880422.406413:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632527 00000100:00100000:1.0:1721880422.406416:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914716 00000100:00100000:3.0:1721880422.406416:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123910700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2432:3688:x1805522011812608:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.406421:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800878d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+827:2004:x1805522257767040:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.406422:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00080000:3.0:1721880422.406422:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64809 count 1 00010000:00010000:0.0:1721880422.406427:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c4d98c0/0x8a60d30f571e9e4b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128c72 expref: 827 pid: 16087 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.406429:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.406429:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207fa640/0x8a60d30f5727cae0 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd29:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.406432:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632528 00010000:00010000:1.0:1721880422.406433:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800962b58c0/0x8a60d30f571e9f5c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128d0c expref: 827 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.406436:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c4d98c0/0x8a60d30f571e9e4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128c72 expref: 827 pid: 16087 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.406437:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2432:3687:x1805522011812480:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.406438:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135340b40/0x8a60d30f571ea35a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128ef6 expref: 827 pid: 16091 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.406441:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800962b58c0/0x8a60d30f571e9f5c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128d0c expref: 827 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.406444:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.406445:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.406447:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207fa640/0x8a60d30f5727cae0 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.406450:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64808 count 1 00010000:00010000:1.0:1721880422.406456:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962b58c0/0x8a60d30f571e9f5c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128d0c expref: 827 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.406460:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727cae7 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd28:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.406461:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135340b40/0x8a60d30f571ea35a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128ef6 expref: 827 pid: 16091 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.406465:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.406466:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.406469:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727cac4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.406469:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135340b40/0x8a60d30f571ea35a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128ef6 expref: 826 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.406470:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e944b40/0x8a60d30f571ea2a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128e94 expref: 826 pid: 16112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.406475:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727cac4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.406476:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.406477:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1721880422.406478:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011812864:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.406480:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727cae7 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.406488:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.406494:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e944b40/0x8a60d30f571ea2a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128e94 expref: 826 pid: 16112 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.406496:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec300 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.406501:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e944b40/0x8a60d30f571ea2a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128e94 expref: 826 pid: 16112 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.406505:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800878d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+826:2004:x1805522257767040:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 83us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.406510:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009993aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011812992:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.406512:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914716 00010000:00010000:0.0:1721880422.406513:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c4d98c0/0x8a60d30f571e9e4b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128c72 expref: 826 pid: 16087 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.406524:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.406525:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.406528:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727cab6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.406528:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfded80 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.406534:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727cac4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.406540:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727cab6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.406540:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727cac4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.406546:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727cac4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.406550:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801207fbcc0/0x8a60d30f5727cabd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.406552:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727cac4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.406556:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.406559:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.406562:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727cac4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.406562:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207fbcc0/0x8a60d30f5727cabd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.406567:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207fbcc0/0x8a60d30f5727cabd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.406570:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b73c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.406571:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801207fbcc0/0x8a60d30f5727cabd lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.406573:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727cac4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.406576:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801207fbcc0/0x8a60d30f5727cabd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.406579:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727cac4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.406579:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801207fbcc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.406581:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207fbcc0/0x8a60d30f5727cabd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.406585:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207fbcc0/0x8a60d30f5727cabd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.406588:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727cac4 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.406591:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801207fbcc0/0x8a60d30f5727cabd lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.406594:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727cac4 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.406595:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801207fbcc0/0x8a60d30f5727cabd lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.406615:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257767168 00000100:00100000:1.0:1721880422.406619:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257767168 00000100:00100000:0.0:1721880422.406625:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800878d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+825:2004:x1805522257766784:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 169us (327us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.406629:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092963840/0x8a60d30f571ea02e lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128d6e expref: 825 pid: 16111 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.406634:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914715 00000100:00100000:1.0:1721880422.406647:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914717 00000100:00100000:1.0:1721880422.406651:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+824:2005:x1805522257767168:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.406657:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.406661:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092963840/0x8a60d30f571ea02e lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128d6e expref: 824 pid: 16111 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.406663:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.406670:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092963840/0x8a60d30f571ea02e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128d6e expref: 824 pid: 16111 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.406680:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.406682:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.406684:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727cacb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.406688:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2433:3687:x1805522011811200:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1346us (1386us total) trans 4296020493 rc 0/0 00010000:00010000:1.0:1721880422.406691:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727cacb lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.406693:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632522 00000100:00100000:3.0:1721880422.406696:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257767296 00000100:00100000:3.0:1721880422.406699:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257767296 00010000:00010000:1.0:1721880422.406702:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.406703:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092963840/0x8a60d30f571ea02e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128d6e expref: 825 pid: 16111 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.406710:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c2c3840/0x8a60d30f571ea0cf lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128dc9 expref: 825 pid: 16128 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.406714:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012fd0ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011811968:192.168.201.24@tcp:104: 00000004:00080000:2.0:1721880422.406716:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880096e58380/2, rc 0, transno 1053197 00000100:00100000:1.0:1721880422.406721:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+824:2005:x1805522257767168:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 68us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.406744:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880096e58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011811200:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.406747:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914717 00000100:00100000:3.0:1721880422.406752:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914718 00010000:00010000:0.0:1721880422.406753:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727cacb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.406753:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727cab6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.406756:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+823:2004:x1805522257767296:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.406757:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727cab6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.406762:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727cab6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.406763:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.406765:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727cab6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.406767:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c2c3840/0x8a60d30f571ea0cf lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128dc9 expref: 823 pid: 16128 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.406769:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727cab6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.406772:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801363521c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.406774:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727cab6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.406774:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c2c3840/0x8a60d30f571ea0cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128dc9 expref: 823 pid: 16128 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.406776:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e898a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011812224:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.406777:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727cab6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.406783:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727cab6 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.406788:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727cab6 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.406790:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1721880422.406790:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727cad2 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd26:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.406790:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c2c3840/0x8a60d30f571ea0cf lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd26:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128dc9 expref: 823 pid: 16128 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.406797:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012fd0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011813120:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.406801:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.406803:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.406806:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727cad2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.406812:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727cad2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.406819:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.406826:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.406841:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+822:2004:x1805522257767296:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 84us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.406847:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914718 00000100:00100000:3.0:1721880422.406864:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011813120 00000100:00100000:3.0:1721880422.406866:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011813120 00000100:00100000:2.0:1721880422.406869:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880076e08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2435:3688:x1805522011811072:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1595us (1638us total) trans 4296020494 rc 0/0 00000100:00100000:2.0:1721880422.406873:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632521 00000100:00100000:3.0:1721880422.406878:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632529 00000100:00100000:3.0:1721880422.406881:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2434:3688:x1805522011813120:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.406889:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64810 count 1 00010000:00010000:3.0:1721880422.406896:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207fb600/0x8a60d30f5727caee lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd2a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.406903:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f57f180/0x8a60d30f571ea3f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128f3c expref: 821 pid: 16037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.406910:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.406911:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.406912:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207fb600/0x8a60d30f5727caee lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.406916:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880076e08000/2, rc 0, transno 1053198 00000100:00100000:1.0:1721880422.406916:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2434:3687:x1805522011811456:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1485us (1523us total) trans 4296020495 rc 0/0 00000004:00080000:2.0:1721880422.406921:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880096e5b100/2, rc 0, transno 1053199 00010000:00010000:3.0:1721880422.406922:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f57f180/0x8a60d30f571ea3f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128f3c expref: 821 pid: 16037 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.406923:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076e08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011811072:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.406923:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632523 00000100:00100000:2.0:1721880422.406924:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880096e5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011811456:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.406927:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f57f180/0x8a60d30f571ea3f4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128f3c expref: 821 pid: 16037 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.406933:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011813248:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.406942:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727cad2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.406949:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec3c0 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.406950:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727cad2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.406952:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1721880422.406957:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727cad2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.406958:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011813504:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.406964:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727cacb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.406964:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727cad2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.406970:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727cad2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.406972:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727cacb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.406972:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.406976:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b7a80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.406979:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727cad2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.406980:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011813376:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.406985:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727cacb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.406985:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727cad2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.406989:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.406991:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727cacb lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.406994:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011813504 00010000:00010000:1.0:1721880422.406995:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727cad2 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.406996:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011813504 00010000:00010000:0.0:1721880422.406998:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727cacb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.407001:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727cad2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.407004:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325c000 already unused, calling callback (ffffffffa084e330) 00000100:00100000:2.0:1721880422.407005:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011813376 00010000:00010000:0.0:1721880422.407007:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727cacb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.407008:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011813376 00000100:00100000:3.0:1721880422.407023:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632530 00000100:00100000:3.0:1721880422.407028:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2435:3687:x1805522011813504:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.407031:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727cacb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.407037:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64812 count 1 00000100:00100000:2.0:1721880422.407038:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632531 00010000:00010000:0.0:1721880422.407042:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727cacb lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.407043:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009993b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2435:3687:x1805522011813376:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.407044:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f9f80/0x8a60d30f5727caf5 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd2c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.407048:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727cacb lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.407051:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ee68900/0x8a60d30f571ea58a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128ff9 expref: 821 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.407055:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00002000:00080000:2.0:1721880422.407056:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64811 count 1 00010000:00010000:3.0:1721880422.407056:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.407058:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f9f80/0x8a60d30f5727caf5 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.407066:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727cafc lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd2b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.407068:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ee68900/0x8a60d30f571ea58a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128ff9 expref: 821 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.407074:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ee68900/0x8a60d30f571ea58a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128ff9 expref: 821 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.407077:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c9bb3c0/0x8a60d30f571ea49c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128f90 expref: 821 pid: 16112 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.407079:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800929ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011813632:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.407084:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.407086:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.407088:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727cafc lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.407094:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03300 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.407105:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c9bb3c0/0x8a60d30f571ea49c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128f90 expref: 821 pid: 16112 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.407113:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c9bb3c0/0x8a60d30f571ea49c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128f90 expref: 821 pid: 16112 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.407122:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099939c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011813760:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.407146:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e898000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2437:3688:x1805522011812096:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1249us (1278us total) trans 4296020496 rc 0/0 00000100:00100000:2.0:1721880422.407150:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde600 going to sleep for 11 seconds 00000004:00080000:0.0:1721880422.407151:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e898380/2, rc 0, transno 1053200 00000100:00100000:1.0:1721880422.407153:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632525 00000100:00100000:0.0:1721880422.407159:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e898380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011812096:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.407184:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011813888:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.407203:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.407218:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011813888 00000100:00100000:1.0:1721880422.407223:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011813888 00000100:00100000:1.0:1721880422.407241:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632532 00000100:00100000:1.0:1721880422.407245:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088683480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2437:3688:x1805522011813888:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.407257:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64813 count 1 00010000:00010000:1.0:1721880422.407267:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727cb03 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd2d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.407278:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f146640/0x8a60d30f571ea639 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129054 expref: 821 pid: 16087 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.407283:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.407285:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.407287:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727cb03 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.407296:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2437:3688:x1805522011811840:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1546us (1728us total) trans 4296020497 rc 0/0 00000100:00100000:0.0:1721880422.407302:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632524 00010000:00010000:1.0:1721880422.407303:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f146640/0x8a60d30f571ea639 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129054 expref: 821 pid: 16087 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.407309:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e89b480/2, rc 0, transno 1053201 00010000:00010000:1.0:1721880422.407313:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f146640/0x8a60d30f571ea639 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129054 expref: 821 pid: 16087 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.407322:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e89b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011811840:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.407323:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e898a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011814016:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.407357:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb300 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.407402:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011814144:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.407441:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.407442:0:9458:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011812736:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.407453:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011812864:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.407458:0:9458:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801207fad00/0x8a60d30f5727cad9 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.407462:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801207fa640/0x8a60d30f5727cae0 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.407520:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011814144 00000100:00100000:0.0:1721880422.407524:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011814144 00000100:00100000:2.0:1721880422.407526:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.407536:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632533 00000100:00100000:0.0:1721880422.407539:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135303800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2437:3689:x1805522011814144:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.407540:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257767424 00000100:00100000:3.0:1721880422.407542:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257767424 00002000:00080000:0.0:1721880422.407549:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64814 count 1 00010000:00010000:3.0:1721880422.407552:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135340b40/0x8a60d30f571ea35a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128ef6 expref: 822 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.407558:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727cb0a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd2e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.407563:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914719 00010000:00010000:0.0:1721880422.407566:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880120207840/0x8a60d30f571ea6d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12909a expref: 822 pid: 16112 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.407566:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099939180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+822:2005:x1805522257767424:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.407571:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.407571:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.407572:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.407574:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727cb0a lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.407574:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135340b40/0x8a60d30f571ea35a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd29:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128ef6 expref: 822 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.407582:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135340b40/0x8a60d30f571ea35a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd29:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128ef6 expref: 822 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.407585:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880120207840/0x8a60d30f571ea6d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12909a expref: 822 pid: 16112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.407591:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880120207840/0x8a60d30f571ea6d3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12909a expref: 822 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.407591:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135340b40/0x8a60d30f571ea35a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd29:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128ef6 expref: 822 pid: 16091 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.407597:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.407598:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.407600:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801207fa640/0x8a60d30f5727cae0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.407604:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207fa640/0x8a60d30f5727cae0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.407606:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.407613:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.407624:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257767552 00000100:00100000:3.0:1721880422.407626:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099939180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+821:2005:x1805522257767424:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 60us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.407628:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257767552 00000100:00100000:3.0:1721880422.407630:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914719 00000100:00100000:2.0:1721880422.407633:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009993aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011812992:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.407640:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801207fa640/0x8a60d30f5727cae0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.407641:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095ee9b00/0x8a60d30f571ea1c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128e32 expref: 821 pid: 15497 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.407643:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088680000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011814272:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.407644:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207fa640/0x8a60d30f5727cae0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.407645:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727cae7 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.407648:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207fa640/0x8a60d30f5727cae0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.407656:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801207fa640/0x8a60d30f5727cae0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.407659:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801207fa640/0x8a60d30f5727cae0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.407660:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914720 00000100:00100000:0.0:1721880422.407662:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e840 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.407663:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801207fa640 already unused, calling callback (ffffffffa084e330) 00000100:00100000:1.0:1721880422.407664:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a70ee450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+821:2004:x1805522257767552:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.407664:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207fa640/0x8a60d30f5727cae0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.407668:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207fa640/0x8a60d30f5727cae0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.407671:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.407673:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801207fa640/0x8a60d30f5727cae0 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.407674:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095ee9b00/0x8a60d30f571ea1c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128e32 expref: 821 pid: 15497 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.407676:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801207fa640/0x8a60d30f5727cae0 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.407682:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095ee9b00/0x8a60d30f571ea1c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128e32 expref: 821 pid: 15497 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.407694:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095ee9b00/0x8a60d30f571ea1c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128e32 expref: 821 pid: 15497 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.407703:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.407705:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.407708:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801207fad00/0x8a60d30f5727cad9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.407715:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207fad00/0x8a60d30f5727cad9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.407756:0:9458:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801207fad00/0x8a60d30f5727cad9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.407769:0:9458:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207fad00/0x8a60d30f5727cad9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.407770:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.407777:0:9458:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207fad00/0x8a60d30f5727cad9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.407783:0:9458:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801207fad00/0x8a60d30f5727cad9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.407789:0:9458:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801207fad00/0x8a60d30f5727cad9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.407790:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a70ee450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+820:2004:x1805522257767552:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 124us (184us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.407795:0:9458:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801207fad00 already unused, calling callback (ffffffffa084e330) 00000100:00100000:1.0:1721880422.407796:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914720 00010000:00010000:2.0:1721880422.407798:0:9458:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207fad00/0x8a60d30f5727cad9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.407805:0:9458:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207fad00/0x8a60d30f5727cad9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.407815:0:9458:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801207fad00/0x8a60d30f5727cad9 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.407822:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801207fad00/0x8a60d30f5727cad9 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.407826:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.407840:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257767680 00000100:00100000:1.0:1721880422.407844:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257767680 00000100:00100000:3.0:1721880422.407848:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880123910700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2438:3688:x1805522011812608:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1430us (1644us total) trans 4296020498 rc 0/0 00000100:00100000:3.0:1721880422.407852:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632527 00010000:00010000:1.0:1721880422.407855:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e944b40/0x8a60d30f571ea2a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128e94 expref: 820 pid: 16112 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.407885:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914721 00000100:00100000:1.0:1721880422.407889:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088680380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+820:2004:x1805522257767680:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.407897:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.407900:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e944b40/0x8a60d30f571ea2a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128e94 expref: 820 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.407909:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e944b40/0x8a60d30f571ea2a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128e94 expref: 820 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.407920:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e944b40/0x8a60d30f571ea2a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128e94 expref: 820 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.407929:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.407931:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.407933:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727cae7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.407938:0:9458:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e89a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2438:3687:x1805522011812352:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1601us (1831us total) trans 4296020499 rc 0/0 00010000:00010000:1.0:1721880422.407939:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727cae7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.407945:0:9458:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632526 00010000:00010000:1.0:1721880422.407955:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.407963:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727cae7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.407968:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727cae7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.407973:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.407973:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727cae7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.407974:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880123913100/2, rc 0, transno 1053202 00010000:00010000:3.0:1721880422.407977:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727cae7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.407979:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088680380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+819:2004:x1805522257767680:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 88us (153us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.407980:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727cae7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.407983:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352640 already unused, calling callback (ffffffffa084e330) 00000100:00100000:1.0:1721880422.407985:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914721 00010000:00010000:3.0:1721880422.407985:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727cae7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.407989:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880123913100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011812608:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.407989:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727cae7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.407995:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727cae7 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.407998:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257767808 00010000:00010000:3.0:1721880422.407998:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727cae7 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.408000:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257767808 00000004:00080000:2.0:1721880422.408007:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880123912300/2, rc 0, transno 1053203 00010000:00010000:1.0:1721880422.408025:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f57f180/0x8a60d30f571ea3f4 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128f3c expref: 819 pid: 16037 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.408029:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011814400:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.408035:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880123912300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011812352:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.408052:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914722 00000100:00100000:1.0:1721880422.408058:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088683b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+819:2005:x1805522257767808:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.408064:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880087927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011814528:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.408065:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.408065:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.408069:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f57f180/0x8a60d30f571ea3f4 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd2a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128f3c expref: 819 pid: 16037 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.408078:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f57f180/0x8a60d30f571ea3f4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd2a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128f3c expref: 819 pid: 16037 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.408082:0:9458:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011814400 00000100:00100000:0.0:1721880422.408085:0:9458:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011814400 00000100:00100000:2.0:1721880422.408085:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.408089:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.408090:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.408093:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801207fb600/0x8a60d30f5727caee lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd2a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.408096:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2439:3687:x1805522011812480:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1658us (1867us total) trans 4296020500 rc 0/0 00000100:00100000:0.0:1721880422.408098:0:9458:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011814528 00000100:00100000:0.0:1721880422.408099:0:9458:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011814528 00010000:00010000:1.0:1721880422.408100:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207fb600/0x8a60d30f5727caee lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd2a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.408100:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632528 00000004:00080000:2.0:1721880422.408108:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880123911500/2, rc 0, transno 1053204 00010000:00010000:1.0:1721880422.408110:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.408112:0:9458:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632534 00000100:00100000:3.0:1721880422.408116:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632535 00000100:00100000:0.0:1721880422.408119:0:9458:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087925500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2439:3686:x1805522011814400:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.408120:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880123911500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011812480:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.408120:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009993aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2439:3687:x1805522011814528:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.408129:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088683b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+819:2005:x1805522257767808:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 70us (156us total) trans 0 rc 0/0 00002000:00080000:3.0:1721880422.408129:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64816 count 1 00000100:00100000:1.0:1721880422.408134:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914722 00010000:00010000:3.0:1721880422.408136:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f8d80/0x8a60d30f5727cb11 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd30:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.408143:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f146f40/0x8a60d30f571ea831 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129142 expref: 818 pid: 16111 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1721880422.408145:0:9458:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64815 count 1 00010000:00010000:3.0:1721880422.408147:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.408148:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.408149:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f8d80/0x8a60d30f5727cb11 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.408154:0:9458:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727cb18 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd2f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.408159:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f146f40/0x8a60d30f571ea831 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129142 expref: 818 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.408162:0:9458:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801203e4fc0/0x8a60d30f571ea774 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1290ee expref: 818 pid: 16053 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.408163:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.408165:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f146f40/0x8a60d30f571ea831 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129142 expref: 818 pid: 16111 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.408166:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.408167:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.408169:0:9458:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727cb18 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.408171:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800929ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011814784:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.408179:0:9458:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801203e4fc0/0x8a60d30f571ea774 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1290ee expref: 818 pid: 16053 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.408179:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.408184:0:9458:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801203e4fc0/0x8a60d30f571ea774 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1290ee expref: 818 pid: 16053 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.408185:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03540 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.408190:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257768064 00000100:00100000:2.0:1721880422.408193:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257768064 00000100:00100000:0.0:1721880422.408195:0:9458:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880087925c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011814912:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.408203:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c9bb3c0/0x8a60d30f571ea49c lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128f90 expref: 819 pid: 16112 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.408215:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800929ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011813632:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.408224:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801207f9f80/0x8a60d30f5727caf5 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.408226:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257767936 00000100:00100000:2.0:1721880422.408228:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257767936 00000100:00100000:1.0:1721880422.408237:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914723 00010000:00010000:2.0:1721880422.408238:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ee68900/0x8a60d30f571ea58a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128ff9 expref: 820 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.408244:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099938a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+820:2004:x1805522257768064:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.408253:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.408253:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914724 00010000:00010000:1.0:1721880422.408258:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c9bb3c0/0x8a60d30f571ea49c lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd2b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128f90 expref: 820 pid: 16112 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.408259:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009993ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+820:2005:x1805522257767936:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.408261:0:9458:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3eb40 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.408266:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.408267:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c9bb3c0/0x8a60d30f571ea49c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd2b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128f90 expref: 820 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.408270:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ee68900/0x8a60d30f571ea58a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128ff9 expref: 820 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.408271:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1721880422.408276:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880087924700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011814656:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.408278:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.408279:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.408280:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ee68900/0x8a60d30f571ea58a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128ff9 expref: 820 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.408282:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727cafc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd2b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.408288:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727cafc lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd2b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.408289:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.408293:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ee68900/0x8a60d30f571ea58a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128ff9 expref: 820 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.408299:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.408303:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.408304:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.408306:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011814656 00010000:00010000:2.0:1721880422.408307:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801207f9f80/0x8a60d30f5727caf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.408310:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011814656 00010000:00010000:2.0:1721880422.408314:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f9f80/0x8a60d30f5727caf5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.408320:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099938a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+819:2004:x1805522257768064:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 76us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.408326:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914723 00000100:00100000:3.0:1721880422.408329:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632536 00010000:00010000:2.0:1721880422.408331:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.408333:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2440:3689:x1805522011814656:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.408345:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.408348:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009993ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+818:2005:x1805522257767936:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 89us (167us total) trans 0 rc 0/0 00002000:00080000:3.0:1721880422.408351:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64817 count 1 00000100:00100000:1.0:1721880422.408355:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257768192 00000100:00100000:2.0:1721880422.408355:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914724 00000100:00100000:1.0:1721880422.408358:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257768192 00010000:00010000:3.0:1721880422.408360:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f86c0/0x8a60d30f5727cb1f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd31:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.408369:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f146640/0x8a60d30f571ea639 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129054 expref: 818 pid: 16087 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.408370:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d2d1680/0x8a60d30f571ea92d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1291ab expref: 818 pid: 15497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.408376:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.408378:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.408380:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f86c0/0x8a60d30f5727cb1f lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.408395:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d2d1680/0x8a60d30f571ea92d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1291ab expref: 818 pid: 15497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.408398:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914725 00010000:00010000:2.0:1721880422.408401:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c9bb3c0/0x8a60d30f571ea49c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128f90 expref: 818 pid: 16112 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.408403:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087924000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+818:2005:x1805522257768192:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.408404:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d2d1680/0x8a60d30f571ea92d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1291ab expref: 818 pid: 15497 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.408410:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.408413:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099939c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011813760:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.408413:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800929ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011815040:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.408415:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f146640/0x8a60d30f571ea639 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129054 expref: 817 pid: 16087 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.408424:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f146640/0x8a60d30f571ea639 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129054 expref: 817 pid: 16087 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.408424:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727cafc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.408435:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.408437:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.408437:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727cafc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.408439:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727cb03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.408445:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727cb03 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.408446:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727cafc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.408451:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03300 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.408453:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727cafc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.408456:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.408460:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727cafc lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.408462:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.408463:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801207f9f80/0x8a60d30f5727caf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.408466:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727cafc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.408469:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207f9f80/0x8a60d30f5727caf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.408473:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352400 already unused, calling callback (ffffffffa084e330) 00000100:00100000:0.0:1721880422.408476:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257768320 00000100:00100000:1.0:1721880422.408476:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087924000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+817:2005:x1805522257768192:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 72us (129us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.408476:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727cafc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.408478:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257768320 00010000:00010000:3.0:1721880422.408480:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f9f80/0x8a60d30f5727caf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.408482:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914725 00010000:00010000:2.0:1721880422.408483:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727cafc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.408487:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f9f80/0x8a60d30f5727caf5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.408488:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880120207840/0x8a60d30f571ea6d3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12909a expref: 818 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.408492:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727cafc lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.408494:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801207f9f80/0x8a60d30f5727caf5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.408498:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801207f9f80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.408499:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727cafc lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.408501:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f9f80/0x8a60d30f5727caf5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.408505:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914726 00010000:00010000:3.0:1721880422.408507:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f9f80/0x8a60d30f5727caf5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.408508:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087925f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+817:2004:x1805522257768320:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.408514:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.408516:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880120207840/0x8a60d30f571ea6d3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd2e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12909a expref: 817 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.408516:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801207f9f80/0x8a60d30f5727caf5 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.408522:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880120207840/0x8a60d30f571ea6d3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd2e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12909a expref: 817 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.408522:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801207f9f80/0x8a60d30f5727caf5 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.408529:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.408530:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.408531:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f146640/0x8a60d30f571ea639 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129054 expref: 817 pid: 16087 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.408532:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727cb0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd2e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.408540:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727cb0a lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd2e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.408544:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e898a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011814016:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.408547:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.408555:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727cb03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.408558:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087925f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+816:2004:x1805522257768320:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 48us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.408562:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914726 00010000:00010000:1.0:1721880422.408563:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727cb03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.408573:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727cb03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.408580:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727cb03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.408582:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880120207840/0x8a60d30f571ea6d3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12909a expref: 815 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.408587:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727cb03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.408589:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088680000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011814272:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.408593:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727cb03 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.408598:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727cb0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.408599:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b6400 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.408601:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727cb03 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.408603:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727cb0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.408607:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727cb0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.408608:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727cb03 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.408611:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727cb0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.408615:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727cb0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.408617:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009993b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2442:3687:x1805522011813376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1572us (1624us total) trans 4296020501 rc 0/0 00010000:00010000:1.0:1721880422.408618:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727cb03 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.408623:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727cb0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.408623:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632531 00010000:00010000:1.0:1721880422.408625:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727cb03 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.408626:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325cd80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.408628:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727cb0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.408632:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727cb0a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.408637:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727cb0a lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.408640:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2441:3687:x1805522011813504:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1610us (1666us total) trans 4296020502 rc 0/0 00010000:00010000:0.0:1721880422.408641:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727cb0a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.408647:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632530 00000004:00080000:2.0:1721880422.408651:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088682d80/2, rc 0, transno 1053206 00000100:00100000:2.0:1721880422.408665:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011813504:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1721880422.408675:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088682a00/2, rc 0, transno 1053205 00000100:00100000:2.0:1721880422.408678:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011813376:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.408692:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1721880422.408698:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1721880422.408700:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880087924380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011815168:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.408705:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880087924e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011815296:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.408723:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.408749:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1721880422.408766:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088681500/2, rc 0, transno 1053207 00000100:00100000:1.0:1721880422.408768:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088683480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2442:3688:x1805522011813888:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1521us (1562us total) trans 4296020503 rc 0/0 00000100:00100000:2.0:1721880422.408774:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011815168 00000100:00100000:1.0:1721880422.408775:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632532 00000100:00100000:2.0:1721880422.408777:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011815168 00000100:00100000:3.0:1721880422.408781:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011813888:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.408789:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011815296 00000100:00100000:1.0:1721880422.408792:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011815296 00000100:00100000:2.0:1721880422.408794:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632537 00000100:00100000:0.0:1721880422.408799:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1721880422.408799:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2443:3688:x1805522011815168:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.408805:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880087926a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011815424:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.408809:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632538 00002000:00080000:2.0:1721880422.408812:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64818 count 1 00000100:00100000:1.0:1721880422.408814:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099939c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2443:3687:x1805522011815296:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.408820:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.408822:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727cb26 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd32:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.408827:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64819 count 1 00010000:00010000:2.0:1721880422.408833:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d0a6f40/0x8a60d30f571ea9ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1291ff expref: 814 pid: 16112 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.408834:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011815424 00010000:00010000:1.0:1721880422.408838:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727cb2d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd33:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.408838:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011815424 00010000:00010000:2.0:1721880422.408839:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.408841:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.408843:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727cb26 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.408848:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d236f40/0x8a60d30f571eaa7d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129245 expref: 814 pid: 16050 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.408853:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632539 00010000:00010000:1.0:1721880422.408854:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.408855:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.408857:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727cb2d lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.408857:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2444:3686:x1805522011815424:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.408860:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d0a6f40/0x8a60d30f571ea9ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1291ff expref: 814 pid: 16112 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.408868:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64820 count 1 00010000:00010000:1.0:1721880422.408875:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d236f40/0x8a60d30f571eaa7d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129245 expref: 814 pid: 16050 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.408875:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d0a6f40/0x8a60d30f571ea9ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1291ff expref: 814 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.408878:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207faf40/0x8a60d30f5727cb34 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd34:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.408885:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d236f40/0x8a60d30f571eaa7d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129245 expref: 814 pid: 16050 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.408886:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009993bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011815552:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.408888:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135341f80/0x8a60d30f571eab02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12928b expref: 814 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.408894:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e898a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011815680:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.408895:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.408896:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1721880422.408898:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135303800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2444:3689:x1805522011814144:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1357us (1457us total) trans 4296020504 rc 0/0 00010000:00010000:3.0:1721880422.408898:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207faf40/0x8a60d30f5727cb34 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.408903:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632533 00000100:00100000:2.0:1721880422.408910:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde600 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.408914:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135341f80/0x8a60d30f571eab02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12928b expref: 814 pid: 15506 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.408916:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb300 going to sleep for 11 seconds 00000004:00080000:0.0:1721880422.408921:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088681c00/2, rc 0, transno 1053208 00010000:00010000:3.0:1721880422.408923:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135341f80/0x8a60d30f571eab02 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12928b expref: 814 pid: 15506 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.408925:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011814144:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.408932:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011815808:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.408938:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f57f180/0x8a60d30f571ea3f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b128f3c expref: 814 pid: 16037 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.408941:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1721880422.408946:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094661880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011815936:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.408951:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800929cf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011813248:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.408952:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f036c0 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.408959:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.408964:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801207fb600/0x8a60d30f5727caee lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.408968:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011815936 00000100:00100000:3.0:1721880422.408971:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011815936 00010000:00010000:2.0:1721880422.408972:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801207fb600/0x8a60d30f5727caee lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.408980:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207fb600/0x8a60d30f5727caee lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.408986:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632540 00010000:00010000:2.0:1721880422.408988:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207fb600/0x8a60d30f5727caee lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.408990:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094661180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2444:3689:x1805522011815936:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.408996:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801207fb600/0x8a60d30f5727caee lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.409000:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64821 count 1 00010000:00010000:2.0:1721880422.409003:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801207fb600/0x8a60d30f5727caee lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.409025:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801207fb600 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.409027:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207fba80/0x8a60d30f5727cb3b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd35:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.409029:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207fb600/0x8a60d30f5727caee lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.409035:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207fb600/0x8a60d30f5727caee lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.409037:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094738fc0/0x8a60d30f571eabb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1292d8 expref: 813 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.409043:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.409044:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.409046:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801207fb600/0x8a60d30f5727caee lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.409046:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207fba80/0x8a60d30f5727cb3b lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.409053:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801207fb600/0x8a60d30f5727caee lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.409062:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094738fc0/0x8a60d30f571eabb1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1292d8 expref: 813 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.409071:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094738fc0/0x8a60d30f571eabb1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1292d8 expref: 813 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.409080:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011816064:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.409097:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03480 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.409172:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2445:3688:x1805522011813120:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2289us (2351us total) trans 4296020505 rc 0/0 00000100:00100000:2.0:1721880422.409179:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632529 00000004:00080000:1.0:1721880422.409188:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012fd0ad80/2, rc 0, transno 1053209 00000100:00100000:1.0:1721880422.409207:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012fd0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011813120:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.409246:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094663b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011816192:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.409265:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.409277:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011816192 00000100:00100000:0.0:1721880422.409280:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011816192 00000100:00100000:0.0:1721880422.409291:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632541 00000100:00100000:0.0:1721880422.409293:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009993a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2445:3689:x1805522011816192:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.409302:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64822 count 1 00010000:00010000:0.0:1721880422.409309:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727cb42 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd36:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.409366:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135341680/0x8a60d30f571eac52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129333 expref: 813 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.409371:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.409372:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.409374:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727cb42 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.409385:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135341680/0x8a60d30f571eac52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129333 expref: 813 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.409391:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135341680/0x8a60d30f571eac52 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129333 expref: 813 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.409397:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094662d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011816320:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.409414:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e840 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.409424:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800929ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011814784:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.409431:0:9458:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880087925c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011814912:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.409434:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801207f8d80/0x8a60d30f5727cb11 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.409447:0:9458:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727cb18 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.409682:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.409693:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800929ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011815040:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.409698:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.409701:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801207f86c0/0x8a60d30f5727cb1f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.409747:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257768576 00000100:00100000:1.0:1721880422.409752:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257768576 00010000:00010000:1.0:1721880422.409768:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801203e4fc0/0x8a60d30f571ea774 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1290ee expref: 814 pid: 16053 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.409792:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257768448 00000100:00100000:1.0:1721880422.409795:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914727 00000100:00100000:0.0:1721880422.409796:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257768448 00000100:00100000:1.0:1721880422.409800:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a70efc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+815:2004:x1805522257768576:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.409808:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.409809:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f146f40/0x8a60d30f571ea831 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129142 expref: 815 pid: 16111 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.409813:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801203e4fc0/0x8a60d30f571ea774 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd2f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1290ee expref: 815 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.409822:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801203e4fc0/0x8a60d30f571ea774 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd2f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1290ee expref: 815 pid: 16053 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.409825:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914728 00000100:00100000:0.0:1721880422.409829:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094663100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+815:2004:x1805522257768448:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.409835:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801203e4fc0/0x8a60d30f571ea774 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd2f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1290ee expref: 815 pid: 16053 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.409836:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.409840:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f146f40/0x8a60d30f571ea831 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd30:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129142 expref: 815 pid: 16111 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.409844:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.409845:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.409848:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727cb18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.409849:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f146f40/0x8a60d30f571ea831 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd30:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129142 expref: 814 pid: 16111 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.409855:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727cb18 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.409871:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.409880:0:9458:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727cb18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.409887:0:9458:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727cb18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.409894:0:9458:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727cb18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.409895:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a70efc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+814:2004:x1805522257768576:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 93us (212us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.409900:0:9458:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727cb18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.409901:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914727 00010000:00010000:2.0:1721880422.409906:0:9458:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727cb18 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.409911:0:9458:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325d440 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.409913:0:9458:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727cb18 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.409920:0:9458:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727cb18 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.409928:0:9458:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727cb18 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.409934:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727cb18 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.409936:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f146f40/0x8a60d30f571ea831 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd30:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129142 expref: 814 pid: 16111 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.409951:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.409952:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.409955:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801207f8d80/0x8a60d30f5727cb11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.409962:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f8d80/0x8a60d30f5727cb11 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.409981:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.409990:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801207f8d80/0x8a60d30f5727cb11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.409994:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207f8d80/0x8a60d30f5727cb11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.409999:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f8d80/0x8a60d30f5727cb11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.410001:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094663100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+812:2004:x1805522257768448:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 170us (300us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.410003:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f8d80/0x8a60d30f5727cb11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.410007:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801207f8d80/0x8a60d30f5727cb11 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.410023:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801207f8d80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.410026:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f8d80/0x8a60d30f5727cb11 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.410027:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914728 00010000:00010000:3.0:1721880422.410032:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f8d80/0x8a60d30f5727cb11 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.410043:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801207f8d80/0x8a60d30f5727cb11 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.410047:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801207f8d80/0x8a60d30f5727cb11 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.410052:0:9458:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087925500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2446:3686:x1805522011814400:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1933us (1985us total) trans 4296020506 rc 0/0 00000100:00100000:2.0:1721880422.410057:0:9458:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632534 00000004:00080000:2.0:1721880422.410082:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088681f80/2, rc 0, transno 1053210 00000100:00100000:2.0:1721880422.410096:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011814400:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.410123:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094661f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011816448:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.410137:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009993aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2446:3687:x1805522011814528:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2016us (2052us total) trans 4296020507 rc 0/0 00000100:00100000:1.0:1721880422.410139:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.410142:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632535 00000100:00100000:2.0:1721880422.410144:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.410153:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011816448 00000100:00100000:3.0:1721880422.410155:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011816448 00000004:00080000:0.0:1721880422.410157:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880087927480/2, rc 0, transno 1053211 00000100:00100000:0.0:1721880422.410164:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880087927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011814528:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.410169:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.410176:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632542 00000100:00100000:3.0:1721880422.410179:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2446:3686:x1805522011816448:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.410184:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00002000:00080000:3.0:1721880422.410187:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64823 count 1 00010000:00010000:3.0:1721880422.410194:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f8b40/0x8a60d30f5727cb49 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd37:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.410200:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099056400/0x8a60d30f571ead08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129379 expref: 811 pid: 16037 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.410201:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257768704 00000100:00100000:0.0:1721880422.410204:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257768704 00000100:00100000:2.0:1721880422.410204:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800929cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011815808:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.410205:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.410206:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.410207:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f8b40/0x8a60d30f5727cb49 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.410215:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801207faf40/0x8a60d30f5727cb34 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.410216:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d2d1680/0x8a60d30f571ea92d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1291ab expref: 812 pid: 15497 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.410217:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099056400/0x8a60d30f571ead08 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129379 expref: 812 pid: 16037 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.410224:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.410227:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099056400/0x8a60d30f571ead08 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129379 expref: 812 pid: 16037 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.410232:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800929ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011816704:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.410242:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257768960 00000100:00100000:2.0:1721880422.410245:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257768960 00000100:00100000:3.0:1721880422.410249:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03300 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.410258:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d236f40/0x8a60d30f571eaa7d lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129245 expref: 813 pid: 16050 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.410266:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800929cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011816064:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.410272:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801207fba80/0x8a60d30f5727cb3b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.410285:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009993bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011815552:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.410288:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257768832 00000100:00100000:0.0:1721880422.410291:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257768832 00000100:00100000:1.0:1721880422.410291:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257769216 00000100:00100000:1.0:1721880422.410294:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257769216 00010000:00010000:3.0:1721880422.410294:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727cb26 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.410295:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914729 00000100:00100000:2.0:1721880422.410300:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088680380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+815:2005:x1805522257768704:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.410301:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d0a6f40/0x8a60d30f571ea9ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1291ff expref: 815 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.410307:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135341680/0x8a60d30f571eac52 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129333 expref: 815 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.410308:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.410312:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d2d1680/0x8a60d30f571ea92d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd31:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1291ab expref: 815 pid: 15497 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.410314:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914730 00000100:00100000:0.0:1721880422.410317:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088683b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+815:2005:x1805522257768960:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.410319:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914731 00010000:00010000:2.0:1721880422.410321:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d2d1680/0x8a60d30f571ea92d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd31:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1291ab expref: 815 pid: 15497 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.410322:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.410323:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087924000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+815:2005:x1805522257768832:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.410325:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d236f40/0x8a60d30f571eaa7d lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd33:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129245 expref: 815 pid: 16050 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.410327:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914732 00010000:00010000:3.0:1721880422.410329:0:15473:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.410331:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087925f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+815:2005:x1805522257769216:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.410332:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d236f40/0x8a60d30f571eaa7d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd33:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129245 expref: 815 pid: 16050 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.410332:0:15473:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d0a6f40/0x8a60d30f571ea9ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd32:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1291ff expref: 815 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.410333:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d2d1680/0x8a60d30f571ea92d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd31:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1291ab expref: 815 pid: 15497 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.410338:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.410338:0:15473:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d0a6f40/0x8a60d30f571ea9ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd32:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1291ff expref: 815 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.410340:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.410341:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.410342:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135341680/0x8a60d30f571eac52 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129333 expref: 814 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.410343:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727cb2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd33:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.410344:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.410345:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.410347:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d0a6f40/0x8a60d30f571ea9ea lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd32:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1291ff expref: 814 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.410348:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801207f86c0/0x8a60d30f5727cb1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.410350:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135341680/0x8a60d30f571eac52 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129333 expref: 814 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.410351:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727cb2d lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd33:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.410354:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.410355:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.410357:0:15473:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727cb26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.410359:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.410359:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f86c0/0x8a60d30f5727cb1f lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.410361:0:15473:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727cb26 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.410362:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.410363:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.410366:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727cb42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.410369:0:15473:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.410371:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088683b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+813:2005:x1805522257768960:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 53us (204us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.410374:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.410375:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914730 00010000:00010000:1.0:1721880422.410377:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727cb42 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.410381:0:15473:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087924000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+812:2005:x1805522257768832:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 57us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.410385:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914731 00000100:00100000:0.0:1721880422.410389:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094660e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011816576:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.410389:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.410391:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088680380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+812:2005:x1805522257768704:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 89us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.410398:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914729 00010000:00010000:3.0:1721880422.410399:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801207f86c0/0x8a60d30f5727cb1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.410403:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207f86c0/0x8a60d30f5727cb1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.410407:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087925f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+810:2005:x1805522257769216:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 74us (182us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.410408:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f86c0/0x8a60d30f5727cb1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.410409:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.410411:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f86c0/0x8a60d30f5727cb1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.410414:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914732 00010000:00010000:3.0:1721880422.410415:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801207f86c0/0x8a60d30f5727cb1f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.410420:0:9458:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011816576 00010000:00010000:3.0:1721880422.410421:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801207f86c0 already unused, calling callback (ffffffffa084e330) 00000100:00100000:0.0:1721880422.410423:0:9458:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011816576 00010000:00010000:3.0:1721880422.410423:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f86c0/0x8a60d30f5727cb1f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.410427:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f86c0/0x8a60d30f5727cb1f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.410432:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801207f86c0/0x8a60d30f5727cb1f lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.410433:0:9458:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632543 00000100:00100000:0.0:1721880422.410435:0:9458:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123b6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2447:3687:x1805522011816576:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.410435:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801207f86c0/0x8a60d30f5727cb1f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.410440:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.410443:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d236f40/0x8a60d30f571eaa7d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129245 expref: 809 pid: 16050 timeout: 887 lvb_type: 0 00002000:00080000:0.0:1721880422.410444:0:9458:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64824 count 1 00010000:00010000:0.0:1721880422.410451:0:9458:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727cb50 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd38:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.410458:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e898a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011815680:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.410459:0:9458:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880072993600/0x8a60d30f571eada2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1293d4 expref: 808 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.410463:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.410464:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.410466:0:9458:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727cb50 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.410468:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727cb2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.410476:0:9458:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880072993600/0x8a60d30f571eada2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1293d4 expref: 808 pid: 16039 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.410481:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257769088 00010000:00010000:0.0:1721880422.410483:0:9458:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880072993600/0x8a60d30f571eada2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1293d4 expref: 808 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.410484:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257769088 00000100:00100000:0.0:1721880422.410488:0:9458:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880123b6f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011816832:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.410496:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135341f80/0x8a60d30f571eab02 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12928b expref: 809 pid: 15506 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.410503:0:9458:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.410511:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914733 00000100:00100000:3.0:1721880422.410514:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2448:3689:x1805522011814656:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2181us (2224us total) trans 4296020508 rc 0/0 00000100:00100000:1.0:1721880422.410515:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009993ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+809:2005:x1805522257769088:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.410519:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632536 00010000:00010000:1.0:1721880422.410521:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.410523:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135341680/0x8a60d30f571eac52 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129333 expref: 809 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.410524:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135341f80/0x8a60d30f571eab02 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd34:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12928b expref: 809 pid: 15506 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.410531:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.410532:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094662d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011816320:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.410538:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135341f80/0x8a60d30f571eab02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd34:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12928b expref: 808 pid: 15506 timeout: 887 lvb_type: 0 00000004:00080000:3.0:1721880422.410539:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880087924700/2, rc 0, transno 1053212 00010000:00010000:0.0:1721880422.410541:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727cb42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.410550:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135341f80/0x8a60d30f571eab02 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd34:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12928b expref: 808 pid: 15506 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.410551:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880087924700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011814656:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.410560:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727cb26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.410562:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.410563:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.410564:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727cb26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.410566:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801207faf40/0x8a60d30f5727cb34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.410569:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727cb26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.410572:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094662d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011816960:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.410573:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207faf40/0x8a60d30f5727cb34 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.410573:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727cb26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.410577:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727cb26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.410581:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350000 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.410582:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.410582:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727cb26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.410585:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.410586:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727cb26 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.410592:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727cb26 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.410595:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727cb26 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.410602:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727cb42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.410607:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727cb42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.410608:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009993ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+807:2005:x1805522257769088:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 92us (167us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.410612:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727cb42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.410614:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914733 00010000:00010000:0.0:1721880422.410617:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727cb42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.410624:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727cb42 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.410625:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257769344 00000100:00100000:1.0:1721880422.410628:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257769344 00010000:00010000:0.0:1721880422.410630:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325d680 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.410630:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801207faf40/0x8a60d30f5727cb34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.410632:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727cb42 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.410637:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094738fc0/0x8a60d30f571eabb1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1292d8 expref: 807 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.410638:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207faf40/0x8a60d30f5727cb34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.410639:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727cb42 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.410646:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207faf40/0x8a60d30f5727cb34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.410648:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727cb42 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.410654:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727cb42 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.410656:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801207faf40/0x8a60d30f5727cb34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.410660:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914734 00010000:00010000:2.0:1721880422.410662:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801207faf40/0x8a60d30f5727cb34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.410664:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ab4d5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+807:2005:x1805522257769344:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.410668:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801207faf40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.410670:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.410671:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207faf40/0x8a60d30f5727cb34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.410672:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2448:3688:x1805522011815168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1872us (1947us total) trans 4296020509 rc 0/0 00010000:00010000:1.0:1721880422.410674:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094738fc0/0x8a60d30f571eabb1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd35:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1292d8 expref: 807 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.410676:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632537 00010000:00010000:2.0:1721880422.410679:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207faf40/0x8a60d30f5727cb34 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.410682:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094738fc0/0x8a60d30f571eabb1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd35:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1292d8 expref: 807 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.410689:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801207faf40/0x8a60d30f5727cb34 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.410690:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880087924380/2, rc 0, transno 1053213 00010000:00010000:1.0:1721880422.410692:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094738fc0/0x8a60d30f571eabb1 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd35:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1292d8 expref: 807 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.410695:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801207faf40/0x8a60d30f5727cb34 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.410698:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880087924380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011815168:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.410701:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.410703:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.410705:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801207fba80/0x8a60d30f5727cb3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.410712:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207fba80/0x8a60d30f5727cb3b lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.410719:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1721880422.410724:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880131eb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011817088:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.410725:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.410768:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.410769:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ab4d5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+806:2005:x1805522257769344:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 103us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.410775:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914734 00010000:00010000:1.0:1721880422.410818:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727cb2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.410826:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727cb2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.410833:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727cb2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.410840:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727cb2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.410846:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727cb2d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.410852:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b6640 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.410855:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727cb2d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.410861:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727cb2d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.410864:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009993a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2449:3689:x1805522011816192:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1568us (1597us total) trans 4296020511 rc 0/0 00010000:00010000:1.0:1721880422.410870:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727cb2d lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.410871:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632541 00010000:00010000:1.0:1721880422.410876:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727cb2d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.410937:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011816960 00000100:00100000:0.0:1721880422.410938:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011817088 00000100:00100000:0.0:1721880422.410941:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011817088 00000100:00100000:2.0:1721880422.410941:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011816960 00000004:00080000:3.0:1721880422.410941:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880094663b80/2, rc 0, transno 1053215 00000100:00100000:3.0:1721880422.410955:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094663b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011816192:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.410963:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632544 00000100:00100000:2.0:1721880422.410969:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008599d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2451:3688:x1805522011817088:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.410969:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632545 00000100:00100000:3.0:1721880422.410973:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084ee0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2451:3688:x1805522011816960:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.410975:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1721880422.410980:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008599df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011817216:0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.410981:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64826 count 1 00002000:00080000:3.0:1721880422.410982:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64825 count 1 00000100:00100000:1.0:1721880422.410986:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099939c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2451:3687:x1805522011815296:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2170us (2236us total) trans 4296020512 rc 0/0 00010000:00010000:3.0:1721880422.410990:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f8900/0x8a60d30f5727cb57 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd39:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.410991:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727cb5e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd3a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.410993:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632538 00010000:00010000:3.0:1721880422.410997:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134c54d80/0x8a60d30f571eae6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129428 expref: 805 pid: 16037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.411000:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.411001:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.411002:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cb39b00/0x8a60d30f571eaf00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12946e expref: 805 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.411003:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f8900/0x8a60d30f5727cb57 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.411008:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.411025:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.411027:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727cb5e lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.411030:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134c54d80/0x8a60d30f571eae6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129428 expref: 805 pid: 16037 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.411039:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134c54d80/0x8a60d30f571eae6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129428 expref: 805 pid: 16037 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.411047:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cb39b00/0x8a60d30f571eaf00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12946e expref: 805 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.411049:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011817344:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.411056:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.411062:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cb39b00/0x8a60d30f571eaf00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12946e expref: 805 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.411072:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099939180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011817472:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.411073:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03480 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.411074:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011817216 00000100:00100000:1.0:1721880422.411078:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011817216 00010000:00010000:3.0:1721880422.411083:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801207fba80/0x8a60d30f5727cb3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.411089:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207fba80/0x8a60d30f5727cb3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.411093:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfded80 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.411094:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632546 00000100:00100000:1.0:1721880422.411098:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2451:3687:x1805522011817216:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.411101:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207fba80/0x8a60d30f5727cb3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.411108:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801207fba80/0x8a60d30f5727cb3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.411110:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64827 count 1 00010000:00010000:3.0:1721880422.411114:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801207fba80/0x8a60d30f5727cb3b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.411119:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801207fba80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.411120:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727cb65 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd3b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.411122:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207fba80/0x8a60d30f5727cb3b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.411129:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207fba80/0x8a60d30f5727cb3b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.411130:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0628240/0x8a60d30f571eaf8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1294c2 expref: 805 pid: 16112 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.411136:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.411137:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.411138:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801207fba80/0x8a60d30f5727cb3b lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.411139:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727cb65 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.411144:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801207fba80/0x8a60d30f5727cb3b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.411155:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0628240/0x8a60d30f571eaf8c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1294c2 expref: 805 pid: 16112 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.411159:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880087924e00/2, rc 0, transno 1053216 00000100:00100000:0.0:1721880422.411164:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880087924e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011815296:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.411164:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0628240/0x8a60d30f571eaf8c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1294c2 expref: 805 pid: 16112 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.411174:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880087924000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011817600:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.411193:0:9458:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880123b6f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011816832:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.411199:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb480 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.411203:0:9458:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727cb50 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.411215:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880134d01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011817728:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.411220:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.411228:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.411246:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011817728 00000100:00100000:0.0:1721880422.411248:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011817728 00000100:00100000:1.0:1721880422.411254:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257769472 00000100:00100000:1.0:1721880422.411258:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257769472 00000100:00100000:3.0:1721880422.411260:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094661180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2453:3689:x1805522011815936:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2267us (2298us total) trans 4296020513 rc 0/0 00000100:00100000:3.0:1721880422.411266:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632540 00010000:00010000:1.0:1721880422.411271:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880072993600/0x8a60d30f571eada2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1293d4 expref: 806 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.411290:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914735 00000100:00100000:1.0:1721880422.411294:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009993ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+806:2004:x1805522257769472:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.411303:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.411306:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880072993600/0x8a60d30f571eada2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd38:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1293d4 expref: 806 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.411310:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2452:3686:x1805522011815424:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2450us (2487us total) trans 4296020510 rc 0/0 00000004:00080000:3.0:1721880422.411310:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880094661880/2, rc 0, transno 1053217 00000100:00100000:0.0:1721880422.411311:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632547 00000100:00100000:0.0:1721880422.411314:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123b6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2452:3687:x1805522011817728:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.411314:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880072993600/0x8a60d30f571eada2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd38:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1293d4 expref: 806 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.411317:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632539 00000100:00100000:3.0:1721880422.411325:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094661880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011815936:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.411326:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880072993600/0x8a60d30f571eada2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd38:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1293d4 expref: 806 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.411335:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.411337:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.411339:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727cb50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.411342:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880087926a00/2, rc 0, transno 1053214 00010000:00010000:1.0:1721880422.411345:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727cb50 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd38:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.411346:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e4a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011817856:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.411348:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800929ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011816704:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.411349:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880087926a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011815424:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.411359:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.411359:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801207f8b40/0x8a60d30f5727cb49 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.411361:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.411370:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1721880422.411373:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011817984:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.411382:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009993ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+805:2004:x1805522257769472:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 86us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.411383:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.411383:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011817856 00000100:00100000:2.0:1721880422.411386:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011817856 00000100:00100000:1.0:1721880422.411388:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914735 00000100:00100000:3.0:1721880422.411397:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011817984 00000100:00100000:3.0:1721880422.411400:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011817984 00000100:00100000:2.0:1721880422.411403:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632548 00010000:00010000:1.0:1721880422.411405:0:9458:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727cb50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.411408:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e4a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2453:3688:x1805522011817856:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.411412:0:9458:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727cb50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.411416:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00002000:00080000:2.0:1721880422.411419:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64829 count 1 00000100:00100000:3.0:1721880422.411421:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632549 00010000:00010000:1.0:1721880422.411424:0:9458:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727cb50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.411426:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e4a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2453:3688:x1805522011817984:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.411430:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727cb6c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd3d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.411431:0:9458:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727cb50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.411438:0:9458:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727cb50 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.411438:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64830 count 1 00010000:00010000:2.0:1721880422.411440:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130636f40/0x8a60d30f571eb02d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd3d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12955c expref: 804 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.411443:0:9458:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325c240 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.411446:0:9458:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727cb50 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.411446:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.411448:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.411448:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f9440/0x8a60d30f5727cb73 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd3e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.411450:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727cb6c lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd3d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.411453:0:9458:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727cb50 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.411458:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801351b3cc0/0x8a60d30f571eb081 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1295b0 expref: 804 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.411462:0:9458:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727cb50 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.411465:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.411466:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.411467:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130636f40/0x8a60d30f571eb02d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd3d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12955c expref: 804 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.411468:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727cb50 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.411468:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f9440/0x8a60d30f5727cb73 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.411477:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130636f40/0x8a60d30f571eb02d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd3d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12955c expref: 804 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.411483:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801351b3cc0/0x8a60d30f571eb081 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1295b0 expref: 804 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.411486:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099938380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011818112:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.411492:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801351b3cc0/0x8a60d30f571eb081 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1295b0 expref: 804 pid: 16101 timeout: 887 lvb_type: 0 00002000:00080000:0.0:1721880422.411504:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64828 count 1 00000100:00100000:3.0:1721880422.411506:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800929ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011818240:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.411509:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde540 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.411512:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727cb7a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd3c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.411520:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a062ad00/0x8a60d30f571eafd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129508 expref: 804 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.411525:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03300 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.411526:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.411527:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.411528:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727cb7a lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.411539:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a062ad00/0x8a60d30f571eafd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129508 expref: 804 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.411545:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a062ad00/0x8a60d30f571eafd9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129508 expref: 804 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.411551:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e4aad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011818368:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.411565:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.411592:0:9458:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880123b6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2454:3687:x1805522011816576:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1153us (1180us total) trans 4296020514 rc 0/0 00000004:00080000:0.0:1721880422.411596:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880094660e00/2, rc 0, transno 1053218 00000100:00100000:1.0:1721880422.411599:0:9458:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632543 00000100:00100000:0.0:1721880422.411601:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094660e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011816576:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.411621:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257769600 00000100:00100000:1.0:1721880422.411624:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257769600 00010000:00010000:1.0:1721880422.411636:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099056400/0x8a60d30f571ead08 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129379 expref: 805 pid: 16037 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.411639:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009993b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011818496:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.411651:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914736 00000100:00100000:1.0:1721880422.411655:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e4ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+805:2004:x1805522257769600:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.411660:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.411661:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.411666:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099056400/0x8a60d30f571ead08 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd37:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129379 expref: 805 pid: 16037 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.411673:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099056400/0x8a60d30f571ead08 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd37:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129379 expref: 805 pid: 16037 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.411681:0:9458:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011818496 00010000:00010000:1.0:1721880422.411684:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099056400/0x8a60d30f571ead08 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd37:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129379 expref: 805 pid: 16037 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.411685:0:9458:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011818496 00010000:00010000:1.0:1721880422.411694:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.411696:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.411699:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801207f8b40/0x8a60d30f5727cb49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.411703:0:9458:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632550 00010000:00010000:1.0:1721880422.411705:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f8b40/0x8a60d30f5727cb49 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.411707:0:9458:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2454:3686:x1805522011818496:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.411708:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800929cd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011817344:192.168.201.24@tcp:104: 00002000:00080000:2.0:1721880422.411717:0:9458:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64831 count 1 00010000:00010000:1.0:1721880422.411720:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.411721:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801207f8900/0x8a60d30f5727cb57 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.411750:0:9458:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727cb81 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd3f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.411753:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801207f8b40/0x8a60d30f5727cb49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.411760:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207f8b40/0x8a60d30f5727cb49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.411761:0:9458:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801351806c0/0x8a60d30f571eb0d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd3f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129604 expref: 804 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.411765:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e4ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+804:2004:x1805522257769600:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 107us (346us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.411767:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.411767:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f8b40/0x8a60d30f5727cb49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.411768:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1721880422.411771:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914736 00010000:00010000:2.0:1721880422.411771:0:9458:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727cb81 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd3f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.411774:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f8b40/0x8a60d30f5727cb49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.411780:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801207f8b40/0x8a60d30f5727cb49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.411786:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801207f8b40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.411788:0:9458:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801351806c0/0x8a60d30f571eb0d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd3f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129604 expref: 803 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.411789:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f8b40/0x8a60d30f5727cb49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.411796:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f8b40/0x8a60d30f5727cb49 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.411801:0:9458:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801351806c0/0x8a60d30f571eb0d5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd3f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129604 expref: 803 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.411805:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801207f8b40/0x8a60d30f5727cb49 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.411806:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880087924000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011817600:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.411810:0:9458:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009993b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011818624:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.411812:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801207f8b40/0x8a60d30f5727cb49 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.411816:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.411819:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727cb65 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.411830:0:9458:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdeb40 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.411834:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257769728 00000100:00100000:1.0:1721880422.411837:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257769728 00010000:00010000:1.0:1721880422.411847:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134c54d80/0x8a60d30f571eae6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129428 expref: 804 pid: 16037 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.411867:0:16188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914737 00000100:00100000:1.0:1721880422.411871:0:16188:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e4a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+804:2005:x1805522257769728:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.411878:0:16188:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.411882:0:16188:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134c54d80/0x8a60d30f571eae6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129428 expref: 804 pid: 16037 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.411890:0:16188:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134c54d80/0x8a60d30f571eae6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129428 expref: 804 pid: 16037 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.411901:0:16188:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134c54d80/0x8a60d30f571eae6d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129428 expref: 804 pid: 16037 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.411909:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.411909:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2455:3686:x1805522011816448:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1727us (1763us total) trans 4296020515 rc 0/0 00010000:00010000:1.0:1721880422.411911:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.411913:0:16188:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801207f8900/0x8a60d30f5727cb57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.411915:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632542 00010000:00010000:1.0:1721880422.411920:0:16188:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f8900/0x8a60d30f5727cb57 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.411926:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880094661f80/2, rc 0, transno 1053219 00010000:00010000:1.0:1721880422.411933:0:16188:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.411935:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094661f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011816448:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.411953:0:16188:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e4a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+803:2005:x1805522257769728:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 80us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.411958:0:16188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914737 00000100:00100000:0.0:1721880422.411969:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099939180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011817472:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.411974:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801207f8900/0x8a60d30f5727cb57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.411977:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.411978:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727cb5e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.411979:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207f8900/0x8a60d30f5727cb57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.411984:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f8900/0x8a60d30f5727cb57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.411987:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f8900/0x8a60d30f5727cb57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.411991:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011818752:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.411991:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801207f8900/0x8a60d30f5727cb57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.411994:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257769856 00000100:00100000:2.0:1721880422.411994:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.411995:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801207f8900 already unused, calling callback (ffffffffa084e330) 00000100:00100000:1.0:1721880422.411997:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257769856 00010000:00010000:3.0:1721880422.411997:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f8900/0x8a60d30f5727cb57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.412001:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f8900/0x8a60d30f5727cb57 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.412007:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.412007:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801207f8900/0x8a60d30f5727cb57 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.412023:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801207f8900/0x8a60d30f5727cb57 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.412028:0:16188:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257769984 00000100:00100000:1.0:1721880422.412030:0:16188:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257769984 00010000:00010000:1.0:1721880422.412040:0:16188:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0628240/0x8a60d30f571eaf8c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1294c2 expref: 804 pid: 16112 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.412055:0:16188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914738 00000100:00100000:1.0:1721880422.412059:0:16188:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009993b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+804:2005:x1805522257769984:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.412062:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800929ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011818240:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.412065:0:16188:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.412068:0:16188:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0628240/0x8a60d30f571eaf8c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd3b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1294c2 expref: 804 pid: 16112 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.412068:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099938380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011818112:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.412070:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801207f9440/0x8a60d30f5727cb73 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.412076:0:16188:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0628240/0x8a60d30f571eaf8c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd3b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1294c2 expref: 804 pid: 16112 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.412080:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011818752 00010000:00010000:2.0:1721880422.412081:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727cb6c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd3d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.412082:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011818752 00000100:00100000:0.0:1721880422.412083:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.412087:0:16188:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0628240/0x8a60d30f571eaf8c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd3b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1294c2 expref: 804 pid: 16112 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.412093:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632551 00000100:00100000:3.0:1721880422.412095:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e4aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2455:3687:x1805522011818752:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.412097:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.412097:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.412098:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.412101:0:16188:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727cb65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.412103:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64832 count 1 00010000:00010000:1.0:1721880422.412108:0:16188:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727cb65 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd3b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.412110:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f9680/0x8a60d30f5727cb88 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd40:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.412112:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257770112 00000100:00100000:2.0:1721880422.412115:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257770112 00010000:00010000:3.0:1721880422.412117:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135180fc0/0x8a60d30f571eb122 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129658 expref: 803 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.412121:0:16188:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.412122:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.412123:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1721880422.412124:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.412124:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f9680/0x8a60d30f5727cb88 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.412126:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130636f40/0x8a60d30f571eb02d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd3d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12955c expref: 804 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.412133:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135180fc0/0x8a60d30f571eb122 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129658 expref: 804 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.412139:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135180fc0/0x8a60d30f571eb122 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129658 expref: 804 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.412142:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e4aad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011818368:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.412142:0:16195:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257770368 00000100:00100000:1.0:1721880422.412144:0:16188:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009993b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+804:2005:x1805522257769984:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 84us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.412144:0:16195:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257770368 00000100:00100000:3.0:1721880422.412146:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800929ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011818880:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.412151:0:16188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914738 00010000:00010000:0.0:1721880422.412153:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727cb7a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd3c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.412153:0:16195:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a062ad00/0x8a60d30f571eafd9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129508 expref: 805 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.412160:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03300 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.412164:0:16188:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257770240 00000100:00100000:1.0:1721880422.412167:0:16188:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257770240 00000100:00100000:2.0:1721880422.412175:0:16195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914739 00010000:00010000:1.0:1721880422.412177:0:16188:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801351b3cc0/0x8a60d30f571eb081 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1295b0 expref: 805 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.412179:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914740 00000100:00100000:2.0:1721880422.412180:0:16195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e4ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+805:2004:x1805522257770112:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.412183:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e196c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+805:2004:x1805522257770368:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.412188:0:16195:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.412189:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.412192:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a062ad00/0x8a60d30f571eafd9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd3c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129508 expref: 805 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.412192:0:16195:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130636f40/0x8a60d30f571eb02d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd3d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12955c expref: 805 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.412199:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a062ad00/0x8a60d30f571eafd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd3c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129508 expref: 805 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.412201:0:16195:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130636f40/0x8a60d30f571eb02d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd3d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12955c expref: 805 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.412203:0:16188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914741 00000100:00100000:1.0:1721880422.412207:0:16188:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e4a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+805:2004:x1805522257770240:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.412213:0:16195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130636f40/0x8a60d30f571eb02d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd3d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12955c expref: 805 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.412214:0:16188:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.412218:0:16188:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801351b3cc0/0x8a60d30f571eb081 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd3e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1295b0 expref: 805 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.412224:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.412226:0:16188:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801351b3cc0/0x8a60d30f571eb081 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd3e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1295b0 expref: 804 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.412226:0:16195:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.412228:0:16195:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727cb6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd3d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.412230:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880084ee0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2456:3688:x1805522011816960:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1256us (1643us total) trans 4296020516 rc 0/0 00000100:00100000:3.0:1721880422.412234:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632545 00010000:00010000:2.0:1721880422.412235:0:16195:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727cb6c lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd3d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.412237:0:16188:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801351b3cc0/0x8a60d30f571eb081 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd3e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1295b0 expref: 804 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.412245:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a062ad00/0x8a60d30f571eafd9 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd3c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129508 expref: 805 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.412248:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.412248:0:16195:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.412250:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.412253:0:16188:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801207f9440/0x8a60d30f5727cb73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.412254:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000004:00080000:3.0:1721880422.412254:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880094662d80/2, rc 0, transno 1053220 00010000:00010000:0.0:1721880422.412255:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.412257:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727cb7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.412258:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094662d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011816960:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.412259:0:16188:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f9440/0x8a60d30f5727cb73 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd3e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.412262:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727cb7a lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd3c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.412265:0:16195:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e4ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:30425778-2709-4512-9d75-01ec53c4cfad+802:2004:x1805522257770112:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 84us (181us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.412272:0:16188:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.412272:0:16195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914739 00010000:00010000:0.0:1721880422.412277:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.412277:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801207f9440/0x8a60d30f5727cb73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.412281:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207f9440/0x8a60d30f5727cb73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.412286:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f9440/0x8a60d30f5727cb73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.412290:0:16188:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e4a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+801:2004:x1805522257770240:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 81us (164us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.412290:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f9440/0x8a60d30f5727cb73 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.412291:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e196c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+801:2004:x1805522257770368:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 107us (193us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.412292:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727cb6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.412294:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801207f9440/0x8a60d30f5727cb73 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.412297:0:16188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914741 00010000:00010000:3.0:1721880422.412297:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801207f9440 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.412299:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727cb6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.412299:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f9440/0x8a60d30f5727cb73 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.412300:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914740 00010000:00010000:3.0:1721880422.412302:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f9440/0x8a60d30f5727cb73 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.412308:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801207f9440/0x8a60d30f5727cb73 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.412311:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727cb6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.412312:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801207f9440/0x8a60d30f5727cb73 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.412318:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727cb6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.412324:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb39b00/0x8a60d30f571eaf00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12946e expref: 799 pid: 16098 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.412326:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727cb6c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.412332:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350480 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.412335:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727cb6c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.412340:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914742 00010000:00010000:2.0:1721880422.412341:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727cb6c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.412344:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099938e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+799:2005:x1805522257769856:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.412350:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.412350:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727cb6c lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.412353:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cb39b00/0x8a60d30f571eaf00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd3a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12946e expref: 799 pid: 16098 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.412356:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727cb6c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.412361:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cb39b00/0x8a60d30f571eaf00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd3a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12946e expref: 799 pid: 16098 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.412372:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cb39b00/0x8a60d30f571eaf00 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd3a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12946e expref: 799 pid: 16098 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.412381:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.412382:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.412385:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727cb5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.412385:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e4a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2456:3688:x1805522011817984:12345-0@lo:6:osp-syn-1-0.0 Request processed in 959us (1000us total) trans 4296020517 rc 0/0 00000100:00100000:3.0:1721880422.412389:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632549 00010000:00010000:1.0:1721880422.412391:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727cb5e lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.412404:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099939500/2, rc 0, transno 1053221 00010000:00010000:1.0:1721880422.412405:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.412408:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011817984:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.412418:0:9458:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009993b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011818624:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.412425:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099938e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+798:2005:x1805522257769856:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 80us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.412425:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800929ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011819008:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.412431:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914742 00010000:00010000:2.0:1721880422.412431:0:9458:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727cb81 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd3f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.412464:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.412470:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727cb65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.412472:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1721880422.412475:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011819136:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.412477:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727cb65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.412483:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.412484:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727cb65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.412488:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.412490:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727cb65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.412493:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011819008 00000100:00100000:3.0:1721880422.412494:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011819008 00010000:00010000:1.0:1721880422.412496:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727cb65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.412502:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b7840 already unused, calling callback (ffffffffa084e330) 00000100:00100000:3.0:1721880422.412503:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011819136 00010000:00010000:1.0:1721880422.412504:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727cb65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.412504:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011819136 00010000:00010000:1.0:1721880422.412511:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727cb65 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.412511:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632552 00000100:00100000:3.0:1721880422.412514:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2458:3688:x1805522011819008:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.412519:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727cb65 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.412521:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64833 count 1 00010000:00010000:0.0:1721880422.412524:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727cb7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.412525:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727cb65 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.412525:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e4a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2458:3688:x1805522011817856:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1114us (1161us total) trans 4296020518 rc 0/0 00010000:00010000:3.0:1721880422.412528:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f8240/0x8a60d30f5727cb8f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd41:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.412529:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727cb7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.412531:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632548 00010000:00010000:0.0:1721880422.412534:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727cb7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.412535:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a094df80/0x8a60d30f571eb192 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd41:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1296c1 expref: 797 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.412538:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727cb7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.412539:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.412540:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.412541:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727cb7a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.412541:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f8240/0x8a60d30f5727cb8f lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd41:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.412545:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325e400 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.412547:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727cb7a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.412551:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727cb7a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.412551:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a094df80/0x8a60d30f571eb192 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd41:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1296c1 expref: 797 pid: 16099 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.412554:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e4a8a80/2, rc 0, transno 1053222 00010000:00010000:0.0:1721880422.412557:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727cb7a lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.412559:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a094df80/0x8a60d30f571eb192 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd41:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1296c1 expref: 797 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.412561:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e4a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011817856:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.412565:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727cb7a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.412572:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880096e59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011819264:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.412595:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009993b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011819392:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.412597:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03480 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.412613:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632553 00000100:00100000:2.0:1721880422.412615:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.412618:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076e08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2459:3688:x1805522011819136:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.412628:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64834 count 1 00010000:00010000:3.0:1721880422.412636:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f9200/0x8a60d30f5727cb96 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.412641:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011819392 00000100:00100000:1.0:1721880422.412644:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2459:3687:x1805522011817216:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1544us (1587us total) trans 4296020519 rc 0/0 00000100:00100000:2.0:1721880422.412644:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011819392 00010000:00010000:3.0:1721880422.412645:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099057180/0x8a60d30f571eb202 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129731 expref: 797 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.412650:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1721880422.412651:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632546 00000100:00100000:0.0:1721880422.412652:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880123b6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2460:3687:x1805522011817728:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1336us (1422us total) trans 4296020520 rc 0/0 00010000:00010000:3.0:1721880422.412652:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.412653:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f9200/0x8a60d30f5727cb96 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.412656:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632547 00000100:00100000:2.0:1721880422.412662:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632554 00010000:00010000:3.0:1721880422.412666:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099057180/0x8a60d30f571eb202 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129731 expref: 797 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.412668:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2458:3686:x1805522011819392:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.412673:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099057180/0x8a60d30f571eb202 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129731 expref: 797 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.412675:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257770496 00000004:00080000:0.0:1721880422.412677:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880134d01880/2, rc 0, transno 1053224 00000100:00100000:1.0:1721880422.412678:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257770496 00002000:00080000:2.0:1721880422.412680:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64835 count 1 00000100:00100000:3.0:1721880422.412681:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880096e59180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011819520:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.412689:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880134d01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011817728:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.412689:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801351806c0/0x8a60d30f571eb0d5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd3f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129604 expref: 798 pid: 16101 timeout: 887 lvb_type: 0 00000004:00080000:0.0:1721880422.412695:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008599df80/2, rc 0, transno 1053223 00000100:00100000:3.0:1721880422.412697:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03540 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.412698:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008599df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011817216:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.412706:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914743 00010000:00010000:0.0:1721880422.412708:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727cb5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.412710:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e4aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+798:2005:x1805522257770496:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.412716:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.412720:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801351806c0/0x8a60d30f571eb0d5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd3f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129604 expref: 798 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.412743:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1721880422.412749:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009993aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011819776:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.412750:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801351806c0/0x8a60d30f571eb0d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd3f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129604 expref: 798 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.412750:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099938700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011819648:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.412766:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801351806c0/0x8a60d30f571eb0d5 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd3f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129604 expref: 798 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.412767:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.412770:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727cb5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.412775:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727cb5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.412777:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.412779:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727cb5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.412779:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.412779:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011819648 00010000:00010000:1.0:1721880422.412782:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727cb81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd3f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.412782:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011819648 00010000:00010000:0.0:1721880422.412783:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727cb5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.412788:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727cb81 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd3f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.412790:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350240 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.412792:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727cb5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.412796:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727cb5e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.412800:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632555 00010000:00010000:0.0:1721880422.412802:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727cb5e lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.412803:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.412804:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123910700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2459:3686:x1805522011819648:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.412805:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727cb5e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.412814:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64836 count 1 00000100:00100000:1.0:1721880422.412819:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e4aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+797:2005:x1805522257770496:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 108us (331us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.412824:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727cb9d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd44:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.412825:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914743 00010000:00010000:2.0:1721880422.412835:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fbb9d40/0x8a60d30f571eb2a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1297d2 expref: 796 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.412842:0:9458:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727cb81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.412847:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.412848:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.412849:0:9458:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727cb81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.412851:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727cb9d lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.412856:0:9458:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727cb81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.412863:0:9458:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727cb81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.412868:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fbb9d40/0x8a60d30f571eb2a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1297d2 expref: 796 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.412874:0:9458:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727cb81 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.412878:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fbb9d40/0x8a60d30f571eb2a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1297d2 expref: 796 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.412880:0:9458:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353840 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.412883:0:9458:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727cb81 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.412888:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009993bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011819904:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.412889:0:9458:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727cb81 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.412898:0:9458:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727cb81 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.412903:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136353840/0x8a60d30f5727cb81 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.412908:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfdeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.412919:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008599d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2460:3688:x1805522011817088:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1950us (2150us total) trans 4296020521 rc 0/0 00000100:00100000:2.0:1721880422.412921:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.412924:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632544 00000100:00100000:3.0:1721880422.412931:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011819776 00000100:00100000:3.0:1721880422.412933:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011819776 00000100:00100000:3.0:1721880422.412945:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632556 00000004:00080000:2.0:1721880422.412946:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880131eb1c00/2, rc 0, transno 1053225 00000100:00100000:3.0:1721880422.412948:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009993ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2461:3688:x1805522011819776:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.412953:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880131eb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011817088:0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.412956:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64837 count 1 00010000:00010000:3.0:1721880422.412963:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a533e1c0/0x8a60d30f5727cba4 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd45:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.412971:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012329e1c0/0x8a60d30f571eb2f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12981f expref: 796 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.412975:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.412976:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.412978:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a533e1c0/0x8a60d30f5727cba4 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.412981:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1721880422.412987:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009993b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011820032:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.412988:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012329e1c0/0x8a60d30f571eb2f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12981f expref: 796 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.412993:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012329e1c0/0x8a60d30f571eb2f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12981f expref: 796 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.412999:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800981e0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011820160:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.413004:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.413007:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.413030:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03d80 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.413033:0:9458:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2461:3686:x1805522011818496:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1323us (1370us total) trans 4296020522 rc 0/0 00000100:00100000:1.0:1721880422.413040:0:9458:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632550 00000100:00100000:2.0:1721880422.413046:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011820032 00000100:00100000:2.0:1721880422.413049:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011820032 00000100:00100000:3.0:1721880422.413051:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800929ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011818880:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.413061:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801207f9680/0x8a60d30f5727cb88 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.413062:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257770624 00000100:00100000:1.0:1721880422.413066:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257770624 00000100:00100000:2.0:1721880422.413067:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632557 00000100:00100000:2.0:1721880422.413071:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2461:3688:x1805522011820032:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.413077:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135180fc0/0x8a60d30f571eb122 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129658 expref: 797 pid: 16101 timeout: 887 lvb_type: 0 00002000:00080000:2.0:1721880422.413083:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64838 count 1 00010000:00010000:2.0:1721880422.413093:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727cbab lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd46:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.413094:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914744 00000100:00100000:1.0:1721880422.413099:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e4a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+797:2004:x1805522257770624:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.413105:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.413105:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b464fc0/0x8a60d30f571eb344 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129873 expref: 797 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.413109:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135180fc0/0x8a60d30f571eb122 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd40:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129658 expref: 797 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.413112:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.413113:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.413116:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727cbab lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.413117:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135180fc0/0x8a60d30f571eb122 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd40:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129658 expref: 797 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.413128:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135180fc0/0x8a60d30f571eb122 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd40:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129658 expref: 797 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.413131:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b464fc0/0x8a60d30f571eb344 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129873 expref: 797 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.413138:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.413139:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.413140:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b464fc0/0x8a60d30f571eb344 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129873 expref: 796 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.413142:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801207f9680/0x8a60d30f5727cb88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.413148:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f9680/0x8a60d30f5727cb88 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd40:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.413149:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099939180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011820288:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.413161:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.413162:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801207f9680/0x8a60d30f5727cb88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.413166:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207f9680/0x8a60d30f5727cb88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.413171:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde540 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.413171:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f9680/0x8a60d30f5727cb88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.413174:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f9680/0x8a60d30f5727cb88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.413178:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801207f9680/0x8a60d30f5727cb88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.413179:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e4a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+796:2004:x1805522257770624:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 79us (174us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.413181:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801207f9680 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.413182:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727cbb2 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd43:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.413183:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f9680/0x8a60d30f5727cb88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.413185:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914744 00010000:00010000:3.0:1721880422.413186:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f9680/0x8a60d30f5727cb88 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.413192:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134936ac0/0x8a60d30f571eb24f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129785 expref: 796 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.413192:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801207f9680/0x8a60d30f5727cb88 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.413198:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.413199:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.413199:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801207f9680/0x8a60d30f5727cb88 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.413202:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727cbb2 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.413217:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009993b480/2, rc 0, transno 1053226 00010000:00010000:2.0:1721880422.413224:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134936ac0/0x8a60d30f571eb24f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129785 expref: 795 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.413226:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009993b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011818496:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.413233:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134936ac0/0x8a60d30f571eb24f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129785 expref: 795 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.413242:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011820416:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.413247:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1721880422.413253:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e4ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011820544:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.413261:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfded80 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.413269:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.413273:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e4aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2462:3687:x1805522011818752:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1176us (1265us total) trans 4296020523 rc 0/0 00000100:00100000:3.0:1721880422.413277:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632551 00000100:00100000:2.0:1721880422.413282:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011820544 00000100:00100000:2.0:1721880422.413285:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011820544 00000004:00080000:0.0:1721880422.413291:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800929cd880/2, rc 0, transno 1053227 00000100:00100000:0.0:1721880422.413295:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800929cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011818752:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.413302:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632558 00000100:00100000:2.0:1721880422.413307:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e4a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2462:3687:x1805522011820544:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.413312:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e4ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011820672:0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.413323:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64839 count 1 00000100:00100000:0.0:1721880422.413333:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.413333:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727cbb9 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd47:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.413341:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011820672 00010000:00010000:2.0:1721880422.413343:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801232c1b00/0x8a60d30f571eb391 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1298c0 expref: 795 pid: 16126 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.413343:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011820672 00010000:00010000:2.0:1721880422.413350:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.413351:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1721880422.413352:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632559 00010000:00010000:2.0:1721880422.413353:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727cbb9 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.413354:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2463:3687:x1805522011820672:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.413362:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64840 count 1 00010000:00010000:2.0:1721880422.413369:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801232c1b00/0x8a60d30f571eb391 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1298c0 expref: 795 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.413369:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727cbc0 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd48:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.413376:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800928f5440/0x8a60d30f571eb3e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129914 expref: 795 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.413381:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.413381:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.413383:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801232c1b00/0x8a60d30f571eb391 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1298c0 expref: 795 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.413383:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727cbc0 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.413393:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011820800:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.413393:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800928f5440/0x8a60d30f571eb3e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129914 expref: 795 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.413399:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800928f5440/0x8a60d30f571eb3e5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129914 expref: 795 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.413406:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800929ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011820928:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.413414:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde600 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.413420:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03300 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.413545:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880096e59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011819264:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.413555:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801207f8240/0x8a60d30f5727cb8f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd41:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.413568:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880096e59180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011819520:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.413569:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009993bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011819904:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.413574:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801207f9200/0x8a60d30f5727cb96 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.413582:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727cb9d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.413636:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800981e0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011820160:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.413641:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.413641:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a533e1c0/0x8a60d30f5727cba4 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.413685:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257771136 00000100:00100000:1.0:1721880422.413689:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257771136 00010000:00010000:1.0:1721880422.413701:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012329e1c0/0x8a60d30f571eb2f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12981f expref: 796 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.413720:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914745 00000100:00100000:1.0:1721880422.413724:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+796:2006:x1805522257771136:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.413748:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.413749:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.413752:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099939180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011820288:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.413753:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012329e1c0/0x8a60d30f571eb2f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd45:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12981f expref: 796 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.413757:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257770880 00000100:00100000:0.0:1721880422.413760:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257770880 00010000:00010000:1.0:1721880422.413762:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012329e1c0/0x8a60d30f571eb2f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd45:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12981f expref: 796 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.413765:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727cbab lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.413770:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099057180/0x8a60d30f571eb202 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129731 expref: 797 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.413774:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012329e1c0/0x8a60d30f571eb2f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd45:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12981f expref: 797 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.413782:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914746 00010000:00010000:1.0:1721880422.413784:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1721880422.413785:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+796:2004:x1805522257770880:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.413786:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.413788:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a533e1c0/0x8a60d30f5727cba4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.413791:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.413793:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099057180/0x8a60d30f571eb202 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129731 expref: 796 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.413795:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a533e1c0/0x8a60d30f5727cba4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd45:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.413799:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099057180/0x8a60d30f571eb202 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129731 expref: 796 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.413810:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099057180/0x8a60d30f571eb202 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129731 expref: 796 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.413810:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.413820:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a533e1c0/0x8a60d30f5727cba4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.413821:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.413823:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.413825:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801207f9200/0x8a60d30f5727cb96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.413827:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a533e1c0/0x8a60d30f5727cba4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.413831:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+795:2006:x1805522257771136:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 105us (189us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.413832:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f9200/0x8a60d30f5727cb96 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.413835:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a533e1c0/0x8a60d30f5727cba4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.413837:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914745 00010000:00010000:2.0:1721880422.413842:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a533e1c0/0x8a60d30f5727cba4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.413849:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.413854:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a533e1c0/0x8a60d30f5727cba4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.413860:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8800a533e1c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.413863:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a533e1c0/0x8a60d30f5727cba4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.413864:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801207f9200/0x8a60d30f5727cb96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.413867:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+794:2004:x1805522257770880:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 79us (118us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.413870:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207f9200/0x8a60d30f5727cb96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.413871:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a533e1c0/0x8a60d30f5727cba4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.413873:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914746 00010000:00010000:3.0:1721880422.413875:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f9200/0x8a60d30f5727cb96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.413878:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f9200/0x8a60d30f5727cb96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.413881:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a533e1c0/0x8a60d30f5727cba4 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.413883:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801207f9200/0x8a60d30f5727cb96 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.413886:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801207f9200 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.413887:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a533e1c0/0x8a60d30f5727cba4 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.413888:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f9200/0x8a60d30f5727cb96 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.413892:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f9200/0x8a60d30f5727cb96 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.413898:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801207f9200/0x8a60d30f5727cb96 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.413902:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801207f9200/0x8a60d30f5727cb96 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.413923:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.413932:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257770752 00000100:00100000:0.0:1721880422.413934:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257770752 00010000:00010000:0.0:1721880422.413943:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a094df80/0x8a60d30f571eb192 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd41:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1296c1 expref: 794 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.413957:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914747 00000100:00100000:0.0:1721880422.413961:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+794:2005:x1805522257770752:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.413967:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.413970:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a094df80/0x8a60d30f571eb192 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd41:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1296c1 expref: 794 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.413978:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a094df80/0x8a60d30f571eb192 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd41:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1296c1 expref: 794 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.413983:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880076e08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2465:3688:x1805522011819136:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1364us (1498us total) trans 4296020524 rc 0/0 00000100:00100000:1.0:1721880422.413987:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.413987:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632553 00010000:00010000:0.0:1721880422.413990:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a094df80/0x8a60d30f571eb192 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd41:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1296c1 expref: 794 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.413999:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.414000:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.414003:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801207f8240/0x8a60d30f5727cb8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd41:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.414008:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009993ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2464:3688:x1805522011819776:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1057us (1084us total) trans 4296020525 rc 0/0 00010000:00010000:0.0:1721880422.414024:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f8240/0x8a60d30f5727cb8f lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd41:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.414032:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632556 00000004:00080000:3.0:1721880422.414042:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009993aa00/2, rc 0, transno 1053229 00010000:00010000:0.0:1721880422.414044:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.414051:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009993aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011819776:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.414060:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+793:2005:x1805522257770752:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 98us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.414066:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914747 00000100:00100000:2.0:1721880422.414071:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011820416:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.414076:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257771008 00000100:00100000:0.0:1721880422.414079:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257771008 00000100:00100000:1.0:1721880422.414080:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.414082:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727cbb2 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.414087:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fbb9d40/0x8a60d30f571eb2a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1297d2 expref: 793 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.414091:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801207f8240/0x8a60d30f5727cb8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.414095:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257771264 00010000:00010000:3.0:1721880422.414098:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801207f8240/0x8a60d30f5727cb8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.414099:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257771264 00000100:00100000:0.0:1721880422.414102:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914748 00000100:00100000:0.0:1721880422.414106:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5276c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+794:2005:x1805522257771008:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.414106:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801207f8240/0x8a60d30f5727cb8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.414110:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b464fc0/0x8a60d30f571eb344 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129873 expref: 794 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.414112:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.414112:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801207f8240/0x8a60d30f5727cb8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.414116:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fbb9d40/0x8a60d30f571eb2a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd44:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1297d2 expref: 794 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.414118:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801207f8240/0x8a60d30f5727cb8f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.414123:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801207f8240 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.414125:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fbb9d40/0x8a60d30f571eb2a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd44:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1297d2 expref: 794 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.414127:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914749 00010000:00010000:3.0:1721880422.414127:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f8240/0x8a60d30f5727cb8f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.414132:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087924000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+794:2005:x1805522257771264:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.414133:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801207f8240/0x8a60d30f5727cb8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.414137:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fbb9d40/0x8a60d30f571eb2a3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd44:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1297d2 expref: 794 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.414138:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.414142:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b464fc0/0x8a60d30f571eb344 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd46:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129873 expref: 794 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.414142:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801207f8240/0x8a60d30f5727cb8f lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.414147:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.414148:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.414149:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801207f8240/0x8a60d30f5727cb8f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.414150:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727cb9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.414151:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b464fc0/0x8a60d30f571eb344 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd46:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129873 expref: 793 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.414158:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727cb9d lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd44:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.414163:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b464fc0/0x8a60d30f571eb344 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd46:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129873 expref: 793 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.414167:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.414175:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.414176:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.414176:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727cb9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.414179:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727cbab lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.414180:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5276c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+792:2005:x1805522257771008:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 73us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.414184:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914748 00010000:00010000:1.0:1721880422.414186:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727cbab lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd46:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.414188:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727cb9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.414196:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727cb9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.414200:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.414204:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727cb9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.414211:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727cb9d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.414217:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801363533c0 already unused, calling callback (ffffffffa084e330) 00000100:00100000:1.0:1721880422.414219:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087924000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+791:2005:x1805522257771264:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 86us (139us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.414221:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727cb9d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.414225:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914749 00010000:00010000:2.0:1721880422.414228:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727cb9d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.414239:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727cb9d lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.414246:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801363533c0/0x8a60d30f5727cb9d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.414249:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2464:3688:x1805522011819008:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1732us (1782us total) trans 4296020526 rc 0/0 00000100:00100000:3.0:1721880422.414255:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632552 00000004:00080000:3.0:1721880422.414278:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800929cce00/2, rc 0, transno 1053228 00000100:00100000:3.0:1721880422.414285:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800929cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011819136:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1721880422.414292:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800929ced80/2, rc 0, transno 1053230 00000100:00100000:3.0:1721880422.414295:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800929ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011819008:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.414303:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800981e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011821056:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.414319:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.414336:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011821056 00000100:00100000:3.0:1721880422.414338:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011821056 00000100:00100000:3.0:1721880422.414353:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632560 00000100:00100000:3.0:1721880422.414356:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2465:3688:x1805522011821056:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.414365:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.414366:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880123910700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2465:3686:x1805522011819648:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1559us (1595us total) trans 4296020527 rc 0/0 00002000:00080000:3.0:1721880422.414366:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64841 count 1 00000100:00100000:0.0:1721880422.414367:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1721880422.414373:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011821184:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.414374:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632555 00010000:00010000:3.0:1721880422.414376:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727cbc7 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd49:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.414385:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0638b40/0x8a60d30f571eb432 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129961 expref: 790 pid: 16126 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.414389:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.414391:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.414392:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.414394:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727cbc7 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.414398:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727cbab lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.414403:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1721880422.414404:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.414406:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011821312:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.414406:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727cbab lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.414408:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0638b40/0x8a60d30f571eb432 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129961 expref: 790 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.414414:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727cbab lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.414415:0:16188:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257771392 00000100:00100000:0.0:1721880422.414416:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.414416:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0638b40/0x8a60d30f571eb432 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129961 expref: 790 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.414417:0:16188:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257771392 00010000:00010000:2.0:1721880422.414421:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727cbab lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.414427:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727cbab lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.414428:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011821184 00010000:00010000:1.0:1721880422.414429:0:16188:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134936ac0/0x8a60d30f571eb24f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129785 expref: 791 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.414429:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880096e59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011821440:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.414430:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011821184 00010000:00010000:2.0:1721880422.414433:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353a80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.414436:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727cbab lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.414441:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011821312 00000100:00100000:1.0:1721880422.414442:0:16188:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257771520 00010000:00010000:2.0:1721880422.414442:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727cbab lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.414443:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011821312 00000100:00100000:1.0:1721880422.414444:0:16188:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257771520 00000100:00100000:3.0:1721880422.414450:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03d80 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.414451:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727cbab lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.414452:0:16188:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801232c1b00/0x8a60d30f571eb391 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1298c0 expref: 792 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.414453:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632561 00000100:00100000:0.0:1721880422.414456:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2466:3688:x1805522011821184:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.414458:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136353a80/0x8a60d30f5727cbab lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.414472:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800929ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011820928:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.414476:0:16188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914750 00000100:00100000:0.0:1721880422.414481:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914751 00000100:00100000:1.0:1721880422.414482:0:16188:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087925f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+792:2005:x1805522257771392:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.414482:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727cbc0 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.414484:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087925c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+792:2004:x1805522257771520:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.414489:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.414489:0:16188:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.414492:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801232c1b00/0x8a60d30f571eb391 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd47:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1298c0 expref: 792 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.414493:0:16188:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134936ac0/0x8a60d30f571eb24f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129785 expref: 792 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.414501:0:16188:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134936ac0/0x8a60d30f571eb24f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129785 expref: 792 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.414503:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801232c1b00/0x8a60d30f571eb391 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd47:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1298c0 expref: 792 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.414511:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.414512:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.414513:0:16188:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134936ac0/0x8a60d30f571eb24f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129785 expref: 792 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.414514:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727cbb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd47:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.414518:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727cbb9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd47:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.414520:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.414523:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.414525:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.414526:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.414527:0:16188:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727cbb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.414534:0:16188:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727cbb2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.414537:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087925c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+791:2004:x1805522257771520:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 52us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.414541:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914751 00000100:00100000:0.0:1721880422.414549:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257771648 00010000:00010000:1.0:1721880422.414549:0:16188:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.414551:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257771648 00010000:00010000:0.0:1721880422.414558:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800928f5440/0x8a60d30f571eb3e5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129914 expref: 791 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.414567:0:16188:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087925f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+791:2005:x1805522257771392:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 84us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.414572:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2467:3688:x1805522011820032:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1496us (1561us total) trans 4296020528 rc 0/0 00000100:00100000:1.0:1721880422.414573:0:16188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914750 00000100:00100000:0.0:1721880422.414577:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914752 00000100:00100000:2.0:1721880422.414578:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632557 00000100:00100000:0.0:1721880422.414580:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+791:2005:x1805522257771648:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.414584:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.414586:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800928f5440/0x8a60d30f571eb3e5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd48:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129914 expref: 790 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.414593:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632562 00010000:00010000:0.0:1721880422.414596:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800928f5440/0x8a60d30f571eb3e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd48:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129914 expref: 790 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.414597:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2466:3687:x1805522011821312:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.414603:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800928f5440/0x8a60d30f571eb3e5 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd48:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129914 expref: 790 pid: 16130 timeout: 887 lvb_type: 0 00000004:00080000:1.0:1721880422.414606:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099938700/2, rc 0, transno 1053231 00002000:00080000:3.0:1721880422.414607:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64843 count 1 00000004:00080000:2.0:1721880422.414608:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009993b800/2, rc 0, transno 1053232 00010000:00010000:0.0:1721880422.414609:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.414610:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.414612:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727cbc0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.414613:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009993b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011820032:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.414614:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099938700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011819648:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.414614:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727cbce lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd4b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.414616:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727cbc0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd48:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.414621:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131be2f40/0x8a60d30f571eb4e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129a09 expref: 789 pid: 16112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.414624:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.414625:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.414626:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.414628:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727cbce lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.414629:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727cbb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.414636:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727cbb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.414637:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+789:2005:x1805522257771648:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 55us (118us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.414638:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131be2f40/0x8a60d30f571eb4e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129a09 expref: 789 pid: 16112 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.414640:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914752 00010000:00010000:2.0:1721880422.414644:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727cbb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.414644:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131be2f40/0x8a60d30f571eb4e1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129a09 expref: 789 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.414650:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727cbb2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.414650:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135302d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011821696:192.168.201.24@tcp:104: 00002000:00080000:0.0:1721880422.414657:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64842 count 1 00010000:00010000:2.0:1721880422.414657:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727cbb2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.414662:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136351680 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.414664:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727cbd5 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd4a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.414664:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03300 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.414665:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727cbb2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.414671:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131be0900/0x8a60d30f571eb486 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1299b5 expref: 788 pid: 16019 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.414672:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727cbb2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.414673:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727cbc0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.414674:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.414676:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.414677:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727cbd5 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.414677:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1721880422.414678:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727cbc0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.414682:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727cbb2 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.414682:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727cbc0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.414684:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880087925500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011821568:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.414686:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727cbc0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.414687:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131be0900/0x8a60d30f571eb486 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1299b5 expref: 788 pid: 16019 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.414688:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136351680/0x8a60d30f5727cbb2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.414690:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727cbc0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.414693:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131be0900/0x8a60d30f571eb486 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1299b5 expref: 788 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.414693:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa9680 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.414695:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727cbc0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.414698:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727cbc0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.414699:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e4a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011821952:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.414704:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727cbc0 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.414705:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.414708:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9680/0x8a60d30f5727cbc0 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.414712:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e840 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.414721:0:9458:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011821568 00000100:00100000:0.0:1721880422.414723:0:9458:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011821568 00000100:00100000:0.0:1721880422.414752:0:9458:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632563 00000100:00100000:0.0:1721880422.414755:0:9458:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094663100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2467:3686:x1805522011821568:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.414778:0:9458:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64844 count 1 00010000:00010000:0.0:1721880422.414785:0:9458:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727cbdc lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd4c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.414792:0:9458:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c0e1b00/0x8a60d30f571eb527 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129a5d expref: 788 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.414796:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.414797:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.414797:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880087924a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011821824:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.414798:0:9458:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727cbdc lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.414808:0:9458:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c0e1b00/0x8a60d30f571eb527 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129a5d expref: 788 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.414814:0:9458:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c0e1b00/0x8a60d30f571eb527 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129a5d expref: 788 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.414819:0:9458:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e4aad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011822080:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.414820:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.414826:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2469:3687:x1805522011820672:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1470us (1492us total) trans 4296020530 rc 0/0 00000100:00100000:3.0:1721880422.414831:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632559 00000100:00100000:3.0:1721880422.414839:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011821824 00000100:00100000:3.0:1721880422.414841:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011821824 00000100:00100000:3.0:1721880422.414850:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632564 00000100:00100000:3.0:1721880422.414853:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800878d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2469:3688:x1805522011821824:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.414860:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64845 count 1 00010000:00010000:3.0:1721880422.414867:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727cbe3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd4d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.414874:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800842c2400/0x8a60d30f571eb597 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129ac6 expref: 788 pid: 16112 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.414878:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.414879:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.414880:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727cbe3 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.414890:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800842c2400/0x8a60d30f571eb597 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129ac6 expref: 788 pid: 16112 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.414893:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e4ab100/2, rc 0, transno 1053234 00010000:00010000:3.0:1721880422.414895:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800842c2400/0x8a60d30f571eb597 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129ac6 expref: 788 pid: 16112 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.414898:0:9458:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.414901:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e4ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011820672:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.414901:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135301f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011822208:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.414918:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03540 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.414919:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801232c1b00/0x8a60d30f571eb391 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd47:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1298c0 expref: 788 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.414929:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011822336:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.414931:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011820800:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.414941:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.414944:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727cbb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.414952:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727cbb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.414954:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011822336 00000100:00100000:0.0:1721880422.414956:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011822336 00010000:00010000:2.0:1721880422.414958:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727cbb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.414966:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727cbb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.414969:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632565 00000100:00100000:0.0:1721880422.414971:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135300000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2470:3689:x1805522011822336:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.414973:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727cbb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1721880422.414979:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64846 count 1 00010000:00010000:2.0:1721880422.414980:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727cbb9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.414986:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727cbea lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd4e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.414987:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353180 already unused, calling callback (ffffffffa084e330) 00000100:00100000:3.0:1721880422.414987:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2470:3686:x1805522011819392:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2319us (2371us total) trans 4296020529 rc 0/0 00010000:00010000:2.0:1721880422.414989:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727cbb9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.414991:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632554 00010000:00010000:0.0:1721880422.414993:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c0e2400/0x8a60d30f571eb5dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129b0c expref: 787 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.414996:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727cbb9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.414997:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.414998:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000004:00080000:1.0:1721880422.415000:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009993b100/2, rc 0, transno 1053233 00010000:00010000:2.0:1721880422.415006:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727cbb9 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.415007:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009993b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011819392:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.415027:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136353180/0x8a60d30f5727cbb9 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.415044:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e899180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011822464:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.415065:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.415077:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011822464 00000100:00100000:3.0:1721880422.415080:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011822464 00010000:00010000:0.0:1721880422.415083:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727cbea lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.415091:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632566 00000100:00100000:3.0:1721880422.415093:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d2ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2471:3686:x1805522011822464:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.415096:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c0e2400/0x8a60d30f571eb5dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129b0c expref: 787 pid: 16119 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.415101:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64847 count 1 00010000:00010000:0.0:1721880422.415102:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c0e2400/0x8a60d30f571eb5dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129b0c expref: 787 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.415108:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727cbf1 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd4f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.415112:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e4a9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011822592:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.415115:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013579a880/0x8a60d30f571eb63f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129b6e expref: 787 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.415119:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.415119:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.415121:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727cbf1 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.415129:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3ea80 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.415131:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013579a880/0x8a60d30f571eb63f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129b6e expref: 787 pid: 16099 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.415140:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e4a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2471:3687:x1805522011820544:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1831us (1868us total) trans 4296020531 rc 0/0 00010000:00010000:3.0:1721880422.415140:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013579a880/0x8a60d30f571eb63f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129b6e expref: 787 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.415145:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135303480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011822720:192.168.201.24@tcp:104: 00000004:00080000:1.0:1721880422.415148:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e4ab800/2, rc 0, transno 1053235 00000100:00100000:2.0:1721880422.415148:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632558 00000100:00100000:1.0:1721880422.415155:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e4ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011820544:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.415167:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880096e59c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011821440:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.415174:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1721880422.415175:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727cbc7 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.415180:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e89a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011822848:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.415231:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03480 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.415238:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.415238:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.415248:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257771776 00000100:00100000:0.0:1721880422.415250:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257771776 00000100:00100000:3.0:1721880422.415250:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011822848 00000100:00100000:3.0:1721880422.415252:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011822848 00010000:00010000:0.0:1721880422.415259:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0638b40/0x8a60d30f571eb432 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129961 expref: 788 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.415263:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632567 00000100:00100000:3.0:1721880422.415265:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2471:3686:x1805522011822848:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.415269:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914753 00000100:00100000:0.0:1721880422.415272:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085a4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+788:2004:x1805522257771776:12345-192.168.201.24@tcp:103:ldlm_bl.0 00002000:00080000:3.0:1721880422.415272:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64848 count 1 00010000:00010000:0.0:1721880422.415277:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.415279:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0638b40/0x8a60d30f571eb432 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd49:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129961 expref: 788 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.415279:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727cbf8 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd50:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.415284:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0638b40/0x8a60d30f571eb432 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd49:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129961 expref: 788 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.415285:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092ba6d00/0x8a60d30f571eb68c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129bbb expref: 788 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.415289:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.415290:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.415291:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727cbf8 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.415292:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0638b40/0x8a60d30f571eb432 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd49:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129961 expref: 788 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.415299:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.415300:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.415302:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727cbc7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.415304:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092ba6d00/0x8a60d30f571eb68c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129bbb expref: 787 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.415309:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727cbc7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.415310:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092ba6d00/0x8a60d30f571eb68c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129bbb expref: 787 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.415315:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135303800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011822976:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.415328:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135302d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011821696:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.415330:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727cbc7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.415334:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727cbc7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.415339:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727cbc7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.415342:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727cbc7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.415343:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727cbce lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.415346:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727cbc7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.415349:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa9440 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.415351:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727cbc7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.415358:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727cbc7 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.415364:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727cbc7 lrc: 3/0,0 mode: --/PW res: [0x2c0000406:0xfd49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.415374:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9440/0x8a60d30f5727cbc7 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd49:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.415388:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.415404:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880085a4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+787:2004:x1805522257771776:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 130us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.415408:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914753 00000100:00100000:1.0:1721880422.415415:0:9458:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e4aad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011822080:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.415431:0:9458:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727cbdc lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.415445:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2472:3688:x1805522011821056:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1088us (1125us total) trans 4296020532 rc 0/0 00000100:00100000:3.0:1721880422.415450:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632560 00000004:00080000:2.0:1721880422.415460:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800981e0a80/2, rc 0, transno 1053236 00000100:00100000:2.0:1721880422.415468:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800981e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011821056:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.415470:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135301f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011822208:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.415479:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727cbe3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.415487:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e4a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011821952:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.415498:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03d80 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.415504:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1721880422.415509:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e4aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011823104:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.415519:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.415530:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011823104 00000100:00100000:3.0:1721880422.415532:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011823104 00000100:00100000:3.0:1721880422.415541:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632568 00010000:00010000:0.0:1721880422.415542:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727cbd5 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.415544:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135301f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2472:3689:x1805522011823104:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.415551:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64849 count 1 00010000:00010000:3.0:1721880422.415557:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727cbff lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd51:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.415564:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c6473c0/0x8a60d30f571eb6d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129c01 expref: 786 pid: 16019 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.415569:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.415570:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.415571:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727cbff lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.415581:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c6473c0/0x8a60d30f571eb6d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129c01 expref: 786 pid: 16019 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.415586:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c6473c0/0x8a60d30f571eb6d2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129c01 expref: 786 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.415592:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135302d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011823232:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.415594:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.415611:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03540 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.415656:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257772160 00000100:00100000:0.0:1721880422.415660:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257772160 00010000:00010000:0.0:1721880422.415672:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c0e1b00/0x8a60d30f571eb527 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129a5d expref: 787 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.415687:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.415696:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257772032 00000100:00100000:0.0:1721880422.415699:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257772032 00010000:00010000:0.0:1721880422.415707:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131be0900/0x8a60d30f571eb486 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1299b5 expref: 788 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.415715:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914754 00000100:00100000:1.0:1721880422.415721:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.415721:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e4a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+788:2007:x1805522257772160:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.415743:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257772416 00000100:00100000:0.0:1721880422.415746:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257772416 00010000:00010000:3.0:1721880422.415746:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.415752:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c0e1b00/0x8a60d30f571eb527 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129a5d expref: 789 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.415754:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914755 00000100:00100000:2.0:1721880422.415760:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e195850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+789:2004:x1805522257772032:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.415761:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c0e1b00/0x8a60d30f571eb527 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129a5d expref: 789 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.415768:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.415770:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.415772:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c0e1b00/0x8a60d30f571eb527 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd4c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129a5d expref: 789 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.415775:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131be0900/0x8a60d30f571eb486 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd4a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1299b5 expref: 789 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.415779:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257771904 00000100:00100000:1.0:1721880422.415782:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257771904 00010000:00010000:2.0:1721880422.415785:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131be0900/0x8a60d30f571eb486 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd4a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1299b5 expref: 788 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.415786:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.415787:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.415789:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727cbdc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.415795:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131be2f40/0x8a60d30f571eb4e1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129a09 expref: 789 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.415795:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727cbdc lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd4c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.415798:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131be0900/0x8a60d30f571eb486 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd4a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b1299b5 expref: 789 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.415807:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.415809:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c0e2400/0x8a60d30f571eb5dd lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd4e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129b0c expref: 788 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.415809:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.415810:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1721880422.415813:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914756 00010000:00010000:2.0:1721880422.415813:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727cbd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.415818:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+788:2005:x1805522257771904:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.415820:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727cbd5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd4a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.415826:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.415830:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131be2f40/0x8a60d30f571eb4e1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd4b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129a09 expref: 788 pid: 16112 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.415832:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e4a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+788:2007:x1805522257772160:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 110us (238us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.415839:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131be2f40/0x8a60d30f571eb4e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd4b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129a09 expref: 788 pid: 16112 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.415839:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914754 00000100:00100000:2.0:1721880422.415845:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914757 00010000:00010000:1.0:1721880422.415851:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131be2f40/0x8a60d30f571eb4e1 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd4b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129a09 expref: 787 pid: 16112 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.415851:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801348c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+787:2004:x1805522257772416:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.415858:0:15473:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.415864:0:15473:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c0e2400/0x8a60d30f571eb5dd lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd4e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129b0c expref: 786 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.415866:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.415868:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.415871:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727cbce lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.415878:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727cbce lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.415878:0:15473:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c0e2400/0x8a60d30f571eb5dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd4e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129b0c expref: 786 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.415888:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.415890:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.415893:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.415893:0:15473:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727cbea lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd4e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.415896:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c0e2400/0x8a60d30f571eb5dd lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd4e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129b0c expref: 786 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.415900:0:15473:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727cbea lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd4e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.415903:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e4a9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011822592:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.415910:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+785:2005:x1805522257771904:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 91us (143us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.415911:0:15473:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.415913:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727cbea lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.415917:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727cbea lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.415917:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914756 00000100:00100000:3.0:1721880422.415926:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135303480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011822720:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.415936:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727cbf1 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.415937:0:9458:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727cbdc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.415939:0:15473:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801348c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+784:2004:x1805522257772416:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 87us (217us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.415945:0:9458:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727cbdc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.415946:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914757 00010000:00010000:1.0:1721880422.415952:0:9458:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727cbdc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.415959:0:9458:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727cbdc lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.415965:0:9458:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727cbdc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.415975:0:9458:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325d200 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.415978:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727cbea lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.415978:0:9458:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727cbdc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.415983:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727cbea lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.415984:0:9458:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727cbdc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.415988:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727cbea lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.415991:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727cbea lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.415994:0:9458:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727cbdc lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.415995:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325ed00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.415996:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727cbea lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.416001:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727cbea lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.416001:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325d200/0x8a60d30f5727cbdc lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.416067:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727cbea lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.416072:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727cbea lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.416113:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.416131:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e195850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+783:2004:x1805522257772032:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 370us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.416138:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914755 00000100:00100000:1.0:1721880422.416140:0:9458:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094663100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2474:3686:x1805522011821568:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1382us (1433us total) trans 4296020533 rc 0/0 00000100:00100000:1.0:1721880422.416148:0:9458:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632563 00000100:00100000:0.0:1721880422.416178:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135300000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2473:3689:x1805522011822336:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1204us (1235us total) trans 4296020534 rc 0/0 00000004:00080000:1.0:1721880422.416178:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880087925500/2, rc 0, transno 1053237 00010000:00010000:2.0:1721880422.416184:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727cbce lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.416185:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632565 00000100:00100000:1.0:1721880422.416185:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880087925500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011821568:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.416192:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727cbce lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.416200:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727cbce lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.416208:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727cbce lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.416210:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727cbd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.416215:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e898000/2, rc 0, transno 1053238 00010000:00010000:0.0:1721880422.416216:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727cbd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.416217:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727cbce lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.416222:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727cbd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.416222:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011822336:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.416223:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8000 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.416227:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727cbd5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.416227:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727cbce lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.416233:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727cbd5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.416234:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727cbce lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.416241:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325e880 already unused, calling callback (ffffffffa084e330) 00000100:00100000:1.0:1721880422.416241:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.416243:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727cbce lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.416244:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727cbd5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.416249:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727cbd5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.416249:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727cbce lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.416250:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011823360:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.416257:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727cbd5 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.416257:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257772288 00000100:00100000:1.0:1721880422.416260:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257772288 00010000:00010000:0.0:1721880422.416263:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727cbd5 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.416271:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.416272:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800842c2400/0x8a60d30f571eb597 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129ac6 expref: 783 pid: 16112 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.416288:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914758 00000100:00100000:1.0:1721880422.416292:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+783:2005:x1805522257772288:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.416301:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.416305:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800842c2400/0x8a60d30f571eb597 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd4d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129ac6 expref: 783 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.416314:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800842c2400/0x8a60d30f571eb597 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd4d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129ac6 expref: 783 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.416326:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800842c2400/0x8a60d30f571eb597 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd4d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129ac6 expref: 783 pid: 16112 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.416337:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.416339:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.416341:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727cbe3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.416349:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727cbe3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd4d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.416350:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.416363:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.416365:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257772544 00000100:00100000:2.0:1721880422.416368:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257772544 00000100:00100000:0.0:1721880422.416375:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2474:3688:x1805522011821184:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1917us (1984us total) trans 4296020536 rc 0/0 00010000:00010000:2.0:1721880422.416379:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013579a880/0x8a60d30f571eb63f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129b6e expref: 783 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.416381:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632561 00000100:00100000:1.0:1721880422.416383:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+783:2005:x1805522257772288:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 89us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.416391:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914758 00000100:00100000:0.0:1721880422.416393:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011823360 00000100:00100000:3.0:1721880422.416393:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2473:3687:x1805522011821312:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1794us (1975us total) trans 4296020535 rc 0/0 00000100:00100000:0.0:1721880422.416396:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011823360 00000100:00100000:2.0:1721880422.416399:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914759 00000100:00100000:3.0:1721880422.416399:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632562 00000100:00100000:2.0:1721880422.416404:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800878d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+782:2004:x1805522257772544:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.416411:0:15473:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1721880422.416412:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632569 00000100:00100000:1.0:1721880422.416413:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135303480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011823488:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.416415:0:15473:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013579a880/0x8a60d30f571eb63f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd4f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129b6e expref: 782 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.416416:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2473:3689:x1805522011823360:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.416423:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727cbe3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.416425:0:15473:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013579a880/0x8a60d30f571eb63f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd4f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129b6e expref: 782 pid: 16099 timeout: 887 lvb_type: 0 00002000:00080000:0.0:1721880422.416427:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64850 count 1 00000100:00100000:1.0:1721880422.416433:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.416434:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727cbe3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.416437:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727cc06 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd52:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.416438:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013579a880/0x8a60d30f571eb63f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd4f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129b6e expref: 782 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.416441:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727cbe3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.416447:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bc1a1c0/0x8a60d30f571eb718 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129c47 expref: 781 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.416448:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727cbe3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.416451:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.416452:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.416454:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727cbe3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.416455:0:15473:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727cbf1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.416458:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.416459:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.416459:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aaa880 already unused, calling callback (ffffffffa084e330) 00000004:00080000:1.0:1721880422.416460:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008fc51500/2, rc 0, transno 1053239 00010000:00010000:0.0:1721880422.416462:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727cc06 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.416462:0:15473:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727cbf1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd4f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.416462:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727cbe3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.416468:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727cbe3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.416476:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011821312:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.416478:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bc1a1c0/0x8a60d30f571eb718 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129c47 expref: 781 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.416478:0:15473:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.416480:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727cbe3 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.416486:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aaa880/0x8a60d30f5727cbe3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.416487:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bc1a1c0/0x8a60d30f571eb718 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129c47 expref: 781 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.416496:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011823616:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.416496:0:15473:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800878d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+781:2004:x1805522257772544:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 91us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.416502:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914759 00000100:00100000:0.0:1721880422.416516:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.416528:0:9458:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011823488 00000100:00100000:0.0:1721880422.416530:0:9458:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011823488 00000004:00080000:2.0:1721880422.416533:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008fc51c00/2, rc 0, transno 1053240 00000100:00100000:2.0:1721880422.416541:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011821184:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.416545:0:9458:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632570 00000100:00100000:0.0:1721880422.416549:0:9458:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2474:3686:x1805522011823488:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.416575:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011823872:0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.416580:0:9458:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64851 count 1 00010000:00010000:0.0:1721880422.416588:0:9458:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727cc0d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd53:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.416596:0:9458:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134a68b40/0x8a60d30f571eb7dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129d0b expref: 780 pid: 16112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.416600:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.416600:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.416600:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.416602:0:9458:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727cc0d lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.416613:0:9458:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134a68b40/0x8a60d30f571eb7dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129d0b expref: 780 pid: 16112 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.416618:0:9458:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134a68b40/0x8a60d30f571eb7dc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129d0b expref: 780 pid: 16112 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.416622:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011823872 00000100:00100000:0.0:1721880422.416623:0:9458:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011824000:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.416625:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011823872 00000100:00100000:3.0:1721880422.416633:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800878d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2476:3688:x1805522011821824:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1777us (1811us total) trans 4296020537 rc 0/0 00000100:00100000:0.0:1721880422.416638:0:9458:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e840 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.416640:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632564 00000100:00100000:2.0:1721880422.416644:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632571 00000100:00100000:1.0:1721880422.416647:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.416649:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800878d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2475:3688:x1805522011823872:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.416666:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135302d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011823232:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.416669:0:16188:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257772800 00000100:00100000:2.0:1721880422.416672:0:16188:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257772800 00000100:00100000:1.0:1721880422.416674:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1721880422.416678:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727cbff lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.416682:0:16188:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c6473c0/0x8a60d30f571eb6d2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129c01 expref: 781 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.416683:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011823744:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.416697:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727cbf1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.416698:0:16188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914760 00000100:00100000:2.0:1721880422.416702:0:16188:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+781:2006:x1805522257772800:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.416704:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727cbf1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.416707:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.416709:0:16188:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.416710:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727cbf1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.416713:0:16188:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c6473c0/0x8a60d30f571eb6d2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129c01 expref: 781 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.416718:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727cbf1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.416722:0:16188:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c6473c0/0x8a60d30f571eb6d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129c01 expref: 781 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.416724:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727cbf1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.416748:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa86c0 already unused, calling callback (ffffffffa084e330) 00000100:00100000:1.0:1721880422.416750:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011823744 00010000:00010000:3.0:1721880422.416751:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727cbf1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.416754:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011823744 00010000:00010000:3.0:1721880422.416757:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727cbf1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.416758:0:16188:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c6473c0/0x8a60d30f571eb6d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd51:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129c01 expref: 781 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.416769:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.416770:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1721880422.416772:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632572 00010000:00010000:3.0:1721880422.416772:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727cbf1 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.416773:0:16188:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727cbff lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.416777:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2476:3686:x1805522011823744:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.416778:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa86c0/0x8a60d30f5727cbf1 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.416785:0:16188:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727cbff lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd51:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.416789:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64852 count 1 00010000:00010000:1.0:1721880422.416801:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727cc14 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd54:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.416809:0:16188:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.416811:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0dd8b40/0x8a60d30f571eb83e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129d6d expref: 780 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.416814:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727cbff lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.416817:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.416818:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.416821:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727cc14 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.416822:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727cbff lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.416828:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727cbff lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.416831:0:16188:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+780:2006:x1805522257772800:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 127us (184us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.416835:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727cbff lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.416838:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0dd8b40/0x8a60d30f571eb83e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129d6d expref: 780 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.416838:0:16188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914760 00010000:00010000:3.0:1721880422.416841:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727cbff lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.416847:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aaaf40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.416848:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0dd8b40/0x8a60d30f571eb83e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129d6d expref: 779 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.416849:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727cbff lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.416856:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727cbff lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.416857:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a03c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011824128:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.416865:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727cbff lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.416869:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880087924a80/2, rc 0, transno 1053241 00010000:00010000:3.0:1721880422.416871:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aaaf40/0x8a60d30f5727cbff lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.416877:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880087924a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011821824:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.416878:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb240 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.416902:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1721880422.416904:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.416909:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011824256:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.416921:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257772672 00000100:00100000:2.0:1721880422.416924:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257772672 00010000:00010000:2.0:1721880422.416935:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092ba6d00/0x8a60d30f571eb68c lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd50:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129bbb expref: 780 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.416950:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914761 00000100:00100000:2.0:1721880422.416954:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+780:2004:x1805522257772672:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.416961:0:15473:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.416964:0:15473:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092ba6d00/0x8a60d30f571eb68c lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd50:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129bbb expref: 780 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.416967:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135301f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2477:3689:x1805522011823104:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1420us (1445us total) trans 4296020538 rc 0/0 00010000:00010000:2.0:1721880422.416973:0:15473:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092ba6d00/0x8a60d30f571eb68c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd50:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129bbb expref: 780 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.416974:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632568 00010000:00010000:2.0:1721880422.416991:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.416992:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.416995:0:15473:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727cbf8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd50:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.417001:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092ba6d00/0x8a60d30f571eb68c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd50:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129bbb expref: 780 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.417002:0:15473:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727cbf8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd50:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.417029:0:15473:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.417029:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135303800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011822976:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.417040:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727cbf8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.417046:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727cbf8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.417050:0:15473:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880085a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+779:2004:x1805522257772672:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 94us (145us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.417052:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727cbf8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.417057:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914761 00010000:00010000:3.0:1721880422.417059:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727cbf8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.417070:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727cbf8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.417076:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727cbf8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.417081:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8480 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.417084:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727cbf8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.417089:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.417090:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727cbf8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.417098:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727cbf8 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.417103:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011824256 00010000:00010000:3.0:1721880422.417104:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8480/0x8a60d30f5727cbf8 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.417106:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011824256 00000004:00080000:2.0:1721880422.417122:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e4aad80/2, rc 0, transno 1053242 00000100:00100000:0.0:1721880422.417124:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632573 00000100:00100000:0.0:1721880422.417127:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087924000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2477:3688:x1805522011824256:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.417128:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e4aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011823104:0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.417136:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64854 count 1 00000100:00100000:1.0:1721880422.417166:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880087925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011824384:0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.417172:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64853 count 1 00010000:00010000:2.0:1721880422.417184:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727cc1b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd55:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.417190:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727cc22 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd56:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.417191:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.417195:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009204b180/0x8a60d30f571eb884 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129db3 expref: 778 pid: 16098 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.417199:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099fdc240/0x8a60d30f571eb8c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129df2 expref: 778 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.417201:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.417203:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.417205:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.417206:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.417206:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727cc1b lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.417208:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727cc22 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.417212:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2478:3686:x1805522011822848:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1944us (1973us total) trans 4296020539 rc 0/0 00000004:00080000:1.0:1721880422.417214:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e89a680/2, rc 0, transno 1053243 00000100:00100000:3.0:1721880422.417218:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632567 00000100:00100000:1.0:1721880422.417229:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e89a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011822848:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.417229:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011824384 00010000:00010000:0.0:1721880422.417231:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099fdc240/0x8a60d30f571eb8c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129df2 expref: 778 pid: 16126 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.417232:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011824384 00010000:00010000:0.0:1721880422.417241:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099fdc240/0x8a60d30f571eb8c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129df2 expref: 778 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.417244:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632574 00000100:00100000:3.0:1721880422.417249:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123b6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2478:3686:x1805522011824384:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.417250:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011824512:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.417254:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1721880422.417255:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009204b180/0x8a60d30f571eb884 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129db3 expref: 778 pid: 16098 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.417259:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880087925f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011824640:0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.417260:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64855 count 1 00010000:00010000:2.0:1721880422.417265:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009204b180/0x8a60d30f571eb884 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129db3 expref: 778 pid: 16098 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.417269:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727cc29 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd57:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.417273:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.417274:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800929ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011824768:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.417280:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa03180/0x8a60d30f571eb910 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129e3f expref: 778 pid: 16040 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.417282:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011824640 00000100:00100000:1.0:1721880422.417284:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011824640 00010000:00010000:3.0:1721880422.417286:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.417287:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.417289:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727cc29 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.417297:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632575 00000100:00100000:2.0:1721880422.417297:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfded80 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.417299:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123b6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2479:3686:x1805522011824640:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.417305:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa03180/0x8a60d30f571eb910 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129e3f expref: 778 pid: 16040 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.417307:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64856 count 1 00010000:00010000:3.0:1721880422.417314:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa03180/0x8a60d30f571eb910 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129e3f expref: 778 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.417315:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727cc30 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd58:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.417320:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e780 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.417322:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095035f80/0x8a60d30f571eb948 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129e77 expref: 778 pid: 16019 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.417324:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088680380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011824896:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.417325:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.417326:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.417328:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727cc30 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.417338:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095035f80/0x8a60d30f571eb948 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129e77 expref: 778 pid: 16019 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.417343:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095035f80/0x8a60d30f571eb948 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129e77 expref: 778 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.417353:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880123b6ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011825024:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.417393:0:9458:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011824000:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.417401:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03d80 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.417403:0:9458:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727cc0d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.417411:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eba80 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.417424:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011823616:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.417430:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727cc06 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.417446:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.417458:0:16188:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257772928 00000100:00100000:2.0:1721880422.417461:0:16188:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257772928 00010000:00010000:2.0:1721880422.417472:0:16188:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134a68b40/0x8a60d30f571eb7dc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129d0b expref: 779 pid: 16112 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.417484:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d2ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2480:3686:x1805522011822464:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2388us (2417us total) trans 4296020540 rc 0/0 00000100:00100000:2.0:1721880422.417488:0:16188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914762 00000100:00100000:3.0:1721880422.417490:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632566 00000100:00100000:2.0:1721880422.417493:0:16188:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129d20850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+779:2005:x1805522257772928:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000004:00080000:1.0:1721880422.417498:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e899180/2, rc 0, transno 1053244 00010000:00010000:2.0:1721880422.417499:0:16188:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.417503:0:16188:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134a68b40/0x8a60d30f571eb7dc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129d0b expref: 779 pid: 16112 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.417505:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e899180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011822464:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.417512:0:16188:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134a68b40/0x8a60d30f571eb7dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129d0b expref: 779 pid: 16112 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.417518:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.417523:0:16188:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134a68b40/0x8a60d30f571eb7dc lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd53:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129d0b expref: 779 pid: 16112 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.417535:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257773056 00000100:00100000:1.0:1721880422.417538:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257773056 00010000:00010000:2.0:1721880422.417538:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.417539:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.417542:0:16188:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727cc0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.417547:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bc1a1c0/0x8a60d30f571eb718 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129c47 expref: 779 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.417549:0:16188:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727cc0d lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd53:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.417554:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.417564:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257773184 00000100:00100000:1.0:1721880422.417567:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257773184 00010000:00010000:2.0:1721880422.417571:0:16188:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.417573:0:9458:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727cc0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.417578:0:9458:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727cc0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.417579:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914763 00000100:00100000:1.0:1721880422.417583:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085a4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+780:2007:x1805522257773056:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.417586:0:9458:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727cc0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.417589:0:16188:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880129d20850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+780:2005:x1805522257772928:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 95us (144us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.417590:0:9458:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727cc0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.417590:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.417594:0:9458:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727cc0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.417595:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bc1a1c0/0x8a60d30f571eb718 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129c47 expref: 780 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.417596:0:16188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914762 00010000:00010000:0.0:1721880422.417597:0:9458:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325cb40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.417599:0:9458:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727cc0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.417603:0:9458:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727cc0d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.417604:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bc1a1c0/0x8a60d30f571eb718 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129c47 expref: 779 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.417610:0:9458:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727cc0d lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.417614:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727cc0d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.417617:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bc1a1c0/0x8a60d30f571eb718 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd52:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129c47 expref: 779 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.417629:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.417631:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.417634:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727cc06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.417640:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727cc06 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd52:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.417641:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1721880422.417649:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880123b6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011825152:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.417656:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.417674:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.417677:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880085a4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+778:2007:x1805522257773056:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 93us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.417683:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914763 00000100:00100000:3.0:1721880422.417692:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011825152 00000100:00100000:3.0:1721880422.417696:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011825152 00000100:00100000:0.0:1721880422.417700:0:9458:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2481:3686:x1805522011823488:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1150us (1267us total) trans 4296020541 rc 0/0 00000100:00100000:0.0:1721880422.417705:0:9458:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632570 00010000:00010000:1.0:1721880422.417709:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0dd8b40/0x8a60d30f571eb83e lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129d6d expref: 777 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.417712:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632576 00000100:00100000:3.0:1721880422.417717:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2480:3689:x1805522011825152:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.417719:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914764 00000100:00100000:1.0:1721880422.417722:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+777:2005:x1805522257773184:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.417744:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.417747:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0dd8b40/0x8a60d30f571eb83e lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129d6d expref: 777 pid: 16130 timeout: 887 lvb_type: 0 00002000:00080000:3.0:1721880422.417749:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64857 count 1 00010000:00010000:1.0:1721880422.417752:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0dd8b40/0x8a60d30f571eb83e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129d6d expref: 777 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.417759:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.417760:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.417760:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727cc37 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd59:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.417762:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727cc14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.417769:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727cc14 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd54:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.417771:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801354858c0/0x8a60d30f571eb99c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129ecb expref: 777 pid: 16019 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.417777:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.417777:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.417778:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.417781:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727cc06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.417781:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727cc37 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.417787:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727cc06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.417792:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727cc06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.417793:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880085a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+777:2005:x1805522257773184:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 69us (238us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.417795:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727cc06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.417796:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801354858c0/0x8a60d30f571eb99c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129ecb expref: 777 pid: 16019 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.417799:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727cc06 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.417799:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914764 00010000:00010000:0.0:1721880422.417802:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325c480 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.417803:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727cc06 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.417805:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801354858c0/0x8a60d30f571eb99c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129ecb expref: 777 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.417807:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727cc06 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.417813:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727cc06 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.417814:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088680000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011825280:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.417817:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727cc06 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.417826:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880135303480/2, rc 0, transno 1053245 00000100:00100000:1.0:1721880422.417833:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135303480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011823488:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.417834:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03540 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.417863:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880123b69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011825408:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.417881:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0dd8b40/0x8a60d30f571eb83e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd54:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129d6d expref: 776 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.417884:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800929ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011824768:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.417887:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.417888:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a03c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011824128:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.417895:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727cc1b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.417898:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727cc14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.417901:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2481:3689:x1805522011823360:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1484us (1629us total) trans 4296020542 rc 0/0 00010000:00010000:1.0:1721880422.417903:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727cc14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.417907:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727cc14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.417911:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727cc14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.417911:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a07b6a00/2, rc 0, transno 1053246 00010000:00010000:1.0:1721880422.417918:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727cc14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.417924:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727cc14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.417926:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a07b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011823360:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.417927:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b6f40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.417929:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727cc14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.417933:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727cc14 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.417940:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727cc14 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.417942:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011825408 00010000:00010000:1.0:1721880422.417944:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6f40/0x8a60d30f5727cc14 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.417945:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011825408 00000100:00100000:1.0:1721880422.417973:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880123b68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011825536:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.417980:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632569 00000100:00100000:1.0:1721880422.417990:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.417995:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011825536 00000100:00100000:0.0:1721880422.417998:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011825536 00000100:00100000:3.0:1721880422.418001:0:9458:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632577 00000100:00100000:3.0:1721880422.418006:0:9458:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088683480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2482:3689:x1805522011825408:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.418033:0:9458:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64858 count 1 00000100:00100000:1.0:1721880422.418040:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632578 00010000:00010000:3.0:1721880422.418043:0:9458:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727cc3e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd5a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.418045:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2482:3686:x1805522011825536:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.418051:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.418054:0:9458:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094210900/0x8a60d30f571eb9cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129efc expref: 775 pid: 16126 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.418057:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64859 count 1 00010000:00010000:3.0:1721880422.418061:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.418062:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.418064:0:9458:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727cc3e lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.418065:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257773312 00010000:00010000:1.0:1721880422.418066:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727cc45 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd5b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.418068:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257773312 00010000:00010000:1.0:1721880422.418077:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a35f840/0x8a60d30f571eba28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129f57 expref: 776 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.418078:0:9458:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094210900/0x8a60d30f571eb9cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129efc expref: 776 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.418083:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.418084:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.418084:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009204b180/0x8a60d30f571eb884 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129db3 expref: 776 pid: 16098 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.418084:0:9458:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094210900/0x8a60d30f571eb9cd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129efc expref: 776 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.418087:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727cc45 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.418090:0:9458:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088683800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011825664:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.418094:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011824512:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.418101:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914765 00010000:00010000:1.0:1721880422.418104:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a35f840/0x8a60d30f571eba28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129f57 expref: 776 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.418107:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727cc22 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.418107:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+776:2005:x1805522257773312:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.418107:0:9458:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03480 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.418110:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a35f840/0x8a60d30f571eba28 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129f57 expref: 776 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.418114:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.418117:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880095d6ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011825792:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.418118:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009204b180/0x8a60d30f571eb884 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd55:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129db3 expref: 776 pid: 16098 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.418127:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009204b180/0x8a60d30f571eb884 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd55:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129db3 expref: 776 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.418127:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088680380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011824896:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.418133:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb240 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.418136:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727cc29 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.418139:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009204b180/0x8a60d30f571eb884 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd55:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129db3 expref: 776 pid: 16098 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.418148:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880123b6ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011825024:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.418149:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.418151:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.418153:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727cc1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.418159:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727cc30 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.418161:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727cc1b lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd55:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.418174:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.418183:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727cc1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.418191:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+775:2005:x1805522257773312:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 84us (140us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.418192:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727cc1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.418196:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.418196:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727cc1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.418197:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914765 00010000:00010000:3.0:1721880422.418200:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727cc1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.418203:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727cc1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.418207:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352d00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.418208:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727cc1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.418212:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727cc1b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.418218:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727cc1b lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.418221:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136352d00/0x8a60d30f5727cc1b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.418246:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257773440 00000100:00100000:1.0:1721880422.418249:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257773440 00010000:00010000:1.0:1721880422.418258:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099fdc240/0x8a60d30f571eb8c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129df2 expref: 775 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.418271:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914766 00000100:00100000:2.0:1721880422.418273:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.418274:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085a4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+775:2005:x1805522257773440:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.418279:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.418281:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099fdc240/0x8a60d30f571eb8c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129df2 expref: 775 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.418285:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257773568 00010000:00010000:1.0:1721880422.418286:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099fdc240/0x8a60d30f571eb8c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129df2 expref: 775 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.418288:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257773568 00010000:00010000:1.0:1721880422.418294:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099fdc240/0x8a60d30f571eb8c3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd56:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129df2 expref: 776 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.418299:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa03180/0x8a60d30f571eb910 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129e3f expref: 775 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.418301:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1721880422.418302:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.418302:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.418304:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727cc22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.418305:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800878d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2484:3688:x1805522011823872:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1655us (1704us total) trans 4296020544 rc 0/0 00010000:00010000:1.0:1721880422.418308:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727cc22 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd56:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.418310:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632571 00010000:00010000:1.0:1721880422.418317:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.418325:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257773696 00000100:00100000:2.0:1721880422.418328:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257773696 00000004:00080000:3.0:1721880422.418329:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800878d9500/2, rc 0, transno 1053248 00000100:00100000:1.0:1721880422.418330:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880085a4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+776:2005:x1805522257773440:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 56us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.418334:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914766 00000100:00100000:3.0:1721880422.418334:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011823872:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.418337:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095035f80/0x8a60d30f571eb948 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129e77 expref: 776 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.418344:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914767 00000100:00100000:1.0:1721880422.418347:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+775:2005:x1805522257773568:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.418351:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.418353:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1721880422.418354:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa03180/0x8a60d30f571eb910 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129e3f expref: 775 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.418358:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011825920:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.418360:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa03180/0x8a60d30f571eb910 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129e3f expref: 775 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.418364:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914768 00010000:00010000:1.0:1721880422.418367:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa03180/0x8a60d30f571eb910 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd57:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129e3f expref: 775 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.418369:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085a4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+775:2006:x1805522257773696:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.418369:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.418375:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.418376:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.418376:0:15473:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.418377:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727cc29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.418379:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011825920 00010000:00010000:2.0:1721880422.418380:0:15473:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095035f80/0x8a60d30f571eb948 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129e77 expref: 774 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.418381:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727cc29 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd57:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.418381:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011825920 00010000:00010000:1.0:1721880422.418388:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.418389:0:15473:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095035f80/0x8a60d30f571eb948 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129e77 expref: 774 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.418391:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632579 00010000:00010000:0.0:1721880422.418394:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727cc22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.418394:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084ee0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2484:3686:x1805522011825920:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.418397:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+774:2005:x1805522257773568:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 49us (125us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.418399:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727cc22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.418400:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914767 00010000:00010000:2.0:1721880422.418401:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095035f80/0x8a60d30f571eb948 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd58:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129e77 expref: 774 pid: 16019 timeout: 887 lvb_type: 0 00002000:00080000:3.0:1721880422.418401:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64860 count 1 00010000:00010000:0.0:1721880422.418404:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727cc22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.418408:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727cc22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.418408:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727cc4c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd5c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.418412:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727cc22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.418412:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.418413:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.418415:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007b97e880/0x8a60d30f571eba6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129f9d expref: 772 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.418416:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325f3c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.418416:0:15473:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727cc30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.418418:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727cc22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.418419:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.418420:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.418422:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727cc4c lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.418423:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727cc22 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.418423:0:15473:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727cc30 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd58:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.418430:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727cc22 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.418431:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007b97e880/0x8a60d30f571eba6e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129f9d expref: 772 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.418433:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727cc22 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.418436:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007b97e880/0x8a60d30f571eba6e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129f9d expref: 772 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.418437:0:15473:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.418445:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800911a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011826048:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.418455:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2484:3686:x1805522011823744:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1678us (1749us total) trans 4296020543 rc 0/0 00000100:00100000:2.0:1721880422.418456:0:15473:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880085a4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+772:2006:x1805522257773696:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 87us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.418459:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632572 00000100:00100000:3.0:1721880422.418459:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03d80 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.418464:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914768 00010000:00010000:3.0:1721880422.418469:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727cc29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.418472:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727cc30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.418473:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727cc29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.418477:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727cc30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.418478:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727cc29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.418481:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727cc29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.418482:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727cc30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.418485:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727cc29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.418486:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727cc30 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.418488:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa9d40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.418489:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727cc30 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.418490:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727cc29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.418493:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b5b00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.418494:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727cc30 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.418494:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727cc29 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.418498:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727cc30 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.418499:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727cc29 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.418503:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727cc30 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.418504:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727cc29 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.418507:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5b00/0x8a60d30f5727cc30 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.418519:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087924000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2484:3688:x1805522011824256:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1390us (1430us total) trans 4296020545 rc 0/0 00000100:00100000:0.0:1721880422.418524:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632573 00000004:00080000:2.0:1721880422.418536:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800878da300/2, rc 0, transno 1053249 00000100:00100000:2.0:1721880422.418553:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011824256:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.418573:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.418574:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1721880422.418579:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880123b6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011826176:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.418583:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257773824 00000100:00100000:0.0:1721880422.418586:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257773824 00000100:00100000:1.0:1721880422.418586:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880123b6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2485:3686:x1805522011824640:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1285us (1311us total) trans 4296020547 rc 0/0 00000100:00100000:1.0:1721880422.418590:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632575 00000100:00100000:3.0:1721880422.418592:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.418596:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801354858c0/0x8a60d30f571eb99c lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129ecb expref: 772 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.418600:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011826176 00000100:00100000:1.0:1721880422.418602:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011826176 00000100:00100000:1.0:1721880422.418612:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632580 00000100:00100000:3.0:1721880422.418613:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088680000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011825280:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.418614:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123b6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2485:3689:x1805522011826176:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.418621:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727cc37 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd59:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.418622:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64861 count 1 00010000:00010000:1.0:1721880422.418628:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727cc53 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd5d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.418635:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092023600/0x8a60d30f571ebac2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129fea expref: 772 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.418639:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.418640:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.418641:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727cc53 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.418651:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092023600/0x8a60d30f571ebac2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129fea expref: 772 pid: 16126 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.418656:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914769 00010000:00010000:1.0:1721880422.418656:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092023600/0x8a60d30f571ebac2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129fea expref: 772 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.418658:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880123b6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2485:3686:x1805522011824384:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1409us (1467us total) trans 4296020546 rc 0/0 00000100:00100000:0.0:1721880422.418660:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e197850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+772:2004:x1805522257773824:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.418662:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880095d6d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011826304:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.418663:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632574 00010000:00010000:0.0:1721880422.418666:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.418670:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801354858c0/0x8a60d30f571eb99c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd59:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129ecb expref: 772 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.418681:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eba80 going to sleep for 11 seconds 00000004:00080000:1.0:1721880422.418696:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880087925f80/2, rc 0, transno 1053251 00000100:00100000:1.0:1721880422.418700:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880087925f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011824640:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1721880422.418705:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880087925c00/2, rc 0, transno 1053250 00000100:00100000:1.0:1721880422.418707:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880087925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011824384:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.418711:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801354858c0/0x8a60d30f571eb99c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd59:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129ecb expref: 772 pid: 16019 timeout: 887 lvb_type: 0 00000004:00080000:1.0:1721880422.418712:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088683b80/2, rc 0, transno 1053247 00000100:00100000:1.0:1721880422.418714:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011823744:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.418721:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801354858c0/0x8a60d30f571eb99c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd59:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129ecb expref: 772 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.418742:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008599d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011826560:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.418744:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1721880422.418746:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.418748:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.418750:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727cc37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.418754:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011826432:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.418755:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727cc37 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd59:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.418755:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.418764:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.418777:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e197850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+771:2004:x1805522257773824:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 117us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.418777:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.418781:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914769 00000100:00100000:0.0:1721880422.418807:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011826560 00000100:00100000:0.0:1721880422.418810:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011826560 00000100:00100000:0.0:1721880422.418818:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632581 00000100:00100000:0.0:1721880422.418821:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2485:3686:x1805522011826560:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.418830:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64863 count 1 00000100:00100000:3.0:1721880422.418832:0:9458:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088683800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011825664:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.418836:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727cc5a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd5f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.418840:0:9458:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727cc3e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.418844:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800973421c0/0x8a60d30f571ebb4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a07d expref: 770 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.418849:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076e08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011826688:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.418851:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.418852:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.418854:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727cc5a lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.418859:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727cc37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.418863:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800973421c0/0x8a60d30f571ebb4e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a07d expref: 770 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.418863:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727cc37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.418864:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.418868:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.418868:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727cc37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.418869:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800973421c0/0x8a60d30f571ebb4e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a07d expref: 770 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.418872:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727cc37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.418875:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011826816:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.418876:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727cc37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.418879:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aaaac0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.418880:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727cc37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.418884:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727cc37 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.418888:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880095d6ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011825792:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.418889:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727cc37 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.418892:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e780 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.418893:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727cc37 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.418898:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.418899:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727cc45 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.418905:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011826432 00000100:00100000:0.0:1721880422.418907:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011826432 00000100:00100000:3.0:1721880422.418907:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011826688 00000100:00100000:3.0:1721880422.418909:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011826688 00000100:00100000:2.0:1721880422.418911:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257774080 00000100:00100000:2.0:1721880422.418914:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257774080 00000100:00100000:3.0:1721880422.418922:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632582 00000100:00100000:1.0:1721880422.418926:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632583 00010000:00010000:2.0:1721880422.418926:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a35f840/0x8a60d30f571eba28 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129f57 expref: 771 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.418926:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801348c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2487:3688:x1805522011826432:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.418928:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2487:3687:x1805522011826688:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.418934:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64862 count 1 00002000:00080000:1.0:1721880422.418937:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64864 count 1 00010000:00010000:3.0:1721880422.418940:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727cc61 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd5e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.418942:0:16188:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257773952 00010000:00010000:1.0:1721880422.418944:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727cc68 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd60:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.418944:0:16188:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257773952 00010000:00010000:1.0:1721880422.418950:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094319200/0x8a60d30f571ebb9b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a0ca expref: 772 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.418950:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094319b00/0x8a60d30f571ebb01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a030 expref: 772 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.418952:0:16188:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094210900/0x8a60d30f571eb9cd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129efc expref: 772 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.418954:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.418954:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.418954:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.418955:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.418956:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727cc68 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.418956:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727cc61 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.418964:0:16188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914770 00010000:00010000:1.0:1721880422.418966:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094319200/0x8a60d30f571ebb9b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a0ca expref: 772 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.418967:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094319b00/0x8a60d30f571ebb01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a030 expref: 772 pid: 16119 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.418968:0:16188:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+772:2004:x1805522257774080:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.418972:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094319b00/0x8a60d30f571ebb01 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a030 expref: 772 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.418974:0:16188:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.418975:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094319200/0x8a60d30f571ebb9b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a0ca expref: 772 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.418978:0:16188:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a35f840/0x8a60d30f571eba28 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd5b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129f57 expref: 772 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.418978:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088683800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011827072:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.418981:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880095d6ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011826944:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.418987:0:16188:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a35f840/0x8a60d30f571eba28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd5b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129f57 expref: 772 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.418993:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03480 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.418999:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb240 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.418999:0:16188:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a35f840/0x8a60d30f571eba28 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd5b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129f57 expref: 772 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.419008:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.419026:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.419029:0:16188:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727cc45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.419036:0:16188:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727cc45 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd5b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.419051:0:16188:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.419056:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727cc45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.419061:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727cc45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.419065:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727cc45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.419067:0:16188:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+771:2004:x1805522257774080:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 98us (199us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.419069:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727cc45 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.419072:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727cc45 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.419073:0:16188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914770 00010000:00010000:1.0:1721880422.419076:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4900 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.419077:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727cc45 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.419081:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727cc45 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.419082:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2488:3689:x1805522011825152:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1365us (1407us total) trans 4296020548 rc 0/0 00000100:00100000:2.0:1721880422.419084:0:16188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914771 00000100:00100000:3.0:1721880422.419087:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632576 00010000:00010000:1.0:1721880422.419088:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727cc45 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.419089:0:16188:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+770:2005:x1805522257773952:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.419091:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4900/0x8a60d30f5727cc45 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.419096:0:16188:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.419100:0:16188:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094210900/0x8a60d30f571eb9cd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd5a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129efc expref: 770 pid: 16126 timeout: 887 lvb_type: 0 00000004:00080000:3.0:1721880422.419103:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880123b6a300/2, rc 0, transno 1053252 00000100:00100000:3.0:1721880422.419107:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880123b6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011825152:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.419110:0:16188:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094210900/0x8a60d30f571eb9cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd5a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129efc expref: 770 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.419121:0:16188:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094210900/0x8a60d30f571eb9cd lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd5a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129efc expref: 770 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.419123:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1721880422.419127:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880123910700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011827200:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.419131:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.419132:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.419135:0:16188:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727cc3e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.419139:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.419141:0:16188:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727cc3e lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd5a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.419157:0:16188:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.419160:0:9458:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727cc3e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.419165:0:9458:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727cc3e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.419169:0:9458:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727cc3e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.419170:0:16188:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+769:2005:x1805522257773952:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 81us (272us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.419173:0:9458:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727cc3e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.419175:0:16188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914771 00000100:00100000:1.0:1721880422.419177:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2488:3686:x1805522011825536:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1132us (1186us total) trans 4296020549 rc 0/0 00010000:00010000:3.0:1721880422.419177:0:9458:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727cc3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.419180:0:9458:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8fc0 already unused, calling callback (ffffffffa084e330) 00000100:00100000:0.0:1721880422.419181:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.419181:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632578 00010000:00010000:3.0:1721880422.419181:0:9458:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727cc3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.419185:0:9458:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727cc3e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.419189:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257774208 00000100:00100000:1.0:1721880422.419191:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011827200 00000100:00100000:2.0:1721880422.419191:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257774208 00010000:00010000:3.0:1721880422.419191:0:9458:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727cc3e lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.419194:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011827200 00010000:00010000:3.0:1721880422.419194:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727cc3e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.419198:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007b97e880/0x8a60d30f571eba6e lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129f9d expref: 769 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.419205:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632584 00000100:00100000:1.0:1721880422.419207:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2488:3689:x1805522011827200:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.419215:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914772 00000100:00100000:2.0:1721880422.419219:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+769:2004:x1805522257774208:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.419223:0:15473:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.419225:0:15473:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007b97e880/0x8a60d30f571eba6e lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd5c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129f9d expref: 769 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.419230:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880095d6d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011826304:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.419232:0:15473:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007b97e880/0x8a60d30f571eba6e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd5c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129f9d expref: 769 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.419240:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727cc53 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.419243:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.419244:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.419245:0:15473:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727cc4c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd5c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.419250:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880123b68a80/2, rc 0, transno 1053253 00010000:00010000:2.0:1721880422.419250:0:15473:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727cc4c lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd5c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.419256:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880123b68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011825536:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.419256:0:15473:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.419261:0:9458:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088683480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2489:3689:x1805522011825408:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1255us (1374us total) trans 4296020550 rc 0/0 00000100:00100000:2.0:1721880422.419265:0:15473:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880085a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+769:2004:x1805522257774208:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 46us (86us total) trans 0 rc 0/0 00002000:00080000:1.0:1721880422.419266:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64865 count 1 00000100:00100000:3.0:1721880422.419266:0:9458:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632577 00000100:00100000:2.0:1721880422.419269:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914772 00010000:00010000:1.0:1721880422.419272:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727cc6f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd61:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.419279:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009430cb40/0x8a60d30f571ebbd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a102 expref: 768 pid: 16039 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.419283:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880123b69880/2, rc 0, transno 1053254 00000100:00100000:3.0:1721880422.419285:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880123b69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011825408:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.419286:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.419287:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.419289:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727cc6f lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.419297:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009430cb40/0x8a60d30f571ebbd3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a102 expref: 768 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.419298:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007b97e880/0x8a60d30f571eba6e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd5c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129f9d expref: 768 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.419302:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009430cb40/0x8a60d30f571ebbd3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a102 expref: 768 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.419307:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800911a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011826048:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.419308:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880095d6d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011827328:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.419315:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727cc4c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.419318:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.419320:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727cc4c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.419323:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eba80 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.419324:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727cc4c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.419328:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727cc4c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.419330:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257774336 00010000:00010000:3.0:1721880422.419331:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727cc4c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.419332:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257774336 00010000:00010000:3.0:1721880422.419335:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727cc4c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.419338:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8d80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.419340:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727cc4c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.419341:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092023600/0x8a60d30f571ebac2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129fea expref: 768 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.419344:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727cc4c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.419350:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914773 00010000:00010000:3.0:1721880422.419350:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727cc4c lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.419353:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+768:2004:x1805522257774336:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.419353:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727cc4c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.419357:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.419359:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092023600/0x8a60d30f571ebac2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd5d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129fea expref: 768 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.419365:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092023600/0x8a60d30f571ebac2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd5d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129fea expref: 768 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.419376:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092023600/0x8a60d30f571ebac2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd5d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b129fea expref: 768 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.419383:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.419384:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.419386:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727cc53 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.419391:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727cc53 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd5d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.419400:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.419413:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727cc53 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.419414:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+767:2004:x1805522257774336:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 59us (96us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.419418:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727cc53 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.419419:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914773 00000100:00100000:3.0:1721880422.419421:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880084ee0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2489:3686:x1805522011825920:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1025us (1050us total) trans 4296020551 rc 0/0 00010000:00010000:1.0:1721880422.419422:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727cc53 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.419425:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632579 00010000:00010000:1.0:1721880422.419426:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727cc53 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.419430:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727cc53 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.419434:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b58c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.419436:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727cc53 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.419440:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727cc53 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.419446:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727cc53 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.419449:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b58c0/0x8a60d30f5727cc53 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.419484:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011827456:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.419496:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.419512:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011827456 00000100:00100000:3.0:1721880422.419514:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011827456 00000100:00100000:3.0:1721880422.419524:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632585 00000100:00100000:3.0:1721880422.419527:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2490:3689:x1805522011827456:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.419533:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880123b6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2490:3689:x1805522011826176:12345-0@lo:6:osp-syn-1-0.0 Request processed in 917us (939us total) trans 4296020552 rc 0/0 00002000:00080000:3.0:1721880422.419534:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64866 count 1 00000100:00100000:1.0:1721880422.419537:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632580 00010000:00010000:3.0:1721880422.419541:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727cc76 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd62:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.419548:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132f2c480/0x8a60d30f571ebc19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a148 expref: 766 pid: 16130 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.419552:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1721880422.419556:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.419556:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1721880422.419558:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011827584:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.419558:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727cc76 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.419567:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132f2c480/0x8a60d30f571ebc19 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a148 expref: 766 pid: 16130 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.419572:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132f2c480/0x8a60d30f571ebc19 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a148 expref: 766 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.419578:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094661180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011827712:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.419580:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.419593:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03d80 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.419595:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011827584 00000100:00100000:0.0:1721880422.419598:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011827584 00000004:00080000:1.0:1721880422.419604:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088680380/2, rc 0, transno 1053255 00000004:00080000:3.0:1721880422.419605:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880123b6f480/2, rc 0, transno 1053256 00000100:00100000:0.0:1721880422.419611:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632586 00000100:00100000:0.0:1721880422.419616:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2490:3687:x1805522011827584:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.419618:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011825920:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.419618:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880123b6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011826176:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.419642:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011827840:0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.419646:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64867 count 1 00000100:00100000:3.0:1721880422.419647:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011827968:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.419654:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727cc7d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd63:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.419661:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.419663:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5998480/0x8a60d30f571ebc58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a187 expref: 766 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.419671:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.419672:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.419674:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727cc7d lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.419676:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.419681:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011827840 00010000:00010000:0.0:1721880422.419683:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5998480/0x8a60d30f571ebc58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a187 expref: 766 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.419686:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011827840 00010000:00010000:0.0:1721880422.419689:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5998480/0x8a60d30f571ebc58 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a187 expref: 766 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.419689:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011827968 00000100:00100000:3.0:1721880422.419691:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011827968 00000100:00100000:0.0:1721880422.419695:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800929ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011828096:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.419713:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.419714:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632587 00000100:00100000:3.0:1721880422.419719:0:9458:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632588 00000100:00100000:2.0:1721880422.419720:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2492:3687:x1805522011827840:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.419722:0:9458:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094663100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2492:3688:x1805522011827968:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.419752:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64868 count 1 00002000:00080000:3.0:1721880422.419753:0:9458:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64869 count 1 00010000:00010000:2.0:1721880422.419764:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727cc84 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd64:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.419764:0:9458:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727cc8b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd65:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.419775:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d5aed00/0x8a60d30f571ebc9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a1cd expref: 766 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.419778:0:9458:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132f2d8c0/0x8a60d30f571ebcf2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a221 expref: 766 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.419784:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.419785:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.419787:0:9458:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727cc8b lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.419788:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.419789:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.419792:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727cc84 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.419802:0:9458:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132f2d8c0/0x8a60d30f571ebcf2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a221 expref: 766 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.419810:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d5aed00/0x8a60d30f571ebc9e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a1cd expref: 766 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.419811:0:9458:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132f2d8c0/0x8a60d30f571ebcf2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a221 expref: 766 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.419820:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d5aed00/0x8a60d30f571ebc9e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a1cd expref: 766 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.419820:0:9458:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc51880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011828224:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.419831:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009993a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011828352:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.419844:0:9458:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03540 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.419852:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfded80 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.420130:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011826816:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.420135:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880095d6ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011826944:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.420144:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727cc5a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.420148:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727cc68 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.420160:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088683800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011827072:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.420172:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727cc61 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.420217:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.420231:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257774592 00000100:00100000:2.0:1721880422.420235:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257774592 00000100:00100000:1.0:1721880422.420240:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880095d6d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011827328:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.420247:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727cc6f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.420247:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094319200/0x8a60d30f571ebb9b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a0ca expref: 767 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.420264:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914774 00000100:00100000:2.0:1721880422.420268:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+767:2007:x1805522257774592:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.420270:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.420275:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.420279:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094319200/0x8a60d30f571ebb9b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd60:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a0ca expref: 767 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.420286:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.420288:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094319200/0x8a60d30f571ebb9b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd60:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a0ca expref: 767 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.420295:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257774464 00000100:00100000:3.0:1721880422.420299:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257774464 00010000:00010000:2.0:1721880422.420302:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094319200/0x8a60d30f571ebb9b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd60:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a0ca expref: 767 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.420312:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800973421c0/0x8a60d30f571ebb4e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a07d expref: 767 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.420313:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.420315:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.420318:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727cc68 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.420325:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800929ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011828096:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.420325:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727cc68 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd60:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.420327:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257774720 00000100:00100000:3.0:1721880422.420330:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257774720 00010000:00010000:1.0:1721880422.420333:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727cc7d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.420338:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094319b00/0x8a60d30f571ebb01 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a030 expref: 768 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.420340:0:16188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914775 00000100:00100000:2.0:1721880422.420345:0:16188:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e4a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+768:2005:x1805522257774464:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.420352:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914776 00000100:00100000:3.0:1721880422.420356:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ab4d7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+768:2004:x1805522257774720:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.420358:0:16188:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.420363:0:16188:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800973421c0/0x8a60d30f571ebb4e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd5f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a07d expref: 768 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.420363:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.420367:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094319b00/0x8a60d30f571ebb01 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd5e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a030 expref: 768 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.420373:0:16188:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800973421c0/0x8a60d30f571ebb4e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd5f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a07d expref: 768 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.420376:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094319b00/0x8a60d30f571ebb01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd5e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a030 expref: 768 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.420385:0:16188:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800973421c0/0x8a60d30f571ebb4e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd5f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a07d expref: 768 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.420389:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094319b00/0x8a60d30f571ebb01 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd5e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a030 expref: 768 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.420396:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.420397:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.420398:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.420398:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.420400:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.420401:0:16188:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727cc5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.420402:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727cc61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.420406:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257775232 00000100:00100000:1.0:1721880422.420408:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257775232 00010000:00010000:2.0:1721880422.420408:0:16188:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727cc5a lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd5f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.420408:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727cc61 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd5e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.420417:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5998480/0x8a60d30f571ebc58 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a187 expref: 767 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.420422:0:16188:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.420422:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.420435:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.420435:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914777 00000100:00100000:1.0:1721880422.420438:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e4a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+767:2006:x1805522257775232:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.420443:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.420446:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5998480/0x8a60d30f571ebc58 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a187 expref: 767 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.420446:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ab4d7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+767:2004:x1805522257774720:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 89us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.420448:0:16188:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e4a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+767:2005:x1805522257774464:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 102us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.420450:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257775104 00010000:00010000:1.0:1721880422.420452:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5998480/0x8a60d30f571ebc58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a187 expref: 767 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.420453:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257775104 00000100:00100000:3.0:1721880422.420453:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914776 00000100:00100000:2.0:1721880422.420457:0:16188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914775 00010000:00010000:0.0:1721880422.420462:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132f2d8c0/0x8a60d30f571ebcf2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a221 expref: 767 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.420464:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5998480/0x8a60d30f571ebc58 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a187 expref: 767 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.420471:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.420472:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.420472:0:16188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914778 00010000:00010000:1.0:1721880422.420474:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727cc7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.420477:0:16188:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e4aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+765:2005:x1805522257775104:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.420478:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727cc7d lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.420481:0:9458:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc51880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011828224:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.420484:0:16188:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.420486:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.420488:0:16188:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132f2d8c0/0x8a60d30f571ebcf2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a221 expref: 765 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.420492:0:9458:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727cc8b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd65:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.420497:0:16188:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132f2d8c0/0x8a60d30f571ebcf2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd65:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a221 expref: 765 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.420500:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e4a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+765:2006:x1805522257775232:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 61us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.420504:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914777 00010000:00010000:2.0:1721880422.420511:0:16188:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132f2d8c0/0x8a60d30f571ebcf2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a221 expref: 764 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.420515:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727cc7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.420518:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727cc61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.420519:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727cc7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.420521:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.420523:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727cc7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.420523:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.420523:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727cc61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.420526:0:16188:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727cc8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.420527:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727cc7d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.420530:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727cc61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.420533:0:16188:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727cc8b lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.420534:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727cc7d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.420535:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727cc61 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.420537:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325d8c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.420539:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727cc7d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.420541:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727cc61 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.420543:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727cc7d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.420546:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aab3c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.420548:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727cc7d lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.420551:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727cc61 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.420552:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727cc7d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.420554:0:16188:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.420557:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727cc61 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.420566:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727cc61 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.420571:0:16188:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e4aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+763:2005:x1805522257775104:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 94us (136us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.420573:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727cc61 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.420577:0:16188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914778 00010000:00010000:3.0:1721880422.420596:0:9458:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727cc8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.420599:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.420602:0:9458:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727cc8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.420608:0:9458:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727cc8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.420610:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+762:2007:x1805522257774592:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 341us (394us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.420614:0:9458:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727cc8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.420616:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914774 00010000:00010000:3.0:1721880422.420619:0:9458:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727cc8b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.420624:0:9458:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8900 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.420626:0:9458:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727cc8b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.420631:0:9458:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727cc8b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.420637:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.420639:0:9458:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727cc8b lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.420644:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727cc5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.420645:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727cc8b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.420653:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727cc5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.420659:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727cc5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.420663:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2493:3687:x1805522011827584:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1046us (1081us total) trans 4296020553 rc 0/0 00010000:00010000:2.0:1721880422.420666:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727cc5a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.420667:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632586 00010000:00010000:2.0:1721880422.420673:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727cc5a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.420677:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.420680:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325eac0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.420683:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727cc5a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.420688:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880085a4c000/2, rc 0, transno 1053257 00010000:00010000:2.0:1721880422.420690:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727cc5a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.420693:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.420700:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727cc5a lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.420701:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011827584:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.420707:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727cc5a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.420710:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727cc68 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.420714:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727cc68 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.420719:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727cc68 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.420724:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e4a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011828480:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.420724:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727cc68 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.420743:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727cc68 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.420746:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4b40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.420748:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727cc68 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.420752:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727cc68 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.420758:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.420758:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727cc68 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.420759:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257774976 00010000:00010000:1.0:1721880422.420762:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4b40/0x8a60d30f5727cc68 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.420763:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257774976 00010000:00010000:2.0:1721880422.420773:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132f2c480/0x8a60d30f571ebc19 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a148 expref: 762 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.420788:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257775360 00000100:00100000:2.0:1721880422.420790:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257775360 00010000:00010000:2.0:1721880422.420797:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d5aed00/0x8a60d30f571ebc9e lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a1cd expref: 763 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.420817:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257774848 00000100:00100000:2.0:1721880422.420820:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257774848 00000100:00100000:1.0:1721880422.420824:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914779 00000100:00100000:1.0:1721880422.420828:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e4a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+764:2005:x1805522257774976:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.420829:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009430cb40/0x8a60d30f571ebbd3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a102 expref: 764 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.420835:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.420838:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132f2c480/0x8a60d30f571ebc19 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a148 expref: 764 pid: 16130 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.420844:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132f2c480/0x8a60d30f571ebc19 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a148 expref: 764 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.420848:0:9458:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094663100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2494:3688:x1805522011827968:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1124us (1170us total) trans 4296020554 rc 0/0 00000100:00100000:2.0:1721880422.420850:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914780 00010000:00010000:1.0:1721880422.420852:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.420852:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.420854:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727cc76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.420854:0:9458:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632588 00000100:00100000:2.0:1721880422.420855:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e4a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+764:2005:x1805522257775360:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.420856:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914781 00010000:00010000:1.0:1721880422.420859:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727cc76 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.420860:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e4a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+764:2004:x1805522257774848:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.420863:0:15473:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.420865:0:9458:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011828480 00010000:00010000:0.0:1721880422.420866:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.420866:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.420867:0:15473:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d5aed00/0x8a60d30f571ebc9e lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a1cd expref: 764 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.420868:0:9458:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011828480 00010000:00010000:0.0:1721880422.420870:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009430cb40/0x8a60d30f571ebbd3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd61:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a102 expref: 764 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.420876:0:15473:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d5aed00/0x8a60d30f571ebc9e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a1cd expref: 764 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.420877:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009430cb40/0x8a60d30f571ebbd3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd61:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a102 expref: 764 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.420880:0:9458:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632589 00000100:00100000:1.0:1721880422.420882:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e4a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+764:2005:x1805522257774976:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 54us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.420884:0:9458:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2494:3689:x1805522011828480:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.420886:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914779 00010000:00010000:0.0:1721880422.420887:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009430cb40/0x8a60d30f571ebbd3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd61:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a102 expref: 764 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.420888:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.420889:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.420892:0:15473:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727cc84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.420894:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.420895:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00002000:00080000:3.0:1721880422.420895:0:9458:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64870 count 1 00010000:00010000:0.0:1721880422.420898:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727cc6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.420899:0:15473:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727cc84 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd64:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.420902:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727cc6f lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd61:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.420905:0:9458:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727cc92 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd66:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.420911:0:15473:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.420912:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.420915:0:9458:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880084268000/0x8a60d30f571ebd3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a26e expref: 762 pid: 16019 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.420920:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.420922:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.420924:0:9458:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727cc92 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.420926:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e4a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+762:2004:x1805522257774848:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 66us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.420931:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914781 00000100:00100000:2.0:1721880422.420931:0:15473:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e4a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+762:2005:x1805522257775360:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 75us (253us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.420938:0:9458:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880084268000/0x8a60d30f571ebd3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a26e expref: 761 pid: 16019 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.420939:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2494:3687:x1805522011826688:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2009us (2073us total) trans 4296020555 rc 0/0 00000100:00100000:2.0:1721880422.420939:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914780 00000100:00100000:1.0:1721880422.420943:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632583 00010000:00010000:3.0:1721880422.420947:0:9458:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880084268000/0x8a60d30f571ebd3f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a26e expref: 760 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.420956:0:9458:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc51880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011828608:192.168.201.24@tcp:104: 00000004:00080000:1.0:1721880422.420958:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880076e08e00/2, rc 0, transno 1053259 00000100:00100000:1.0:1721880422.420970:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076e08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011826688:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.420974:0:9458:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03540 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.420982:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727cc6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.420986:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727cc6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.420994:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727cc6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.420994:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880085a4d500/2, rc 0, transno 1053258 00010000:00010000:1.0:1721880422.420998:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727cc6f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.420998:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011827968:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.421002:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727cc6f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.421005:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b5200 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.421007:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727cc6f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.421028:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727cc6f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.421034:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727cc6f lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.421038:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5200/0x8a60d30f5727cc6f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.421095:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132f2c480/0x8a60d30f571ebc19 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a148 expref: 760 pid: 16130 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.421106:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094661180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011827712:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.421116:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727cc76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.421123:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727cc76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.421128:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727cc76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.421134:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727cc76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.421140:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727cc76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.421145:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2496:3689:x1805522011827200:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1935us (2004us total) trans 4296020558 rc 0/0 00000100:00100000:2.0:1721880422.421145:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2496:3686:x1805522011826560:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2321us (2387us total) trans 4296020556 rc 0/0 00010000:00010000:3.0:1721880422.421146:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727cc76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.421149:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632584 00010000:00010000:3.0:1721880422.421152:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aab600 already unused, calling callback (ffffffffa084e330) 00000100:00100000:2.0:1721880422.421153:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632581 00010000:00010000:3.0:1721880422.421154:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727cc76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.421158:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880123910700/2, rc 0, transno 1053262 00010000:00010000:3.0:1721880422.421160:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727cc76 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.421165:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880123910700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011827200:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.421166:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e22c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011828736:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.421169:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727cc76 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.421174:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727cc76 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.421181:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.421182:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d5aed00/0x8a60d30f571ebc9e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd64:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a1cd expref: 759 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.421184:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1721880422.421190:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e22f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011828992:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1721880422.421196:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008599d500/2, rc 0, transno 1053260 00000100:00100000:2.0:1721880422.421197:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009993a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011828352:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.421209:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008599d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011826560:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.421210:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727cc84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.421214:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1721880422.421218:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e22f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011828864:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.421218:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727cc84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.421226:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727cc84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.421228:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.421234:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727cc84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.421241:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727cc84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.421242:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011828736 00000100:00100000:1.0:1721880422.421244:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011828736 00010000:00010000:2.0:1721880422.421248:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727cc84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.421252:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011828864 00000100:00100000:1.0:1721880422.421253:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011828864 00010000:00010000:2.0:1721880422.421254:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350480 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.421257:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727cc84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.421257:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800911a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2497:3689:x1805522011827456:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1728us (1759us total) trans 4296020559 rc 0/0 00000100:00100000:1.0:1721880422.421259:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632590 00000100:00100000:1.0:1721880422.421261:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2497:3686:x1805522011828736:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.421263:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632585 00010000:00010000:2.0:1721880422.421264:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727cc84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.421269:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64871 count 1 00000100:00100000:3.0:1721880422.421275:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632591 00000100:00100000:0.0:1721880422.421276:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.421277:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727cc99 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd67:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.421280:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727cc84 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.421280:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2496:3686:x1805522011828864:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.421285:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b1fd440/0x8a60d30f571ebd7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a2ad expref: 758 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.421287:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350480/0x8a60d30f5727cc84 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.421289:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.421290:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00002000:00080000:3.0:1721880422.421290:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64872 count 1 00010000:00010000:1.0:1721880422.421291:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727cc99 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.421295:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880085a4f100/2, rc 0, transno 1053263 00000100:00100000:0.0:1721880422.421299:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011827456:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.421300:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727cca0 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd68:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.421301:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b1fd440/0x8a60d30f571ebd7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a2ad expref: 758 pid: 16119 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.421307:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b1fd440/0x8a60d30f571ebd7e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a2ad expref: 758 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.421310:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c4c7840/0x8a60d30f571ebdcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a2fa expref: 758 pid: 16039 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.421313:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800929cf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011829248:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.421316:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1721880422.421317:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e22e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011829120:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.421317:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.421319:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727cca0 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.421331:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.421331:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eba80 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.421334:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c4c7840/0x8a60d30f571ebdcb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a2fa expref: 758 pid: 16039 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.421340:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011828992 00010000:00010000:3.0:1721880422.421341:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c4c7840/0x8a60d30f571ebdcb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a2fa expref: 758 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.421342:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011828992 00000100:00100000:0.0:1721880422.421348:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011829120 00000100:00100000:0.0:1721880422.421350:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011829120 00000100:00100000:3.0:1721880422.421350:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc51180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011829504:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.421354:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632592 00000100:00100000:1.0:1721880422.421357:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e22ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2499:3689:x1805522011828992:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.421363:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632593 00002000:00080000:1.0:1721880422.421364:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64873 count 1 00000100:00100000:0.0:1721880422.421366:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e22c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2499:3689:x1805522011829120:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.421366:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03d80 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.421371:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727cca7 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd69:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1721880422.421375:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64874 count 1 00010000:00010000:1.0:1721880422.421377:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c4c4900/0x8a60d30f571ebe0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a339 expref: 758 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.421381:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.421381:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.421382:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727ccae lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd6a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.421383:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727cca7 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.421389:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2499:3687:x1805522011827840:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1667us (1725us total) trans 4296020560 rc 0/0 00010000:00010000:1.0:1721880422.421392:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c4c4900/0x8a60d30f571ebe0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a339 expref: 758 pid: 16039 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.421395:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632587 00010000:00010000:1.0:1721880422.421396:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c4c4900/0x8a60d30f571ebe0a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a339 expref: 758 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.421402:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800929ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011829632:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.421416:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302eb240 going to sleep for 11 seconds 00000004:00080000:1.0:1721880422.421430:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880085a4ca80/2, rc 0, transno 1053264 00000100:00100000:3.0:1721880422.421431:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801348c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2498:3688:x1805522011826432:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2504us (2653us total) trans 4296020557 rc 0/0 00010000:00010000:0.0:1721880422.421435:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801303bd200/0x8a60d30f571ebe50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a37f expref: 758 pid: 16019 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.421436:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011827840:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.421437:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632582 00010000:00010000:0.0:1721880422.421440:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.421441:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1721880422.421441:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1721880422.421442:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727ccae lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.421448:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088680000/2, rc 0, transno 1053261 00000100:00100000:2.0:1721880422.421454:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011826432:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.421473:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1721880422.421477:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011829888:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.421485:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801303bd200/0x8a60d30f571ebe50 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a37f expref: 758 pid: 16019 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.421491:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.421495:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801303bd200/0x8a60d30f571ebe50 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a37f expref: 758 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.421502:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e22d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011830016:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.421502:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e22fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011829376:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.421503:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011829888 00000100:00100000:3.0:1721880422.421506:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011829888 00000100:00100000:1.0:1721880422.421515:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.421519:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e840 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.421519:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011829376 00000100:00100000:3.0:1721880422.421521:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011829376 00000100:00100000:1.0:1721880422.421523:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880123b6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011829760:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.421532:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.421532:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632594 00000100:00100000:3.0:1721880422.421536:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2499:3689:x1805522011829888:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.421537:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011829760 00000100:00100000:0.0:1721880422.421541:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632595 00000100:00100000:2.0:1721880422.421541:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011829760 00000100:00100000:0.0:1721880422.421544:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096c9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2500:3687:x1805522011829376:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.421546:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64877 count 1 00002000:00080000:0.0:1721880422.421553:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64875 count 1 00010000:00010000:3.0:1721880422.421555:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727ccb5 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd6d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.421560:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727ccbc lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd6b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.421560:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632596 00010000:00010000:3.0:1721880422.421564:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095a75680/0x8a60d30f571ebf30 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a45f expref: 758 pid: 16119 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.421566:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2500:3687:x1805522011829760:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.421567:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880123a4f840/0x8a60d30f571ebeab lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a3da expref: 758 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.421571:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.421572:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.421573:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727ccbc lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.421573:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.421574:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.421577:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727ccb5 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.421578:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64876 count 1 00010000:00010000:0.0:1721880422.421582:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880123a4f840/0x8a60d30f571ebeab lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a3da expref: 758 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.421588:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880123a4f840/0x8a60d30f571ebeab lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a3da expref: 758 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.421589:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727ccc3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd6c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.421591:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095a75680/0x8a60d30f571ebf30 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a45f expref: 758 pid: 16119 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.421597:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e22f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011830144:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.421599:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095a75680/0x8a60d30f571ebf30 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a45f expref: 758 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.421601:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880123983840/0x8a60d30f571ebeea lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a419 expref: 758 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.421608:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1721880422.421608:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc50a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011830272:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.421609:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3ecc0 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.421609:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.421611:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727ccc3 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.421626:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03480 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.421633:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880123983840/0x8a60d30f571ebeea lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a419 expref: 758 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.421639:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880123983840/0x8a60d30f571ebeea lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a419 expref: 758 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.421646:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009993a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011830400:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.421654:0:9458:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc51880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011828608:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.421662:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfded80 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.421664:0:9458:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727cc92 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.421684:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.421699:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257775488 00000100:00100000:3.0:1721880422.421702:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257775488 00010000:00010000:3.0:1721880422.421713:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880084268000/0x8a60d30f571ebd3f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a26e expref: 759 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.421744:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914782 00000100:00100000:3.0:1721880422.421749:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fbabb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+759:2005:x1805522257775488:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.421756:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.421760:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880084268000/0x8a60d30f571ebd3f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a26e expref: 759 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.421768:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880084268000/0x8a60d30f571ebd3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a26e expref: 759 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.421779:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880084268000/0x8a60d30f571ebd3f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a26e expref: 759 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.421787:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.421789:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.421791:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727cc92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.421797:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727cc92 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.421810:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.421818:0:9458:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727cc92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.421824:0:9458:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727cc92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.421829:0:9458:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727cc92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.421832:0:9458:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727cc92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.421837:0:9458:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727cc92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.421837:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fbabb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+758:2005:x1805522257775488:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 88us (153us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.421840:0:9458:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aaa400 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.421842:0:9458:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727cc92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.421842:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914782 00010000:00010000:0.0:1721880422.421846:0:9458:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727cc92 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.421852:0:9458:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727cc92 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.421856:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727cc92 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.421944:0:9458:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2501:3689:x1805522011828480:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1059us (1185us total) trans 4296020561 rc 0/0 00000100:00100000:0.0:1721880422.421949:0:9458:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632589 00000004:00080000:1.0:1721880422.421961:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e4a9180/2, rc 0, transno 1053265 00000100:00100000:1.0:1721880422.421978:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e4a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011828480:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.422040:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099939c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011830528:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.422062:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.422075:0:9458:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011830528 00000100:00100000:0.0:1721880422.422078:0:9458:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011830528 00000100:00100000:0.0:1721880422.422088:0:9458:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632597 00000100:00100000:0.0:1721880422.422091:0:9458:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2501:3689:x1805522011830528:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.422099:0:9458:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64878 count 1 00010000:00010000:0.0:1721880422.422106:0:9458:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727ccca lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.422113:0:9458:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880123982640/0x8a60d30f571ebf76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a4a5 expref: 757 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.422118:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.422119:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.422120:0:9458:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727ccca lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.422131:0:9458:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880123982640/0x8a60d30f571ebf76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a4a5 expref: 757 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.422136:0:9458:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880123982640/0x8a60d30f571ebf76 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a4a5 expref: 757 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.422143:0:9458:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008c737b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011830656:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.422159:0:9458:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.422625:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.422644:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800929ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011829632:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.422651:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc51180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011829504:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.422652:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.422658:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727cca7 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.422659:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257775616 00000100:00100000:0.0:1721880422.422661:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.422662:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257775616 00010000:00010000:3.0:1721880422.422663:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727cca0 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.422680:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800929cf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011829248:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.422689:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727cc99 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.422700:0:16188:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257775744 00000100:00100000:2.0:1721880422.422702:0:16188:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257775744 00000100:00100000:0.0:1721880422.422712:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.422712:0:16188:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c4c4900/0x8a60d30f571ebe0a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a339 expref: 759 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.422723:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.422749:0:16188:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257775872 00000100:00100000:2.0:1721880422.422751:0:16188:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257775872 00000100:00100000:3.0:1721880422.422752:0:15473:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257776000 00000100:00100000:1.0:1721880422.422754:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257776128 00000100:00100000:3.0:1721880422.422756:0:15473:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257776000 00000100:00100000:1.0:1721880422.422758:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257776128 00010000:00010000:2.0:1721880422.422761:0:16188:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c4c7840/0x8a60d30f571ebdcb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a2fa expref: 762 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.422762:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.422770:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257776384 00010000:00010000:3.0:1721880422.422770:0:15473:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801303bd200/0x8a60d30f571ebe50 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a37f expref: 762 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.422772:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880123a4f840/0x8a60d30f571ebeab lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a3da expref: 762 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.422773:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257776384 00000100:00100000:2.0:1721880422.422777:0:16188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914783 00000100:00100000:2.0:1721880422.422781:0:16188:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c735500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+763:2004:x1805522257775744:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.422782:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880123983840/0x8a60d30f571ebeea lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a419 expref: 763 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.422788:0:16188:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.422793:0:16188:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c4c4900/0x8a60d30f571ebe0a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd69:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a339 expref: 763 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.422793:0:15473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914784 00000100:00100000:3.0:1721880422.422797:0:15473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c737480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+763:2004:x1805522257775872:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.422805:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914785 00010000:00010000:3.0:1721880422.422805:0:15473:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.422806:0:16188:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c4c4900/0x8a60d30f571ebe0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd69:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a339 expref: 763 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.422809:0:15473:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c4c7840/0x8a60d30f571ebdcb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a2fa expref: 763 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.422810:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c736a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+763:2007:x1805522257776000:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.422811:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914786 00010000:00010000:0.0:1721880422.422816:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.422816:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+763:2004:x1805522257776128:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.422818:0:16188:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c4c4900/0x8a60d30f571ebe0a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd69:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a339 expref: 763 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.422818:0:15473:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c4c7840/0x8a60d30f571ebdcb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a2fa expref: 763 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.422819:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801303bd200/0x8a60d30f571ebe50 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd6a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a37f expref: 763 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.422824:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.422825:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801303bd200/0x8a60d30f571ebe50 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd6a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a37f expref: 762 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.422827:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.422829:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880123a4f840/0x8a60d30f571ebeab lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd6b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a3da expref: 762 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.422830:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.422831:0:15473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c4c7840/0x8a60d30f571ebdcb lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a2fa expref: 762 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.422832:0:16188:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727cca7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.422834:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.422835:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.422837:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727ccae lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd6a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.422837:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880123a4f840/0x8a60d30f571ebeab lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd6b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a3da expref: 761 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.422838:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.422839:0:16188:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727cca7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.422839:0:15473:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.422841:0:15473:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727cca0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.422842:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727ccae lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd6a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.422845:0:15473:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727cca0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.422849:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.422849:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.422850:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.422852:0:16188:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.422853:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727ccbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd6b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.422854:0:15473:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.422860:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727ccbc lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd6b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.422862:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c736a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+761:2007:x1805522257776000:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 53us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.422866:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914785 00000100:00100000:2.0:1721880422.422867:0:16188:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c735500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+761:2004:x1805522257775744:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 85us (214us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.422870:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.422871:0:15473:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c737480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:30425778-2709-4512-9d75-01ec53c4cfad+761:2004:x1805522257775872:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 73us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.422873:0:16188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914783 00000100:00100000:3.0:1721880422.422877:0:15473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914784 00000100:00100000:0.0:1721880422.422880:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914787 00000100:00100000:0.0:1721880422.422883:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fa1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+759:2004:x1805522257776384:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.422887:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.422887:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+758:2004:x1805522257776128:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 71us (162us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.422890:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880123983840/0x8a60d30f571ebeea lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd6c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a419 expref: 758 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.422894:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914786 00010000:00010000:0.0:1721880422.422896:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880123983840/0x8a60d30f571ebeea lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd6c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a419 expref: 758 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.422897:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b1fd440/0x8a60d30f571ebd7e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a2ad expref: 758 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.422902:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.422903:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.422905:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727ccc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd6c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.422908:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc50a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011830272:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.422909:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727ccc3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd6c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.422911:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914788 00010000:00010000:0.0:1721880422.422914:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.422915:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a70ef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+757:2004:x1805522257775616:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.422924:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fa1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+757:2004:x1805522257776384:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 40us (161us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.422925:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.422925:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727ccb5 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.422929:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914787 00010000:00010000:1.0:1721880422.422930:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b1fd440/0x8a60d30f571ebd7e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a2ad expref: 757 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.422932:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123983840/0x8a60d30f571ebeea lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a419 expref: 757 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.422940:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b1fd440/0x8a60d30f571ebd7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a2ad expref: 755 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.422943:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009993a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011830400:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.422943:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727cca0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.422948:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801303bd200/0x8a60d30f571ebe50 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a37f expref: 755 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.422950:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727cca0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.422951:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b1fd440/0x8a60d30f571ebd7e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a2ad expref: 755 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.422955:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727ccc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.422957:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e22d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011830016:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.422957:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727cca0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.422962:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.422962:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727ccc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.422962:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727cca0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.422963:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.422964:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727ccae lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.422965:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727cc99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.422968:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727ccc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.422968:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727cca0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.422969:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727ccae lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.422972:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727cc99 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.422973:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727ccae lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.422973:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aabcc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.422976:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727ccc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.422976:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727cca0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.422977:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727ccae lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.422981:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727ccae lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.422981:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727cca0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.422982:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727ccc3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.422985:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727ccae lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.422985:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.422988:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325c6c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.422989:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727ccc3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.422990:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727ccae lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.422990:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727cca0 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.422995:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350240 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.422997:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727ccae lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.422998:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727ccc3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.423000:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727cca0 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.423002:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a70ef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+753:2004:x1805522257775616:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 86us (377us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.423003:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727ccae lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.423004:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727ccc3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.423007:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727ccae lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.423008:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914788 00010000:00010000:2.0:1721880422.423023:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727ccc3 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.423035:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350240/0x8a60d30f5727ccc3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.423079:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727cca7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.423083:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123a4f840/0x8a60d30f571ebeab lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a3da expref: 752 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.423086:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727cca7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.423089:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e22f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011830144:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.423096:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727ccbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.423098:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727cca7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.423100:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727ccbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.423104:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727ccbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.423104:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727cca7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.423108:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727ccbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.423111:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727cca7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.423115:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727ccbc lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.423117:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b6640 already unused, calling callback (ffffffffa084e330) 00000100:00100000:3.0:1721880422.423118:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2504:3686:x1805522011828864:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1837us (1886us total) trans 4296020562 rc 0/0 00010000:00010000:0.0:1721880422.423119:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727ccbc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.423120:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727cca7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.423122:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325ed00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.423124:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727ccbc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.423124:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632591 00010000:00010000:1.0:1721880422.423126:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727cca7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.423128:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727ccbc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.423133:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727ccbc lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.423136:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727ccbc lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.423136:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727cca7 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.423139:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2503:3687:x1805522011829760:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1572us (1605us total) trans 4296020564 rc 0/0 00010000:00010000:1.0:1721880422.423142:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6640/0x8a60d30f5727cca7 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.423144:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632596 00000004:00080000:2.0:1721880422.423164:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880123b6ad80/2, rc 0, transno 1053268 00000100:00100000:2.0:1721880422.423168:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880123b6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011829760:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.423184:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1721880422.423188:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009993a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011830784:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.423191:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e22c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2503:3689:x1805522011829120:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1822us (1857us total) trans 4296020563 rc 0/0 00000100:00100000:3.0:1721880422.423196:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632593 00000100:00100000:2.0:1721880422.423202:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.423212:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011830784 00000004:00080000:2.0:1721880422.423213:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e22fb80/2, rc 0, transno 1053269 00000100:00100000:0.0:1721880422.423215:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880096c9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2503:3687:x1805522011829376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1670us (1698us total) trans 4296020565 rc 0/0 00000100:00100000:3.0:1721880422.423215:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011830784 00000100:00100000:2.0:1721880422.423217:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e22fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011829376:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.423220:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632595 00000100:00100000:3.0:1721880422.423228:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632598 00000100:00100000:3.0:1721880422.423233:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2503:3687:x1805522011830784:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.423234:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009993ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011830912:0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.423242:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64879 count 1 00000100:00100000:0.0:1721880422.423249:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.423249:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.423251:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727ccd1 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.423261:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096cdef40/0x8a60d30f571ebfbc lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a4eb expref: 751 pid: 16099 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.423267:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e22ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2503:3689:x1805522011828992:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1907us (1989us total) trans 4296020566 rc 0/0 00000100:00100000:2.0:1721880422.423267:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011830912 00010000:00010000:3.0:1721880422.423267:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.423268:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.423269:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011830912 00010000:00010000:3.0:1721880422.423269:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727ccd1 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.423274:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632592 00000100:00100000:2.0:1721880422.423280:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632599 00010000:00010000:3.0:1721880422.423281:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096cdef40/0x8a60d30f571ebfbc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a4eb expref: 751 pid: 16099 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.423284:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2503:3687:x1805522011830912:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.423288:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096cdef40/0x8a60d30f571ebfbc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a4eb expref: 751 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.423290:0:9458:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008c737b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011830656:192.168.201.24@tcp:104: 00002000:00080000:2.0:1721880422.423292:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64880 count 1 00000100:00100000:1.0:1721880422.423294:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257776256 00000100:00100000:3.0:1721880422.423295:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc50a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011831040:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.423297:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257776256 00010000:00010000:0.0:1721880422.423299:0:9458:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727ccca lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.423300:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727ccd8 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.423308:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880123981f80/0x8a60d30f571ebffb lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a52a expref: 752 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.423309:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095a75680/0x8a60d30f571ebf30 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a45f expref: 752 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.423311:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03480 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.423316:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.423317:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.423319:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727ccd8 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.423325:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914789 00000004:00080000:3.0:1721880422.423328:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e22f100/2, rc 0, transno 1053266 00010000:00010000:2.0:1721880422.423329:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880123981f80/0x8a60d30f571ebffb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a52a expref: 752 pid: 16099 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.423330:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e22f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+752:2005:x1805522257776256:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.423335:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880123981f80/0x8a60d30f571ebffb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a52a expref: 752 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.423337:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.423341:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095a75680/0x8a60d30f571ebf30 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd6d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a45f expref: 752 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.423343:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e22f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011828864:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.423344:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099938380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011831168:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.423348:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.423350:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095a75680/0x8a60d30f571ebf30 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd6d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a45f expref: 752 pid: 16119 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.423361:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095a75680/0x8a60d30f571ebf30 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd6d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a45f expref: 752 pid: 16119 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.423365:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011831296:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.423371:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.423372:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.423375:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727ccb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.423375:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfded80 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.423381:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.423382:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727ccb5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.423395:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.423397:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011831296 00010000:00010000:3.0:1721880422.423398:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727ccb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.423399:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011831296 00010000:00010000:3.0:1721880422.423405:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727ccb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.423412:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e22f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+751:2005:x1805522257776256:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 82us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.423412:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632600 00010000:00010000:3.0:1721880422.423412:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727ccb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.423414:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2504:3688:x1805522011831296:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.423418:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914789 00010000:00010000:3.0:1721880422.423418:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727ccb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.423422:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64881 count 1 00010000:00010000:3.0:1721880422.423424:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727ccb5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.423428:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727ccdf lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd71:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.423430:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257776512 00010000:00010000:3.0:1721880422.423430:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa9f80 already unused, calling callback (ffffffffa084e330) 00000100:00100000:1.0:1721880422.423433:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257776512 00010000:00010000:3.0:1721880422.423433:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727ccb5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.423436:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007ca8e400/0x8a60d30f571ec072 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd71:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a5a1 expref: 751 pid: 16019 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.423439:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727ccb5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.423440:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.423441:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.423442:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880123982640/0x8a60d30f571ebf76 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a4a5 expref: 751 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.423443:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727ccdf lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd71:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.423448:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727ccb5 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.423453:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007ca8e400/0x8a60d30f571ec072 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd71:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a5a1 expref: 751 pid: 16019 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.423453:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727ccb5 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.423457:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914790 00010000:00010000:2.0:1721880422.423458:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007ca8e400/0x8a60d30f571ec072 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd71:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a5a1 expref: 751 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.423462:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e195050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+751:2004:x1805522257776512:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.423464:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009993bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011831424:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.423469:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.423472:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880123982640/0x8a60d30f571ebf76 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a4a5 expref: 751 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.423479:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde840 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.423480:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880123982640/0x8a60d30f571ebf76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a4a5 expref: 751 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.423491:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123982640/0x8a60d30f571ebf76 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a4a5 expref: 751 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.423501:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.423502:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.423505:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727ccca lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.423511:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727ccca lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.423524:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.423531:0:9458:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727ccca lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.423536:0:9458:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727ccca lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.423541:0:9458:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727ccca lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.423545:0:9458:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727ccca lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.423546:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e195050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+750:2004:x1805522257776512:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 83us (196us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.423548:0:9458:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727ccca lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.423549:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2505:3689:x1805522011829888:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2011us (2056us total) trans 4296020567 rc 0/0 00010000:00010000:0.0:1721880422.423551:0:9458:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325e400 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.423553:0:9458:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727ccca lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.423554:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632594 00000100:00100000:1.0:1721880422.423556:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914790 00010000:00010000:0.0:1721880422.423557:0:9458:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727ccca lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.423563:0:9458:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727ccca lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.423570:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727ccca lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.423617:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880088887480/2, rc 0, transno 1053271 00000100:00100000:1.0:1721880422.423634:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011829888:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1721880422.423645:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e22e300/2, rc 0, transno 1053267 00000100:00100000:1.0:1721880422.423649:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e22e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011829120:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.423655:0:9458:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2505:3689:x1805522011830528:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1562us (1592us total) trans 4296020568 rc 0/0 00000100:00100000:0.0:1721880422.423659:0:9458:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632597 00000004:00080000:1.0:1721880422.423659:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e22f480/2, rc 0, transno 1053270 00000100:00100000:3.0:1721880422.423661:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1721880422.423662:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e22f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011828992:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.423669:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011831552:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1721880422.423673:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099939c00/2, rc 0, transno 1053272 00000100:00100000:2.0:1721880422.423681:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011831808:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.423685:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099939c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011830528:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.423690:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.423708:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011831552 00000100:00100000:1.0:1721880422.423711:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011831552 00000100:00100000:2.0:1721880422.423715:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.423719:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011831936:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.423726:0:9458:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011831808 00000100:00100000:2.0:1721880422.423741:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1721880422.423742:0:9458:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011831808 00000100:00100000:2.0:1721880422.423745:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011831680:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.423749:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632601 00000100:00100000:1.0:1721880422.423754:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2506:3688:x1805522011831552:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.423756:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.423758:0:9458:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632602 00000100:00100000:0.0:1721880422.423761:0:9458:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085a4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2506:3687:x1805522011831808:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.423769:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011831680 00002000:00080000:0.0:1721880422.423770:0:9458:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64884 count 1 00000100:00100000:2.0:1721880422.423771:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011831680 00010000:00010000:0.0:1721880422.423777:0:9458:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727cce6 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd74:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.423783:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632603 00010000:00010000:0.0:1721880422.423784:0:9458:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800911a6f40/0x8a60d30f571ec0fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd74:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a62d expref: 749 pid: 16099 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.423786:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d132300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2507:3687:x1805522011831680:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.423788:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.423789:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.423791:0:9458:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727cce6 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd74:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.423793:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64883 count 1 00010000:00010000:0.0:1721880422.423800:0:9458:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800911a6f40/0x8a60d30f571ec0fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd74:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a62d expref: 749 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.423800:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727cced lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd73:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.423805:0:9458:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800911a6f40/0x8a60d30f571ec0fe lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd74:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a62d expref: 749 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.423808:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800842a73c0/0x8a60d30f571ec0cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd73:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a5fc expref: 749 pid: 16019 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.423811:0:9458:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e22d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011832064:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.423815:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.423816:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.423818:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727cced lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd73:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.423826:0:9458:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e6c0 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.423829:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800842a73c0/0x8a60d30f571ec0cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd73:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a5fc expref: 749 pid: 16019 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.423834:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800842a73c0/0x8a60d30f571ec0cd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd73:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a5fc expref: 749 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.423840:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d130380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011832192:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.423853:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.423859:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.423877:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011831936 00000100:00100000:2.0:1721880422.423879:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011831936 00002000:00080000:1.0:1721880422.423880:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64882 count 1 00010000:00010000:1.0:1721880422.423890:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727ccf4 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd72:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.423890:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632604 00000100:00100000:2.0:1721880422.423893:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094661180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2508:3688:x1805522011831936:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.423900:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ff74240/0x8a60d30f571ec0a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd72:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a5d2 expref: 749 pid: 16101 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.423900:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64885 count 1 00010000:00010000:1.0:1721880422.423906:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.423907:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.423907:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727ccfb lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.423909:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727ccf4 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd72:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.423915:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800971e9f80/0x8a60d30f571ec13d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a665 expref: 749 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.423919:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.423920:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.423922:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727ccfb lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.423931:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ff74240/0x8a60d30f571ec0a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd72:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a5d2 expref: 749 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.423933:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800971e9f80/0x8a60d30f571ec13d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a665 expref: 749 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.423940:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ff74240/0x8a60d30f571ec0a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd72:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a5d2 expref: 749 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.423940:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800971e9f80/0x8a60d30f571ec13d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a665 expref: 749 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.423945:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d133800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011832448:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.423951:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012edb1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011832320:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.423959:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec240 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.423973:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff8801302ebe40 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.423985:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727cc99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.423992:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727cc99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.423999:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727cc99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.424006:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727cc99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.424030:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727cc99 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.424037:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b7840 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.424040:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727cc99 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.424046:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727cc99 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.424056:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727cc99 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.424062:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7840/0x8a60d30f5727cc99 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.424116:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc50a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011831040:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.424128:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727ccd1 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.424141:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099938380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011831168:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.424148:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727ccd8 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.424158:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.424174:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880095d6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2509:3686:x1805522011828736:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2910us (2990us total) trans 4296020569 rc 0/0 00000100:00100000:2.0:1721880422.424174:0:7117:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257776640 00000100:00100000:2.0:1721880422.424176:0:7117:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257776640 00000100:00100000:1.0:1721880422.424181:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632590 00010000:00010000:2.0:1721880422.424185:0:7117:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096cdef40/0x8a60d30f571ebfbc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a4eb expref: 750 pid: 16099 timeout: 887 lvb_type: 0 00000004:00080000:3.0:1721880422.424185:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e22c380/2, rc 0, transno 1053273 00000100:00100000:3.0:1721880422.424196:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e22c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011828736:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.424199:0:7117:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914791 00000100:00100000:2.0:1721880422.424202:0:7117:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e22f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30425778-2709-4512-9d75-01ec53c4cfad+750:2005:x1805522257776640:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.424208:0:7117:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.424211:0:7117:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096cdef40/0x8a60d30f571ebfbc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a4eb expref: 750 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.424217:0:7117:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096cdef40/0x8a60d30f571ebfbc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a4eb expref: 750 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.424225:0:7117:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096cdef40/0x8a60d30f571ebfbc lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a4eb expref: 750 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.424231:0:7117:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.424232:0:7117:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.424234:0:7117:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727ccd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.424238:0:7117:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727ccd1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.424249:0:7117:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.424261:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727ccd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.424265:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.424268:0:7117:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e22f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30425778-2709-4512-9d75-01ec53c4cfad+749:2005:x1805522257776640:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 64us (109us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.424269:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727ccd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.424274:0:15455:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257776768 00000100:00100000:2.0:1721880422.424274:0:7117:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914791 00000100:00100000:0.0:1721880422.424276:0:15455:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257776768 00010000:00010000:3.0:1721880422.424281:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727ccd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.424286:0:15455:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880123981f80/0x8a60d30f571ebffb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a52a expref: 749 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.424287:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727ccd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.424293:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727ccd1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.424297:0:15455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914792 00010000:00010000:3.0:1721880422.424298:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aaad00 already unused, calling callback (ffffffffa084e330) 00000100:00100000:0.0:1721880422.424300:0:15455:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e22c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+749:2005:x1805522257776768:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.424301:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727ccd1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.424305:0:15455:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.424307:0:15455:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880123981f80/0x8a60d30f571ebffb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a52a expref: 749 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.424307:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727ccd1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.424312:0:15455:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880123981f80/0x8a60d30f571ebffb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a52a expref: 749 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.424317:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727ccd1 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.424319:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d130a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011832576:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.424320:0:15455:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123981f80/0x8a60d30f571ebffb lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a52a expref: 749 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.424323:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aaad00/0x8a60d30f5727ccd1 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.424326:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.424326:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009993bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011831424:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.424327:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.424329:0:15455:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727ccd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.424337:0:15455:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727ccd8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.424338:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727ccdf lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd71:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.424339:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.424345:0:15455:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.424352:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727ccd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.424356:0:15455:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e22c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+748:2005:x1805522257776768:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 55us (92us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.424359:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727ccd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.424360:0:15455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914792 00000100:00100000:1.0:1721880422.424361:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011832576 00000100:00100000:1.0:1721880422.424365:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011832576 00010000:00010000:2.0:1721880422.424367:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727ccd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.424374:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727ccd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.424381:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632605 00010000:00010000:2.0:1721880422.424381:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727ccd8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.424385:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2510:3689:x1805522011832576:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.424387:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.424387:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350000 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.424390:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727ccd8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.424394:0:15455:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257776896 00000100:00100000:0.0:1721880422.424396:0:15455:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257776896 00002000:00080000:1.0:1721880422.424396:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64886 count 1 00010000:00010000:2.0:1721880422.424397:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727ccd8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.424402:0:15455:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007ca8e400/0x8a60d30f571ec072 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd71:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a5a1 expref: 748 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.424406:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727cd02 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd76:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.424407:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727ccd8 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.424415:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bc86f40/0x8a60d30f571ec160 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd76:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a688 expref: 748 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.424415:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350000/0x8a60d30f5727ccd8 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.424421:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.424423:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1721880422.424423:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2510:3687:x1805522011830784:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1188us (1219us total) trans 4296020570 rc 0/0 00010000:00010000:1.0:1721880422.424425:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727cd02 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd76:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.424430:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632598 00010000:00010000:1.0:1721880422.424442:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bc86f40/0x8a60d30f571ec160 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd76:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a688 expref: 748 pid: 16040 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.424451:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bc86f40/0x8a60d30f571ec160 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd76:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a688 expref: 748 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.424460:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012edb0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011832704:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.424477:0:15455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914793 00000100:00100000:1.0:1721880422.424478:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a240 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.424481:0:15455:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e22ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+748:2006:x1805522257776896:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.424486:0:15455:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.424489:0:15455:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007ca8e400/0x8a60d30f571ec072 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd71:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a5a1 expref: 748 pid: 16019 timeout: 887 lvb_type: 0 00000004:00080000:2.0:1721880422.424500:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009993a680/2, rc 0, transno 1053274 00000100:00100000:2.0:1721880422.424509:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009993a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011830784:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.424513:0:9458:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e22d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011832064:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.424523:0:9458:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727cce6 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd74:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.424547:0:15455:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007ca8e400/0x8a60d30f571ec072 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd71:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a5a1 expref: 748 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.424552:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094663100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011832832:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.424556:0:15455:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007ca8e400/0x8a60d30f571ec072 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd71:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a5a1 expref: 748 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.424565:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.424579:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2510:3687:x1805522011830912:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1293us (1327us total) trans 4296020571 rc 0/0 00000100:00100000:3.0:1721880422.424580:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.424586:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632599 00000100:00100000:3.0:1721880422.424600:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011832832 00000100:00100000:2.0:1721880422.424601:0:7117:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257777024 00010000:00010000:0.0:1721880422.424602:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.424603:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.424604:0:7117:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257777024 00000100:00100000:3.0:1721880422.424604:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011832832 00010000:00010000:0.0:1721880422.424605:0:15455:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727ccdf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd71:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.424610:0:15455:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727ccdf lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd71:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.424614:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.424615:0:7117:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800911a6f40/0x8a60d30f571ec0fe lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd74:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a62d expref: 748 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.424619:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632606 00010000:00010000:0.0:1721880422.424620:0:15455:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.424623:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088683480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2510:3686:x1805522011832832:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.424631:0:7117:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257777152 00000100:00100000:0.0:1721880422.424633:0:15455:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e22ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+748:2006:x1805522257776896:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 152us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.424633:0:7117:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257777152 00002000:00080000:3.0:1721880422.424635:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64887 count 1 00000100:00100000:1.0:1721880422.424636:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914794 00000100:00100000:0.0:1721880422.424640:0:15455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914793 00010000:00010000:2.0:1721880422.424641:0:7117:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800842a73c0/0x8a60d30f571ec0cd lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd73:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a5fc expref: 749 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.424642:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+749:2005:x1805522257777024:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.424644:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727cd09 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.424650:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.424654:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801239806c0/0x8a60d30f571ec183 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a6ab expref: 748 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.424655:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800911a6f40/0x8a60d30f571ec0fe lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd74:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a62d expref: 748 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.424657:0:7117:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914795 00010000:00010000:3.0:1721880422.424660:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.424661:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.424662:0:7117:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30425778-2709-4512-9d75-01ec53c4cfad+748:2005:x1805522257777152:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.424663:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727cd09 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.424665:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727ccdf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.424665:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800911a6f40/0x8a60d30f571ec0fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd74:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a62d expref: 748 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.424670:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727ccdf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.424670:0:7117:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.424674:0:7117:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800842a73c0/0x8a60d30f571ec0cd lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd73:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a5fc expref: 748 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.424675:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727ccdf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.424676:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801239806c0/0x8a60d30f571ec183 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a6ab expref: 748 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.424678:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727ccdf lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.424679:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800911a6f40/0x8a60d30f571ec0fe lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd74:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a62d expref: 748 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.424682:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727ccdf lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.424683:0:7117:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800842a73c0/0x8a60d30f571ec0cd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd73:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a5fc expref: 748 pid: 16019 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.424683:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801239806c0/0x8a60d30f571ec183 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a6ab expref: 748 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.424687:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.424688:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.424689:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352400 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.424690:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727cce6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd74:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.424691:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727ccdf lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.424692:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088683800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011832960:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.424694:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727cce6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd74:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.424695:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727ccdf lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.424695:0:7117:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.424696:0:7117:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.424699:0:7117:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727cced lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd73:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.424700:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727ccdf lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.424703:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727ccdf lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.424705:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.424708:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03d80 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.424711:0:7117:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727cced lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd73:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.424719:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+747:2005:x1805522257777024:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 78us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.424723:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914794 00010000:00010000:2.0:1721880422.424724:0:7117:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.424756:0:9458:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727cce6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.424761:0:9458:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727cce6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.424763:0:7117:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30425778-2709-4512-9d75-01ec53c4cfad+746:2005:x1805522257777152:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 99us (148us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.424765:0:9458:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727cce6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.424769:0:9458:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727cce6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.424771:0:7117:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914795 00010000:00010000:1.0:1721880422.424776:0:9458:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727cce6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.424780:0:9458:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325c240 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.424781:0:9458:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727cce6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.424785:0:9458:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727cce6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.424790:0:9458:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727cce6 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.424794:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727cce6 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.424798:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009993ad80/2, rc 0, transno 1053275 00000100:00100000:0.0:1721880422.424807:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2511:3688:x1805522011831296:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1391us (1424us total) trans 4296020572 rc 0/0 00000100:00100000:2.0:1721880422.424807:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009993ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011830912:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.424811:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632600 00000100:00100000:2.0:1721880422.424830:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d133800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011832448:192.168.201.24@tcp:104: 00000004:00080000:3.0:1721880422.424840:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099939180/2, rc 0, transno 1053276 00010000:00010000:2.0:1721880422.424843:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727ccfb lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.424846:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011831296:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.424859:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.424860:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011833088:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.424872:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011833216:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.424875:0:7117:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257777280 00000100:00100000:2.0:1721880422.424877:0:7117:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257777280 00010000:00010000:2.0:1721880422.424888:0:7117:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800971e9f80/0x8a60d30f571ec13d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a665 expref: 746 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.424888:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.424906:0:7117:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914796 00000100:00100000:1.0:1721880422.424908:0:9458:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880085a4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2511:3687:x1805522011831808:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1142us (1189us total) trans 4296020573 rc 0/0 00000100:00100000:0.0:1721880422.424909:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.424910:0:7117:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e22d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30425778-2709-4512-9d75-01ec53c4cfad+746:2004:x1805522257777280:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.424914:0:9458:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632602 00010000:00010000:2.0:1721880422.424917:0:7117:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1721880422.424919:0:15455:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257777408 00010000:00010000:2.0:1721880422.424921:0:7117:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800971e9f80/0x8a60d30f571ec13d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a665 expref: 746 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.424922:0:15455:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257777408 00000100:00100000:1.0:1721880422.424929:0:9458:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011833216 00010000:00010000:0.0:1721880422.424930:0:15455:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff74240/0x8a60d30f571ec0a3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd72:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a5d2 expref: 747 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.424932:0:9458:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011833216 00010000:00010000:2.0:1721880422.424936:0:7117:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800971e9f80/0x8a60d30f571ec13d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a665 expref: 747 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.424940:0:15455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914797 00000100:00100000:0.0:1721880422.424944:0:15455:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129d21c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+747:2004:x1805522257777408:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.424948:0:9458:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632607 00010000:00010000:2.0:1721880422.424948:0:7117:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800971e9f80/0x8a60d30f571ec13d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a665 expref: 747 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.424951:0:15455:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.424952:0:9458:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800878d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2511:3688:x1805522011833216:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.424953:0:15455:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ff74240/0x8a60d30f571ec0a3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd72:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a5d2 expref: 747 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.424959:0:15455:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ff74240/0x8a60d30f571ec0a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd72:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a5d2 expref: 746 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.424960:0:7117:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.424961:0:7117:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00002000:00080000:1.0:1721880422.424963:0:9458:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64889 count 1 00010000:00010000:2.0:1721880422.424964:0:7117:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727ccfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.424967:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.424968:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.424969:0:15455:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727ccf4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd72:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.424971:0:7117:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727ccfb lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.424973:0:15455:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727ccf4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd72:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.424973:0:9458:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727cd10 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.424980:0:15455:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.424985:0:7117:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.424989:0:9458:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082c0f840/0x8a60d30f571ec1d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a6ff expref: 746 pid: 16126 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.424991:0:15455:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880129d21c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+746:2004:x1805522257777408:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 46us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.424995:0:15455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914797 00010000:00010000:1.0:1721880422.424995:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.424997:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.424998:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727ccfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.424999:0:9458:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727cd10 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.425002:0:7117:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e22d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30425778-2709-4512-9d75-01ec53c4cfad+745:2004:x1805522257777280:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 91us (142us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.425005:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727ccfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.425008:0:7117:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914796 00010000:00010000:3.0:1721880422.425026:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727ccfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.425032:0:9458:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082c0f840/0x8a60d30f571ec1d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a6ff expref: 745 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.425032:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727ccfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.425039:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727ccfb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.425041:0:9458:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082c0f840/0x8a60d30f571ec1d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a6ff expref: 744 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.425043:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350fc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.425046:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727ccfb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.425051:0:9458:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012edb0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011833344:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.425052:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727ccfb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.425061:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727ccfb lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.425072:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350fc0/0x8a60d30f5727ccfb lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.425079:0:9458:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a180 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.425080:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.425092:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011833088 00000100:00100000:0.0:1721880422.425095:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011833088 00000004:00080000:2.0:1721880422.425102:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a07b4e00/2, rc 0, transno 1053277 00000100:00100000:0.0:1721880422.425106:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632608 00010000:00010000:1.0:1721880422.425106:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ff74240/0x8a60d30f571ec0a3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd72:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a5d2 expref: 744 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.425109:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d133800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2512:3687:x1805522011833088:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.425118:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64888 count 1 00000100:00100000:1.0:1721880422.425118:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012edb1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011832320:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.425118:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a07b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011831808:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.425125:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727cd17 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.425131:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727ccf4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.425133:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011e8c8fc0/0x8a60d30f571ec1a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a6ce expref: 743 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.425138:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.425138:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727ccf4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.425139:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.425141:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727cd17 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.425143:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800842a73c0/0x8a60d30f571ec0cd lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd73:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a5fc expref: 743 pid: 16019 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.425143:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1721880422.425147:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727ccf4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.425150:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135301f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011833472:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.425151:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011e8c8fc0/0x8a60d30f571ec1a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a6ce expref: 742 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.425154:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727ccf4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.425154:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d130380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011832192:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.425157:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011e8c8fc0/0x8a60d30f571ec1a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a6ce expref: 742 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.425159:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727ccf4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.425163:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e22f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011833600:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.425165:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727ccf4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.425169:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727cced lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.425170:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b6400 already unused, calling callback (ffffffffa084e330) 00000100:00100000:3.0:1721880422.425171:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.425172:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727ccf4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.425177:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3ec00 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.425177:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727cced lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.425178:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727ccf4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.425184:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727cced lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.425187:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011833472 00010000:00010000:1.0:1721880422.425187:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727ccf4 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.425189:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011833472 00010000:00010000:2.0:1721880422.425191:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727cced lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.425193:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6400/0x8a60d30f5727ccf4 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.425198:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727cced lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.425199:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632609 00000100:00100000:0.0:1721880422.425202:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135300000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2514:3688:x1805522011833472:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.425205:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727cced lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1721880422.425209:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64890 count 1 00010000:00010000:2.0:1721880422.425210:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352640 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.425213:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727cced lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.425215:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727cd1e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.425220:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727cced lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.425222:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130732880/0x8a60d30f571ec1fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a71b expref: 742 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.425226:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.425227:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.425229:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727cd1e lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.425230:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727cced lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.425238:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130732880/0x8a60d30f571ec1fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a71b expref: 742 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.425242:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136352640/0x8a60d30f5727cced lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.425243:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130732880/0x8a60d30f571ec1fa lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a71b expref: 742 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.425248:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e22c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011833728:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.425253:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094661180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2515:3688:x1805522011831936:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1357us (1393us total) trans 4296020574 rc 0/0 00000100:00100000:0.0:1721880422.425258:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.425259:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632604 00000004:00080000:3.0:1721880422.425284:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880085a4e680/2, rc 0, transno 1053278 00000100:00100000:3.0:1721880422.425290:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011831936:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.425295:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2515:3688:x1805522011831552:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1540us (1603us total) trans 4296020575 rc 0/0 00000100:00100000:1.0:1721880422.425302:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632601 00000004:00080000:3.0:1721880422.425318:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a07b4700/2, rc 0, transno 1053279 00000100:00100000:3.0:1721880422.425324:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a07b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011831552:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.425330:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d132300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2514:3687:x1805522011831680:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1542us (1571us total) trans 4296020576 rc 0/0 00000100:00100000:2.0:1721880422.425334:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632603 00000100:00100000:3.0:1721880422.425345:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135303800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011833856:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.425352:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011833984:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.425363:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.425372:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011833856 00000100:00100000:2.0:1721880422.425375:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011833856 00000100:00100000:2.0:1721880422.425386:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632610 00000100:00100000:2.0:1721880422.425389:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f41ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2514:3686:x1805522011833856:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.425397:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64891 count 1 00010000:00010000:2.0:1721880422.425404:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727cd25 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.425412:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880123980480/0x8a60d30f571ec224 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a745 expref: 742 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.425416:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.425417:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.425418:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727cd25 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.425428:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880123980480/0x8a60d30f571ec224 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a745 expref: 742 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.425437:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880123980480/0x8a60d30f571ec224 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a745 expref: 742 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.425442:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008d130380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011834112:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.425458:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.425467:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1721880422.425480:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a07b6300/2, rc 0, transno 1053280 00000100:00100000:1.0:1721880422.425481:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011833984 00000100:00100000:1.0:1721880422.425485:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011833984 00000100:00100000:2.0:1721880422.425485:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a07b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011831680:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.425499:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632611 00000100:00100000:1.0:1721880422.425502:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d133480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2515:3687:x1805522011833984:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.425512:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64892 count 1 00010000:00010000:1.0:1721880422.425519:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727cd2c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd7c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.425522:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a05fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011834240:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.425527:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fd82d00/0x8a60d30f571ec247 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd7c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a768 expref: 742 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.425531:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.425531:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.425533:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727cd2c lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd7c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.425534:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.425544:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fd82d00/0x8a60d30f571ec247 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd7c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a768 expref: 742 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.425549:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fd82d00/0x8a60d30f571ec247 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd7c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a768 expref: 742 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.425555:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012edb1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011834368:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.425573:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a840 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.425576:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012edb0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011832704:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.425588:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088683800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011832960:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.425595:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727cd02 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd76:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.425597:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727cd09 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.425622:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011834240 00000100:00100000:1.0:1721880422.425623:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.425626:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011834240 00000100:00100000:2.0:1721880422.425635:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257777664 00000100:00100000:2.0:1721880422.425638:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257777664 00000100:00100000:3.0:1721880422.425644:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632612 00010000:00010000:2.0:1721880422.425647:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801239806c0/0x8a60d30f571ec183 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a6ab expref: 743 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.425649:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009993bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2516:3688:x1805522011834240:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.425655:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.425658:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914798 00002000:00080000:3.0:1721880422.425660:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64893 count 1 00000100:00100000:2.0:1721880422.425661:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+743:2004:x1805522257777664:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.425665:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1721880422.425668:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257777536 00010000:00010000:2.0:1721880422.425668:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801239806c0/0x8a60d30f571ec183 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a6ab expref: 743 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.425670:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257777536 00010000:00010000:3.0:1721880422.425670:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727cd33 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd7d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.425674:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801239806c0/0x8a60d30f571ec183 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a6ab expref: 744 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.425680:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bc86f40/0x8a60d30f571ec160 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd76:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a688 expref: 744 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.425680:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801203e0b40/0x8a60d30f571ec271 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd7d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a792 expref: 744 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.425682:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801239806c0/0x8a60d30f571ec183 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a6ab expref: 744 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.425688:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.425689:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1721880422.425691:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914799 00010000:00010000:2.0:1721880422.425691:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727cd09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.425691:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.425693:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1721880422.425694:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+743:2005:x1805522257777536:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.425695:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727cd33 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd7d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.425696:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727cd09 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.425699:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.425701:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bc86f40/0x8a60d30f571ec160 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd76:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a688 expref: 743 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.425703:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.425712:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bc86f40/0x8a60d30f571ec160 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd76:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a688 expref: 743 pid: 16040 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.425712:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801203e0b40/0x8a60d30f571ec271 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd7d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a792 expref: 743 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.425719:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bc86f40/0x8a60d30f571ec160 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd76:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a688 expref: 743 pid: 16040 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.425720:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+743:2004:x1805522257777664:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 57us (96us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.425722:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801203e0b40/0x8a60d30f571ec271 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd7d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a792 expref: 743 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.425725:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914798 00010000:00010000:0.0:1721880422.425744:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.425746:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.425747:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727cd02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd76:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.425752:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727cd02 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd76:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.425755:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880134e96a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011834496:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.425762:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727cd09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.425772:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727cd09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.425780:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727cd09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.425791:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727cd09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.425795:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727cd09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.425798:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8000 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.425800:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727cd09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.425803:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727cd09 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.425809:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727cd09 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.425813:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727cd09 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.425818:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.425835:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+741:2005:x1805522257777536:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 139us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.425839:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914799 00010000:00010000:0.0:1721880422.425852:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727cd02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.425857:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727cd02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.425862:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727cd02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.425869:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727cd02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.425873:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727cd02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.425874:0:9458:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012edb0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011833344:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.425877:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b7a80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.425878:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727cd02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.425885:0:9458:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727cd10 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.425928:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727cd02 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.425935:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727cd02 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.425939:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727cd02 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.425942:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03540 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.425948:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088683480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2517:3686:x1805522011832832:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1324us (1368us total) trans 4296020577 rc 0/0 00000100:00100000:2.0:1721880422.425953:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632606 00000004:00080000:3.0:1721880422.425967:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880094663100/2, rc 0, transno 1053281 00000100:00100000:3.0:1721880422.425974:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094663100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011832832:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.426003:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099938380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011834624:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.426029:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d130380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011834112:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.426033:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.426039:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.426046:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727cd25 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.426061:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011834624 00000100:00100000:0.0:1721880422.426062:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257777920 00000100:00100000:2.0:1721880422.426064:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011834624 00000100:00100000:1.0:1721880422.426067:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.426079:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632613 00000100:00100000:2.0:1721880422.426083:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2518:3689:x1805522011834624:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.426084:0:7117:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257778176 00000100:00100000:1.0:1721880422.426085:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012edb1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011834368:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.426087:0:7117:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257778176 00010000:00010000:1.0:1721880422.426094:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727cd2c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd7c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.426094:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64894 count 1 00010000:00010000:3.0:1721880422.426100:0:7117:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880123980480/0x8a60d30f571ec224 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a745 expref: 741 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.426105:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257777920 00010000:00010000:2.0:1721880422.426105:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727cd3a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd7e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.426115:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880082c0f840/0x8a60d30f571ec1d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a6ff expref: 742 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.426115:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d8f3c0/0x8a60d30f571ec29b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd7e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a7bc expref: 742 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.426123:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.426125:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.426127:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727cd3a lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd7e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.426128:0:7117:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914800 00000100:00100000:3.0:1721880422.426134:0:7117:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30425778-2709-4512-9d75-01ec53c4cfad+742:2004:x1805522257778176:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.426139:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.426141:0:7117:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.426143:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914801 00010000:00010000:3.0:1721880422.426145:0:7117:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880123980480/0x8a60d30f571ec224 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a745 expref: 742 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.426148:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+742:2004:x1805522257777920:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.426152:0:15455:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257778304 00010000:00010000:3.0:1721880422.426154:0:7117:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880123980480/0x8a60d30f571ec224 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a745 expref: 742 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.426155:0:15455:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257778304 00010000:00010000:2.0:1721880422.426155:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.426160:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082c0f840/0x8a60d30f571ec1d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a6ff expref: 743 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.426165:0:15455:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd82d00/0x8a60d30f571ec247 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd7c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a768 expref: 743 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.426166:0:7117:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123980480/0x8a60d30f571ec224 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a745 expref: 743 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.426168:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082c0f840/0x8a60d30f571ec1d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a6ff expref: 743 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.426175:0:7117:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.426176:0:7117:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1721880422.426177:0:15455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914802 00010000:00010000:3.0:1721880422.426179:0:7117:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727cd25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.426181:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082c0f840/0x8a60d30f571ec1d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a6ff expref: 742 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.426182:0:15455:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+742:2004:x1805522257778304:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.426186:0:7117:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727cd25 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.426187:0:15455:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.426189:0:15455:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fd82d00/0x8a60d30f571ec247 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd7c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a768 expref: 742 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.426196:0:15455:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fd82d00/0x8a60d30f571ec247 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd7c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a768 expref: 741 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.426196:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.426197:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.426199:0:7117:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.426200:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e22c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011833728:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.426200:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727cd10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.426204:0:15455:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fd82d00/0x8a60d30f571ec247 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd7c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a768 expref: 741 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.426206:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727cd10 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.426209:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727cd1e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.426213:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.426214:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.426217:0:15455:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727cd2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd7c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.426217:0:7117:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30425778-2709-4512-9d75-01ec53c4cfad+740:2004:x1805522257778176:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 83us (148us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.426220:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.426221:0:15455:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727cd2c lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd7c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.426222:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e22f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011833600:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.426223:0:7117:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914800 00010000:00010000:0.0:1721880422.426228:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727cd17 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.426230:0:15455:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.426237:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+739:2004:x1805522257777920:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 89us (198us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.426242:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727cd25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.426243:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914801 00000100:00100000:1.0:1721880422.426244:0:15455:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+739:2004:x1805522257778304:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 61us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.426247:0:15455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914802 00010000:00010000:3.0:1721880422.426249:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727cd25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.426252:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2518:3689:x1805522011832576:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1866us (1913us total) trans 4296020578 rc 0/0 00000100:00100000:0.0:1721880422.426256:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632605 00010000:00010000:3.0:1721880422.426257:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727cd25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.426261:0:9458:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727cd10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.426263:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727cd25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.426265:0:9458:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727cd10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.426269:0:9458:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727cd10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.426269:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d8f3c0/0x8a60d30f571ec29b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd7e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a7bc expref: 737 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.426270:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727cd25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.426273:0:9458:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727cd10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.426275:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008d130a80/2, rc 0, transno 1053282 00010000:00010000:3.0:1721880422.426275:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350d80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.426276:0:9458:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727cd10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.426277:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d8f3c0/0x8a60d30f571ec29b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd7e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a7bc expref: 737 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.426278:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727cd25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.426283:0:9458:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b73c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.426284:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727cd25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.426285:0:9458:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727cd10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.426288:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc50a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011834752:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.426289:0:9458:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727cd10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.426293:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727cd25 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.426294:0:9458:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727cd10 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.426297:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b73c0/0x8a60d30f5727cd10 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.426299:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350d80/0x8a60d30f5727cd25 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.426323:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008d130a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011832576:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.426326:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1721880422.426333:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013107a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011834880:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.426355:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.426364:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727cd2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.426367:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011834880 00010000:00010000:1.0:1721880422.426368:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727cd2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.426370:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011834880 00010000:00010000:1.0:1721880422.426372:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727cd2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.426376:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727cd2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.426379:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727cd2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.426381:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632614 00010000:00010000:1.0:1721880422.426383:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b6d00 already unused, calling callback (ffffffffa084e330) 00000100:00100000:2.0:1721880422.426383:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdecb40 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.426384:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131078000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2520:3687:x1805522011834880:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.426385:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727cd2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.426388:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727cd2c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1721880422.426392:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64895 count 1 00010000:00010000:1.0:1721880422.426394:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727cd2c lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.426397:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6d00/0x8a60d30f5727cd2c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.426399:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727cd41 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.426407:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007b9ee640/0x8a60d30f571ec2c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a7e6 expref: 737 pid: 16126 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.426410:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f41ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2520:3686:x1805522011833856:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1017us (1044us total) trans 4296020579 rc 0/0 00010000:00010000:0.0:1721880422.426411:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.426413:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.426414:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727cd41 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.426416:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632610 00000004:00080000:3.0:1721880422.426444:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880135303800/2, rc 0, transno 1053283 00000100:00100000:3.0:1721880422.426452:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135303800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011833856:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.426467:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d133480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2520:3687:x1805522011833984:12345-0@lo:6:osp-syn-1-0.0 Request processed in 963us (999us total) trans 4296020581 rc 0/0 00010000:00010000:0.0:1721880422.426469:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007b9ee640/0x8a60d30f571ec2c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a7e6 expref: 737 pid: 16126 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.426471:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632611 00010000:00010000:0.0:1721880422.426475:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007b9ee640/0x8a60d30f571ec2c5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a7e6 expref: 737 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.426481:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.426482:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e22f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011835008:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.426489:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88011ef28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011835136:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.426498:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.426498:0:15455:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257777792 00000100:00100000:1.0:1721880422.426500:0:15455:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257777792 00010000:00010000:1.0:1721880422.426508:0:15455:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011e8c8fc0/0x8a60d30f571ec1a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a6ce expref: 738 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.426512:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.426527:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011835136 00000100:00100000:1.0:1721880422.426527:0:15455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914803 00000100:00100000:0.0:1721880422.426529:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011835136 00000100:00100000:1.0:1721880422.426530:0:15455:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d130380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+738:2005:x1805522257777792:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.426530:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.426535:0:15455:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.426538:0:15455:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011e8c8fc0/0x8a60d30f571ec1a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a6ce expref: 738 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.426542:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632615 00010000:00010000:1.0:1721880422.426544:0:15455:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011e8c8fc0/0x8a60d30f571ec1a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a6ce expref: 738 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.426545:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ef2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2520:3687:x1805522011835136:12345-0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1721880422.426548:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880135302d80/2, rc 0, transno 1053285 00002000:00080000:0.0:1721880422.426552:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64896 count 1 00010000:00010000:1.0:1721880422.426552:0:15455:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011e8c8fc0/0x8a60d30f571ec1a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a6ce expref: 738 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.426555:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011833984:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.426558:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.426559:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727cd48 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd80:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.426559:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.426560:0:15455:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727cd17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.426565:0:15455:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727cd17 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.426565:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257778048 00010000:00010000:0.0:1721880422.426567:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801203e1b00/0x8a60d30f571ec2ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd80:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a810 expref: 737 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.426568:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257778048 00010000:00010000:0.0:1721880422.426571:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.426572:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.426574:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727cd48 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd80:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.426574:0:15455:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.426580:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130732880/0x8a60d30f571ec1fa lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a71b expref: 738 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.426582:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801203e1b00/0x8a60d30f571ec2ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd80:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a810 expref: 738 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.426587:0:15455:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d130380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+738:2005:x1805522257777792:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 56us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.426591:0:15455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914803 00010000:00010000:0.0:1721880422.426592:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801203e1b00/0x8a60d30f571ec2ef lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd80:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a810 expref: 738 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.426598:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e22c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011835264:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.426600:0:15455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914804 00000100:00100000:1.0:1721880422.426604:0:15455:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8064050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+737:2005:x1805522257778048:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.426608:0:15455:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1721880422.426611:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3ecc0 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.426611:0:15455:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130732880/0x8a60d30f571ec1fa lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a71b expref: 737 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.426616:0:15455:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130732880/0x8a60d30f571ec1fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a71b expref: 737 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.426622:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727cd17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.426623:0:15455:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130732880/0x8a60d30f571ec1fa lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a71b expref: 737 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.426626:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727cd17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.426630:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.426630:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.426631:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727cd17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.426631:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88011ef29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011835392:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.426632:0:15455:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727cd1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.426635:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727cd17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.426636:0:15455:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727cd1e lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.426638:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727cd17 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.426638:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.426641:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325d440 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.426643:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727cd17 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.426647:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727cd17 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.426649:0:15455:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.426654:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727cd17 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.426656:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257778432 00010000:00010000:0.0:1721880422.426658:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325d440/0x8a60d30f5727cd17 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.426659:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257778432 00000100:00100000:1.0:1721880422.426664:0:15455:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8064050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+737:2005:x1805522257778048:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 58us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.426670:0:15455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914804 00010000:00010000:2.0:1721880422.426672:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801203e0b40/0x8a60d30f571ec271 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd7d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a792 expref: 737 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.426675:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880134e96a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011834496:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.426687:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727cd33 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd7d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.426699:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914805 00000100:00100000:2.0:1721880422.426705:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135756a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+736:2004:x1805522257778432:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.426712:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.426716:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801203e0b40/0x8a60d30f571ec271 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd7d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a792 expref: 736 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.426726:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801203e0b40/0x8a60d30f571ec271 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd7d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a792 expref: 736 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.426757:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801203e0b40/0x8a60d30f571ec271 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd7d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a792 expref: 736 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.426759:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d133800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2521:3687:x1805522011833088:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1648us (1679us total) trans 4296020582 rc 0/0 00000100:00100000:0.0:1721880422.426763:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632608 00010000:00010000:2.0:1721880422.426767:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.426769:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.426772:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727cd33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd7d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.426776:0:9458:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800878d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2520:3688:x1805522011833216:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1822us (1886us total) trans 4296020580 rc 0/0 00010000:00010000:2.0:1721880422.426779:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727cd33 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd7d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.426781:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727cd1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.426782:0:9458:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632607 00010000:00010000:0.0:1721880422.426785:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727cd1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.426789:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727cd1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.426793:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727cd1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.426793:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.426797:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727cd1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.426800:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325d680 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.426801:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727cd1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.426806:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727cd1e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.426812:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727cd1e lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.426812:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135756a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+735:2004:x1805522257778432:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 106us (174us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.426815:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325d680/0x8a60d30f5727cd1e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.426818:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914805 00000100:00100000:2.0:1721880422.426836:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.426837:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727cd33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.426845:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727cd33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.426851:0:9458:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011835392 00010000:00010000:3.0:1721880422.426852:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727cd33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.426854:0:9458:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011835392 00010000:00010000:3.0:1721880422.426859:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727cd33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.426862:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800878d9180/2, rc 0, transno 1053284 00010000:00010000:3.0:1721880422.426866:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727cd33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.426869:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011833216:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.426871:0:9458:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632616 00010000:00010000:3.0:1721880422.426871:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa9b00 already unused, calling callback (ffffffffa084e330) 00000100:00100000:1.0:1721880422.426874:0:9458:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011ef29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2521:3688:x1805522011835392:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.426874:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727cd33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.426884:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727cd33 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.426886:0:9458:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64897 count 1 00000100:00100000:0.0:1721880422.426888:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135300000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2521:3688:x1805522011833472:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1684us (1716us total) trans 4296020583 rc 0/0 00000100:00100000:0.0:1721880422.426892:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632609 00010000:00010000:3.0:1721880422.426894:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727cd33 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.426897:0:9458:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727cd4f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.426900:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880135301f80/2, rc 0, transno 1053287 00010000:00010000:3.0:1721880422.426900:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9b00/0x8a60d30f5727cd33 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.426905:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135301f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011833472:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.426906:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88011ef29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011835520:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.426908:0:9458:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801203e0000/0x8a60d30f571ec312 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a833 expref: 734 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.426914:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.426915:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1721880422.426917:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.426917:0:9458:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727cd4f lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.426928:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011835520 00000100:00100000:0.0:1721880422.426930:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011835520 00010000:00010000:1.0:1721880422.426932:0:9458:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801203e0000/0x8a60d30f571ec312 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a833 expref: 734 pid: 16099 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.426936:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800878d9c00/2, rc 0, transno 1053286 00000100:00100000:0.0:1721880422.426939:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632617 00010000:00010000:1.0:1721880422.426941:0:9458:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801203e0000/0x8a60d30f571ec312 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a833 expref: 734 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.426941:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011833088:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.426942:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e22ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2521:3689:x1805522011835520:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.426949:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64898 count 1 00000100:00100000:1.0:1721880422.426950:0:9458:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012edb2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011835776:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.426957:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727cd56 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.426962:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011835904:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.426964:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801203e1200/0x8a60d30f571ec33c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a85d expref: 734 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.426968:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.426969:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.426971:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727cd56 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.426972:0:9458:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a180 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.426980:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801203e1200/0x8a60d30f571ec33c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a85d expref: 734 pid: 16099 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.426982:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.426986:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801203e1200/0x8a60d30f571ec33c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a85d expref: 734 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.426992:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e22d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011836032:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.426996:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1721880422.427001:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099ad4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011835648:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.427006:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e840 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.427027:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011835904 00000100:00100000:0.0:1721880422.427029:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011835904 00000100:00100000:3.0:1721880422.427030:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009993bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2522:3688:x1805522011834240:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1378us (1492us total) trans 4296020584 rc 0/0 00000100:00100000:3.0:1721880422.427036:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632612 00000100:00100000:0.0:1721880422.427040:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632618 00000100:00100000:0.0:1721880422.427043:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2523:3687:x1805522011835904:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.427043:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.427049:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011835648 00002000:00080000:0.0:1721880422.427050:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64900 count 1 00000100:00100000:3.0:1721880422.427052:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011835648 00010000:00010000:0.0:1721880422.427057:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727cd5d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd84:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.427063:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009be04000/0x8a60d30f571ec382 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a8a3 expref: 734 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.427067:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1721880422.427067:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632619 00010000:00010000:0.0:1721880422.427068:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.427070:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727cd5d lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.427071:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a05fe680/2, rc 0, transno 1053288 00000100:00100000:3.0:1721880422.427071:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2523:3687:x1805522011835648:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.427077:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a05fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011834240:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.427079:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009be04000/0x8a60d30f571ec382 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a8a3 expref: 734 pid: 16126 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.427082:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64899 count 1 00010000:00010000:0.0:1721880422.427084:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009be04000/0x8a60d30f571ec382 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a8a3 expref: 734 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.427089:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008c736a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011836160:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.427092:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727cd64 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd83:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.427103:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012380ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011836288:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.427103:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130972400/0x8a60d30f571ec35f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a887 expref: 734 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.427105:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3ea80 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.427108:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.427110:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.427112:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727cd64 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.427121:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.427130:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130972400/0x8a60d30f571ec35f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a887 expref: 734 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.427133:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011836288 00000100:00100000:0.0:1721880422.427135:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011836288 00010000:00010000:3.0:1721880422.427139:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130972400/0x8a60d30f571ec35f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a887 expref: 734 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.427145:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632620 00000100:00100000:0.0:1721880422.427148:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012380b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2524:3688:x1805522011836288:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.427148:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135755c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011836416:192.168.201.24@tcp:104: 00002000:00080000:0.0:1721880422.427154:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64901 count 1 00010000:00010000:0.0:1721880422.427160:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727cd6b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd85:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.427166:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009be07cc0/0x8a60d30f571ec3ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a8cd expref: 734 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.427170:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.427171:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.427172:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727cd6b lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.427172:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03540 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.427183:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009be07cc0/0x8a60d30f571ec3ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a8cd expref: 734 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.427243:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009be07cc0/0x8a60d30f571ec3ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a8cd expref: 734 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.427308:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008c735500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011836544:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.427326:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e780 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.427422:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc50a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011834752:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.427435:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727cd3a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd7e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.427543:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e22f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011835008:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.427552:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727cd41 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.427595:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e22c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011835264:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.427611:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e22d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011836032:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.427611:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727cd48 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd80:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.427620:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727cd56 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.427626:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.427632:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008c736a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011836160:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.427634:0:9458:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012edb2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011835776:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.427639:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257778560 00000100:00100000:2.0:1721880422.427642:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257778560 00000100:00100000:3.0:1721880422.427645:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135755c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011836416:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.427646:0:9458:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727cd4f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.427653:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d8f3c0/0x8a60d30f571ec29b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd7e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a7bc expref: 735 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.427656:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727cd64 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.427673:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914806 00010000:00010000:0.0:1721880422.427674:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727cd5d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.427678:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123809c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+735:2005:x1805522257778560:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.427686:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.427690:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d8f3c0/0x8a60d30f571ec29b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd7e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a7bc expref: 735 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.427699:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d8f3c0/0x8a60d30f571ec29b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd7e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a7bc expref: 735 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.427712:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d8f3c0/0x8a60d30f571ec29b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd7e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a7bc expref: 735 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.427721:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.427723:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.427726:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727cd3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd7e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.427765:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727cd3a lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd7e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.427780:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.427785:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727cd3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.427790:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727cd3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.427794:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727cd3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.427798:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727cd3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.427802:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727cd3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.427806:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801363521c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.427808:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727cd3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.427808:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880123809c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+734:2005:x1805522257778560:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 129us (183us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.427811:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727cd3a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.427815:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914806 00010000:00010000:0.0:1721880422.427817:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727cd3a lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.427821:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727cd3a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.427872:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.427886:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.427895:0:8793:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257778816 00000100:00100000:2.0:1721880422.427896:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257779072 00000100:00100000:3.0:1721880422.427897:0:8793:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257778816 00000100:00100000:2.0:1721880422.427900:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257779072 00010000:00010000:3.0:1721880422.427907:0:8793:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801203e1b00/0x8a60d30f571ec2ef lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd80:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a810 expref: 735 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.427912:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801203e0000/0x8a60d30f571ec312 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a833 expref: 735 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.427913:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2525:3689:x1805522011834624:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1828us (1879us total) trans 4296020585 rc 0/0 00000100:00100000:0.0:1721880422.427916:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632613 00000100:00100000:3.0:1721880422.427919:0:8793:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914807 00000100:00100000:3.0:1721880422.427923:0:8793:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135755c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30425778-2709-4512-9d75-01ec53c4cfad+735:2005:x1805522257778816:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.427928:0:8793:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.427931:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914808 00010000:00010000:3.0:1721880422.427931:0:8793:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801203e1b00/0x8a60d30f571ec2ef lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd80:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a810 expref: 735 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.427936:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135754e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+735:2005:x1805522257779072:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.427940:0:8793:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801203e1b00/0x8a60d30f571ec2ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd80:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a810 expref: 735 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.427944:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.427948:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801203e0000/0x8a60d30f571ec312 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a833 expref: 735 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.427949:0:8793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801203e1b00/0x8a60d30f571ec2ef lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd80:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a810 expref: 735 pid: 16101 timeout: 887 lvb_type: 0 00000004:00080000:1.0:1721880422.427955:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099938380/2, rc 0, transno 1053289 00010000:00010000:3.0:1721880422.427955:0:8793:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.427956:0:8793:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.427957:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801203e0000/0x8a60d30f571ec312 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a833 expref: 734 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.427958:0:8793:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727cd48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd80:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.427962:0:8793:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727cd48 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd80:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.427965:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099938380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011834624:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.427971:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801203e0000/0x8a60d30f571ec312 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a833 expref: 734 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.427971:0:8793:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.427978:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727cd48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.427981:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.427983:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.427983:0:8793:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135755c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30425778-2709-4512-9d75-01ec53c4cfad+733:2005:x1805522257778816:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 59us (112us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.427985:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727cd48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.427986:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727cd4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.427987:0:8793:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914807 00010000:00010000:1.0:1721880422.427993:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727cd48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.427993:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727cd4f lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.427998:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008c736a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011836672:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.427999:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727cd48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.428005:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.428006:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727cd48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.428007:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.428029:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.428031:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325c000 already unused, calling callback (ffffffffa084e330) 00000100:00100000:3.0:1721880422.428032:0:8793:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257778688 00010000:00010000:1.0:1721880422.428034:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727cd48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.428035:0:8793:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257778688 00010000:00010000:1.0:1721880422.428040:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727cd48 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.428041:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135754e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+733:2005:x1805522257779072:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 104us (152us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.428043:0:8793:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007b9ee640/0x8a60d30f571ec2c5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a7e6 expref: 733 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.428049:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914808 00010000:00010000:1.0:1721880422.428050:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727cd48 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.428056:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325c000/0x8a60d30f5727cd48 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.428058:0:8793:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914809 00000100:00100000:3.0:1721880422.428060:0:8793:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135757800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30425778-2709-4512-9d75-01ec53c4cfad+732:2005:x1805522257778688:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.428065:0:8793:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.428067:0:8793:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007b9ee640/0x8a60d30f571ec2c5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a7e6 expref: 732 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.428073:0:8793:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007b9ee640/0x8a60d30f571ec2c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a7e6 expref: 732 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.428080:0:8793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007b9ee640/0x8a60d30f571ec2c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd7f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a7e6 expref: 732 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.428086:0:8793:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.428087:0:8793:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.428089:0:8793:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727cd41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.428093:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011836672 00010000:00010000:3.0:1721880422.428093:0:8793:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727cd41 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.428096:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011836672 00010000:00010000:3.0:1721880422.428102:0:8793:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.428108:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632621 00000100:00100000:0.0:1721880422.428110:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c737480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2526:3689:x1805522011836672:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.428114:0:8793:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135757800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30425778-2709-4512-9d75-01ec53c4cfad+731:2005:x1805522257778688:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 53us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.428117:0:8793:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914809 00002000:00080000:0.0:1721880422.428120:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64902 count 1 00010000:00010000:0.0:1721880422.428127:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727cd72 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd86:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.428135:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d9aeac0/0x8a60d30f571ec3cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a8f0 expref: 730 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.428139:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.428140:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.428141:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727cd72 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.428145:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.428151:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d9aeac0/0x8a60d30f571ec3cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a8f0 expref: 730 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.428156:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d9aeac0/0x8a60d30f571ec3cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a8f0 expref: 730 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.428161:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008c737b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011836800:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.428162:0:15455:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257779328 00000100:00100000:3.0:1721880422.428165:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.428166:0:15455:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257779328 00000100:00100000:3.0:1721880422.428172:0:8793:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257778944 00000100:00100000:3.0:1721880422.428174:0:8793:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257778944 00000100:00100000:1.0:1721880422.428175:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ef2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2526:3687:x1805522011835136:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1627us (1661us total) trans 4296020586 rc 0/0 00010000:00010000:2.0:1721880422.428175:0:15455:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130972400/0x8a60d30f571ec35f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a887 expref: 731 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.428177:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3ea80 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.428181:0:8793:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801203e1200/0x8a60d30f571ec33c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a85d expref: 732 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.428183:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632615 00010000:00010000:0.0:1721880422.428185:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727cd41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.428189:0:15455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914810 00010000:00010000:0.0:1721880422.428190:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727cd41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.428192:0:15455:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135756680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+732:2007:x1805522257779328:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.428194:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727cd41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.428197:0:8793:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914811 00010000:00010000:0.0:1721880422.428198:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727cd41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.428200:0:8793:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5275450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30425778-2709-4512-9d75-01ec53c4cfad+732:2005:x1805522257778944:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.428202:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727cd41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.428203:0:15455:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.428204:0:8793:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.428205:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325cd80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.428205:0:9458:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727cd4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.428206:0:15455:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130972400/0x8a60d30f571ec35f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd83:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a887 expref: 732 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.428207:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727cd41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.428207:0:8793:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801203e1200/0x8a60d30f571ec33c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a85d expref: 732 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.428210:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727cd41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.428212:0:9458:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727cd4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.428213:0:15455:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130972400/0x8a60d30f571ec35f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd83:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a887 expref: 732 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.428213:0:8793:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801203e1200/0x8a60d30f571ec33c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a85d expref: 732 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.428216:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727cd41 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.428219:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325cd80/0x8a60d30f5727cd41 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.428219:0:9458:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727cd4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.428221:0:8793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801203e1200/0x8a60d30f571ec33c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a85d expref: 732 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.428222:0:15455:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130972400/0x8a60d30f571ec35f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd83:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a887 expref: 732 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.428225:0:9458:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727cd4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.428226:0:8793:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.428227:0:8793:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.428229:0:8793:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727cd56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.428231:0:9458:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727cd4f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.428233:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.428233:0:8793:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727cd56 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.428234:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.428236:0:15455:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727cd64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.428237:0:9458:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b5440 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.428240:0:9458:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727cd4f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.428241:0:15455:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727cd64 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.428241:0:8793:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.428246:0:9458:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727cd4f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.428251:0:15455:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.428253:0:8793:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5275450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30425778-2709-4512-9d75-01ec53c4cfad+730:2005:x1805522257778944:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 52us (87us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.428255:0:9458:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727cd4f lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.428256:0:8793:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914811 00010000:00010000:1.0:1721880422.428261:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5440/0x8a60d30f5727cd4f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.428264:0:15455:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135756680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+729:2007:x1805522257779328:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 71us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.428268:0:15455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914810 00010000:00010000:3.0:1721880422.428269:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727cd64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.428274:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727cd64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.428278:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727cd64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.428282:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727cd64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.428286:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727cd64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.428289:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8b40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.428290:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727cd64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.428294:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727cd64 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.428299:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880131078000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2526:3687:x1805522011834880:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1913us (1943us total) trans 4296020587 rc 0/0 00010000:00010000:3.0:1721880422.428299:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727cd64 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.428303:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632614 00010000:00010000:3.0:1721880422.428303:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8b40/0x8a60d30f5727cd64 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.428312:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011ef28380/2, rc 0, transno 1053290 00010000:00010000:0.0:1721880422.428318:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727cd56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.428324:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727cd56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.428325:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88011ef28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011835136:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.428329:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727cd56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.428333:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727cd56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.428334:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88013107a300/2, rc 0, transno 1053291 00000100:00100000:2.0:1721880422.428336:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013107a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011834880:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.428337:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727cd56 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.428340:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325df80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.428342:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727cd56 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.428346:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727cd56 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.428351:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727cd56 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.428355:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325df80/0x8a60d30f5727cd56 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.428365:0:9458:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88011ef29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2527:3688:x1805522011835392:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1489us (1527us total) trans 4296020588 rc 0/0 00000100:00100000:1.0:1721880422.428372:0:9458:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632616 00000004:00080000:2.0:1721880422.428372:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011ef29f80/2, rc 0, transno 1053292 00000100:00100000:2.0:1721880422.428375:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88011ef29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011835392:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.428386:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2526:3687:x1805522011835648:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1314us (1343us total) trans 4296020589 rc 0/0 00000100:00100000:3.0:1721880422.428390:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632619 00000004:00080000:2.0:1721880422.428392:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099ad4380/2, rc 0, transno 1053293 00000100:00100000:0.0:1721880422.428394:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1721880422.428401:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099ad4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011835648:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.428404:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.428405:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e22d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011836928:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.428409:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e22c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011837056:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.428412:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e22f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011837184:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.428417:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.428425:0:7117:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257779200 00000100:00100000:2.0:1721880422.428427:0:7117:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257779200 00000100:00100000:0.0:1721880422.428430:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.428435:0:7117:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009be04000/0x8a60d30f571ec382 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a8a3 expref: 729 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.428446:0:7117:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914812 00000100:00100000:0.0:1721880422.428449:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011837312:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.428449:0:7117:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30425778-2709-4512-9d75-01ec53c4cfad+729:2005:x1805522257779200:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.428453:0:9458:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011836928 00010000:00010000:2.0:1721880422.428453:0:7117:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.428456:0:7117:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009be04000/0x8a60d30f571ec382 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd84:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a8a3 expref: 729 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.428457:0:9458:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011836928 00000100:00100000:0.0:1721880422.428461:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.428462:0:7117:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009be04000/0x8a60d30f571ec382 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd84:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a8a3 expref: 729 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.428469:0:7117:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009be04000/0x8a60d30f571ec382 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd84:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a8a3 expref: 729 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.428470:0:9458:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011837184 00000100:00100000:1.0:1721880422.428473:0:9458:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011837184 00010000:00010000:2.0:1721880422.428477:0:7117:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.428477:0:7117:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.428479:0:7117:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727cd5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.428481:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.428483:0:9458:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011837312 00010000:00010000:2.0:1721880422.428483:0:7117:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727cd5d lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.428485:0:9458:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011837312 00000100:00100000:3.0:1721880422.428491:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257779456 00010000:00010000:2.0:1721880422.428493:0:7117:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.428493:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257779456 00000100:00100000:1.0:1721880422.428497:0:9458:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632622 00000100:00100000:1.0:1721880422.428502:0:9458:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135756a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2529:3686:x1805522011836928:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.428503:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009be07cc0/0x8a60d30f571ec3ac lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a8cd expref: 729 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.428506:0:7117:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30425778-2709-4512-9d75-01ec53c4cfad+729:2005:x1805522257779200:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 56us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.428510:0:7117:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914812 00002000:00080000:1.0:1721880422.428514:0:9458:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64903 count 1 00000100:00100000:3.0:1721880422.428514:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914813 00000100:00100000:3.0:1721880422.428516:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135755c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+728:2005:x1805522257779456:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.428521:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.428523:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009be07cc0/0x8a60d30f571ec3ac lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd85:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a8cd expref: 728 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.428524:0:9458:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727cd79 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd87:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.428529:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632623 00010000:00010000:3.0:1721880422.428529:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009be07cc0/0x8a60d30f571ec3ac lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd85:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a8cd expref: 728 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.428533:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2529:3689:x1805522011837184:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.428534:0:9458:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132c28b40/0x8a60d30f571ec3f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a913 expref: 728 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.428536:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.428537:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.428538:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727cd6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd85:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.428540:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.428542:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00002000:00080000:2.0:1721880422.428542:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64905 count 1 00010000:00010000:3.0:1721880422.428542:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727cd6b lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd85:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.428544:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e22ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2529:3689:x1805522011835520:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1601us (1627us total) trans 4296020590 rc 0/0 00010000:00010000:1.0:1721880422.428544:0:9458:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727cd79 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.428548:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632617 00010000:00010000:2.0:1721880422.428549:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727cd80 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd89:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.428551:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.428556:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c56c240/0x8a60d30f571ec446 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a967 expref: 728 pid: 16126 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.428559:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632624 00000100:00100000:0.0:1721880422.428561:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092857050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2528:3689:x1805522011837312:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.428561:0:9458:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132c28b40/0x8a60d30f571ec3f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a913 expref: 728 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.428561:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.428562:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.428563:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727cd80 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.428563:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135755c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+728:2005:x1805522257779456:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 46us (83us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.428567:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914813 00002000:00080000:0.0:1721880422.428569:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64906 count 1 00010000:00010000:2.0:1721880422.428573:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c56c240/0x8a60d30f571ec446 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a967 expref: 727 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.428575:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727cd87 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.428575:0:9458:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132c28b40/0x8a60d30f571ec3f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a913 expref: 727 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.428579:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c56c240/0x8a60d30f571ec446 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a967 expref: 727 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.428583:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132d0df80/0x8a60d30f571ec470 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a991 expref: 727 pid: 16126 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.428585:0:9458:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012edb2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011837440:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.428585:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880123809c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011837568:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.428587:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.428588:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.428589:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727cd87 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.428599:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132d0df80/0x8a60d30f571ec470 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a991 expref: 727 pid: 16126 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.428600:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec3c0 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.428605:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132d0df80/0x8a60d30f571ec470 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a991 expref: 727 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.428608:0:9458:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a180 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.428610:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009be59180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011837696:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.428618:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.428624:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e840 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.428628:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011837056 00000100:00100000:1.0:1721880422.428631:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011837056 00000004:00080000:0.0:1721880422.428638:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88011ef29c00/2, rc 0, transno 1053294 00000100:00100000:0.0:1721880422.428643:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88011ef29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011835520:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.428649:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632625 00000100:00100000:1.0:1721880422.428653:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880123808700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2529:3687:x1805522011837056:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.428664:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64904 count 1 00010000:00010000:0.0:1721880422.428665:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727cd5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.428667:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009a1d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011837824:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.428670:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727cd5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.428673:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727cd8e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd88:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.428674:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727cd5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.428677:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727cd5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.428678:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.428681:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727cd5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.428684:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325f840 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.428684:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f490900/0x8a60d30f571ec41c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a944 expref: 727 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.428686:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727cd5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.428689:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727cd5d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.428689:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1721880422.428689:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011837824 00010000:00010000:1.0:1721880422.428691:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1721880422.428692:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011837824 00010000:00010000:1.0:1721880422.428693:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727cd8e lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.428695:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727cd5d lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.428698:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325f840/0x8a60d30f5727cd5d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.428703:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632626 00000100:00100000:3.0:1721880422.428706:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012380aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2530:3686:x1805522011837824:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.428709:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f490900/0x8a60d30f571ec41c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a944 expref: 727 pid: 16099 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.428714:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64907 count 1 00010000:00010000:1.0:1721880422.428718:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f490900/0x8a60d30f571ec41c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a944 expref: 727 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.428721:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727cd95 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd8b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.428748:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091145b00/0x8a60d30f571ec48c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9ad expref: 727 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.428752:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.428753:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1721880422.428755:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012edb0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011837952:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.428755:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727cd95 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.428798:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2531:3687:x1805522011835904:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1753us (1815us total) trans 4296020591 rc 0/0 00000100:00100000:0.0:1721880422.428803:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632618 00000004:00080000:2.0:1721880422.428803:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099ad4e00/2, rc 0, transno 1053295 00000100:00100000:2.0:1721880422.428807:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099ad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011835904:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.428818:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091145b00/0x8a60d30f571ec48c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9ad expref: 727 pid: 16039 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.428823:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1721880422.428823:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091145b00/0x8a60d30f571ec48c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9ad expref: 727 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.428824:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009be07cc0/0x8a60d30f571ec3ac lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a8cd expref: 727 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.428827:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011838208:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.428833:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008c735500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011836544:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.428833:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135754e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011838080:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.428839:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.428850:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03540 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.428858:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011838208 00010000:00010000:0.0:1721880422.428859:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727cd6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.428862:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011838208 00010000:00010000:0.0:1721880422.428864:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727cd6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.428867:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727cd6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.428871:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727cd6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.428875:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727cd6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.428878:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727cd6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.428879:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632627 00000100:00100000:1.0:1721880422.428884:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800956c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2531:3686:x1805522011838208:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.428885:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325e1c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.428887:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727cd6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.428891:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727cd6b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.428894:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64908 count 1 00010000:00010000:0.0:1721880422.428896:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727cd6b lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.428899:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325e1c0/0x8a60d30f5727cd6b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.428904:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727cd9c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.428914:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013097a400/0x8a60d30f571ec49a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9bb expref: 726 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.428920:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.428922:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.428924:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727cd9c lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.428939:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013097a400/0x8a60d30f571ec49a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9bb expref: 726 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.428947:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013097a400/0x8a60d30f571ec49a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9bb expref: 726 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.428956:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012edb0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011838336:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.428977:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a780 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.428994:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.429047:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012380b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2532:3688:x1805522011836288:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1897us (1925us total) trans 4296020592 rc 0/0 00000100:00100000:0.0:1721880422.429051:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632620 00000004:00080000:2.0:1721880422.429052:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012380ad80/2, rc 0, transno 1053296 00000100:00100000:2.0:1721880422.429057:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012380ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011836288:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.429087:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135757800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011838464:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.429100:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.429109:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011838464 00000100:00100000:0.0:1721880422.429112:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011838464 00000100:00100000:0.0:1721880422.429122:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632628 00000100:00100000:0.0:1721880422.429124:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800888cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2532:3688:x1805522011838464:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.429132:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64909 count 1 00010000:00010000:0.0:1721880422.429139:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727cda3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.429146:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096743840/0x8a60d30f571ec4a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9c9 expref: 726 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.429154:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.429155:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.429157:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727cda3 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.429166:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096743840/0x8a60d30f571ec4a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9c9 expref: 726 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.429171:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096743840/0x8a60d30f571ec4a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9c9 expref: 726 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.429178:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009a1d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011838592:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.429201:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e780 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.429473:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008c737b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011836800:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.429477:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.429485:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727cd72 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.429493:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880123809c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011837568:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.429505:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727cd80 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.429510:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.429518:0:8793:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257779712 00000100:00100000:3.0:1721880422.429519:0:8793:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257779712 00000100:00100000:2.0:1721880422.429522:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257779968 00000100:00100000:2.0:1721880422.429524:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257779968 00010000:00010000:3.0:1721880422.429528:0:8793:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c56c240/0x8a60d30f571ec446 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a967 expref: 728 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.429533:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091145b00/0x8a60d30f571ec48c lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9ad expref: 728 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.429542:0:8793:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914814 00000100:00100000:3.0:1721880422.429544:0:8793:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a1d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30425778-2709-4512-9d75-01ec53c4cfad+728:2005:x1805522257779712:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.429546:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914815 00000100:00100000:2.0:1721880422.429550:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a1d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+728:2004:x1805522257779968:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.429553:0:9458:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012edb2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011837440:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.429555:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.429558:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091145b00/0x8a60d30f571ec48c lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9ad expref: 728 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.429559:0:8793:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.429562:0:8793:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c56c240/0x8a60d30f571ec446 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a967 expref: 728 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.429564:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091145b00/0x8a60d30f571ec48c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9ad expref: 728 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.429567:0:9458:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727cd79 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.429568:0:8793:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c56c240/0x8a60d30f571ec446 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a967 expref: 728 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.429572:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.429573:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.429575:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727cd95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.429576:0:8793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c56c240/0x8a60d30f571ec446 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a967 expref: 728 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.429579:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727cd95 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.429583:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012edb0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011838336:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.429583:0:8793:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.429585:0:8793:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.429586:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.429587:0:8793:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727cd80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.429588:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.429591:0:8793:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727cd80 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.429595:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727cd9c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.429597:0:8793:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.429600:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a1d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+727:2004:x1805522257779968:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 50us (90us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.429604:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914815 00000100:00100000:1.0:1721880422.429609:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012edb0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011837952:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.429611:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257780096 00000100:00100000:2.0:1721880422.429612:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257780096 00010000:00010000:1.0:1721880422.429614:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727cd8e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.429618:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132d0df80/0x8a60d30f571ec470 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a991 expref: 727 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.429626:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914816 00000100:00100000:2.0:1721880422.429628:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a1db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+727:2004:x1805522257780096:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.429632:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.429635:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132d0df80/0x8a60d30f571ec470 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a991 expref: 727 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.429640:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132d0df80/0x8a60d30f571ec470 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a991 expref: 727 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.429646:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.429646:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.429648:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727cd87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.429649:0:8793:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a1d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30425778-2709-4512-9d75-01ec53c4cfad+727:2005:x1805522257779712:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 104us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.429653:0:8793:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914814 00010000:00010000:2.0:1721880422.429656:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727cd87 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.429659:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132d0df80/0x8a60d30f571ec470 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd8a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a991 expref: 727 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.429662:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.429665:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727cd80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.429668:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009be59180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011837696:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.429670:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727cd80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.429672:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a1db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+725:2004:x1805522257780096:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 42us (84us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.429673:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.429674:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727cd80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.429676:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914816 00010000:00010000:3.0:1721880422.429678:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727cd80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.429683:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727cd80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.429686:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352ac0 already unused, calling callback (ffffffffa084e330) 00000100:00100000:2.0:1721880422.429687:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257780224 00010000:00010000:3.0:1721880422.429688:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727cd80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.429689:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257780224 00010000:00010000:0.0:1721880422.429692:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727cd87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.429692:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727cd80 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.429694:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013097a400/0x8a60d30f571ec49a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9bb expref: 725 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.429697:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727cd87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.429698:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727cd80 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.429702:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727cd80 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.429704:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.429706:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727cd87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.429709:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257780352 00010000:00010000:0.0:1721880422.429711:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727cd87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.429712:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257780352 00010000:00010000:0.0:1721880422.429715:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727cd87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.429719:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727cd87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.429719:0:8793:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914817 00010000:00010000:2.0:1721880422.429721:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f490900/0x8a60d30f571ec41c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a944 expref: 726 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.429723:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325f600 already unused, calling callback (ffffffffa084e330) 00000100:00100000:3.0:1721880422.429723:0:8793:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30425778-2709-4512-9d75-01ec53c4cfad+726:2006:x1805522257780224:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.429725:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727cd87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.429742:0:8793:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.429745:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727cd87 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.429745:0:8793:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013097a400/0x8a60d30f571ec49a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9bb expref: 726 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.429751:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727cd87 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.429751:0:8793:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013097a400/0x8a60d30f571ec49a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9bb expref: 726 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.429755:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325f600/0x8a60d30f5727cd87 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.429755:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914818 00000100:00100000:1.0:1721880422.429757:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.429758:0:8793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013097a400/0x8a60d30f571ec49a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9bb expref: 726 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.429760:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e196850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+726:2004:x1805522257780352:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.429763:0:8793:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.429764:0:8793:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.429766:0:8793:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727cd9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.429767:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.429768:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257779584 00000100:00100000:1.0:1721880422.429771:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257779584 00010000:00010000:2.0:1721880422.429771:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f490900/0x8a60d30f571ec41c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a944 expref: 725 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.429773:0:8793:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727cd9c lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.429779:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f490900/0x8a60d30f571ec41c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a944 expref: 726 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.429782:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d9aeac0/0x8a60d30f571ec3cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a8f0 expref: 726 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.429782:0:8793:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.429793:0:8793:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30425778-2709-4512-9d75-01ec53c4cfad+726:2006:x1805522257780224:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 70us (121us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.429795:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f490900/0x8a60d30f571ec41c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a944 expref: 726 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.429797:0:8793:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914817 00000100:00100000:1.0:1721880422.429805:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914819 00010000:00010000:2.0:1721880422.429805:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.429806:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1721880422.429809:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+724:2005:x1805522257779584:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.429809:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727cd8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.429815:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.429815:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727cd8e lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.429818:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d9aeac0/0x8a60d30f571ec3cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a8f0 expref: 724 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.429828:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d9aeac0/0x8a60d30f571ec3cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a8f0 expref: 724 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.429828:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.429837:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d9aeac0/0x8a60d30f571ec3cf lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a8f0 expref: 724 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.429844:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.429845:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.429845:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e196850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+723:2004:x1805522257780352:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 85us (140us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.429848:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727cd72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.429851:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914818 00010000:00010000:1.0:1721880422.429852:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727cd72 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.429862:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.429863:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880092857050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2534:3689:x1805522011837312:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1301us (1400us total) trans 4296020593 rc 0/0 00000100:00100000:0.0:1721880422.429868:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632624 00000100:00100000:1.0:1721880422.429877:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+722:2005:x1805522257779584:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 68us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.429882:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914819 00000004:00080000:0.0:1721880422.429886:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880085830380/2, rc 0, transno 1053297 00000100:00100000:0.0:1721880422.429891:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011837312:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.429891:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2533:3689:x1805522011837184:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1356us (1458us total) trans 4296020594 rc 0/0 00010000:00010000:1.0:1721880422.429896:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727cd9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.429898:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632623 00010000:00010000:2.0:1721880422.429900:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727cd72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.429901:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727cd9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.429905:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727cd9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.429907:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727cd72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.429912:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727cd9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.429914:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e22f800/2, rc 0, transno 1053298 00010000:00010000:2.0:1721880422.429914:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727cd72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.429916:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727cd9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.429918:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e22f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011837184:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.429920:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4d80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.429920:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727cd72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.429921:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727cd9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.429925:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727cd9c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.429930:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727cd9c lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.429930:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091145b00/0x8a60d30f571ec48c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9ad expref: 721 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.429931:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009a1d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011838720:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.429931:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727cd72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.429934:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4d80/0x8a60d30f5727cd9c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.429936:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325db00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.429938:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727cd72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.429942:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727cd72 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.429942:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135754e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011838080:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.429948:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727cd72 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.429952:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325db00/0x8a60d30f5727cd72 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.429955:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727cd95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.429961:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727cd95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.429967:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727cd95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.429973:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727cd95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.429983:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727cd95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.429989:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727cd95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.429994:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aab840 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.429996:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727cd95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.429999:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.430002:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727cd95 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.430026:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727cd95 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.430032:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aab840/0x8a60d30f5727cd95 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.430045:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800956c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2534:3686:x1805522011838208:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1160us (1204us total) trans 4296020595 rc 0/0 00000100:00100000:1.0:1721880422.430049:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632627 00000100:00100000:1.0:1721880422.430059:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011838720 00000100:00100000:1.0:1721880422.430061:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011838720 00000100:00100000:2.0:1721880422.430070:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c737480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2535:3689:x1805522011836672:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1957us (2039us total) trans 4296020596 rc 0/0 00000004:00080000:0.0:1721880422.430072:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008c736a00/2, rc 0, transno 1053300 00000100:00100000:1.0:1721880422.430073:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632629 00000100:00100000:1.0:1721880422.430076:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a1d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2535:3689:x1805522011838720:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.430077:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008c736a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011836672:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.430077:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632621 00002000:00080000:1.0:1721880422.430086:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64910 count 1 00010000:00010000:1.0:1721880422.430093:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727cdaa lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.430099:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009a1d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011838848:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.430100:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096741f80/0x8a60d30f571ec4b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9d7 expref: 720 pid: 16039 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.430104:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009a1d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011838592:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.430105:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.430106:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.430107:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727cdaa lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.430113:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727cda3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.430115:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.430118:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096741f80/0x8a60d30f571ec4b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9d7 expref: 720 pid: 16039 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.430120:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012380aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2534:3686:x1805522011837824:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1412us (1439us total) trans 4296020597 rc 0/0 00000100:00100000:0.0:1721880422.430122:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011838848 00010000:00010000:1.0:1721880422.430123:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096741f80/0x8a60d30f571ec4b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9d7 expref: 720 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.430124:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632626 00000100:00100000:0.0:1721880422.430125:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011838848 00000004:00080000:2.0:1721880422.430129:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008fc50a80/2, rc 0, transno 1053299 00000100:00100000:1.0:1721880422.430130:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012edb2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011839104:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.430134:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632630 00000100:00100000:3.0:1721880422.430136:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800888cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2534:3686:x1805522011838848:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.430138:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011838208:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1721880422.430145:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009a1d9880/2, rc 0, transno 1053301 00002000:00080000:3.0:1721880422.430145:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64911 count 1 00000100:00100000:1.0:1721880422.430146:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.430147:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009a1d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011837824:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.430152:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727cdb1 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.430153:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1721880422.430155:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727cd8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.430155:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009a1db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011838976:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.430159:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727cd8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.430159:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013063af40/0x8a60d30f571ec4d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9f3 expref: 720 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.430163:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727cd8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.430163:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.430164:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.430165:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727cdb1 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.430167:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.430168:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009be59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011839360:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.430168:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727cd8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.430171:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727cd8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.430174:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b5f80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.430175:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013063af40/0x8a60d30f571ec4d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9f3 expref: 720 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.430176:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727cd8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.430178:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009a1d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011839232:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.430180:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727cd8e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.430180:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013063af40/0x8a60d30f571ec4d2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9f3 expref: 720 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.430186:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727cd8e lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.430186:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135754e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011839488:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.430189:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.430189:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727cd8e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.430194:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011838976 00000100:00100000:2.0:1721880422.430196:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011838976 00000100:00100000:3.0:1721880422.430200:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03540 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.430206:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011839360 00000100:00100000:2.0:1721880422.430207:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011839360 00000100:00100000:3.0:1721880422.430211:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632631 00000100:00100000:3.0:1721880422.430215:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800888cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2536:3686:x1805522011838976:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.430217:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632632 00000100:00100000:0.0:1721880422.430222:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c737b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2536:3689:x1805522011839360:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.430222:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64912 count 1 00000100:00100000:2.0:1721880422.430224:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.430227:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727cdb8 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd90:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1721880422.430233:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64914 count 1 00000100:00100000:2.0:1721880422.430234:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011839232 00010000:00010000:3.0:1721880422.430234:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880123328b40/0x8a60d30f571ec4f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa16 expref: 720 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.430236:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011839232 00010000:00010000:3.0:1721880422.430241:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.430242:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.430243:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727cdbf lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd92:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.430243:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727cdb8 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.430244:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632633 00000100:00100000:2.0:1721880422.430247:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012387f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2538:3688:x1805522011839232:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.430252:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094102400/0x8a60d30f571ec52d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa4e expref: 720 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.430252:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880123328b40/0x8a60d30f571ec4f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa16 expref: 720 pid: 16101 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.430255:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64913 count 1 00010000:00010000:3.0:1721880422.430256:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880123328b40/0x8a60d30f571ec4f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa16 expref: 720 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.430258:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.430260:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1721880422.430261:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135756680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011839616:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.430262:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727cdbf lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.430263:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727cdc6 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd91:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.430272:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801350d6f40/0x8a60d30f571ec511 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa32 expref: 720 pid: 16099 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.430272:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03e40 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.430275:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880123808700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2538:3687:x1805522011837056:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1620us (1655us total) trans 4296020598 rc 0/0 00010000:00010000:0.0:1721880422.430276:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094102400/0x8a60d30f571ec52d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa4e expref: 720 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.430276:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.430277:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.430278:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727cdc6 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.430280:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632625 00010000:00010000:0.0:1721880422.430285:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094102400/0x8a60d30f571ec52d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa4e expref: 720 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.430289:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801350d6f40/0x8a60d30f571ec511 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa32 expref: 720 pid: 16099 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.430295:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008c735500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011839744:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.430298:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801350d6f40/0x8a60d30f571ec511 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa32 expref: 720 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.430304:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012387c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011839872:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.430315:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e780 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.430317:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec840 going to sleep for 11 seconds 00000004:00080000:2.0:1721880422.430331:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e22c700/2, rc 0, transno 1053302 00000100:00100000:2.0:1721880422.430336:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e22c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011837056:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.430348:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.430358:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257779840 00000100:00100000:2.0:1721880422.430360:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257779840 00010000:00010000:2.0:1721880422.430369:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132c28b40/0x8a60d30f571ec3f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a913 expref: 721 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.430372:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1721880422.430378:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012edb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011840000:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.430380:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914820 00000100:00100000:2.0:1721880422.430382:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+721:2005:x1805522257779840:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.430386:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.430389:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132c28b40/0x8a60d30f571ec3f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a913 expref: 721 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.430393:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.430394:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132c28b40/0x8a60d30f571ec3f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a913 expref: 721 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.430402:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132c28b40/0x8a60d30f571ec3f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a913 expref: 721 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.430406:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011840000 00000100:00100000:3.0:1721880422.430409:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011840000 00010000:00010000:2.0:1721880422.430412:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.430413:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.430415:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727cd79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.430420:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727cd79 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.430422:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632634 00000100:00100000:3.0:1721880422.430424:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2538:3687:x1805522011840000:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.430428:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00080000:3.0:1721880422.430432:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64915 count 1 00010000:00010000:1.0:1721880422.430434:0:9458:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727cd79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.430439:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.430439:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727cdcd lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd93:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.430440:0:9458:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727cd79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.430442:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+720:2005:x1805522257779840:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 58us (94us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.430444:0:9458:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727cd79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.430446:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914820 00010000:00010000:3.0:1721880422.430446:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e997600/0x8a60d30f571ec549 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa6a expref: 720 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.430448:0:9458:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727cd79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.430451:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.430452:0:9458:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727cd79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.430452:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.430454:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727cdcd lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.430455:0:9458:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b46c0 already unused, calling callback (ffffffffa084e330) 00000100:00100000:2.0:1721880422.430455:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257780480 00010000:00010000:1.0:1721880422.430456:0:9458:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727cd79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.430458:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257780480 00010000:00010000:1.0:1721880422.430460:0:9458:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727cd79 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.430466:0:9458:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727cd79 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.430466:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096743840/0x8a60d30f571ec4a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9c9 expref: 720 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.430469:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727cd79 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.430470:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e997600/0x8a60d30f571ec549 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa6a expref: 720 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.430476:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e997600/0x8a60d30f571ec549 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa6a expref: 720 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.430483:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135755c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011840128:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.430490:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914821 00000100:00100000:2.0:1721880422.430495:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+720:2004:x1805522257780480:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.430502:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.430505:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096743840/0x8a60d30f571ec4a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9c9 expref: 720 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.430508:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03000 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.430513:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096743840/0x8a60d30f571ec4a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9c9 expref: 720 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.430528:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096743840/0x8a60d30f571ec4a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9c9 expref: 720 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.430536:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.430537:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.430539:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727cda3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.430546:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727cda3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.430549:0:9458:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135756a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2539:3686:x1805522011836928:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2046us (2130us total) trans 4296020599 rc 0/0 00000100:00100000:1.0:1721880422.430553:0:9458:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632622 00010000:00010000:2.0:1721880422.430559:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.430565:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727cda3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.430570:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727cda3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.430575:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727cda3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.430579:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727cda3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.430579:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+719:2004:x1805522257780480:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 83us (138us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.430583:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727cda3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.430585:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914821 00010000:00010000:0.0:1721880422.430586:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325fa80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.430588:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727cda3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.430592:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727cda3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.430598:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727cda3 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.430601:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325fa80/0x8a60d30f5727cda3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.430613:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e22d880/2, rc 0, transno 1053303 00000100:00100000:2.0:1721880422.430621:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e22d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011836928:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.430647:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1721880422.430653:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011840256:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.430669:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.430686:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800888cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2539:3688:x1805522011838464:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1560us (1584us total) trans 4296020600 rc 0/0 00000100:00100000:0.0:1721880422.430690:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632628 00000100:00100000:1.0:1721880422.430692:0:9458:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011840256 00000100:00100000:1.0:1721880422.430695:0:9458:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011840256 00000004:00080000:3.0:1721880422.430695:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880135757800/2, rc 0, transno 1053304 00000100:00100000:3.0:1721880422.430701:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135757800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011838464:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.430708:0:9458:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632635 00000100:00100000:1.0:1721880422.430711:0:9458:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012387e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2539:3686:x1805522011840256:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.430719:0:9458:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64916 count 1 00000100:00100000:3.0:1721880422.430726:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012387c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011840384:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.430746:0:9458:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727cdd4 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.430754:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.430756:0:9458:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009735c000/0x8a60d30f571ec55e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa7f expref: 718 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.430762:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.430763:0:9458:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.430765:0:9458:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727cdd4 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.430781:0:9458:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009735c000/0x8a60d30f571ec55e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa7f expref: 718 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.430789:0:9458:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009735c000/0x8a60d30f571ec55e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa7f expref: 718 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.430797:0:9458:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012edb0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011840512:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.430801:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011840384 00000100:00100000:0.0:1721880422.430804:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011840384 00000100:00100000:0.0:1721880422.430817:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632636 00000100:00100000:0.0:1721880422.430820:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012380b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2540:3688:x1805522011840384:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.430823:0:9458:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a3c0 going to sleep for 11 seconds 00002000:00080000:0.0:1721880422.430828:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64917 count 1 00010000:00010000:0.0:1721880422.430836:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727cddb lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.430885:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800941033c0/0x8a60d30f571ec57a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa9b expref: 718 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.430890:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.430891:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.430893:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727cddb lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.430905:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800941033c0/0x8a60d30f571ec57a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa9b expref: 718 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.430911:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800941033c0/0x8a60d30f571ec57a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa9b expref: 718 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.430917:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011840640:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.430919:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012edb2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011839104:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.430930:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727cdaa lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.430935:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135754e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011839488:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.430938:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e840 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.430944:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727cdb1 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.431207:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.431223:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135756680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011839616:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.431232:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727cdb8 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.431233:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257780608 00000100:00100000:2.0:1721880422.431236:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257780608 00010000:00010000:2.0:1721880422.431245:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096741f80/0x8a60d30f571ec4b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9d7 expref: 719 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.431257:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.431257:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914822 00000100:00100000:2.0:1721880422.431260:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+719:2005:x1805522257780608:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.431265:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.431267:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096741f80/0x8a60d30f571ec4b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9d7 expref: 719 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.431271:0:15455:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257780736 00010000:00010000:2.0:1721880422.431273:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096741f80/0x8a60d30f571ec4b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9d7 expref: 719 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.431275:0:15455:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257780736 00010000:00010000:2.0:1721880422.431281:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096741f80/0x8a60d30f571ec4b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9d7 expref: 720 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.431287:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.431287:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.431287:0:15455:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013063af40/0x8a60d30f571ec4d2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9f3 expref: 719 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.431290:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727cdaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.431291:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.431297:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727cdaa lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.431303:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.431303:0:15455:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257780992 00000100:00100000:3.0:1721880422.431306:0:15455:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257780992 00010000:00010000:2.0:1721880422.431312:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.431313:0:16158:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257780864 00000100:00100000:0.0:1721880422.431314:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.431314:0:15455:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880123328b40/0x8a60d30f571ec4f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa16 expref: 720 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.431317:0:16158:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257780864 00000100:00100000:0.0:1721880422.431322:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257781120 00000100:00100000:0.0:1721880422.431324:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257781120 00000100:00100000:3.0:1721880422.431329:0:15455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914823 00010000:00010000:1.0:1721880422.431330:0:16158:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094102400/0x8a60d30f571ec52d lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa4e expref: 722 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.431332:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+722:2005:x1805522257780608:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 69us (124us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.431334:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801350d6f40/0x8a60d30f571ec511 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa32 expref: 722 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.431334:0:15455:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+722:2005:x1805522257780736:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.431338:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914822 00010000:00010000:3.0:1721880422.431341:0:15455:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.431345:0:15455:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013063af40/0x8a60d30f571ec4d2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9f3 expref: 722 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.431353:0:16158:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914824 00010000:00010000:3.0:1721880422.431354:0:15455:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013063af40/0x8a60d30f571ec4d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9f3 expref: 721 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.431358:0:16158:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+721:2005:x1805522257780992:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.431364:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914825 00010000:00010000:3.0:1721880422.431365:0:15455:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013063af40/0x8a60d30f571ec4d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12a9f3 expref: 721 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.431366:0:16158:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1721880422.431368:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914826 00010000:00010000:1.0:1721880422.431370:0:16158:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880123328b40/0x8a60d30f571ec4f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa16 expref: 721 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.431370:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ab4d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+721:2007:x1805522257780864:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.431371:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bea3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+721:2007:x1805522257781120:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.431376:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.431377:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.431377:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.431378:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.431379:0:16158:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880123328b40/0x8a60d30f571ec4f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa16 expref: 720 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.431380:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801350d6f40/0x8a60d30f571ec511 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd91:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa32 expref: 720 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.431380:0:15455:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727cdb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.431383:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094102400/0x8a60d30f571ec52d lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd92:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa4e expref: 720 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.431386:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801350d6f40/0x8a60d30f571ec511 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd91:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa32 expref: 720 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.431386:0:15455:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727cdb1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.431391:0:16158:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123328b40/0x8a60d30f571ec4f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa16 expref: 720 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.431392:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094102400/0x8a60d30f571ec52d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd92:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa4e expref: 720 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.431400:0:15455:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.431402:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.431404:0:16158:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.431404:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.431405:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.431407:0:16158:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727cdb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.431408:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727cdbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd92:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.431414:0:16158:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727cdb8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.431414:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727cdbf lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd92:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.431418:0:15455:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+719:2005:x1805522257780736:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 84us (160us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.431424:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.431424:0:15455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914823 00010000:00010000:1.0:1721880422.431429:0:16158:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.431436:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.431440:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ab4d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+718:2007:x1805522257780864:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 71us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.431446:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914825 00010000:00010000:3.0:1721880422.431446:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727cdb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.431447:0:16158:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_012:30425778-2709-4512-9d75-01ec53c4cfad+718:2005:x1805522257780992:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 88us (154us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.431453:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727cdb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.431454:0:16158:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914824 00010000:00010000:3.0:1721880422.431460:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727cdb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.431466:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727cdb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.431473:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727cdb1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.431478:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801350d6f40/0x8a60d30f571ec511 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd91:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa32 expref: 716 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.431478:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aaba80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.431479:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.431481:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727cdb1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.431482:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727cdc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd91:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.431486:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727cdc6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.431487:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727cdb1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.431488:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012387c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011839872:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.431491:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727cdb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.431494:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.431496:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727cdb1 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.431498:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727cdb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.431499:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727cdc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.431506:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727cdb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.431507:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727cdc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.431507:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aaba80/0x8a60d30f5727cdb1 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.431508:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bea3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+715:2007:x1805522257781120:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 136us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.431512:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914826 00010000:00010000:1.0:1721880422.431512:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727cdb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.431518:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727cdc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.431519:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727cdb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.431524:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa9200 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.431526:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727cdc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.431527:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727cdb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.431533:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727cdb8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.431533:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727cdc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.431539:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727cdc6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.431542:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727cdb8 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.431545:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136351200 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.431547:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727cdc6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.431554:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9200/0x8a60d30f5727cdb8 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.431554:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727cdc6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.431557:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.431562:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727cdc6 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.431563:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257781248 00000100:00100000:0.0:1721880422.431565:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257781248 00010000:00010000:2.0:1721880422.431568:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727cdc6 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.431572:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e997600/0x8a60d30f571ec549 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa6a expref: 715 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.431581:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914827 00000100:00100000:0.0:1721880422.431584:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091211880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+715:2005:x1805522257781248:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.431589:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.431591:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e997600/0x8a60d30f571ec549 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa6a expref: 715 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.431597:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e997600/0x8a60d30f571ec549 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa6a expref: 715 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.431604:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.431604:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.431606:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727cdcd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.431610:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727cdcd lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd93:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.431611:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800888cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2542:3686:x1805522011838848:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1471us (1493us total) trans 4296020601 rc 0/0 00010000:00010000:0.0:1721880422.431616:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.431617:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632630 00000100:00100000:0.0:1721880422.431625:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880091211880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+715:2005:x1805522257781248:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 40us (68us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.431629:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914827 00010000:00010000:3.0:1721880422.431657:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e997600/0x8a60d30f571ec549 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd93:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa6a expref: 714 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.431666:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135755c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011840128:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.431677:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800888cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2542:3686:x1805522011838976:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1459us (1507us total) trans 4296020602 rc 0/0 00010000:00010000:3.0:1721880422.431677:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727cdcd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.431683:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632631 00010000:00010000:3.0:1721880422.431685:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727cdcd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.431689:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012387f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2542:3688:x1805522011839232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1438us (1461us total) trans 4296020603 rc 0/0 00000100:00100000:0.0:1721880422.431690:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.431691:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727cdcd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.431695:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632633 00000100:00100000:0.0:1721880422.431696:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257781376 00010000:00010000:3.0:1721880422.431697:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727cdcd lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.431698:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257781376 00010000:00010000:3.0:1721880422.431703:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727cdcd lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.431704:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009735c000/0x8a60d30f571ec55e lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa7f expref: 714 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.431714:0:9458:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012edb0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9458:1805522011840512:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.431714:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727cdcd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.431716:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914828 00000100:00100000:0.0:1721880422.431718:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bc2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+714:2004:x1805522257781376:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.431720:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8240 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.431722:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727cdcd lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.431723:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00080000:2.0:1721880422.431723:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009a1db800/2, rc 0, transno 1053306 00010000:00010000:0.0:1721880422.431725:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009735c000/0x8a60d30f571ec55e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa7f expref: 714 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.431746:0:9458:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727cdd4 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.431747:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009735c000/0x8a60d30f571ec55e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa7f expref: 714 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.431749:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009a1db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011838976:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.431749:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727cdcd lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.431755:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009735c000/0x8a60d30f571ec55e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa7f expref: 714 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.431758:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727cdcd lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.431764:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.431764:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8240/0x8a60d30f5727cdcd lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.431765:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.431766:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727cdd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.431771:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727cdd4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.431773:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094102400/0x8a60d30f571ec52d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa4e expref: 713 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.431778:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012387c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011840768:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.431780:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.431783:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008c735500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011839744:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.431790:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bc2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+712:2004:x1805522257781376:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 71us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.431793:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914828 00000100:00100000:2.0:1721880422.431796:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.431808:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727cdbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.431811:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011840640:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.431815:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727cdbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.431817:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009a1d8380/2, rc 0, transno 1053305 00010000:00010000:1.0:1721880422.431821:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727cdbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.431821:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009a1d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011838848:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.431823:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727cddb lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.431828:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727cdbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.431833:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727cdbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.431836:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012387ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011840896:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.431840:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727cdbf lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.431845:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325e640 already unused, calling callback (ffffffffa084e330) 00000100:00100000:2.0:1721880422.431847:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.431848:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727cdbf lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.431855:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727cdbf lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.431863:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2541:3687:x1805522011840000:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1436us (1467us total) trans 4296020604 rc 0/0 00010000:00010000:1.0:1721880422.431864:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727cdbf lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.431864:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012edb1f80/2, rc 0, transno 1053308 00000100:00100000:0.0:1721880422.431865:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.431867:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012edb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011840000:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.431870:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632634 00010000:00010000:1.0:1721880422.431871:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325e640/0x8a60d30f5727cdbf lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.431874:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257781504 00000100:00100000:0.0:1721880422.431876:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257781504 00000100:00100000:2.0:1721880422.431879:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1721880422.431881:0:16089:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011840768 00000100:00100000:2.0:1721880422.431882:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012387dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011841024:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.431884:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800941033c0/0x8a60d30f571ec57a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa9b expref: 712 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.431884:0:16089:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011840768 00000100:00100000:0.0:1721880422.431893:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914829 00000100:00100000:0.0:1721880422.431898:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+712:2004:x1805522257781504:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.431899:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.431899:0:16089:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632637 00010000:00010000:0.0:1721880422.431902:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.431903:0:16089:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012387f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2541:3689:x1805522011840768:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.431904:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800941033c0/0x8a60d30f571ec57a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa9b expref: 712 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.431911:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800941033c0/0x8a60d30f571ec57a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa9b expref: 712 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.431911:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011840896 00002000:00080000:3.0:1721880422.431912:0:16089:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64918 count 1 00000100:00100000:2.0:1721880422.431913:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011840896 00010000:00010000:0.0:1721880422.431918:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800941033c0/0x8a60d30f571ec57a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aa9b expref: 712 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.431921:0:16089:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727cde2 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.431923:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011841024 00010000:00010000:0.0:1721880422.431924:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.431924:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011841024 00010000:00010000:0.0:1721880422.431925:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.431926:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727cddb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.431930:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727cddb lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.431931:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632638 00000100:00100000:2.0:1721880422.431935:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012387d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2544:3686:x1805522011840896:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.431935:0:16089:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801239b4000/0x8a60d30f571ec596 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aab7 expref: 711 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.431939:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.431942:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00002000:00080000:2.0:1721880422.431943:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64919 count 1 00010000:00010000:3.0:1721880422.431944:0:16089:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.431946:0:16089:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727cde2 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.431948:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+711:2004:x1805522257781504:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 52us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.431951:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914829 00010000:00010000:2.0:1721880422.431951:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727cde9 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.431958:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c232f40/0x8a60d30f571ec5c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aad3 expref: 710 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.431960:0:16089:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801239b4000/0x8a60d30f571ec596 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aab7 expref: 710 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.431963:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1721880422.431965:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632639 00010000:00010000:2.0:1721880422.431965:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.431967:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727cde9 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.431967:0:16089:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801239b4000/0x8a60d30f571ec596 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aab7 expref: 710 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.431968:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130b65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2544:3686:x1805522011841024:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.431973:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c737b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2544:3689:x1805522011839360:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1750us (1782us total) trans 4296020605 rc 0/0 00000100:00100000:3.0:1721880422.431973:0:16089:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880123809c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011841152:192.168.201.24@tcp:104: 00002000:00080000:0.0:1721880422.431975:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64920 count 1 00010000:00010000:2.0:1721880422.431977:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c232f40/0x8a60d30f571ec5c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aad3 expref: 710 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.431978:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632632 00010000:00010000:0.0:1721880422.431983:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727cdf0 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd98:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.431983:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c232f40/0x8a60d30f571ec5c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aad3 expref: 710 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.431988:0:16089:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03000 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.431989:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008bcf6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011841280:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.431990:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801239b61c0/0x8a60d30f571ec5d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aaef expref: 710 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.431993:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.431994:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.431994:0:9458:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727cdd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.431995:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727cdf0 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.431999:0:9458:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727cdd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.432004:0:9458:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727cdd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.432005:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801239b61c0/0x8a60d30f571ec5d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aaef expref: 710 pid: 16126 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.432005:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec840 going to sleep for 11 seconds 00000004:00080000:3.0:1721880422.432006:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009a1d9180/2, rc 0, transno 1053307 00010000:00010000:1.0:1721880422.432008:0:9458:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727cdd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.432024:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801239b61c0/0x8a60d30f571ec5d5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aaef expref: 710 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.432028:0:9458:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727cdd4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.432030:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099d29500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011841408:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.432030:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009a1d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011839232:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.432032:0:9458:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b5d40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.432034:0:9458:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727cdd4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.432035:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009be59180/2, rc 0, transno 1053309 00010000:00010000:1.0:1721880422.432038:0:9458:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727cdd4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.432038:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009be59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011839360:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.432044:0:9458:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727cdd4 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.432045:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e840 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.432047:0:9458:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5d40/0x8a60d30f5727cdd4 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9458 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.432053:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727cddb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.432057:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727cddb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.432062:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727cddb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.432063:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011841536:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.432066:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727cddb lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.432067:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135756680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011841664:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.432069:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727cddb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.432072:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325cfc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.432074:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727cddb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.432078:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727cddb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.432079:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.432084:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727cddb lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.432087:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325cfc0/0x8a60d30f5727cddb lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.432093:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.432097:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011841536 00000100:00100000:3.0:1721880422.432099:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011841536 00000100:00100000:3.0:1721880422.432109:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011841664 00000100:00100000:3.0:1721880422.432111:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011841664 00000100:00100000:2.0:1721880422.432114:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632640 00000100:00100000:2.0:1721880422.432118:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2546:3688:x1805522011841536:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.432121:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632641 00000100:00100000:1.0:1721880422.432122:0:9458:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012387e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2546:3686:x1805522011840256:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1409us (1451us total) trans 4296020606 rc 0/0 00000100:00100000:3.0:1721880422.432124:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bcf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2546:3689:x1805522011841664:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.432127:0:9458:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632635 00002000:00080000:2.0:1721880422.432127:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64921 count 1 00010000:00010000:2.0:1721880422.432134:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727cdf7 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.432137:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64922 count 1 00010000:00010000:2.0:1721880422.432142:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099926640/0x8a60d30f571ec637 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab51 expref: 710 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.432143:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727cdaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.432145:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727cdfe lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.432147:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.432148:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727cdaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.432148:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.432149:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727cdf7 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.432152:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727cdaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.432152:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800999261c0/0x8a60d30f571ec64c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab66 expref: 710 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.432156:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727cdaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.432156:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.432157:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.432158:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727cdfe lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.432159:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727cdaa lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.432159:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099926640/0x8a60d30f571ec637 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab51 expref: 710 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.432162:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b5680 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.432164:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727cdaa lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.432164:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099926640/0x8a60d30f571ec637 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab51 expref: 710 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.432168:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727cdaa lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.432168:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800999261c0/0x8a60d30f571ec64c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab66 expref: 710 pid: 16126 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.432170:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011841792:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.432173:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727cdaa lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.432173:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800999261c0/0x8a60d30f571ec64c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab66 expref: 710 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.432177:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5680/0x8a60d30f5727cdaa lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.432179:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880134e96a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011841920:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.432186:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.432192:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03e40 going to sleep for 11 seconds 00000004:00080000:2.0:1721880422.432201:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880135756a00/2, rc 0, transno 1053310 00000100:00100000:2.0:1721880422.432206:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011840256:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.432233:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012380b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2547:3688:x1805522011840384:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1411us (1478us total) trans 4296020607 rc 0/0 00000100:00100000:2.0:1721880422.432234:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009e909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011842048:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.432237:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632636 00000004:00080000:3.0:1721880422.432241:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012387c000/2, rc 0, transno 1053311 00000100:00100000:3.0:1721880422.432245:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012387c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011840384:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.432254:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.432261:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a1d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2546:3689:x1805522011838720:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2184us (2262us total) trans 4296020608 rc 0/0 00000100:00100000:0.0:1721880422.432265:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011842048 00000100:00100000:1.0:1721880422.432266:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632629 00000100:00100000:2.0:1721880422.432266:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1721880422.432267:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011842048 00000100:00100000:2.0:1721880422.432270:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009e908a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011842176:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.432279:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632642 00000100:00100000:2.0:1721880422.432280:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.432283:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ad00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2546:3686:x1805522011842048:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.432284:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011842176 00000100:00100000:0.0:1721880422.432285:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011842176 00002000:00080000:1.0:1721880422.432293:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64923 count 1 00000100:00100000:0.0:1721880422.432294:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632643 00000004:00080000:2.0:1721880422.432296:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009a1d8700/2, rc 0, transno 1053312 00000100:00100000:0.0:1721880422.432297:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ad00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2547:3686:x1805522011842176:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.432300:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727ce05 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.432300:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009a1d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011838720:0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.432305:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64924 count 1 00010000:00010000:1.0:1721880422.432307:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b772f40/0x8a60d30f571ec668 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab82 expref: 710 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.432312:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727ce0c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd9c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.432312:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.432312:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.432314:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727ce05 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.432320:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011eb96880/0x8a60d30f571ec684 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab9e expref: 710 pid: 16126 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.432322:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009e90aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011842304:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.432324:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.432324:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b772f40/0x8a60d30f571ec668 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab82 expref: 710 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.432325:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.432327:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727ce0c lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.432329:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b772f40/0x8a60d30f571ec668 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab82 expref: 710 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.432334:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.432336:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012edb0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011842432:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.432337:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011eb96880/0x8a60d30f571ec684 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab9e expref: 710 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.432343:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011eb96880/0x8a60d30f571ec684 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab9e expref: 710 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.432347:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011842304 00000100:00100000:3.0:1721880422.432349:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011842304 00000100:00100000:1.0:1721880422.432350:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.432352:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099d28000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011842560:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.432361:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632644 00000100:00100000:3.0:1721880422.432364:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ad03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2548:3688:x1805522011842304:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.432367:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3ec00 going to sleep for 11 seconds 00002000:00080000:3.0:1721880422.432372:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64925 count 1 00010000:00010000:3.0:1721880422.432379:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727ce13 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd9d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.432386:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d4b1f80/0x8a60d30f571ec6a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd9d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12abba expref: 710 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.432390:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.432390:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.432392:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727ce13 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd9d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.432401:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d4b1f80/0x8a60d30f571ec6a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd9d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12abba expref: 710 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.432406:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d4b1f80/0x8a60d30f571ec6a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd9d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12abba expref: 710 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.432412:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009e908e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011842688:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.432429:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03540 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.432746:0:16089:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880123809c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_079:lustre-OST0001_UUID:16089:1805522011841152:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.432754:0:16089:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727cde2 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.432816:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099d29500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011841408:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.432835:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727cdf0 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.433027:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.433054:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008bcf6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011841280:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.433067:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257781632 00010000:00010000:2.0:1721880422.433069:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727cde9 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.433072:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257781632 00010000:00010000:1.0:1721880422.433086:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801239b4000/0x8a60d30f571ec596 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aab7 expref: 711 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.433093:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012ce13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011841792:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.433108:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727cdf7 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.433110:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914830 00000100:00100000:1.0:1721880422.433115:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+711:2006:x1805522257781632:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.433124:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.433128:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801239b4000/0x8a60d30f571ec596 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aab7 expref: 711 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.433129:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.433138:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801239b4000/0x8a60d30f571ec596 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aab7 expref: 711 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.433140:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257781760 00000100:00100000:0.0:1721880422.433141:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.433143:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257781760 00010000:00010000:2.0:1721880422.433156:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801239b61c0/0x8a60d30f571ec5d5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aaef expref: 712 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.433160:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801239b4000/0x8a60d30f571ec596 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aab7 expref: 712 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.433170:0:16154:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257781888 00000100:00100000:3.0:1721880422.433170:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880134e96a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011841920:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.433171:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.433173:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.433173:0:16154:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257781888 00010000:00010000:1.0:1721880422.433175:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727cde2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.433180:0:16154:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c232f40/0x8a60d30f571ec5c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aad3 expref: 712 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.433180:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727cdfe lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.433182:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727cde2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.433193:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914831 00000100:00100000:2.0:1721880422.433197:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+712:2004:x1805522257781760:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.433198:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.433203:0:16089:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727cde2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.433205:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1721880422.433206:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.433209:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801239b61c0/0x8a60d30f571ec5d5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aaef expref: 712 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.433210:0:16089:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727cde2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.433218:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801239b61c0/0x8a60d30f571ec5d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aaef expref: 712 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.433218:0:16089:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727cde2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.433224:0:16089:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727cde2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.433227:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+712:2006:x1805522257781632:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 110us (198us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.433230:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801239b61c0/0x8a60d30f571ec5d5 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd98:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aaef expref: 712 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.433231:0:16089:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727cde2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.433234:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914830 00010000:00010000:3.0:1721880422.433236:0:16089:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aaa400 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.433239:0:16089:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727cde2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.433242:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.433244:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.433246:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727cdf0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.433246:0:16089:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727cde2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.433252:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257782016 00010000:00010000:2.0:1721880422.433253:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727cdf0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd98:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.433255:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257782016 00010000:00010000:3.0:1721880422.433259:0:16089:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727cde2 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.433264:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.433265:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099926640/0x8a60d30f571ec637 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab51 expref: 711 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.433265:0:16089:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aaa400/0x8a60d30f5727cde2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16089 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.433268:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.433273:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.433283:0:16152:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257782144 00000100:00100000:1.0:1721880422.433286:0:16152:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257782144 00000100:00100000:2.0:1721880422.433287:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+711:2004:x1805522257781760:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 88us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.433288:0:7117:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257782272 00000100:00100000:3.0:1721880422.433291:0:7117:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257782272 00010000:00010000:1.0:1721880422.433294:0:16152:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800999261c0/0x8a60d30f571ec64c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab66 expref: 712 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.433294:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914831 00010000:00010000:3.0:1721880422.433303:0:7117:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b772f40/0x8a60d30f571ec668 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab82 expref: 712 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.433309:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.433309:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914832 00000100:00100000:1.0:1721880422.433314:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914833 00000100:00100000:2.0:1721880422.433314:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8066450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+712:2004:x1805522257781888:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.433320:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+712:2007:x1805522257782016:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.433320:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.433324:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c232f40/0x8a60d30f571ec5c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aad3 expref: 712 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.433327:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.433328:0:7117:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257782400 00000100:00100000:3.0:1721880422.433330:0:7117:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257782400 00010000:00010000:1.0:1721880422.433331:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099926640/0x8a60d30f571ec637 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab51 expref: 712 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.433333:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c232f40/0x8a60d30f571ec5c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aad3 expref: 713 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.433338:0:7117:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011eb96880/0x8a60d30f571ec684 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab9e expref: 713 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.433341:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.433341:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099926640/0x8a60d30f571ec637 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab51 expref: 713 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.433343:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c232f40/0x8a60d30f571ec5c0 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aad3 expref: 713 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.433352:0:16152:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099926640/0x8a60d30f571ec637 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab51 expref: 712 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.433352:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.433352:0:7117:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257782528 00010000:00010000:2.0:1721880422.433354:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.433355:0:7117:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257782528 00010000:00010000:2.0:1721880422.433357:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727cde9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.433361:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099d28000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011842560:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.433362:0:7117:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d4b1f80/0x8a60d30f571ec6a0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd9d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12abba expref: 712 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.433363:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.433365:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.433368:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727cdf7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.433368:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727cde9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.433372:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727ce0c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.433374:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727cdf7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.433375:0:7117:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914834 00000100:00100000:3.0:1721880422.433380:0:7117:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a27b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30425778-2709-4512-9d75-01ec53c4cfad+712:2005:x1805522257782144:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.433387:0:7117:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.433389:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.433391:0:7117:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800999261c0/0x8a60d30f571ec64c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab66 expref: 712 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.433399:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.433402:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727cdf7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.433405:0:7117:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800999261c0/0x8a60d30f571ec64c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab66 expref: 712 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.433407:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727cdf7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.433408:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8066450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+712:2004:x1805522257781888:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 93us (265us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.433411:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727cdf7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.433415:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727cdf7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.433415:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914832 00010000:00010000:3.0:1721880422.433417:0:7117:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800999261c0/0x8a60d30f571ec64c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab66 expref: 712 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.433420:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+712:2007:x1805522257782016:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 99us (213us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.433422:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727cdf7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.433425:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136350b40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.433427:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727cdf7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.433427:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914833 00010000:00010000:3.0:1721880422.433427:0:7117:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.433429:0:7117:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.433431:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727cdf7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.433431:0:7117:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727cdfe lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.433437:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727cdf7 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.433438:0:7117:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727cdfe lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.433440:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136350b40/0x8a60d30f5727cdf7 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.433441:0:16152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914835 00000100:00100000:1.0:1721880422.433446:0:16152:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfb9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+709:2004:x1805522257782272:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.433451:0:7117:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.433452:0:16152:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.433455:0:16154:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914836 00010000:00010000:1.0:1721880422.433456:0:16152:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b772f40/0x8a60d30f571ec668 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab82 expref: 709 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.433461:0:16154:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008571d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+709:2004:x1805522257782400:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.433465:0:16152:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b772f40/0x8a60d30f571ec668 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab82 expref: 709 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.433468:0:16154:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.433468:0:7117:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a27b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30425778-2709-4512-9d75-01ec53c4cfad+709:2005:x1805522257782144:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 87us (203us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.433473:0:16154:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011eb96880/0x8a60d30f571ec684 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab9e expref: 709 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.433475:0:7117:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914834 00010000:00010000:1.0:1721880422.433476:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.433477:0:16152:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.433479:0:16152:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727ce05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.433483:0:16154:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011eb96880/0x8a60d30f571ec684 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab9e expref: 709 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.433486:0:16152:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727ce05 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.433492:0:7117:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914837 00010000:00010000:2.0:1721880422.433494:0:16154:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011eb96880/0x8a60d30f571ec684 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd9c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab9e expref: 708 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.433496:0:16152:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.433496:0:7117:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008571c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30425778-2709-4512-9d75-01ec53c4cfad+708:2004:x1805522257782528:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.433502:0:7117:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.433503:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.433505:0:16154:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.433506:0:7117:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d4b1f80/0x8a60d30f571ec6a0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd9d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12abba expref: 707 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.433507:0:16154:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727ce0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.433512:0:16152:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfb9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_010:30425778-2709-4512-9d75-01ec53c4cfad+707:2004:x1805522257782272:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 65us (236us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.433514:0:16154:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727ce0c lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd9c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.433514:0:7117:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d4b1f80/0x8a60d30f571ec6a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd9d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12abba expref: 707 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.433517:0:16152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914835 00010000:00010000:3.0:1721880422.433524:0:7117:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.433525:0:7117:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.433528:0:16154:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.433528:0:7117:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727ce13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd9d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.433534:0:7117:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727ce13 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd9d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.433543:0:7117:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.433545:0:16154:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008571d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_011:30425778-2709-4512-9d75-01ec53c4cfad+706:2004:x1805522257782400:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 84us (235us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.433550:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b772f40/0x8a60d30f571ec668 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ab82 expref: 706 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.433552:0:16154:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914836 00000100:00100000:3.0:1721880422.433558:0:7117:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008571c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30425778-2709-4512-9d75-01ec53c4cfad+705:2004:x1805522257782528:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 62us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.433560:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012edb0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011842432:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.433563:0:7117:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914837 00000100:00100000:0.0:1721880422.433574:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2549:3688:x1805522011841536:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1454us (1493us total) trans 4296020609 rc 0/0 00010000:00010000:1.0:1721880422.433574:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727ce05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.433578:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632640 00010000:00010000:2.0:1721880422.433579:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727cde9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.433581:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727ce05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.433587:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727ce05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.433587:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727cde9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.433594:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727ce05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.433594:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727cde9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.433596:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d4b1f80/0x8a60d30f571ec6a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd9d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12abba expref: 703 pid: 16126 timeout: 887 lvb_type: 0 00000004:00080000:0.0:1721880422.433599:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880135755c00/2, rc 0, transno 1053313 00010000:00010000:1.0:1721880422.433601:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727ce05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.433601:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727cde9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.433604:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009e908e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011842688:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.433607:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727ce05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.433607:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727cde9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.433611:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011841536:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.433613:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b6ac0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.433613:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352400 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.433613:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727ce13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.433615:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727cde9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.433616:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727ce05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.433620:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727ce0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.433622:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727cde9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.433623:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727ce05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.433624:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727ce0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.433629:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727ce0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.433631:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727ce05 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.433633:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727ce0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.433636:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727cde9 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.433637:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727ce0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.433637:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b6ac0/0x8a60d30f5727ce05 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.433642:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325c240 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.433643:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727cde9 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.433644:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727ce0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.433646:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727ce13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.433648:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727ce0c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.433651:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727ce13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.433653:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727ce0c lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.433655:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727ce13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.433657:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325c240/0x8a60d30f5727ce0c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.433660:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727ce13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.433664:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727ce13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.433667:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aabcc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.433669:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727ce13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.433672:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1721880422.433673:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727ce13 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.433677:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009e908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011842816:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.433678:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727ce13 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.433682:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aabcc0/0x8a60d30f5727ce13 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.433691:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.433702:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011842816 00000100:00100000:0.0:1721880422.433704:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011842816 00000100:00100000:0.0:1721880422.433713:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632645 00000100:00100000:0.0:1721880422.433716:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008571d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2552:3688:x1805522011842816:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.433724:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64926 count 1 00010000:00010000:0.0:1721880422.433746:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727ce1a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd9e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.433747:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727cdfe lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.433752:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727cdfe lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.433753:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d028000/0x8a60d30f571ec6bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12abd6 expref: 702 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.433756:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727cdfe lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.433757:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.433758:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.433760:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727ce1a lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.433761:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727cdfe lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.433764:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727cdfe lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.433767:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa9f80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.433769:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d028000/0x8a60d30f571ec6bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12abd6 expref: 702 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.433769:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727cdfe lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.433773:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727cdfe lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.433775:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d028000/0x8a60d30f571ec6bc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12abd6 expref: 702 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.433780:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727cdfe lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.433781:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099d29880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011842944:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.433783:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9f80/0x8a60d30f5727cdfe lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.433795:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.433841:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012387d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2553:3686:x1805522011840896:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1904us (1991us total) trans 4296020611 rc 0/0 00000100:00100000:2.0:1721880422.433847:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632638 00000004:00080000:2.0:1721880422.433872:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012387ca80/2, rc 0, transno 1053315 00000100:00100000:2.0:1721880422.433887:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012387ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011840896:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.433890:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ad00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2553:3686:x1805522011842176:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1590us (1608us total) trans 4296020613 rc 0/0 00000100:00100000:0.0:1721880422.433896:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632643 00000004:00080000:2.0:1721880422.433899:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009e908a80/2, rc 0, transno 1053317 00000100:00100000:2.0:1721880422.433903:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009e908a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011842176:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.433913:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009e908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011843072:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.433936:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.433950:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1721880422.433956:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880134e96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011843200:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.433965:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bcf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2553:3689:x1805522011841664:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1839us (1871us total) trans 4296020615 rc 0/0 00000100:00100000:3.0:1721880422.433969:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632641 00000100:00100000:2.0:1721880422.433975:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.433983:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011843072 00000100:00100000:1.0:1721880422.433985:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ad00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2552:3686:x1805522011842048:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1699us (1728us total) trans 4296020610 rc 0/0 00000100:00100000:0.0:1721880422.433986:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011843072 00000004:00080000:3.0:1721880422.433987:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880135756680/2, rc 0, transno 1053319 00000100:00100000:3.0:1721880422.433991:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135756680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011841664:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.433992:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632642 00000004:00080000:2.0:1721880422.433994:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009e909180/2, rc 0, transno 1053314 00000100:00100000:0.0:1721880422.434000:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011843200 00000100:00100000:2.0:1721880422.434000:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009e909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011842048:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.434001:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011843200 00000100:00100000:1.0:1721880422.434026:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632646 00000100:00100000:1.0:1721880422.434031:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bea3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2553:3686:x1805522011843072:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.434035:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011843328:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.434038:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880123809c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011843456:0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.434045:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64927 count 1 00000100:00100000:0.0:1721880422.434049:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.434056:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727ce21 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd9f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.434067:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007c9e6ac0/0x8a60d30f571ec6d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12abf2 expref: 702 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.434070:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.434072:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.434074:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.434076:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727ce21 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfd9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.434078:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011843328 00000100:00100000:0.0:1721880422.434080:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011843328 00000100:00100000:0.0:1721880422.434090:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011843456 00000100:00100000:0.0:1721880422.434091:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011843456 00000100:00100000:2.0:1721880422.434093:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ad03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2554:3688:x1805522011842304:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1726us (1756us total) trans 4296020612 rc 0/0 00000100:00100000:3.0:1721880422.434095:0:16089:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012387f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_079:lustre-MDT0000-mdtlov_UUID+2555:3689:x1805522011840768:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2192us (2298us total) trans 4296020614 rc 0/0 00000100:00100000:3.0:1721880422.434099:0:16089:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632637 00010000:00010000:1.0:1721880422.434100:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007c9e6ac0/0x8a60d30f571ec6d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12abf2 expref: 702 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.434103:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632644 00000100:00100000:0.0:1721880422.434106:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632647 00000100:00100000:0.0:1721880422.434109:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2554:3686:x1805522011843200:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.434109:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007c9e6ac0/0x8a60d30f571ec6d8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12abf2 expref: 702 pid: 16101 timeout: 887 lvb_type: 0 00000004:00080000:3.0:1721880422.434113:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012387c700/2, rc 0, transno 1053318 00000100:00100000:3.0:1721880422.434117:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012387c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011840768:0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.434118:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64928 count 1 00000100:00100000:1.0:1721880422.434119:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012edb0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011843584:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.434120:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632648 00000100:00100000:2.0:1721880422.434124:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2553:3688:x1805522011843328:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.434125:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727ce28 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfda0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.434133:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ab55440/0x8a60d30f571ec6f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfda0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac0e expref: 702 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.434134:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632649 00002000:00080000:2.0:1721880422.434136:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64929 count 1 00010000:00010000:0.0:1721880422.434137:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.434139:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.434140:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727ce28 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfda0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.434140:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091ae3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2553:3689:x1805522011843456:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.434147:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727ce2f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfda1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.434151:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ab55440/0x8a60d30f571ec6f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfda0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac0e expref: 702 pid: 16101 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.434151:0:16088:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64930 count 1 00010000:00010000:2.0:1721880422.434155:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880122fcad00/0x8a60d30f571ec710 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfda1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac2a expref: 702 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.434156:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ab55440/0x8a60d30f571ec6f4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfda0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac0e expref: 702 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.434160:0:16088:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727ce36 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfda2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.434160:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.434160:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1721880422.434162:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099d29500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011843840:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.434162:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727ce2f lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfda1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.434170:0:16088:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880122fca400/0x8a60d30f571ec725 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfda2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac3f expref: 702 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.434173:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880122fcad00/0x8a60d30f571ec710 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfda1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac2a expref: 702 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.434177:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.434178:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1721880422.434179:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3ef00 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.434179:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880122fcad00/0x8a60d30f571ec710 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfda1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac2a expref: 702 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.434180:0:16088:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727ce36 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfda2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.434185:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012bc2f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011843968:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.434196:0:16088:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880122fca400/0x8a60d30f571ec725 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfda2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac3f expref: 702 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.434200:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec9c0 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.434204:0:16088:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880122fca400/0x8a60d30f571ec725 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfda2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac3f expref: 702 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.434214:0:16088:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012edb0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011844096:192.168.201.24@tcp:104: 00000004:00080000:2.0:1721880422.434222:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009e90aa00/2, rc 0, transno 1053316 00000100:00100000:2.0:1721880422.434229:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009e90aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011842304:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.434241:0:16088:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a780 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.434243:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880091ae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011843712:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.434259:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727cdf0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.434262:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.434266:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727cdf0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.434274:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727cdf0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.434275:0:16075:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011843712 00000100:00100000:0.0:1721880422.434278:0:16075:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011843712 00000100:00100000:2.0:1721880422.434279:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1721880422.434280:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727cdf0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.434284:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880091ae1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011844224:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.434286:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727cdf0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.434290:0:16075:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632650 00010000:00010000:1.0:1721880422.434292:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325dd40 already unused, calling callback (ffffffffa084e330) 00000100:00100000:0.0:1721880422.434293:0:16075:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bcf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2554:3686:x1805522011843712:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.434295:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727cdf0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1721880422.434301:0:16075:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64931 count 1 00010000:00010000:1.0:1721880422.434301:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727cdf0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.434302:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721880422.434308:0:16075:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727ce3d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfda3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.434311:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727cdf0 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.434316:0:16075:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007c9e7600/0x8a60d30f571ec748 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfda3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac62 expref: 702 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.434318:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325dd40/0x8a60d30f5727cdf0 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.434320:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.434321:0:16075:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1721880422.434322:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011844224 00010000:00010000:0.0:1721880422.434323:0:16075:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727ce3d lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfda3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.434325:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011844224 00010000:00010000:0.0:1721880422.434332:0:16075:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007c9e7600/0x8a60d30f571ec748 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfda3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac62 expref: 702 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.434337:0:16075:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007c9e7600/0x8a60d30f571ec748 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfda3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac62 expref: 702 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.434339:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632651 00000100:00100000:0.0:1721880422.434343:0:16075:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099d28000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011844352:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.434344:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2555:3686:x1805522011844224:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.434354:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64932 count 1 00000100:00100000:0.0:1721880422.434357:0:16075:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e600 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.434363:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727ce44 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfda4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.434373:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099fbaf40/0x8a60d30f571ec75d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfda4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac77 expref: 702 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.434379:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.434380:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.434382:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727ce44 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfda4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.434393:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099fbaf40/0x8a60d30f571ec75d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfda4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac77 expref: 702 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.434399:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099fbaf40/0x8a60d30f571ec75d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfda4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac77 expref: 702 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.434405:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099a3dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011844480:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.434422:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.434460:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880130b65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2556:3686:x1805522011841024:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2489us (2561us total) trans 4296020616 rc 0/0 00000004:00080000:2.0:1721880422.434465:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012387dc00/2, rc 0, transno 1053320 00000100:00100000:1.0:1721880422.434467:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632639 00000100:00100000:2.0:1721880422.434470:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012387dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011841024:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.434496:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880091ae2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011844608:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.434502:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.434511:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.434530:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011844608 00000100:00100000:1.0:1721880422.434534:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011844608 00000100:00100000:1.0:1721880422.434553:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632652 00000100:00100000:1.0:1721880422.434557:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2556:3688:x1805522011844608:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.434569:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64933 count 1 00010000:00010000:1.0:1721880422.434579:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727ce4b lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfda5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.434589:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880084f20480/0x8a60d30f571ec779 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfda5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac93 expref: 702 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.434595:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.434597:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.434599:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727ce4b lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfda5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.434608:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099d29880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011842944:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.434612:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.434615:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880084f20480/0x8a60d30f571ec779 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfda5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac93 expref: 702 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.434624:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880084f20480/0x8a60d30f571ec779 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfda5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac93 expref: 702 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.434628:0:15455:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257782656 00000100:00100000:3.0:1721880422.434631:0:15455:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257782656 00000100:00100000:1.0:1721880422.434633:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012edb2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011844736:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.434641:0:15455:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d028000/0x8a60d30f571ec6bc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12abd6 expref: 703 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.434652:0:15455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914838 00010000:00010000:0.0:1721880422.434653:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727ce1a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfd9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.434655:0:15455:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009427ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+703:2005:x1805522257782656:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.434658:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a180 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.434666:0:15455:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.434669:0:15455:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d028000/0x8a60d30f571ec6bc lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12abd6 expref: 703 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.434671:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099d29500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011843840:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.434675:0:15455:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d028000/0x8a60d30f571ec6bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12abd6 expref: 703 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.434676:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727ce28 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfda0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.434682:0:15455:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d028000/0x8a60d30f571ec6bc lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd9e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12abd6 expref: 703 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.434691:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.434692:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.434694:0:15455:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727ce1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.434702:0:15455:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727ce1a lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd9e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.434711:0:15455:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.434716:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012bc2f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011843968:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.434718:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727ce1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.434723:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727ce1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.434741:0:15455:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009427ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+702:2005:x1805522257782656:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 71us (116us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.434744:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727ce1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.434745:0:15455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914838 00010000:00010000:2.0:1721880422.434746:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727ce2f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfda1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.434748:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727ce1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.434752:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727ce1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.434756:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325e400 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.434757:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727ce1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.434761:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727ce1a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.434766:0:16088:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012edb0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011844096:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.434770:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727ce1a lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.434774:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325e400/0x8a60d30f5727ce1a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.434780:0:16088:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727ce36 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfda2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.434925:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008571d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2557:3688:x1805522011842816:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1207us (1231us total) trans 4296020617 rc 0/0 00000100:00100000:0.0:1721880422.434930:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632645 00000004:00080000:3.0:1721880422.434934:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009e908e00/2, rc 0, transno 1053321 00000100:00100000:3.0:1721880422.434938:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009e908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011842816:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.434947:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.434956:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1721880422.434960:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880091ae2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011844864:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.434964:0:8271:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257782784 00000100:00100000:0.0:1721880422.434967:0:8271:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257782784 00010000:00010000:0.0:1721880422.434975:0:8271:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ab55440/0x8a60d30f571ec6f4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfda0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac0e expref: 702 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.434979:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.434993:0:8271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914839 00000100:00100000:0.0:1721880422.434996:0:8271:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8065450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+702:2007:x1805522257782784:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.435002:0:8271:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.435004:0:8271:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ab55440/0x8a60d30f571ec6f4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfda0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac0e expref: 702 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.435024:0:8271:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ab55440/0x8a60d30f571ec6f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfda0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac0e expref: 702 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.435033:0:8271:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ab55440/0x8a60d30f571ec6f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfda0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac0e expref: 702 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.435043:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.435044:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1721880422.435045:0:16075:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099d28000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_065:lustre-OST0001_UUID:16075:1805522011844352:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.435046:0:8271:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727ce28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfda0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.435051:0:8271:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727ce28 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfda0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.435060:0:8271:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.435061:0:16075:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727ce3d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfda3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.435073:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727ce28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfda0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.435082:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727ce28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfda0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.435089:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727ce28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfda0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.435096:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727ce28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfda0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.435103:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727ce28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfda0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.435108:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325ed00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.435111:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727ce28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfda0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.435116:0:8271:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8065450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+701:2007:x1805522257782784:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 79us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.435121:0:8271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914839 00010000:00010000:2.0:1721880422.435122:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727ce28 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfda0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.435133:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727ce28 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfda0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.435139:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325ed00/0x8a60d30f5727ce28 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfda0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.435167:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011844864 00000100:00100000:0.0:1721880422.435169:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011844864 00000100:00100000:1.0:1721880422.435169:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.435197:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.435208:0:15455:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257782912 00000100:00100000:3.0:1721880422.435211:0:15455:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257782912 00010000:00010000:3.0:1721880422.435219:0:15455:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880122fca400/0x8a60d30f571ec725 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfda2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac3f expref: 701 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.435221:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.435227:0:8271:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257783168 00000100:00100000:0.0:1721880422.435230:0:8271:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257783168 00000100:00100000:3.0:1721880422.435230:0:15455:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257783040 00000100:00100000:3.0:1721880422.435232:0:15455:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257783040 00010000:00010000:3.0:1721880422.435237:0:15455:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880122fcad00/0x8a60d30f571ec710 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfda1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac2a expref: 703 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.435239:0:8271:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007c9e7600/0x8a60d30f571ec748 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfda3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac62 expref: 703 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.435241:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880091211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2558:3686:x1805522011843200:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1130us (1265us total) trans 4296020618 rc 0/0 00000100:00100000:3.0:1721880422.435245:0:15455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914840 00000100:00100000:2.0:1721880422.435246:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632647 00000100:00100000:3.0:1721880422.435248:0:15455:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+703:2007:x1805522257782912:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.435253:0:15455:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1721880422.435254:0:8271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914841 00010000:00010000:3.0:1721880422.435256:0:15455:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880122fca400/0x8a60d30f571ec725 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfda2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac3f expref: 703 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.435257:0:8271:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+703:2004:x1805522257783040:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.435257:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632653 00000100:00100000:2.0:1721880422.435260:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d2b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2557:3688:x1805522011844864:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.435262:0:8271:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.435262:0:15455:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880122fca400/0x8a60d30f571ec725 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfda2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac3f expref: 703 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.435263:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.435265:0:8271:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880122fcad00/0x8a60d30f571ec710 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfda1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac2a expref: 703 pid: 16101 timeout: 887 lvb_type: 0 00002000:00080000:2.0:1721880422.435269:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64934 count 1 00010000:00010000:3.0:1721880422.435269:0:15455:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880122fca400/0x8a60d30f571ec725 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfda2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac3f expref: 703 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.435271:0:8271:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880122fcad00/0x8a60d30f571ec710 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfda1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac2a expref: 703 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.435275:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.435276:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.435277:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727ce52 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfda6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.435278:0:15455:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727ce36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfda2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.435281:0:8271:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880122fcad00/0x8a60d30f571ec710 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfda1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac2a expref: 702 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.435282:0:15455:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727ce36 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfda2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.435285:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095337cc0/0x8a60d30f571ec795 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfda6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12acaf expref: 702 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.435287:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.435289:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.435289:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.435290:0:8271:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727ce2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfda1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.435290:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.435290:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.435290:0:15455:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.435292:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727ce52 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfda6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.435295:0:8271:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727ce2f lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfda1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.435303:0:8271:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.435309:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257783296 00000100:00100000:3.0:1721880422.435309:0:15455:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+701:2007:x1805522257782912:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 60us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.435311:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257783296 00000100:00100000:3.0:1721880422.435313:0:15455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914840 00000100:00100000:0.0:1721880422.435316:0:8271:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+702:2004:x1805522257783040:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 58us (95us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.435318:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099fbaf40/0x8a60d30f571ec75d lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfda4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac77 expref: 701 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.435319:0:8271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914841 00000100:00100000:3.0:1721880422.435320:0:15455:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257783424 00000100:00100000:3.0:1721880422.435322:0:15455:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257783424 00010000:00010000:3.0:1721880422.435328:0:15455:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007c9e6ac0/0x8a60d30f571ec6d8 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12abf2 expref: 701 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.435329:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914842 00000100:00100000:0.0:1721880422.435332:0:8271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914843 00000100:00100000:2.0:1721880422.435333:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+701:2007:x1805522257783168:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.435335:0:8271:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+701:2004:x1805522257783296:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.435337:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.435339:0:8271:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.435339:0:15455:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914844 00010000:00010000:2.0:1721880422.435340:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007c9e7600/0x8a60d30f571ec748 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfda3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac62 expref: 701 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.435342:0:8271:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099fbaf40/0x8a60d30f571ec75d lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfda4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac77 expref: 701 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.435342:0:15455:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+701:2005:x1805522257783424:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.435346:0:15455:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.435347:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007c9e7600/0x8a60d30f571ec748 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfda3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac62 expref: 701 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.435348:0:8271:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099fbaf40/0x8a60d30f571ec75d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfda4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac77 expref: 701 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.435348:0:15455:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007c9e6ac0/0x8a60d30f571ec6d8 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfd9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12abf2 expref: 701 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.435354:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.435354:0:15455:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007c9e6ac0/0x8a60d30f571ec6d8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12abf2 expref: 701 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.435355:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007c9e7600/0x8a60d30f571ec748 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfda3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac62 expref: 701 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.435356:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.435357:0:8271:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727ce44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfda4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.435360:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.435360:0:15455:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.435361:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.435361:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.435362:0:8271:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727ce44 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfda4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.435362:0:15455:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727ce21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.435363:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727ce3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfda3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.435366:0:8271:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.435366:0:15455:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727ce21 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfd9f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.435368:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727ce3d lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfda3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.435371:0:15455:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.435375:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.435376:0:8271:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+700:2004:x1805522257783296:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 40us (114us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.435377:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.435379:0:8271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914843 00000100:00100000:3.0:1721880422.435380:0:15455:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:30425778-2709-4512-9d75-01ec53c4cfad+700:2005:x1805522257783424:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 38us (91us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.435384:0:15455:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914844 00000100:00100000:0.0:1721880422.435389:0:8271:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257783552 00000100:00100000:0.0:1721880422.435391:0:8271:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257783552 00010000:00010000:0.0:1721880422.435398:0:8271:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880084f20480/0x8a60d30f571ec779 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfda5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac93 expref: 699 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.435401:0:16088:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727ce36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfda2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.435404:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+699:2007:x1805522257783168:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 71us (208us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.435405:0:16088:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727ce36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfda2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.435408:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914842 00010000:00010000:3.0:1721880422.435411:0:16088:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727ce36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfda2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.435416:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914845 00010000:00010000:3.0:1721880422.435418:0:16088:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727ce36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfda2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.435419:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+698:2004:x1805522257783552:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.435422:0:16088:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727ce36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfda2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.435425:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727ce2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfda1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.435426:0:16088:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4fc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.435427:0:16088:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727ce36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfda2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.435429:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.435430:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727ce2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfda1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.435431:0:16088:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727ce36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfda2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.435433:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880084f20480/0x8a60d30f571ec779 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfda5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac93 expref: 698 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.435434:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727ce2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfda1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.435436:0:16088:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727ce36 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfda2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.435438:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727ce2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfda1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.435439:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880084f20480/0x8a60d30f571ec779 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfda5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac93 expref: 698 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.435439:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4fc0/0x8a60d30f5727ce36 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfda2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.435442:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727ce2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfda1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.435446:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352f40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.435447:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.435448:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727ce2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfda1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.435448:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.435449:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727ce4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfda5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.435452:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727ce2f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfda1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.435453:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727ce4b lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfda5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.435457:0:16075:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727ce3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfda3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.435458:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727ce2f lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfda1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.435460:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.435461:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136352f40/0x8a60d30f5727ce2f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfda1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.435466:0:16075:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727ce3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfda3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.435473:0:16075:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727ce3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfda3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.435474:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+698:2004:x1805522257783552:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 55us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.435478:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914845 00010000:00010000:1.0:1721880422.435485:0:16075:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727ce3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfda3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.435492:0:16075:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727ce3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfda3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.435498:0:16075:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325c6c0 already unused, calling callback (ffffffffa084e330) 00000004:00080000:2.0:1721880422.435499:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880134e96a00/2, rc 0, transno 1053322 00010000:00010000:1.0:1721880422.435501:0:16075:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727ce3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfda3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.435507:0:16075:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727ce3d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfda3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.435511:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880134e96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011843200:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.435517:0:16075:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727ce3d lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfda3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.435524:0:16075:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325c6c0/0x8a60d30f5727ce3d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfda3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16075 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.435526:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095337cc0/0x8a60d30f571ec795 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfda6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12acaf expref: 697 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.435534:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095337cc0/0x8a60d30f571ec795 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfda6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12acaf expref: 697 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.435540:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094278e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011845120:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.435549:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880091ae3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2559:3689:x1805522011843456:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1409us (1477us total) trans 4296020619 rc 0/0 00000100:00100000:2.0:1721880422.435553:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.435553:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632649 00000100:00100000:0.0:1721880422.435559:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2559:3688:x1805522011843328:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1433us (1507us total) trans 4296020620 rc 0/0 00000100:00100000:2.0:1721880422.435560:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1721880422.435563:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632648 00000100:00100000:2.0:1721880422.435565:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009bf68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011844992:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1721880422.435575:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012ce13b80/2, rc 0, transno 1053324 00000100:00100000:3.0:1721880422.435579:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012ce13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011843328:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.435580:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1721880422.435588:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880123809c00/2, rc 0, transno 1053323 00000100:00100000:0.0:1721880422.435592:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880123809c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011843456:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.435596:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009bf69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011845248:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.435601:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011844992 00000100:00100000:0.0:1721880422.435603:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011844992 00000100:00100000:2.0:1721880422.435605:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.435606:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009bf6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011845376:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.435612:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011845248 00000100:00100000:0.0:1721880422.435613:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011845248 00000100:00100000:2.0:1721880422.435620:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632654 00000100:00100000:3.0:1721880422.435621:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.435623:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632655 00000100:00100000:2.0:1721880422.435623:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009427aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2560:3687:x1805522011844992:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.435626:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009427bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2560:3687:x1805522011845248:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.435631:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64935 count 1 00002000:00080000:0.0:1721880422.435634:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64936 count 1 00000100:00100000:3.0:1721880422.435637:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011845376 00000100:00100000:3.0:1721880422.435638:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011845376 00010000:00010000:2.0:1721880422.435639:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727ce59 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfda7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.435642:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727ce60 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfda8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.435643:0:16075:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bcf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_065:lustre-MDT0000-mdtlov_UUID+2561:3686:x1805522011843712:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1346us (1377us total) trans 4296020621 rc 0/0 00010000:00010000:2.0:1721880422.435646:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099e37a80/0x8a60d30f571ec7aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfda7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12acc4 expref: 697 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.435648:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632656 00000100:00100000:3.0:1721880422.435650:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2561:3688:x1805522011845376:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.435651:0:16075:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632650 00010000:00010000:2.0:1721880422.435651:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.435651:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.435653:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727ce59 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfda7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.435658:0:16088:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64937 count 1 00010000:00010000:2.0:1721880422.435662:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099e37a80/0x8a60d30f571ec7aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfda7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12acc4 expref: 697 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.435665:0:16088:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727ce67 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfda9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.435668:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099e37a80/0x8a60d30f571ec7aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfda7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12acc4 expref: 697 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.435672:0:16088:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ffcc240/0x8a60d30f571ec7e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfda9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12acfc expref: 697 pid: 16099 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.435673:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094278700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011845504:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.435677:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.435678:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.435679:0:16088:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727ce67 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfda9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.435683:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007c9e6ac0/0x8a60d30f571ec6d8 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd9f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12abf2 expref: 697 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.435684:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde300 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.435689:0:16088:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ffcc240/0x8a60d30f571ec7e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfda9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12acfc expref: 697 pid: 16099 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.435694:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012edb0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011843584:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.435694:0:16088:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ffcc240/0x8a60d30f571ec7e2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfda9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12acfc expref: 696 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.435697:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d2aeac0/0x8a60d30f571ec7c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfda8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ace0 expref: 696 pid: 16099 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.435700:0:16088:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009bf69180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011845632:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.435703:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.435704:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.435706:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727ce60 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfda8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.435707:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727ce21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.435714:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727ce21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.435715:0:16088:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03540 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.435717:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d2aeac0/0x8a60d30f571ec7c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfda8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ace0 expref: 696 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.435721:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727ce21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.435724:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d2aeac0/0x8a60d30f571ec7c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfda8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ace0 expref: 696 pid: 16099 timeout: 887 lvb_type: 0 00000004:00080000:3.0:1721880422.435744:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880091ae3480/2, rc 0, transno 1053325 00000100:00100000:0.0:1721880422.435748:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099d29500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011845760:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.435749:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880091ae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011843712:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.435760:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727ce21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfd9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.435763:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.435766:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1721880422.435767:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727ce21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfd9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.435770:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009bf6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011845888:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.435773:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727ce21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.435779:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b7cc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.435782:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727ce21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfd9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.435785:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.435788:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727ce21 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfd9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.435798:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011845888 00010000:00010000:1.0:1721880422.435798:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727ce21 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfd9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.435800:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011845888 00010000:00010000:1.0:1721880422.435810:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7cc0/0x8a60d30f5727ce21 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfd9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.435814:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632657 00000100:00100000:0.0:1721880422.435816:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800876b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2561:3688:x1805522011845888:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.435824:0:16125:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64938 count 1 00010000:00010000:0.0:1721880422.435832:0:16125:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727ce6e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfdaa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.435839:0:16125:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ffcc6c0/0x8a60d30f571ec7fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdaa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad18 expref: 696 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.435846:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.435847:0:16125:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.435849:0:16125:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727ce6e lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfdaa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.435857:0:16125:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ffcc6c0/0x8a60d30f571ec7fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdaa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad18 expref: 696 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.435862:0:16125:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ffcc6c0/0x8a60d30f571ec7fe lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdaa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad18 expref: 696 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.435867:0:16125:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099d29880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011846016:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.435880:0:16125:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.435926:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bea3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2562:3686:x1805522011843072:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1894us (1988us total) trans 4296020622 rc 0/0 00000100:00100000:1.0:1721880422.435933:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632646 00000004:00080000:3.0:1721880422.435937:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009e908700/2, rc 0, transno 1053326 00000100:00100000:3.0:1721880422.435943:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009e908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011843072:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.435962:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880084f20480/0x8a60d30f571ec779 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfda5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac93 expref: 696 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.435971:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094279f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011846144:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.435972:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012edb2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011844736:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.435985:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727ce4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfda5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.435985:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.435992:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727ce4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfda5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.435998:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727ce4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfda5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.436000:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011846144 00000100:00100000:0.0:1721880422.436002:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011846144 00010000:00010000:1.0:1721880422.436005:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727ce4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfda5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.436025:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632658 00010000:00010000:1.0:1721880422.436027:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727ce4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfda5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.436028:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800876b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2562:3686:x1805522011846144:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.436035:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64939 count 1 00010000:00010000:1.0:1721880422.436038:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727ce4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfda5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.436042:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727ce75 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfdab:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.436044:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b61c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.436046:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727ce4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfda5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.436049:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c2daac0/0x8a60d30f571ec81a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad34 expref: 695 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.436052:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727ce4b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfda5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.436053:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.436054:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.436056:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727ce75 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfdab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.436061:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727ce4b lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfda5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.436067:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c2daac0/0x8a60d30f571ec81a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad34 expref: 695 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.436067:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b61c0/0x8a60d30f5727ce4b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfda5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.436072:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c2daac0/0x8a60d30f571ec81a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad34 expref: 695 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.436077:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099d28000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011846272:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.436099:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e600 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.436165:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2563:3688:x1805522011844608:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1606us (1652us total) trans 4296020623 rc 0/0 00000100:00100000:1.0:1721880422.436170:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632652 00000004:00080000:3.0:1721880422.436174:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880091ae2680/2, rc 0, transno 1053327 00000100:00100000:2.0:1721880422.436184:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094278e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011845120:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.436186:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880091ae2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011844608:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.436194:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727ce52 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfda6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.436197:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099fbaf40/0x8a60d30f571ec75d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfda4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ac77 expref: 695 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.436206:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099a3dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011844480:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.436220:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727ce44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfda4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.436221:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094278e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011846400:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.436225:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094278700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011845504:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.436231:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727ce44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfda4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.436232:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727ce59 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfda7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.436236:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727ce44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfda4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.436236:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.436242:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727ce44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfda4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.436248:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727ce44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfda4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.436252:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011846400 00010000:00010000:1.0:1721880422.436253:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727ce44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfda4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.436255:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011846400 00010000:00010000:1.0:1721880422.436258:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801363506c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.436260:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727ce44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfda4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.436263:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.436265:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727ce44 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfda4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.436267:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632659 00000100:00100000:2.0:1721880422.436270:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800876b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2563:3687:x1805522011846400:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.436273:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727ce44 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfda4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.436278:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64940 count 1 00010000:00010000:1.0:1721880422.436279:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801363506c0/0x8a60d30f5727ce44 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfda4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.436286:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727ce7c lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfdac:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.436294:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007b9b4900/0x8a60d30f571ec836 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad50 expref: 694 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.436301:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.436302:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.436304:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727ce7c lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfdac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.436312:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007b9b4900/0x8a60d30f571ec836 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad50 expref: 694 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.436317:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007b9b4900/0x8a60d30f571ec836 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad50 expref: 694 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.436323:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094278700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011846528:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.436335:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.436339:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde300 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.436348:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257783680 00000100:00100000:2.0:1721880422.436351:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257783808 00000100:00100000:3.0:1721880422.436351:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257783680 00000100:00100000:2.0:1721880422.436354:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257783808 00010000:00010000:3.0:1721880422.436361:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095337cc0/0x8a60d30f571ec795 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfda6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12acaf expref: 696 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.436366:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099e37a80/0x8a60d30f571ec7aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfda7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12acc4 expref: 696 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.436373:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914846 00000100:00100000:3.0:1721880422.436377:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a70ef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+696:2005:x1805522257783680:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.436380:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2564:3686:x1805522011844224:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2034us (2075us total) trans 4296020624 rc 0/0 00010000:00010000:3.0:1721880422.436382:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.436384:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095337cc0/0x8a60d30f571ec795 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfda6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12acaf expref: 696 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.436386:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632651 00010000:00010000:3.0:1721880422.436390:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095337cc0/0x8a60d30f571ec795 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfda6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12acaf expref: 696 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.436393:0:8793:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914847 00000100:00100000:2.0:1721880422.436398:0:8793:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30425778-2709-4512-9d75-01ec53c4cfad+696:2005:x1805522257783808:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.436402:0:16094:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095337cc0/0x8a60d30f571ec795 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfda6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12acaf expref: 696 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.436403:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099d29500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011845760:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.436405:0:8793:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.436410:0:8793:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099e37a80/0x8a60d30f571ec7aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfda7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12acc4 expref: 695 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.436411:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727ce60 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfda8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.436411:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.436412:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.436414:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727ce52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfda6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.436418:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727ce52 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfda6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.436419:0:8793:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099e37a80/0x8a60d30f571ec7aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfda7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12acc4 expref: 695 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.436422:0:16125:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099d29880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_109:lustre-OST0001_UUID:16125:1805522011846016:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.436426:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.436427:0:16125:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727ce6e lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfdaa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.436432:0:8793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099e37a80/0x8a60d30f571ec7aa lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfda7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12acc4 expref: 695 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.436442:0:8793:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.436442:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a70ef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+694:2005:x1805522257783680:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 64us (179us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.436444:0:8793:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.436445:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914846 00010000:00010000:2.0:1721880422.436446:0:8793:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727ce59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfda7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.436453:0:8793:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727ce59 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfda7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.436465:0:8793:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:3.0:1721880422.436478:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880091ae1500/2, rc 0, transno 1053328 00000100:00100000:2.0:1721880422.436483:0:8793:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30425778-2709-4512-9d75-01ec53c4cfad+693:2005:x1805522257783808:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 83us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.436483:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880091ae1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011844224:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.436487:0:8793:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914847 00000100:00100000:3.0:1721880422.436504:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800876b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011846656:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.436505:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727ce52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfda6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.436510:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727ce52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfda6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.436515:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727ce52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfda6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.436518:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727ce52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfda6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.436524:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721880422.436526:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727ce52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfda6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.436530:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136351f80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.436532:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727ce52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfda6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.436535:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727ce52 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfda6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.436541:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727ce52 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfda6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.436544:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136351f80/0x8a60d30f5727ce52 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfda6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.436548:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011846656 00000100:00100000:1.0:1721880422.436552:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011846656 00000100:00100000:1.0:1721880422.436569:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632660 00000100:00100000:1.0:1721880422.436573:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800876b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2564:3688:x1805522011846656:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1721880422.436598:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64941 count 1 00010000:00010000:0.0:1721880422.436607:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727ce83 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfdad:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.436613:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:0.0:1721880422.436615:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132cb8480/0x8a60d30f571ec852 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad6c expref: 692 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.436623:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.436624:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.436626:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727ce83 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfdad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.436635:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132cb8480/0x8a60d30f571ec852 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad6c expref: 692 pid: 16039 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.436636:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d2b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2565:3688:x1805522011844864:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1375us (1656us total) trans 4296020625 rc 0/0 00010000:00010000:0.0:1721880422.436640:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132cb8480/0x8a60d30f571ec852 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad6c expref: 692 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.436641:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632653 00000004:00080000:3.0:1721880422.436642:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880091ae2d80/2, rc 0, transno 1053329 00000100:00100000:0.0:1721880422.436646:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880095a27b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011846784:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.436646:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880091ae2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011844864:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.436659:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257784064 00000100:00100000:1.0:1721880422.436663:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257784064 00000100:00100000:0.0:1721880422.436664:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.436666:0:16088:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009bf69180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011845632:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.436676:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ffcc6c0/0x8a60d30f571ec7fe lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdaa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad18 expref: 693 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.436676:0:16088:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727ce67 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfda9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.436679:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099d28000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011846272:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.436686:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1721880422.436690:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800876b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011846912:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.436704:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.436706:0:15531:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914848 00000100:00100000:1.0:1721880422.436711:0:15531:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+693:2006:x1805522257784064:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.436712:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011846912 00000100:00100000:3.0:1721880422.436714:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011846912 00010000:00010000:1.0:1721880422.436719:0:15531:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.436723:0:15531:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ffcc6c0/0x8a60d30f571ec7fe lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdaa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad18 expref: 693 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.436724:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632661 00000100:00100000:3.0:1721880422.436741:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800876b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2565:3688:x1805522011846912:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.436749:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64942 count 1 00010000:00010000:2.0:1721880422.436751:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727ce59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfda7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.436754:0:15531:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ffcc6c0/0x8a60d30f571ec7fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdaa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad18 expref: 693 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.436756:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727ce75 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfdab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.436756:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727ce59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfda7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.436756:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727ce8a lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfdae:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.436760:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727ce59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfda7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.436763:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136201d40/0x8a60d30f571ec867 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad81 expref: 693 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.436765:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727ce59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfda7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.436766:0:15531:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ffcc6c0/0x8a60d30f571ec7fe lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdaa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad18 expref: 693 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.436767:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.436767:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.436769:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727ce59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfda7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.436769:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727ce8a lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfdae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.436772:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353cc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.436773:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727ce59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfda7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.436777:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727ce59 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfda7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.436778:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.436778:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136201d40/0x8a60d30f571ec867 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad81 expref: 692 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.436781:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.436783:0:15531:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.436783:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727ce59 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfda7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.436784:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136201d40/0x8a60d30f571ec867 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad81 expref: 692 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.436786:0:15531:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727ce6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdaa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.436787:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136353cc0/0x8a60d30f5727ce59 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfda7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.436790:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800876b0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011847040:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.436792:0:15531:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727ce6e lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfdaa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.436800:0:8793:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257783936 00000100:00100000:2.0:1721880422.436802:0:8793:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257783936 00000100:00100000:3.0:1721880422.436804:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03540 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.436809:0:15531:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.436810:0:8793:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d2aeac0/0x8a60d30f571ec7c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfda8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ace0 expref: 693 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.436820:0:8793:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914849 00000100:00100000:2.0:1721880422.436824:0:8793:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30425778-2709-4512-9d75-01ec53c4cfad+693:2004:x1805522257783936:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.436826:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.436829:0:8793:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.436831:0:15531:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:30425778-2709-4512-9d75-01ec53c4cfad+693:2006:x1805522257784064:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 117us (216us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.436832:0:8793:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d2aeac0/0x8a60d30f571ec7c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfda8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ace0 expref: 693 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.436836:0:7117:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257784320 00000100:00100000:1.0:1721880422.436837:0:15531:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914848 00010000:00010000:2.0:1721880422.436838:0:8793:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d2aeac0/0x8a60d30f571ec7c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfda8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ace0 expref: 693 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.436838:0:7117:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257784320 00010000:00010000:3.0:1721880422.436845:0:7117:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ffcc240/0x8a60d30f571ec7e2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfda9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12acfc expref: 694 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.436846:0:8793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d2aeac0/0x8a60d30f571ec7c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfda8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ace0 expref: 693 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.436853:0:8793:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.436854:0:8793:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.436856:0:8793:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727ce60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfda8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.436857:0:7117:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914850 00010000:00010000:2.0:1721880422.436860:0:8793:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727ce60 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfda8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.436860:0:7117:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30425778-2709-4512-9d75-01ec53c4cfad+692:2004:x1805522257784320:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.436865:0:7117:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.436867:0:7117:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ffcc240/0x8a60d30f571ec7e2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfda9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12acfc expref: 692 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.436869:0:8793:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.436873:0:7117:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ffcc240/0x8a60d30f571ec7e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfda9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12acfc expref: 692 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.436881:0:8793:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30425778-2709-4512-9d75-01ec53c4cfad+692:2004:x1805522257783936:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 56us (103us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.436881:0:7117:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ffcc240/0x8a60d30f571ec7e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfda9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12acfc expref: 692 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.436883:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727ce60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfda8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.436885:0:8793:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914849 00010000:00010000:3.0:1721880422.436886:0:7117:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.436887:0:7117:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.436889:0:7117:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727ce67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfda9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.436891:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727ce60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfda8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.436893:0:7117:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727ce67 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfda9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.436898:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727ce60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfda8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.436900:0:7117:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.436905:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727ce60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfda8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.436912:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727ce60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfda8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.436916:0:7117:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30425778-2709-4512-9d75-01ec53c4cfad+690:2004:x1805522257784320:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 54us (90us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.436920:0:7117:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914850 00010000:00010000:1.0:1721880422.436923:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325eac0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.436926:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727ce60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfda8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.436929:0:16088:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727ce67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfda9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.436931:0:16125:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727ce6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.436932:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727ce60 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfda8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.436933:0:16088:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727ce67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfda9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.436937:0:16125:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727ce6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.436937:0:16088:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727ce67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfda9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.436941:0:16088:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727ce67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfda9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.436942:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727ce60 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfda8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.436945:0:16125:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727ce6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.436945:0:16088:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727ce67 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfda9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.436948:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325eac0/0x8a60d30f5727ce60 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfda8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.436948:0:16088:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8000 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.436949:0:16125:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727ce6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.436949:0:16088:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727ce67 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfda9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.436953:0:16125:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727ce6e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.436953:0:16088:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727ce67 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfda9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.436956:0:16125:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325f3c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.436958:0:16125:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727ce6e lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.436958:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009427aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2566:3687:x1805522011844992:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1333us (1376us total) trans 4296020626 rc 0/0 00010000:00010000:3.0:1721880422.436958:0:16088:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727ce67 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfda9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.436961:0:16125:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727ce6e lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.436962:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632654 00010000:00010000:3.0:1721880422.436965:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8000/0x8a60d30f5727ce67 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfda9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.436968:0:16125:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727ce6e lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfdaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.436971:0:16125:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325f3c0/0x8a60d30f5727ce6e lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16125 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.436981:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009bf68700/2, rc 0, transno 1053330 00000100:00100000:2.0:1721880422.436987:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009bf68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011844992:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.437029:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1721880422.437036:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009427a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011847168:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.437056:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.437076:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.437077:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011847168 00000100:00100000:2.0:1721880422.437079:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011847168 00000100:00100000:0.0:1721880422.437086:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800876b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+2569:3688:x1805522011845888:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1267us (1299us total) trans 4296020629 rc 0/0 00000100:00100000:0.0:1721880422.437090:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632657 00000100:00100000:2.0:1721880422.437095:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632662 00000100:00100000:2.0:1721880422.437100:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009427ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2568:3687:x1805522011847168:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.437105:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2568:3688:x1805522011845376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1452us (1482us total) trans 4296020628 rc 0/0 00000100:00100000:3.0:1721880422.437109:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632656 00002000:00080000:2.0:1721880422.437110:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64943 count 1 00010000:00010000:2.0:1721880422.437118:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727ce91 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfdaf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.437125:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132cbb840/0x8a60d30f571ec88a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ada4 expref: 689 pid: 16039 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.437126:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000004:00080000:3.0:1721880422.437128:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009bf6b800/2, rc 0, transno 1053333 00010000:00010000:2.0:1721880422.437130:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.437131:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.437132:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727ce91 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfdaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.437142:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009bf6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011845888:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.437149:0:7117:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257784192 00000100:00100000:3.0:1721880422.437151:0:7117:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257784192 00010000:00010000:3.0:1721880422.437159:0:7117:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c2daac0/0x8a60d30f571ec81a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad34 expref: 690 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.437164:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800956c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011847296:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.437172:0:7117:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257784448 00000100:00100000:3.0:1721880422.437174:0:7117:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257784448 00000100:00100000:2.0:1721880422.437179:0:8793:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914851 00010000:00010000:3.0:1721880422.437179:0:7117:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007b9b4900/0x8a60d30f571ec836 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfdac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad50 expref: 691 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.437182:0:8793:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30425778-2709-4512-9d75-01ec53c4cfad+691:2004:x1805522257784192:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.437187:0:8793:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.437188:0:7117:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914852 00010000:00010000:2.0:1721880422.437190:0:8793:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c2daac0/0x8a60d30f571ec81a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad34 expref: 691 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.437191:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009427bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2567:3687:x1805522011845248:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1562us (1583us total) trans 4296020627 rc 0/0 00000100:00100000:3.0:1721880422.437191:0:7117:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30425778-2709-4512-9d75-01ec53c4cfad+691:2005:x1805522257784448:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.437197:0:7117:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721880422.437198:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632655 00010000:00010000:3.0:1721880422.437199:0:7117:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007b9b4900/0x8a60d30f571ec836 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfdac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad50 expref: 691 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.437200:0:8793:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c2daac0/0x8a60d30f571ec81a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad34 expref: 691 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.437205:0:7117:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007b9b4900/0x8a60d30f571ec836 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad50 expref: 691 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.437209:0:8793:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c2daac0/0x8a60d30f571ec81a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdab:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad34 expref: 691 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.437213:0:7117:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.437214:0:7117:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.437215:0:8793:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.437216:0:8793:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.437216:0:7117:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727ce7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.437218:0:8793:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727ce75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.437220:0:7117:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727ce7c lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfdac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.437222:0:8793:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727ce75 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfdab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.437226:0:7117:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.437231:0:8793:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.437241:0:7117:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30425778-2709-4512-9d75-01ec53c4cfad+690:2005:x1805522257784448:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 49us (117us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.437243:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727ce75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.437243:0:8793:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30425778-2709-4512-9d75-01ec53c4cfad+690:2004:x1805522257784192:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 60us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.437245:0:7117:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914852 00000100:00100000:2.0:1721880422.437247:0:8793:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914851 00010000:00010000:1.0:1721880422.437251:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727ce75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.437259:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727ce75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.437261:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009bf6b480/2, rc 0, transno 1053332 00000100:00100000:3.0:1721880422.437266:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009bf6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011845376:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.437267:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.437270:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727ce75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.437277:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727ce75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.437283:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325c480 already unused, calling callback (ffffffffa084e330) 00000004:00080000:2.0:1721880422.437285:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009bf69880/2, rc 0, transno 1053331 00010000:00010000:1.0:1721880422.437286:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727ce75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.437286:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800876b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011847424:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.437292:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727ce75 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.437298:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009bf69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011845248:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.437302:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727ce75 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfdab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.437308:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325c480/0x8a60d30f5727ce75 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.437310:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011847296 00000100:00100000:2.0:1721880422.437312:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011847296 00000100:00100000:3.0:1721880422.437319:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.437325:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011847424 00000100:00100000:2.0:1721880422.437327:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011847424 00000100:00100000:3.0:1721880422.437328:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1721880422.437331:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800876b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011847552:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.437335:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632663 00000100:00100000:2.0:1721880422.437338:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800888cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2568:3687:x1805522011847296:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.437344:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:2.0:1721880422.437346:0:16088:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64944 count 1 00000100:00100000:0.0:1721880422.437349:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.437353:0:16088:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727ce98 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfdb0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.437359:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257784704 00000100:00100000:3.0:1721880422.437361:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257784704 00010000:00010000:2.0:1721880422.437362:0:16088:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ebd2f40/0x8a60d30f571ec89f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12adb9 expref: 688 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.437366:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.437367:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.437369:0:16088:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727ce98 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfdb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.437369:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136201d40/0x8a60d30f571ec867 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfdae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad81 expref: 689 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.437377:0:8793:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914853 00000100:00100000:0.0:1721880422.437379:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.437381:0:8793:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ab4d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30425778-2709-4512-9d75-01ec53c4cfad+689:2005:x1805522257784704:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.437384:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257784576 00010000:00010000:2.0:1721880422.437385:0:8793:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721880422.437385:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257784576 00010000:00010000:2.0:1721880422.437388:0:8793:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136201d40/0x8a60d30f571ec867 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfdae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad81 expref: 690 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.437391:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132cb8480/0x8a60d30f571ec852 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfdad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad6c expref: 690 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.437393:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011847552 00010000:00010000:2.0:1721880422.437394:0:8793:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136201d40/0x8a60d30f571ec867 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad81 expref: 690 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.437396:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011847552 00010000:00010000:2.0:1721880422.437401:0:8793:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.437401:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914854 00010000:00010000:2.0:1721880422.437402:0:8793:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.437403:0:8793:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727ce8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.437404:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+690:2005:x1805522257784576:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.437408:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632664 00010000:00010000:2.0:1721880422.437408:0:8793:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727ce8a lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfdae:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.437408:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.437410:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132cb8480/0x8a60d30f571ec852 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfdad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad6c expref: 690 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.437412:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800876b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2570:3688:x1805522011847424:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.437413:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800876b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2570:3686:x1805522011846144:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1381us (1424us total) trans 4296020630 rc 0/0 00010000:00010000:2.0:1721880422.437417:0:8793:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.437417:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132cb8480/0x8a60d30f571ec852 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad6c expref: 690 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.437419:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632658 00002000:00080000:0.0:1721880422.437420:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64945 count 1 00010000:00010000:3.0:1721880422.437424:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.437425:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.437426:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727ce83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.437428:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727ce9f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfdb1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.437430:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727ce83 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfdad:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.437431:0:8793:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ab4d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30425778-2709-4512-9d75-01ec53c4cfad+690:2005:x1805522257784704:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 50us (84us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.437434:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632665 00000100:00100000:2.0:1721880422.437435:0:8793:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914853 00010000:00010000:0.0:1721880422.437436:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800910773c0/0x8a60d30f571ec8bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12add5 expref: 690 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.437436:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.437439:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800876b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2569:3688:x1805522011847552:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.437441:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.437442:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.437443:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727ce9f lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfdb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.437447:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+689:2005:x1805522257784576:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 42us (68us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.437451:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914854 00002000:00080000:1.0:1721880422.437452:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64946 count 1 00010000:00010000:0.0:1721880422.437453:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800910773c0/0x8a60d30f571ec8bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12add5 expref: 689 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.437459:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800910773c0/0x8a60d30f571ec8bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12add5 expref: 688 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.437462:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727cea6 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfdb2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.437464:0:16088:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ebd2f40/0x8a60d30f571ec89f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12adb9 expref: 688 pid: 16039 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.437465:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099d29500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011847680:192.168.201.24@tcp:104: 00000004:00080000:3.0:1721880422.437470:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880094279f80/2, rc 0, transno 1053334 00010000:00010000:2.0:1721880422.437471:0:16088:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ebd2f40/0x8a60d30f571ec89f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12adb9 expref: 688 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.437472:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ebd2400/0x8a60d30f571ec8d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12adf1 expref: 688 pid: 16039 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.437474:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094279f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011846144:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.437477:0:16088:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800888cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011847808:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.437478:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.437479:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1721880422.437480:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e600 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.437482:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727cea6 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfdb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.437488:0:16088:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfded80 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.437492:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1721880422.437495:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800876b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011847936:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.437499:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ebd2400/0x8a60d30f571ec8d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12adf1 expref: 688 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.437501:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132cbb840/0x8a60d30f571ec88a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ada4 expref: 688 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.437503:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132cb8480/0x8a60d30f571ec852 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad6c expref: 688 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.437509:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ebd2400/0x8a60d30f571ec8d7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12adf1 expref: 688 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.437509:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132cbb840/0x8a60d30f571ec88a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ada4 expref: 688 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.437510:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.437514:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880095a27b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011846784:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.437515:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800888cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011848192:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.437519:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012edb2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011848064:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.437522:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727ce83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.437523:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012cfde780 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.437527:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727ce83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.437530:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136201d40/0x8a60d30f571ec867 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad81 expref: 687 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.437531:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727ce83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.437531:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011847936 00000100:00100000:2.0:1721880422.437532:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011847936 00010000:00010000:0.0:1721880422.437535:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727ce83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.437537:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800876b0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011847040:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.437539:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727ce83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.437539:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a180 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.437542:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727ce83 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.437542:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632666 00000100:00100000:2.0:1721880422.437544:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800876b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2570:3687:x1805522011847936:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.437545:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325d8c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.437545:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727ce8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.437547:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727ce83 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.437550:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727ce8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.437551:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727ce83 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.437553:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64947 count 1 00010000:00010000:3.0:1721880422.437554:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727ce8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.437558:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727ce8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.437559:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727cead lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfdb3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.437560:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727ce83 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfdad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.437562:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727ce8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.437565:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325d8c0/0x8a60d30f5727ce83 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.437565:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ebd21c0/0x8a60d30f571ec8f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae0d expref: 686 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.437565:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727ce8a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.437569:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.437569:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aab600 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.437570:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.437570:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727ce8a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.437571:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727cead lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfdb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.437578:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727ce8a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.437581:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ebd21c0/0x8a60d30f571ec8f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae0d expref: 686 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.437583:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727ce8a lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfdae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.437586:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ebd21c0/0x8a60d30f571ec8f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae0d expref: 686 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.437587:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aab600/0x8a60d30f5727ce8a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.437592:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880095a27b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011848320:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.437604:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec480 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.437619:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007b9b4900/0x8a60d30f571ec836 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ad50 expref: 686 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.437627:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094278700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011846528:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.437636:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727ce7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.437644:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727ce7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.437648:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727ce7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.437652:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727ce7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.437656:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727ce7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.437659:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727ce7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.437663:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801363521c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.437664:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727ce7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.437668:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800876b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2572:3688:x1805522011846656:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1094us (1141us total) trans 4296020631 rc 0/0 00010000:00010000:2.0:1721880422.437668:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727ce7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.437672:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632660 00010000:00010000:2.0:1721880422.437673:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727ce7c lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfdac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.437673:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800876b2d80/2, rc 0, transno 1053335 00010000:00010000:2.0:1721880422.437677:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801363521c0/0x8a60d30f5727ce7c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.437678:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800876b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011846656:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.437708:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800876b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011848448:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.437720:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800876b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2572:3688:x1805522011846912:12345-0@lo:6:osp-syn-1-0.0 Request processed in 992us (1015us total) trans 4296020632 rc 0/0 00000100:00100000:0.0:1721880422.437724:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.437725:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632661 00000100:00100000:1.0:1721880422.437750:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011848448 00000100:00100000:1.0:1721880422.437755:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011848448 00000004:00080000:3.0:1721880422.437758:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800876b1c00/2, rc 0, transno 1053336 00000100:00100000:3.0:1721880422.437761:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800876b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011846912:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.437774:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800876b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2572:3687:x1805522011846400:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1502us (1537us total) trans 4296020633 rc 0/0 00000100:00100000:1.0:1721880422.437778:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632667 00000004:00080000:0.0:1721880422.437780:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880094278e00/2, rc 0, transno 1053337 00000100:00100000:2.0:1721880422.437782:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632659 00000100:00100000:1.0:1721880422.437783:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2572:3687:x1805522011848448:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.437784:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800876b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011848576:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.437786:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094278e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011846400:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.437800:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:1.0:1721880422.437801:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64948 count 1 00000100:00100000:2.0:1721880422.437809:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011848576 00000100:00100000:3.0:1721880422.437810:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1721880422.437812:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011848576 00000100:00100000:3.0:1721880422.437813:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099d2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011848704:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.437818:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727ceb4 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfdb4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.437821:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632668 00000100:00100000:3.0:1721880422.437822:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880422.437824:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800876b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2572:3688:x1805522011848576:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.437830:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa8b600/0x8a60d30f571ec92b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae45 expref: 685 pid: 16039 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1721880422.437831:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64949 count 1 00000100:00100000:3.0:1721880422.437833:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011848704 00000100:00100000:3.0:1721880422.437834:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011848704 00010000:00010000:1.0:1721880422.437836:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.437838:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.437838:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727cebb lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfdb5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.437840:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727ceb4 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfdb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.437846:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632669 00010000:00010000:2.0:1721880422.437847:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009431ef40/0x8a60d30f571ec947 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae61 expref: 685 pid: 16039 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.437849:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2573:3688:x1805522011848704:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.437851:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.437852:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.437854:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727cebb lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfdb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.437857:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa8b600/0x8a60d30f571ec92b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae45 expref: 685 pid: 16039 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.437857:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64950 count 1 00010000:00010000:3.0:1721880422.437864:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727cec2 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfdb6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.437866:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009431ef40/0x8a60d30f571ec947 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae61 expref: 685 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.437867:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa8b600/0x8a60d30f571ec92b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae45 expref: 685 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.437871:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009431ed00/0x8a60d30f571ec963 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae7d expref: 685 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.437874:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009431ef40/0x8a60d30f571ec947 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae61 expref: 685 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.437875:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.437876:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1721880422.437877:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012edb0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011848832:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.437878:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727cec2 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfdb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.437884:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880095a27100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011848960:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.437889:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009431ed00/0x8a60d30f571ec963 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae7d expref: 685 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.437894:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009431ed00/0x8a60d30f571ec963 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae7d expref: 685 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.437901:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e616a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011849088:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.437902:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.437904:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.437915:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03540 going to sleep for 11 seconds 00000100:00100000:2.0:1721880422.438570:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800888cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011848192:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.438580:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727ce91 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfdaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.438600:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012edb2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011848064:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.438600:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880095a27b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011848320:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.438601:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.438608:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727cead lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfdb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.438611:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.438616:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727cea6 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfdb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.438628:0:7117:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257784832 00000100:00100000:0.0:1721880422.438630:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.438631:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880095a27100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011848960:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.438632:0:7117:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257784832 00010000:00010000:2.0:1721880422.438636:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727cebb lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfdb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.438638:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012edb0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011848832:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.438640:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.438647:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727ceb4 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfdb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.438648:0:7117:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132cbb840/0x8a60d30f571ec88a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ada4 expref: 686 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.438649:0:8793:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257785216 00000100:00100000:0.0:1721880422.438651:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.438651:0:8793:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257785216 00000100:00100000:0.0:1721880422.438658:0:8271:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257785088 00010000:00010000:2.0:1721880422.438659:0:8793:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ebd2f40/0x8a60d30f571ec89f lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfdb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12adb9 expref: 687 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.438661:0:8271:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257785088 00000100:00100000:3.0:1721880422.438667:0:7117:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257785344 00000100:00100000:3.0:1721880422.438669:0:7117:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257785344 00010000:00010000:0.0:1721880422.438670:0:8271:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800910773c0/0x8a60d30f571ec8bb lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfdb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12add5 expref: 688 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.438670:0:8793:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257784960 00000100:00100000:2.0:1721880422.438672:0:8793:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257784960 00010000:00010000:2.0:1721880422.438677:0:8793:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ebd2400/0x8a60d30f571ec8d7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12adf1 expref: 690 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.438680:0:7117:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ebd21c0/0x8a60d30f571ec8f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae0d expref: 690 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.438682:0:8271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914855 00000100:00100000:0.0:1721880422.438686:0:8271:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfb9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+690:2004:x1805522257784832:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.438689:0:8793:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914856 00010000:00010000:0.0:1721880422.438692:0:8271:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.438693:0:8793:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008571d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30425778-2709-4512-9d75-01ec53c4cfad+690:2004:x1805522257785216:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.438695:0:8271:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132cbb840/0x8a60d30f571ec88a lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdaf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ada4 expref: 690 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.438698:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914857 00010000:00010000:2.0:1721880422.438699:0:8793:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.438701:0:8271:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132cbb840/0x8a60d30f571ec88a lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdaf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ada4 expref: 690 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.438702:0:8793:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ebd2f40/0x8a60d30f571ec89f lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfdb0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12adb9 expref: 690 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.438703:0:7117:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914858 00000100:00100000:1.0:1721880422.438704:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008571d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+690:2004:x1805522257785088:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.438708:0:8793:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ebd2f40/0x8a60d30f571ec89f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdb0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12adb9 expref: 690 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.438708:0:7117:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30425778-2709-4512-9d75-01ec53c4cfad+690:2006:x1805522257784960:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.438709:0:8271:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132cbb840/0x8a60d30f571ec88a lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdaf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ada4 expref: 690 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.438713:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.438716:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.438716:0:8793:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.438716:0:7117:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.438717:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.438717:0:8793:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.438718:0:8793:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727ce98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdb0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.438719:0:8271:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727ce91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.438719:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800910773c0/0x8a60d30f571ec8bb lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfdb1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12add5 expref: 689 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.438720:0:7117:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ebd2400/0x8a60d30f571ec8d7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdb2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12adf1 expref: 689 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.438723:0:8271:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727ce91 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfdaf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.438723:0:8793:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727ce98 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfdb0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.438746:0:7117:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ebd2400/0x8a60d30f571ec8d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdb2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12adf1 expref: 689 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.438747:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800910773c0/0x8a60d30f571ec8bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdb1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12add5 expref: 689 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.438747:0:8793:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.438748:0:8271:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.438757:0:7117:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ebd2400/0x8a60d30f571ec8d7 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdb2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12adf1 expref: 689 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.438759:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.438761:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1721880422.438764:0:8271:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfb9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+688:2004:x1805522257784832:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 77us (163us total) trans 0 rc 0/0 00010000:00010000:1.0:1721880422.438764:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727ce9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdb1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.438764:0:8793:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008571d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30425778-2709-4512-9d75-01ec53c4cfad+688:2004:x1805522257785216:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 70us (152us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.438764:0:7117:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.438766:0:7117:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.438767:0:7117:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727cea6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.438768:0:8271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914855 00000100:00100000:2.0:1721880422.438770:0:8793:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914856 00010000:00010000:1.0:1721880422.438771:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727ce9f lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfdb1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.438772:0:7117:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727cea6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfdb2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.438778:0:8271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914859 00000100:00100000:0.0:1721880422.438781:0:8271:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008571c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+686:2006:x1805522257785344:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.438782:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.438783:0:7117:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721880422.438785:0:8271:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.438788:0:8271:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ebd21c0/0x8a60d30f571ec8f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdb3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae0d expref: 686 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.438795:0:8271:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ebd21c0/0x8a60d30f571ec8f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdb3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae0d expref: 686 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.438800:0:7117:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30425778-2709-4512-9d75-01ec53c4cfad+686:2006:x1805522257784960:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 92us (148us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.438803:0:8271:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ebd21c0/0x8a60d30f571ec8f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdb3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae0d expref: 686 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.438805:0:7117:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914858 00000100:00100000:1.0:1721880422.438806:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008571d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+686:2004:x1805522257785088:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 100us (172us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.438808:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.438809:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.438811:0:8271:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727cead lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.438812:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914857 00010000:00010000:0.0:1721880422.438815:0:8271:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727cead lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfdb3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.438823:0:8271:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.438832:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ebd2f40/0x8a60d30f571ec89f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdb0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12adb9 expref: 683 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.438833:0:8271:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008571c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+683:2006:x1805522257785344:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 51us (192us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.438834:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727cead lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.438836:0:8271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914859 00010000:00010000:2.0:1721880422.438840:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727cead lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.438841:0:16088:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800888cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011847808:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.438844:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727cead lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.438852:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727cead lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.438853:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800910773c0/0x8a60d30f571ec8bb lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdb1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12add5 expref: 681 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.438856:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727cead lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.438856:0:16088:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727ce98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.438859:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136351b00 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.438860:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727cead lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.438863:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099d29500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011847680:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.438863:0:16088:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727ce98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.438864:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727cead lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.438869:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727cead lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfdb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.438869:0:16088:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727ce98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.438871:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727ce9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.438873:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136351b00/0x8a60d30f5727cead lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.438875:0:16088:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727ce98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.438876:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727ce9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.438880:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727ce9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.438882:0:16088:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727ce98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.438885:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727ce9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.438888:0:16088:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727ce98 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.438889:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727ce9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.438892:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727ce9f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.438894:0:16088:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352880 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.438896:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325cb40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.438897:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727ce9f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.438897:0:16088:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727ce98 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.438901:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727ce9f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.438903:0:16088:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727ce98 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.438906:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727ce9f lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfdb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.438910:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325cb40/0x8a60d30f5727ce9f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.438916:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727cea6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.438918:0:16088:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727ce98 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfdb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.438923:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727cea6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.438924:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136352880/0x8a60d30f5727ce98 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.438930:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727cea6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.438936:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727cea6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.438943:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727cea6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.438949:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4000 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.438951:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727cea6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.438951:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800876b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2575:3687:x1805522011847936:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1405us (1442us total) trans 4296020634 rc 0/0 00000100:00100000:2.0:1721880422.438955:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632666 00010000:00010000:1.0:1721880422.438957:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727cea6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.438966:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727cea6 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfdb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.438973:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4000/0x8a60d30f5727cea6 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1721880422.438973:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800876b3480/2, rc 0, transno 1053338 00000100:00100000:2.0:1721880422.438978:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800876b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011847936:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.438995:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1721880422.438999:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880095a27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011849216:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.439001:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800876b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2575:3688:x1805522011847424:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1588us (1680us total) trans 4296020635 rc 0/0 00000100:00100000:0.0:1721880422.439006:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632664 00000100:00100000:2.0:1721880422.439027:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.439033:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011849216 00000100:00100000:0.0:1721880422.439035:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011849216 00000100:00100000:0.0:1721880422.439045:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632670 00000100:00100000:0.0:1721880422.439048:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2576:3687:x1805522011849216:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.439054:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800888cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2576:3687:x1805522011847296:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1714us (1784us total) trans 4296020636 rc 0/0 00002000:00080000:0.0:1721880422.439056:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64951 count 1 00000004:00080000:2.0:1721880422.439059:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800956c8380/2, rc 0, transno 1053340 00000100:00100000:3.0:1721880422.439059:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632663 00010000:00010000:0.0:1721880422.439063:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727cec9 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfdb7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.439064:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800956c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011847296:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.439070:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c4a8900/0x8a60d30f571ec97f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae99 expref: 680 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.439074:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.439075:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1721880422.439077:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727cec9 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfdb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.439079:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800888cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011849344:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.439087:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c4a8900/0x8a60d30f571ec97f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae99 expref: 680 pid: 16039 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.439089:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800876b3100/2, rc 0, transno 1053339 00010000:00010000:0.0:1721880422.439092:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c4a8900/0x8a60d30f571ec97f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae99 expref: 680 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.439095:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880422.439098:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011849472:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.439104:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800876b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2575:3688:x1805522011847552:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1663us (1757us total) trans 4296020637 rc 0/0 00000100:00100000:3.0:1721880422.439105:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800876b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011847424:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.439110:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632665 00000100:00100000:0.0:1721880422.439111:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012bb3e600 going to sleep for 11 seconds 00000004:00080000:3.0:1721880422.439119:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800876b1880/2, rc 0, transno 1053341 00000100:00100000:3.0:1721880422.439123:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800876b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011847552:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.439133:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.439134:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094278700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011849600:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.439135:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009bd8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011849728:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.439138:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011849344 00000100:00100000:2.0:1721880422.439140:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011849344 00000100:00100000:2.0:1721880422.439150:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632671 00000100:00100000:2.0:1721880422.439153:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800888cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2575:3687:x1805522011849344:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.439159:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880422.439159:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:2.0:1721880422.439161:0:16101:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64952 count 1 00000100:00100000:0.0:1721880422.439168:0:8271:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257785472 00000100:00100000:0.0:1721880422.439170:0:8271:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257785472 00010000:00010000:2.0:1721880422.439170:0:16101:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727ced0 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfdb8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.439171:0:16060:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011849600 00000100:00100000:1.0:1721880422.439175:0:16060:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011849600 00010000:00010000:0.0:1721880422.439178:0:8271:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa8b600/0x8a60d30f571ec92b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae45 expref: 681 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.439180:0:16101:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c4a86c0/0x8a60d30f571ec99b lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aeb5 expref: 681 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.439186:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.439187:0:16101:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.439189:0:16101:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727ced0 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfdb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.439195:0:8271:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257785600 00000100:00100000:0.0:1721880422.439197:0:8271:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257785600 00010000:00010000:0.0:1721880422.439201:0:8271:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009431ef40/0x8a60d30f571ec947 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae61 expref: 682 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.439206:0:16101:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c4a86c0/0x8a60d30f571ec99b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aeb5 expref: 682 pid: 16039 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.439209:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632672 00000100:00100000:0.0:1721880422.439211:0:8271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914860 00000100:00100000:0.0:1721880422.439215:0:8271:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129d22c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+682:2006:x1805522257785472:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.439215:0:16101:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c4a86c0/0x8a60d30f571ec99b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aeb5 expref: 682 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.439215:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e616300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2576:3688:x1805522011849600:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.439218:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914861 00010000:00010000:0.0:1721880422.439219:0:8271:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.439222:0:8271:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa8b600/0x8a60d30f571ec92b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdb4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae45 expref: 682 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.439224:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+682:2005:x1805522257785600:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1721880422.439228:0:8271:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa8b600/0x8a60d30f571ec92b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdb4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae45 expref: 682 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.439230:0:16101:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800966b3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011849856:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.439233:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.439235:0:8271:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa8b600/0x8a60d30f571ec92b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdb4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae45 expref: 682 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.439239:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009431ef40/0x8a60d30f571ec947 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdb5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae61 expref: 682 pid: 16039 timeout: 887 lvb_type: 0 00002000:00080000:3.0:1721880422.439242:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64953 count 1 00010000:00010000:0.0:1721880422.439243:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.439244:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.439245:0:8271:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727ceb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.439248:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009431ef40/0x8a60d30f571ec947 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdb5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae61 expref: 681 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.439249:0:16101:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec3c0 going to sleep for 11 seconds 00010000:00010000:0.0:1721880422.439250:0:8271:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727ceb4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfdb4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.439252:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727ced7 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfdb9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.439261:0:8271:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.439261:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009431ef40/0x8a60d30f571ec947 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdb5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae61 expref: 681 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.439262:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c4aa640/0x8a60d30f571ec9b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aed1 expref: 681 pid: 16039 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.439272:0:8271:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880129d22c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+680:2006:x1805522257785472:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 56us (138us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.439272:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.439273:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.439274:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.439275:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.439276:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727ced7 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfdb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.439277:0:8271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914860 00010000:00010000:1.0:1721880422.439277:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727cebb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.439284:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727cebb lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfdb5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.439292:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c4aa640/0x8a60d30f571ec9b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aed1 expref: 679 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.439300:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721880422.439301:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c4aa640/0x8a60d30f571ec9b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aed1 expref: 679 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.439305:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727cebb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.439308:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e615180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011849984:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.439310:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727cebb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.439315:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727cebb lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.439319:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727cebb lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.439322:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727cebb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.439323:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+679:2005:x1805522257785600:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 99us (162us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.439325:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff8801363518c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.439327:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727cebb lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.439327:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03000 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.439329:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914861 00010000:00010000:2.0:1721880422.439331:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727cebb lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.439337:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727cebb lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfdb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.439342:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801363518c0/0x8a60d30f5727cebb lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.439344:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e616a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011849088:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.439351:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721880422.439354:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727cec2 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfdb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.439360:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.439380:0:15444:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257785728 00000100:00100000:1.0:1721880422.439383:0:15444:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257785728 00010000:00010000:1.0:1721880422.439396:0:15444:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009431ed00/0x8a60d30f571ec963 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae7d expref: 679 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.439422:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914862 00000100:00100000:2.0:1721880422.439423:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800876b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2577:3688:x1805522011848576:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1598us (1623us total) trans 4296020638 rc 0/0 00000100:00100000:1.0:1721880422.439427:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+679:2005:x1805522257785728:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1721880422.439428:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632668 00010000:00010000:0.0:1721880422.439433:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727ce91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.439434:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721880422.439436:0:16028:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011849728 00010000:00010000:0.0:1721880422.439438:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727ce91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.439438:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009431ed00/0x8a60d30f571ec963 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdb6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae7d expref: 679 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.439439:0:16028:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011849728 00000004:00080000:3.0:1721880422.439439:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800876b0a80/2, rc 0, transno 1053342 00010000:00010000:0.0:1721880422.439443:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727ce91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.439446:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727ce91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.439447:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009431ed00/0x8a60d30f571ec963 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdb6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae7d expref: 679 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.439449:0:16028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632673 00000100:00100000:3.0:1721880422.439450:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800876b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011848576:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.439451:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727ce91 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.439452:0:16028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2577:3689:x1805522011849728:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1721880422.439454:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136351440 already unused, calling callback (ffffffffa084e330) 00010000:00010000:0.0:1721880422.439456:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727ce91 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.439459:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009431ed00/0x8a60d30f571ec963 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdb6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae7d expref: 679 pid: 16039 timeout: 887 lvb_type: 0 00002000:00080000:2.0:1721880422.439459:0:16028:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64954 count 1 00010000:00010000:0.0:1721880422.439460:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727ce91 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.439466:0:16028:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727cede lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfdba:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.439468:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.439470:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727ce91 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfdaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.439470:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.439473:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727cec2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.439473:0:16028:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092115d40/0x8a60d30f571ec9d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aeed expref: 678 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.439474:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136351440/0x8a60d30f5727ce91 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.439478:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.439479:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727cec2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfdb6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.439479:0:16028:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.439481:0:16028:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727cede lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfdba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.439485:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e616a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011850112:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.439491:0:16028:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092115d40/0x8a60d30f571ec9d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aeed expref: 678 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.439493:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.439496:0:16028:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092115d40/0x8a60d30f571ec9d3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aeed expref: 678 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.439503:0:16028:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800966b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011850240:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.439509:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.439515:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+678:2005:x1805522257785728:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 87us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.439516:0:16028:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec480 going to sleep for 11 seconds 00000100:00100000:1.0:1721880422.439521:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914862 00000100:00100000:3.0:1721880422.439527:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011850112 00000100:00100000:3.0:1721880422.439530:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011850112 00000100:00100000:1.0:1721880422.439546:0:16060:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632674 00000100:00100000:1.0:1721880422.439550:0:16060:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e616d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2579:3686:x1805522011850112:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.439551:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009427ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2579:3687:x1805522011847168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2451us (2494us total) trans 4296020639 rc 0/0 00000100:00100000:0.0:1721880422.439555:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632662 00000004:00080000:2.0:1721880422.439555:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009427a680/2, rc 0, transno 1053343 00010000:00010000:3.0:1721880422.439555:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727cec2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1721880422.439562:0:16060:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64955 count 1 00000100:00100000:2.0:1721880422.439565:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009427a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011847168:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.439565:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727cec2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.439573:0:16060:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727cee5 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfdbb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.439573:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727cec2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.439580:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727cec2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.439586:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727cec2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.439588:0:16060:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e76af40/0x8a60d30f571ec9ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af09 expref: 677 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.439592:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8900 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.439594:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.439595:0:16060:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.439595:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727cec2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.439598:0:16060:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727cee5 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfdbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.439602:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727cec2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.439611:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727cec2 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfdb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.439613:0:16060:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e76af40/0x8a60d30f571ec9ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af09 expref: 677 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.439618:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8900/0x8a60d30f5727cec2 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.439623:0:16060:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e76af40/0x8a60d30f571ec9ef lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af09 expref: 677 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.439632:0:16060:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012edb2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011850368:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.439657:0:16060:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a3c0 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.439668:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727ceb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.439670:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1721880422.439675:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727ceb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.439677:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e9c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011850496:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.439682:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727ceb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.439688:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727ceb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.439695:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727ceb4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.439698:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.439700:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b4240 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.439703:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727ceb4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.439709:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727ceb4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.439718:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727ceb4 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfdb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.439718:0:15453:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011850496 00000100:00100000:2.0:1721880422.439723:0:15453:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011850496 00010000:00010000:1.0:1721880422.439725:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b4240/0x8a60d30f5727ceb4 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.439762:0:15453:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632675 00000100:00100000:2.0:1721880422.439767:0:15453:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2580:3686:x1805522011850496:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.439781:0:15453:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64956 count 1 00010000:00010000:2.0:1721880422.439792:0:15453:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727ceec lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfdbc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.439805:0:15453:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e769200/0x8a60d30f571eca04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af25 expref: 677 pid: 16039 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.439811:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.439813:0:15453:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.439816:0:15453:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727ceec lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfdbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.439825:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bf69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2581:3688:x1805522011848704:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1974us (2000us total) trans 4296020640 rc 0/0 00010000:00010000:2.0:1721880422.439832:0:15453:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e769200/0x8a60d30f571eca04 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af25 expref: 677 pid: 16039 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.439833:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632669 00010000:00010000:2.0:1721880422.439842:0:15453:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e769200/0x8a60d30f571eca04 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af25 expref: 677 pid: 16039 timeout: 887 lvb_type: 0 00000004:00080000:3.0:1721880422.439855:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099d2b800/2, rc 0, transno 1053344 00000100:00100000:2.0:1721880422.439857:0:15453:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800966b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011850624:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.439861:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099d2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011848704:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.439864:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2580:3687:x1805522011848448:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2079us (2137us total) trans 4296020641 rc 0/0 00000100:00100000:1.0:1721880422.439870:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632667 00000100:00100000:2.0:1721880422.439885:0:15453:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1721880422.439888:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e9c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011850752:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.439910:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1721880422.439915:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800876b0700/2, rc 0, transno 1053345 00000100:00100000:1.0:1721880422.439923:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011850752 00000100:00100000:2.0:1721880422.439924:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800876b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011848448:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.439926:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011850752 00000100:00100000:1.0:1721880422.439941:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632676 00000100:00100000:1.0:1721880422.439945:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2580:3688:x1805522011850752:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.439957:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64957 count 1 00000100:00100000:0.0:1721880422.439961:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800966b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011850880:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.439966:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727cef3 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfdbd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.439978:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.439981:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800921146c0/0x8a60d30f571eca20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af3a expref: 677 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.439988:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.439990:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1721880422.439990:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011850880 00010000:00010000:1.0:1721880422.439993:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727cef3 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfdbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.439995:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011850880 00010000:00010000:1.0:1721880422.440025:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800921146c0/0x8a60d30f571eca20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af3a expref: 677 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.440026:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632677 00000100:00100000:2.0:1721880422.440027:0:16101:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800966b3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_088:lustre-OST0001_UUID:16101:1805522011849856:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.440031:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2581:3689:x1805522011850880:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.440035:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800921146c0/0x8a60d30f571eca20 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af3a expref: 677 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.440038:0:16101:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727ced0 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfdb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.440043:0:16017:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64958 count 1 00000100:00100000:1.0:1721880422.440045:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012edb0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011851008:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.440052:0:16017:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727cefa lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfdbe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.440062:0:16017:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135347a80/0x8a60d30f571eca3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af56 expref: 677 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.440068:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a180 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.440068:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.440069:0:16017:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.440071:0:16017:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727cefa lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfdbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.440087:0:16017:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135347a80/0x8a60d30f571eca3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af56 expref: 677 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.440101:0:16017:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135347a80/0x8a60d30f571eca3c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af56 expref: 677 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.440106:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009fff1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011849472:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.440110:0:16017:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e9cb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011851136:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.440121:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727cec9 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfdb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.440136:0:16017:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03540 going to sleep for 11 seconds 00000100:00100000:0.0:1721880422.440153:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.440169:0:15444:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257785856 00000100:00100000:1.0:1721880422.440172:0:15444:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257785856 00010000:00010000:1.0:1721880422.440184:0:15444:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c4a86c0/0x8a60d30f571ec99b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aeb5 expref: 678 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.440192:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880422.440211:0:15444:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257785984 00000100:00100000:1.0:1721880422.440214:0:15444:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257785984 00000100:00100000:0.0:1721880422.440216:0:8271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914863 00000100:00100000:0.0:1721880422.440220:0:8271:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008571d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+679:2005:x1805522257785856:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.440224:0:15444:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c4a8900/0x8a60d30f571ec97f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae99 expref: 679 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.440226:0:8271:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721880422.440229:0:8271:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c4a86c0/0x8a60d30f571ec99b lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdb8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aeb5 expref: 679 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.440235:0:8271:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c4a86c0/0x8a60d30f571ec99b lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdb8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aeb5 expref: 679 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.440239:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914864 00000100:00100000:1.0:1721880422.440245:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008571d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+679:2005:x1805522257785984:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.440252:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.440256:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c4a8900/0x8a60d30f571ec97f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdb7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae99 expref: 679 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.440265:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c4a8900/0x8a60d30f571ec97f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdb7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae99 expref: 679 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.440277:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c4a8900/0x8a60d30f571ec97f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdb7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12ae99 expref: 679 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:0.0:1721880422.440282:0:8271:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c4a86c0/0x8a60d30f571ec99b lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdb8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aeb5 expref: 679 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.440287:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.440289:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.440291:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727cec9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.440293:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.440294:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.440296:0:8271:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727ced0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.440298:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727cec9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfdb7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.440301:0:8271:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727ced0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfdb8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.440311:0:8271:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.440314:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721880422.440322:0:8271:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008571d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+677:2005:x1805522257785856:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 102us (208us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.440324:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727cec9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.440326:0:8271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914863 00010000:00010000:2.0:1721880422.440332:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727cec9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.440333:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008571d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+677:2005:x1805522257785984:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 87us (140us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.440339:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727cec9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.440340:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914864 00010000:00010000:2.0:1721880422.440345:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727cec9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.440351:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727cec9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.440356:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009325e880 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.440359:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727cec9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.440366:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727cec9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.440375:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727cec9 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfdb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.440381:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009325e880/0x8a60d30f5727cec9 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.440439:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e615180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011849984:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.440451:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727ced7 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfdb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.440454:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.440463:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.440471:0:8271:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257786112 00000100:00100000:0.0:1721880422.440473:0:8271:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257786112 00000100:00100000:1.0:1721880422.440476:0:15444:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257786240 00000100:00100000:1.0:1721880422.440481:0:15444:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257786240 00010000:00010000:0.0:1721880422.440482:0:8271:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c4aa640/0x8a60d30f571ec9b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aed1 expref: 676 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.440483:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2582:3687:x1805522011849216:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1432us (1454us total) trans 4296020642 rc 0/0 00000100:00100000:2.0:1721880422.440488:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632670 00000004:00080000:3.0:1721880422.440490:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880095a27100/2, rc 0, transno 1053346 00010000:00010000:1.0:1721880422.440493:0:15444:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092115d40/0x8a60d30f571ec9d3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfdba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aeed expref: 677 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.440496:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880095a27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011849216:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.440512:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914865 00000100:00100000:1.0:1721880422.440516:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+677:2004:x1805522257786240:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1721880422.440517:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e615180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011851264:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.440518:0:16028:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800966b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_034:lustre-OST0001_UUID:16028:1805522011850240:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.440524:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.440527:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092115d40/0x8a60d30f571ec9d3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aeed expref: 677 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.440532:0:16028:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727cede lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfdba:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.440532:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.440536:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092115d40/0x8a60d30f571ec9d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdba:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aeed expref: 677 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.440547:0:8271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914866 00010000:00010000:1.0:1721880422.440549:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092115d40/0x8a60d30f571ec9d3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdba:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aeed expref: 677 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.440560:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.440561:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1721880422.440561:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011851264 00010000:00010000:1.0:1721880422.440564:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727cede lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.440565:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011851264 00010000:00010000:1.0:1721880422.440570:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727cede lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfdba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.440583:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632678 00010000:00010000:1.0:1721880422.440586:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.440588:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2582:3686:x1805522011851264:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1721880422.440600:0:15452:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64959 count 1 00000100:00100000:0.0:1721880422.440605:0:8271:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008571c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+676:2004:x1805522257786112:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.440607:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+676:2004:x1805522257786240:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 89us (141us total) trans 0 rc 0/0 00010000:00010000:0.0:1721880422.440611:0:8271:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.440611:0:15452:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727cf01 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfdbf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.440614:0:8271:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c4aa640/0x8a60d30f571ec9b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdb9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aed1 expref: 676 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.440617:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914865 00010000:00010000:0.0:1721880422.440621:0:8271:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c4aa640/0x8a60d30f571ec9b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdb9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aed1 expref: 676 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.440627:0:15452:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135344240/0x8a60d30f571eca58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af72 expref: 675 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.440631:0:8271:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c4aa640/0x8a60d30f571ec9b7 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdb9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12aed1 expref: 675 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.440633:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.440635:0:15452:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1721880422.440637:0:15452:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727cf01 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfdbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.440638:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.440640:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1721880422.440641:0:8271:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727ced7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721880422.440646:0:8271:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727ced7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfdb9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.440646:0:16060:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012edb2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_060:lustre-OST0001_UUID:16060:1805522011850368:192.168.201.24@tcp:104: 00010000:00010000:0.0:1721880422.440654:0:8271:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.440654:0:15452:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135344240/0x8a60d30f571eca58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af72 expref: 674 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.440659:0:16060:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727cee5 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfdbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.440663:0:15452:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135344240/0x8a60d30f571eca58 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af72 expref: 674 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.440664:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727ced7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.440667:0:8271:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008571c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+674:2004:x1805522257786112:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 116us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880422.440671:0:8271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914866 00010000:00010000:3.0:1721880422.440672:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727ced7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.440673:0:15452:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800966b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011851392:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.440679:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727ced7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.440684:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727ced7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.440692:0:15452:0:(client.c:2562:ptlrpc_set_wait()) set ffff88012fdec480 going to sleep for 11 seconds 00010000:00010000:3.0:1721880422.440695:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727ced7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.440696:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.440701:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aab3c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.440703:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727ced7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.440705:0:16028:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727cede lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.440709:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727ced7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.440710:0:16028:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727cede lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.440714:0:8271:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257786368 00010000:00010000:2.0:1721880422.440714:0:16028:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727cede lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.440717:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727ced7 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfdb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.440718:0:8271:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257786368 00010000:00010000:2.0:1721880422.440718:0:16028:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727cede lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.440722:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aab3c0/0x8a60d30f5727ced7 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.440723:0:16028:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727cede lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.440742:0:16028:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136351200 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.440744:0:16028:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727cede lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.440748:0:16028:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727cede lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.440749:0:8271:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e76af40/0x8a60d30f571ec9ef lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af09 expref: 674 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.440755:0:16028:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727cede lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfdba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.440758:0:16028:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136351200/0x8a60d30f5727cede lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16028 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.440765:0:8271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914867 00000100:00100000:1.0:1721880422.440770:0:8271:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a70ee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+674:2005:x1805522257786368:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.440777:0:8271:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721880422.440781:0:8271:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e76af40/0x8a60d30f571ec9ef lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdbb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af09 expref: 674 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.440789:0:8271:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e76af40/0x8a60d30f571ec9ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdbb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af09 expref: 674 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.440801:0:8271:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e76af40/0x8a60d30f571ec9ef lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdbb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af09 expref: 674 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.440813:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.440815:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.440817:0:8271:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727cee5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.440828:0:8271:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727cee5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfdbb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.440830:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.440842:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.440843:0:8271:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.440849:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e616300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2584:3688:x1805522011849600:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1631us (1688us total) trans 4296020643 rc 0/0 00000100:00100000:3.0:1721880422.440856:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632672 00000100:00100000:1.0:1721880422.440862:0:8271:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a70ee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+673:2005:x1805522257786368:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 92us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.440868:0:8271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914867 00000100:00100000:3.0:1721880422.440875:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257786496 00000100:00100000:3.0:1721880422.440877:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257786496 00000100:00100000:0.0:1721880422.440885:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.440890:0:16028:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_034:lustre-MDT0000-mdtlov_UUID+2583:3689:x1805522011849728:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1436us (1538us total) trans 4296020644 rc 0/0 00010000:00010000:3.0:1721880422.440890:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e769200/0x8a60d30f571eca04 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfdbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af25 expref: 673 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.440896:0:16028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632673 00000100:00100000:3.0:1721880422.440901:0:16094:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257786752 00000100:00100000:3.0:1721880422.440903:0:16094:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257786752 00000004:00080000:0.0:1721880422.440905:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009bd8aa00/2, rc 0, transno 1053348 00010000:00010000:3.0:1721880422.440908:0:16094:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135347a80/0x8a60d30f571eca3c lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfdbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af56 expref: 674 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.440910:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257786624 00000100:00100000:0.0:1721880422.440911:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009bd8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011849728:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.440913:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257786624 00000100:00100000:1.0:1721880422.440917:0:8271:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914868 00000100:00100000:3.0:1721880422.440920:0:16094:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914869 00000100:00100000:1.0:1721880422.440922:0:8271:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+675:2004:x1805522257786496:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1721880422.440922:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800921146c0/0x8a60d30f571eca20 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfdbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af3a expref: 675 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.440923:0:16094:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880134fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+675:2004:x1805522257786752:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.440927:0:8271:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.440929:0:16094:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.440931:0:16094:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135347a80/0x8a60d30f571eca3c lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfdbe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af56 expref: 675 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.440932:0:8271:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e769200/0x8a60d30f571eca04 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfdbc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af25 expref: 675 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.440935:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1721880422.440937:0:16094:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135347a80/0x8a60d30f571eca3c lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdbe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af56 expref: 675 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.440938:0:16188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914870 00000100:00100000:0.0:1721880422.440941:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d7a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011851520:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.440941:0:8271:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e769200/0x8a60d30f571eca04 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdbc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af25 expref: 675 pid: 16039 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.440941:0:16188:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d7a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+675:2005:x1805522257786624:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.440945:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.440946:0:16094:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.440947:0:16094:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727cefa lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdbe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.440951:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.440951:0:16094:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727cefa lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfdbe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.440953:0:8271:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.440954:0:16188:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1721880422.440955:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.440956:0:8271:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727ceec lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdbc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.440957:0:16188:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800921146c0/0x8a60d30f571eca20 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfdbd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af3a expref: 675 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.440958:0:16094:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721880422.440962:0:8271:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727ceec lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfdbc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.440963:0:16188:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800921146c0/0x8a60d30f571eca20 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdbd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af3a expref: 675 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.440972:0:8271:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.440972:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.440972:0:16094:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880134fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:30425778-2709-4512-9d75-01ec53c4cfad+675:2004:x1805522257786752:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 48us (129us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.440973:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.440976:0:16188:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727cef3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdbd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.440976:0:16094:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914869 00010000:00010000:2.0:1721880422.440980:0:16188:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727cef3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfdbd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.440988:0:8271:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30425778-2709-4512-9d75-01ec53c4cfad+675:2004:x1805522257786496:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 66us (158us total) trans 0 rc 0/0 00010000:00010000:2.0:1721880422.440988:0:16188:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721880422.440994:0:8271:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914868 00000100:00100000:2.0:1721880422.441000:0:16188:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d7a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+673:2005:x1805522257786624:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 58us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.441005:0:16188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914870 00010000:00010000:1.0:1721880422.441027:0:16060:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727cee5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1721880422.441029:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880094278700/2, rc 0, transno 1053347 00010000:00010000:1.0:1721880422.441034:0:16060:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727cee5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.441037:0:16101:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727ced0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.441040:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094278700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011849600:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.441041:0:16060:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727cee5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.441042:0:16101:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727ced0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.441046:0:16060:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727cee5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.441046:0:16101:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727ced0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.441052:0:16060:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727cee5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.441054:0:16101:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727ced0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.441055:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011851520 00010000:00010000:1.0:1721880422.441057:0:16060:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b7a80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.441058:0:16101:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727ced0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.441058:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011851520 00010000:00010000:1.0:1721880422.441059:0:16060:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727cee5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.441062:0:16101:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352400 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.441063:0:16101:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727ced0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.441065:0:16060:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727cee5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.441068:0:16101:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727ced0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.441073:0:16060:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727cee5 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfdbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.441073:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632679 00010000:00010000:2.0:1721880422.441075:0:16101:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727ced0 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfdb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.441077:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d7a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2583:3686:x1805522011851520:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.441078:0:16060:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b7a80/0x8a60d30f5727cee5 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16060 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.441081:0:16101:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136352400/0x8a60d30f5727ced0 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16101 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1721880422.441088:0:16111:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64960 count 1 00010000:00010000:3.0:1721880422.441097:0:16111:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727cf08 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfdc0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.441106:0:16111:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d0bb180/0x8a60d30f571eca74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af8e expref: 672 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.441112:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.441113:0:16111:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.441115:0:16111:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727cf08 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfdc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.441131:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1721880422.441132:0:16111:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d0bb180/0x8a60d30f571eca74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af8e expref: 672 pid: 16099 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.441137:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d7a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011851648:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.441141:0:16111:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d0bb180/0x8a60d30f571eca74 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af8e expref: 672 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.441150:0:16111:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088dc1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011851776:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.441152:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.441170:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011851648 00000100:00100000:3.0:1721880422.441173:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011851648 00000100:00100000:3.0:1721880422.441186:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632680 00000100:00100000:1.0:1721880422.441187:0:16060:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e616d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_060:lustre-MDT0000-mdtlov_UUID+2586:3686:x1805522011850112:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1635us (1677us total) trans 4296020645 rc 0/0 00000100:00100000:3.0:1721880422.441189:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d7a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2586:3689:x1805522011851648:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1721880422.441194:0:16060:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632674 00002000:00080000:3.0:1721880422.441197:0:16088:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64961 count 1 00000100:00100000:2.0:1721880422.441200:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800888cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+2586:3687:x1805522011849344:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2045us (2103us total) trans 4296020646 rc 0/0 00010000:00010000:3.0:1721880422.441204:0:16088:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727cf0f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfdc1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.441205:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632671 00010000:00010000:3.0:1721880422.441211:0:16088:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d0bba80/0x8a60d30f571eca97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12afb1 expref: 672 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.441214:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.441215:0:16088:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.441216:0:16088:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727cf0f lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfdc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.441223:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800921146c0/0x8a60d30f571eca20 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdbd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af3a expref: 672 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.441227:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e769200/0x8a60d30f571eca04 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdbc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af25 expref: 672 pid: 16039 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.441228:0:16088:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d0bba80/0x8a60d30f571eca97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12afb1 expref: 672 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.441233:0:16088:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d0bba80/0x8a60d30f571eca97 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12afb1 expref: 670 pid: 16099 timeout: 887 lvb_type: 0 00000004:00080000:0.0:1721880422.441234:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e616a00/2, rc 0, transno 1053349 00000100:00100000:1.0:1721880422.441234:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012edb0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011851008:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.441237:0:15453:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800966b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:15453:1805522011850624:192.168.201.24@tcp:104: 00000100:00100000:0.0:1721880422.441239:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e616a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011850112:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.441239:0:16088:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099eb1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011851904:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.441247:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727cef3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.441247:0:15453:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727ceec lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.441252:0:15453:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727ceec lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.441254:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727cef3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.441256:0:15453:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727ceec lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.441258:0:16088:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03b40 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.441260:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727cef3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.441260:0:15453:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727ceec lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.441264:0:15453:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727ceec lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.441267:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727cef3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.441268:0:15453:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727ceec lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.441268:0:16111:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03000 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.441271:0:15453:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136353600 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.441272:0:15453:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727ceec lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.441274:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727cef3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.441276:0:15453:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727ceec lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.441281:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727cef3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.441282:0:15453:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727ceec lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfdbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.441289:0:15453:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136353600/0x8a60d30f5727ceec lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.441290:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b46c0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:1.0:1721880422.441293:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727cef3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.441295:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009d7a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011852032:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1721880422.441299:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727cef3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.441307:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727cef3 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfdbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.441309:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721880422.441313:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b46c0/0x8a60d30f5727cef3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.441336:0:3687:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800888cce00/2, rc 0, transno 1053350 00000100:00100000:0.0:1721880422.441339:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800888cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011849344:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.441357:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011852032 00000100:00100000:3.0:1721880422.441360:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011852032 00000100:00100000:2.0:1721880422.441369:0:15453:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2587:3686:x1805522011850496:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1601us (1670us total) trans 4296020647 rc 0/0 00000100:00100000:2.0:1721880422.441373:0:15453:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632675 00000100:00100000:3.0:1721880422.441377:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632681 00000100:00100000:3.0:1721880422.441381:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d7a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2586:3689:x1805522011852032:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1721880422.441392:0:16081:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64962 count 1 00000100:00100000:2.0:1721880422.441393:0:15452:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800966b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:15452:1805522011851392:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.441401:0:15452:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727cf01 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfdbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.441402:0:16081:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727cf16 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfdc2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.441417:0:16081:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009110d440/0x8a60d30f571ecab3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12afc6 expref: 670 pid: 16126 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.441423:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1721880422.441425:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880084df4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011852160:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1721880422.441425:0:16081:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1721880422.441427:0:16081:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727cf16 lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfdc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.441430:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2586:3688:x1805522011850752:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1482us (1517us total) trans 4296020648 rc 0/0 00000100:00100000:1.0:1721880422.441436:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632676 00010000:00010000:3.0:1721880422.441443:0:16081:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009110d440/0x8a60d30f571ecab3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12afc6 expref: 670 pid: 16126 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.441445:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880422.441450:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011852160 00010000:00010000:3.0:1721880422.441452:0:16081:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009110d440/0x8a60d30f571ecab3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12afc6 expref: 670 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.441454:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011852160 00000004:00080000:0.0:1721880422.441458:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e9c8380/2, rc 0, transno 1053351 00000100:00100000:0.0:1721880422.441461:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e9c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011850496:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1721880422.441461:0:16081:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099eb0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011852288:192.168.201.24@tcp:104: 00000100:00100000:1.0:1721880422.441470:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632682 00000100:00100000:1.0:1721880422.441475:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880096c9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2586:3686:x1805522011852160:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1721880422.441486:0:15466:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000406:64963 count 1 00000100:00100000:3.0:1721880422.441487:0:16081:0:(client.c:2562:ptlrpc_set_wait()) set ffff880099f03c00 going to sleep for 11 seconds 00010000:00010000:1.0:1721880422.441496:0:15466:0:(ldlm_lock.c:785:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727cf1d lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfdc3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.441500:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:1.0:1721880422.441506:0:15466:0:(ldlm_lock.c:698:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800980e86c0/0x8a60d30f571ecac8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12afe2 expref: 670 pid: 16099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.441513:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135347a80/0x8a60d30f571eca3c lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdbe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af56 expref: 670 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.441516:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.441518:0:15466:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1721880422.441520:0:15466:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727cf1d lrc: 4/0,1 mode: --/PW res: [0x2c0000406:0xfdc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.441525:0:16017:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e9cb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_023:lustre-OST0001_UUID:16017:1805522011851136:192.168.201.24@tcp:104: 00010000:00010000:1.0:1721880422.441535:0:15466:0:(ldlm_lockd.c:1015:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800980e86c0/0x8a60d30f571ecac8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12afe2 expref: 669 pid: 16099 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.441536:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257786880 00010000:00010000:3.0:1721880422.441536:0:16017:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727cefa lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.441539:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257786880 00010000:00010000:3.0:1721880422.441543:0:16017:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727cefa lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.441544:0:15466:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800980e86c0/0x8a60d30f571ecac8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12afe2 expref: 670 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.441548:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135344240/0x8a60d30f571eca58 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af72 expref: 670 pid: 16101 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.441553:0:15466:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012edb0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011852416:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.441554:0:16017:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727cefa lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.441560:0:16017:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727cefa lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.441561:0:16188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914871 00000100:00100000:2.0:1721880422.441564:0:16188:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084df5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+670:2004:x1805522257786880:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.441565:0:16017:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727cefa lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.441570:0:16188:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.441571:0:16017:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727cefa lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.441572:0:16188:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135344240/0x8a60d30f571eca58 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdbf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af72 expref: 670 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.441575:0:16017:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8d80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.441578:0:16017:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727cefa lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.441579:0:15466:0:(client.c:2562:ptlrpc_set_wait()) set ffff88009522a180 going to sleep for 11 seconds 00010000:00010000:2.0:1721880422.441579:0:16188:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135344240/0x8a60d30f571eca58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdbf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af72 expref: 670 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.441583:0:16017:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727cefa lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.441586:0:16188:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135344240/0x8a60d30f571eca58 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdbf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af72 expref: 670 pid: 16101 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.441591:0:16017:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727cefa lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfdbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.441595:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.441596:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.441597:0:16017:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8d80/0x8a60d30f5727cefa lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16017 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.441598:0:16188:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727cf01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1721880422.441602:0:3688:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e9c9c00/2, rc 0, transno 1053352 00010000:00010000:2.0:1721880422.441603:0:16188:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727cf01 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfdbf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.441607:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e9c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011850752:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.441611:0:16188:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.441624:0:16188:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880084df5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+669:2004:x1805522257786880:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 59us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.441627:0:16188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914871 00010000:00010000:2.0:1721880422.441638:0:15452:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727cf01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.441643:0:15452:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727cf01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.441648:0:15452:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727cf01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.441651:0:15452:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727cf01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.441655:0:15452:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727cf01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.441662:0:15452:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880136352ac0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.441664:0:15452:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727cf01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.441668:0:15452:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727cf01 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.441673:0:15452:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727cf01 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfdbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.441676:0:15452:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136352ac0/0x8a60d30f5727cf01 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15452 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.441697:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+2587:3689:x1805522011850880:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1664us (1715us total) trans 4296020649 rc 0/0 00000100:00100000:3.0:1721880422.441703:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632677 00000004:00080000:0.0:1721880422.441712:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800966b2680/2, rc 0, transno 1053353 00000100:00100000:0.0:1721880422.441717:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800966b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011850880:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.441869:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2587:3686:x1805522011851264:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1279us (1334us total) trans 4296020650 rc 0/0 00000100:00100000:2.0:1721880422.441873:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632678 00000004:00080000:0.0:1721880422.441884:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e615180/2, rc 0, transno 1053354 00000100:00100000:0.0:1721880422.441888:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e615180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011851264:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1721880422.442130:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.442139:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.442148:0:15531:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257787008 00000100:00100000:2.0:1721880422.442151:0:15531:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257787008 00000100:00100000:3.0:1721880422.442151:0:16088:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099eb1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_078:lustre-OST0001_UUID:16088:1805522011851904:192.168.201.24@tcp:104: 00000100:00100000:2.0:1721880422.442157:0:16188:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257787136 00000100:00100000:2.0:1721880422.442158:0:16188:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257787136 00010000:00010000:2.0:1721880422.442166:0:16188:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d0bb180/0x8a60d30f571eca74 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfdc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af8e expref: 670 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:0.0:1721880422.442171:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:3.0:1721880422.442175:0:16088:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727cf0f lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfdc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.442176:0:16188:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257787264 00000100:00100000:2.0:1721880422.442178:0:16188:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257787264 00010000:00010000:2.0:1721880422.442183:0:16188:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009110d440/0x8a60d30f571ecab3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfdc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12afc6 expref: 671 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.442202:0:16188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914872 00000100:00100000:2.0:1721880422.442206:0:16188:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084df6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+671:2004:x1805522257787136:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1721880422.442210:0:15444:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914873 00000100:00100000:3.0:1721880422.442210:0:16081:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099eb0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_071:lustre-OST0001_UUID:16081:1805522011852288:192.168.201.24@tcp:104: 00010000:00010000:2.0:1721880422.442211:0:16188:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.442214:0:16188:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d0bb180/0x8a60d30f571eca74 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfdc0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af8e expref: 671 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.442216:0:15444:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129d23450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+671:2005:x1805522257787264:12345-192.168.201.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1721880422.442217:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00010000:00010000:2.0:1721880422.442219:0:16188:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d0bb180/0x8a60d30f571eca74 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdc0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af8e expref: 671 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.442224:0:16081:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727cf16 lrc: 3/0,1 mode: --/PW res: [0x2c0000406:0xfdc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.442225:0:15444:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.442227:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.442228:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.442229:0:15444:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009110d440/0x8a60d30f571ecab3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdc2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12afc6 expref: 671 pid: 16126 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.442229:0:16188:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727cf08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdc0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.442233:0:16188:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727cf08 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfdc0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.442238:0:15444:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009110d440/0x8a60d30f571ecab3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12afc6 expref: 671 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.442238:0:7117:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257787392 00010000:00010000:2.0:1721880422.442241:0:16188:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721880422.442241:0:7117:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257787392 00010000:00010000:3.0:1721880422.442252:0:7117:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800980e86c0/0x8a60d30f571ecac8 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfdc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12afe2 expref: 672 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:1.0:1721880422.442256:0:15444:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009110d440/0x8a60d30f571ecab3 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12afc6 expref: 672 pid: 16126 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.442256:0:16188:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880084df6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+672:2004:x1805522257787136:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 49us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.442262:0:16188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914872 00010000:00010000:1.0:1721880422.442267:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1721880422.442268:0:15444:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1721880422.442270:0:7117:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914874 00010000:00010000:1.0:1721880422.442271:0:15444:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727cf16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721880422.442275:0:7117:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084df7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30425778-2709-4512-9d75-01ec53c4cfad+670:2005:x1805522257787392:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1721880422.442278:0:15444:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727cf16 lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfdc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.442279:0:15531:0:(ldlm_lockd.c:2738:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d0bba80/0x8a60d30f571eca97 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12afb1 expref: 670 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.442282:0:7117:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721880422.442286:0:7117:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800980e86c0/0x8a60d30f571ecac8 lrc: 5/0,0 mode: PW/PW res: [0x2c0000406:0xfdc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12afe2 expref: 670 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.442289:0:16188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 914875 00010000:00010000:1.0:1721880422.442290:0:15444:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.442293:0:16188:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084df6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+670:2006:x1805522257787008:12345-192.168.201.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1721880422.442295:0:7117:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800980e86c0/0x8a60d30f571ecac8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12afe2 expref: 670 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.442297:0:16188:0:(ldlm_lockd.c:1827:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721880422.442300:0:16188:0:(ldlm_lockd.c:1870:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d0bba80/0x8a60d30f571eca97 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdc1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12afb1 expref: 670 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:2.0:1721880422.442306:0:16188:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d0bba80/0x8a60d30f571eca97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdc1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12afb1 expref: 670 pid: 16099 timeout: 887 lvb_type: 0 00010000:00010000:3.0:1721880422.442306:0:7117:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.442308:0:7117:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1721880422.442311:0:7117:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727cf1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.442312:0:16188:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d0bba80/0x8a60d30f571eca97 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdc1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12afb1 expref: 670 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:1.0:1721880422.442315:0:15444:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880129d23450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30425778-2709-4512-9d75-01ec53c4cfad+670:2005:x1805522257787264:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 98us (142us total) trans 0 rc 0/0 00010000:00010000:3.0:1721880422.442318:0:7117:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727cf1d lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfdc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.442319:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1721880422.442320:0:16188:0:(ldlm_extent.c:437:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1721880422.442322:0:15444:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914873 00010000:00010000:2.0:1721880422.442322:0:16188:0:(ldlm_lock.c:726:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727cf0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.442326:0:16188:0:(ldlm_resource.c:1708:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727cf0f lrc: 4/0,1 mode: PW/PW res: [0x2c0000406:0xfdc1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.442327:0:7117:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721880422.442335:0:16188:0:(ldlm_lockd.c:1882:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721880422.442350:0:16188:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880084df6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_014:30425778-2709-4512-9d75-01ec53c4cfad+668:2006:x1805522257787008:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 56us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.442352:0:7117:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880084df7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30425778-2709-4512-9d75-01ec53c4cfad+668:2005:x1805522257787392:12345-192.168.201.24@tcp:103:ldlm_bl.0 Request processed in 76us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.442354:0:16188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914875 00010000:00010000:1.0:1721880422.442357:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800980e86c0/0x8a60d30f571ecac8 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12afe2 expref: 668 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:3.0:1721880422.442359:0:7117:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 914874 00000100:00100000:1.0:1721880422.442366:0:15466:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012edb0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:15466:1805522011852416:192.168.201.24@tcp:104: 00010000:00010000:3.0:1721880422.442377:0:16081:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727cf16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.442378:0:15466:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727cf1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.442385:0:15466:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727cf1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.442385:0:16081:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727cf16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.442391:0:15466:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727cf1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.442392:0:16081:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727cf16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.442393:0:16088:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727cf0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.442397:0:16088:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727cf0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.442399:0:15466:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727cf1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.442399:0:16081:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727cf16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.442403:0:16088:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727cf0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.442405:0:15466:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727cf1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.442405:0:16081:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727cf16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.442407:0:16088:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727cf0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.442411:0:15466:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727cf1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.442411:0:16088:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727cf0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.442411:0:16081:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa9d40 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.442414:0:16088:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aaaac0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:3.0:1721880422.442414:0:16081:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727cf16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.442416:0:16088:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727cf0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.442417:0:15466:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff88009d8b5f80 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.442419:0:16088:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727cf0f lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.442420:0:15466:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727cf1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.442424:0:16088:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727cf0f lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfdc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.442426:0:16081:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727cf16 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.442427:0:15466:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727cf1d lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.442428:0:16088:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aaaac0/0x8a60d30f5727cf0f lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16088 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.442435:0:16081:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727cf16 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfdc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.442436:0:15466:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727cf1d lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfdc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721880422.442441:0:16081:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa9d40/0x8a60d30f5727cf16 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16081 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721880422.442442:0:15466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d8b5f80/0x8a60d30f5727cf1d lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15466 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721880422.442521:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d7a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2589:3689:x1805522011851648:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1331us (1368us total) trans 4296020651 rc 0/0 00000100:00100000:2.0:1721880422.442525:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632680 00000004:00080000:0.0:1721880422.442538:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009d7a1180/2, rc 0, transno 1053355 00000100:00100000:0.0:1721880422.442542:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d7a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011851648:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1721880422.442553:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d0bb180/0x8a60d30f571eca74 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdc0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.24@tcp remote: 0x215e54ff2b12af8e expref: 665 pid: 16099 timeout: 887 lvb_type: 0 00000100:00100000:2.0:1721880422.442561:0:16111:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088dc1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_095:lustre-OST0001_UUID:16111:1805522011851776:192.168.201.24@tcp:104: 00000100:00100000:3.0:1721880422.442562:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d7a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+2588:3689:x1805522011852032:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1179us (1249us total) trans 4296020652 rc 0/0 00000100:00100000:3.0:1721880422.442569:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632681 00010000:00010000:2.0:1721880422.442571:0:16111:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727cf08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.442575:0:16111:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727cf08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.442579:0:16111:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727cf08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.442583:0:16111:0:(ldlm_lock.c:839:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727cf08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000406:0xfdc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.442586:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880096c9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2587:3686:x1805522011852160:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1109us (1139us total) trans 4296020653 rc 0/0 00010000:00010000:2.0:1721880422.442586:0:16111:0:(ldlm_lock.c:897:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727cf08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000406:0xfdc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.442590:0:16111:0:(ldlm_lockd.c:1979:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727cf08 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721880422.442593:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632682 00010000:00010000:2.0:1721880422.442593:0:16111:0:(ldlm_lockd.c:1993:ldlm_handle_bl_callback()) Lock ffff880098aa8fc0 already unused, calling callback (ffffffffa084e330) 00010000:00010000:2.0:1721880422.442595:0:16111:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727cf08 lrc: 3/0,0 mode: PW/PW res: [0x2c0000406:0xfdc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.442598:0:16111:0:(ldlm_request.c:1324:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727cf08 lrc: 4/0,0 mode: PW/PW res: [0x2c0000406:0xfdc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721880422.442607:0:16111:0:(ldlm_lockd.c:2003:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727cf08 lrc: 2/0,0 mode: --/PW res: [0x2c0000406:0xfdc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1721880422.442610:0:3689:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009d7a0700/2, rc 0, transno 1053356 00010000:00010000:2.0:1721880422.442611:0:16111:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098aa8fc0/0x8a60d30f5727cf08 lrc: 0/0,0 mode: --/PW res: [0x2c0000406:0xfdc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721880422.442613:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d7a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011852032:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1721880422.442625:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880084df4700/2, rc 0, transno 1053357 00000100:00100000:0.0:1721880422.442627:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880084df4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011852160:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.442691:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d7a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+2587:3686:x1805522011851520:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1613us (1735us total) trans 4296020654 rc 0/0 00000004:00080000:0.0:1721880422.442693:0:3686:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009d7a2680/2, rc 0, transno 1053358 00000100:00100000:0.0:1721880422.442695:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009d7a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011851520:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1721880422.442696:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632679 00010000:00010000:3.0:1721880422.444878:0:7120:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880422.818099:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.818165:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.818197:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.818213:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.818236:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880422.818255:0:15432:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257787648 00000100:00100000:3.0:1721880422.818257:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257787520 00000100:00100000:2.0:1721880422.818261:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257787776 00000100:00100000:0.0:1721880422.818264:0:15432:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257787648 00000100:00100000:2.0:1721880422.818267:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257787776 00000100:00100000:3.0:1721880422.818270:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257787520 00000100:00100000:1.0:1721880422.818285:0:15420:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257788160 00000100:00100000:1.0:1721880422.818291:0:15420:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257788160 00000100:00100000:0.0:1721880422.818310:0:15432:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2861 00000100:00100000:0.0:1721880422.818316:0:15432:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084df5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2006:x1805522257787648:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880422.818326:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2862 00000100:00100000:3.0:1721880422.818329:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 575 00000100:00100000:2.0:1721880422.818331:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084df6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2007:x1805522257787776:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880422.818337:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b19d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4976b229-99ef-4953-87e9-78e1b901883f+12:2007:x1805522257787520:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880422.818338:0:15420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2863 00000100:00100000:1.0:1721880422.818344:0:15420:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:30425778-2709-4512-9d75-01ec53c4cfad+3694:2006:x1805522257788160:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880422.818374:0:15432:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880084df5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2006:x1805522257787648:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 59us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.818374:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880084df6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2007:x1805522257787776:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 43us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880422.818379:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2862 00000100:00100000:0.0:1721880422.818385:0:15432:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2861 00000100:00100000:1.0:1721880422.818393:0:15420:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:30425778-2709-4512-9d75-01ec53c4cfad+3694:2006:x1805522257788160:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 48us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.818394:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b19d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4976b229-99ef-4953-87e9-78e1b901883f+12:2007:x1805522257787520:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 59us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.818398:0:15420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2863 00000100:00100000:3.0:1721880422.818399:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 575 00000100:00100000:2.0:1721880422.818414:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257787904 00000100:00100000:2.0:1721880422.818416:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257787904 00000100:00080000:1.0:1721880422.818425:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880392 00000100:00080000:1.0:1721880422.818427:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880392 00000100:00080000:1.0:1721880422.818429:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880392 00000100:00100000:0.0:1721880422.818435:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880422.818439:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 292 00000100:00100000:2.0:1721880422.818443:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880084df6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2006:x1805522257787904:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880422.818455:0:11334:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257788032 00000100:00100000:1.0:1721880422.818458:0:11334:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257788032 00000100:00100000:2.0:1721880422.818467:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880084df6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2006:x1805522257787904:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 23us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.818473:0:11334:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2864 00000100:00100000:1.0:1721880422.818476:0:11334:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30425778-2709-4512-9d75-01ec53c4cfad+4135:2007:x1805522257788032:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880422.818480:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 292 00000100:00100000:1.0:1721880422.818493:0:11334:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30425778-2709-4512-9d75-01ec53c4cfad+4135:2007:x1805522257788032:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 17us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880422.818497:0:11334:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2864 00000100:00080000:1.0:1721880422.818505:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880392 00000100:00100000:0.0:1721880422.904982:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800966b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011852544:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1721880422.905068:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880422.905141:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011852544 00000100:00100000:3.0:1721880422.905149:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011852544 00000100:00100000:3.0:1721880422.905193:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101085 00000100:00100000:3.0:1721880422.905199:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011852544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1721880422.905235:0:15587:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1435709440 avail 1306247168 00000100:00100000:3.0:1721880422.905279:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011852544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880422.905284:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101085 00000100:00100000:0.0:1721880422.905321:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800966b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011852544:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1721880423.447032:0:15560:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880424.448950:0:11721:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880425.451014:0:7119:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1721880425.801017:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012edb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011852672:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1721880425.801086:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880425.801145:0:10429:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011852672 00000100:00100000:1.0:1721880425.801153:0:10429:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011852672 00000100:00080000:2.0:1721880425.801179:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880395 00000100:00100000:1.0:1721880425.801202:0:10429:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 568 00000100:00100000:1.0:1721880425.801209:0:10429:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011852672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1721880425.801237:0:10429:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:1.0:1721880425.801311:0:10429:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011852672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880425.801318:0:10429:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 568 00000100:00100000:2.0:1721880425.801345:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012edb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011852672:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1721880426.201012:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880098d27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011852800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1721880426.201069:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880426.201148:0:10429:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011852800 00000100:00100000:1.0:1721880426.201157:0:10429:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011852800 00000100:00080000:2.0:1721880426.201196:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880396 00000100:00100000:1.0:1721880426.201213:0:10429:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 569 00000100:00100000:1.0:1721880426.201220:0:10429:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+2769:3689:x1805522011852800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1721880426.201243:0:10429:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:1.0:1721880426.201299:0:10429:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+2769:3689:x1805522011852800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880426.201306:0:10429:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 569 00000100:00100000:2.0:1721880426.201321:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880098d27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011852800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1721880426.297118:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1721880426.297144:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800966b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011852928:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1721880426.297226:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880426.297316:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011852928 00000100:00100000:3.0:1721880426.297326:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011852928 00000100:00100000:3.0:1721880426.297375:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101086 00000100:00100000:3.0:1721880426.297381:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098d27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+19:3687:x1805522011852928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1721880426.297416:0:15587:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1435418624 avail 1305956352 00000100:00100000:3.0:1721880426.297495:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098d27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+19:3687:x1805522011852928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880426.297503:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101086 00000100:00100000:0.0:1721880426.297528:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800966b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011852928:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1721880426.392966:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012edb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0603f996-9d5e-4498-85ba-9976a06b304f:3687:1805522011853056:0@lo:400:kworker.0 00000100:00100000:2.0:1721880426.392985:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012edb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011853440:0@lo:400:kworker.0 00000100:00100000:3.0:1721880426.392985:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012edb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3688:1805522011853184:0@lo:400:kworker.0 00000100:00100000:1.0:1721880426.393022:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012edb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3689:1805522011853312:0@lo:400:kworker.0 00000100:00100000:0.0:1721880426.393046:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880426.393058:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880426.393061:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880426.393079:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012edb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3687:1805522011853568:0@lo:400:kworker.0 00000100:00100000:1.0:1721880426.393109:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880426.393113:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012edb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3688:1805522011853696:0@lo:400:kworker.0 00000100:00100000:2.0:1721880426.393119:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012edb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3686:1805522011853952:0@lo:400:kworker.0 00000100:00100000:0.0:1721880426.393139:0:15420:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011853184 00000100:00100000:3.0:1721880426.393143:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880426.393147:0:15420:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011853184 00000100:00100000:1.0:1721880426.393149:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012edb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011853824:0@lo:400:kworker.0 00000100:00100000:2.0:1721880426.393161:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011853440 00000100:00100000:3.0:1721880426.393163:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099d28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011854208:0@lo:400:kworker.0 00000100:00100000:2.0:1721880426.393166:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011853440 00000100:00100000:1.0:1721880426.393180:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880426.393187:0:15420:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011853312 00000100:00100000:0.0:1721880426.393190:0:15420:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011853312 00000100:00100000:3.0:1721880426.393190:0:7124:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011853056 00000100:00100000:3.0:1721880426.393194:0:7124:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011853056 00000100:00100000:2.0:1721880426.393198:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101087 00000100:00100000:1.0:1721880426.393203:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099d29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011854336:0@lo:400:kworker.0 00000100:00100000:0.0:1721880426.393204:0:15420:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011853696 00000100:00100000:2.0:1721880426.393204:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3686:x1805522011853440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880426.393207:0:15420:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011853696 00000100:00100000:3.0:1721880426.393220:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 576 00000100:00100000:1.0:1721880426.393222:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880426.393224:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0603f996-9d5e-4498-85ba-9976a06b304f+23:3687:x1805522011853056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880426.393228:0:15420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2865 00000100:00100000:0.0:1721880426.393234:0:15420:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099eb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-MDT0000_UUID+5:3688:x1805522011853184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880426.393252:0:7124:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0603f996-9d5e-4498-85ba-9976a06b304f+23:3687:x1805522011853056:12345-0@lo:400:kworker.0 Request processed in 27us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880426.393256:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 576 00000100:00100000:2.0:1721880426.393259:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3686:x1805522011853440:12345-0@lo:400:kworker.0 Request processed in 55us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880426.393266:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011853824 00000100:00100000:2.0:1721880426.393266:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101087 00000100:00100000:1.0:1721880426.393270:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011853824 00000100:00100000:0.0:1721880426.393285:0:15420:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099eb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-MDT0000_UUID+5:3688:x1805522011853184:12345-0@lo:400:kworker.0 Request processed in 49us (225us total) trans 0 rc 0/0 00000100:00080000:3.0:1721880426.393286:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880396 00000100:00080000:3.0:1721880426.393289:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880396 00000100:00100000:0.0:1721880426.393292:0:15420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2865 00000100:00100000:1.0:1721880426.393295:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011854336 00000100:00100000:1.0:1721880426.393297:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011854336 00000100:00100000:3.0:1721880426.393298:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880426.393300:0:15477:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2866 00000100:00100000:2.0:1721880426.393305:0:15477:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-lwp-MDT0001_UUID+5:3689:x1805522011853312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880426.393316:0:15420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2867 00000100:00100000:1.0:1721880426.393317:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011854208 00000100:00100000:0.0:1721880426.393320:0:15420:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099eb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-lwp-OST0000_UUID+5:3688:x1805522011853696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880426.393320:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011854208 00000100:00100000:3.0:1721880426.393329:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012edb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3688:1805522011853184:0@lo:400:kworker.0 00000100:00100000:1.0:1721880426.393337:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1721880426.393341:0:15477:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-lwp-MDT0001_UUID+5:3689:x1805522011853312:12345-0@lo:400:kworker.0 Request processed in 36us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880426.393343:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008571d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011853824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880426.393347:0:15477:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2866 00000100:00100000:0.0:1721880426.393351:0:15420:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099eb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-lwp-OST0000_UUID+5:3688:x1805522011853696:12345-0@lo:400:kworker.0 Request processed in 30us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880426.393357:0:15420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2867 00000100:00100000:3.0:1721880426.393358:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1721880426.393362:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008571d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2587:3689:x1805522011854336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880426.393381:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1721880426.393382:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008571d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011853824:12345-0@lo:400:kworker.0 Request processed in 38us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880426.393383:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008571d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+2587:3689:x1805522011854336:12345-0@lo:400:kworker.0 Request processed in 21us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880426.393386:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099eb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011854208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880426.393387:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1721880426.393391:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1721880426.393396:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1721880426.393406:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880396 00000100:00100000:2.0:1721880426.393411:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099eb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011854208:12345-0@lo:400:kworker.0 Request processed in 25us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880426.393415:0:15432:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011853568 00000100:00100000:2.0:1721880426.393416:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1721880426.393417:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099d28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011854208:0@lo:400:kworker.0 00000100:00100000:0.0:1721880426.393418:0:15432:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011853568 00000100:00100000:3.0:1721880426.393425:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012edb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3688:1805522011853696:0@lo:400:kworker.0 00000100:00100000:2.0:1721880426.393433:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880426.393435:0:15432:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2868 00000100:00100000:0.0:1721880426.393438:0:15432:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b59aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-OST0000_UUID+5:3687:x1805522011853568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880426.393442:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012edb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3689:1805522011853312:0@lo:400:kworker.0 00000100:00080000:3.0:1721880426.393444:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880396 00000100:00100000:1.0:1721880426.393457:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012edb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011853824:0@lo:400:kworker.0 00000100:00100000:2.0:1721880426.393457:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012edb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011853440:0@lo:400:kworker.0 00000100:00100000:0.0:1721880426.393463:0:15432:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b59aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-OST0000_UUID+5:3687:x1805522011853568:12345-0@lo:400:kworker.0 Request processed in 24us (67us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880426.393469:0:15432:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2868 00000100:00100000:1.0:1721880426.393470:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099d29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011854336:0@lo:400:kworker.0 00000100:00100000:0.0:1721880426.393476:0:15432:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011853952 00000100:00100000:0.0:1721880426.393477:0:15432:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011853952 00000100:00080000:3.0:1721880426.393488:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880396 00000100:00100000:0.0:1721880426.393490:0:15432:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2869 00000100:00100000:0.0:1721880426.393492:0:15432:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-OST0001_UUID+5:3686:x1805522011853952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880426.393518:0:15432:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-OST0001_UUID+5:3686:x1805522011853952:12345-0@lo:400:kworker.0 Request processed in 25us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880426.393522:0:15432:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2869 00000100:00100000:0.0:1721880426.393538:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012edb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011854080:0@lo:400:kworker.0 00000100:00100000:2.0:1721880426.393539:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012edb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3686:1805522011853952:0@lo:400:kworker.0 00000100:00100000:0.0:1721880426.393552:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880426.393574:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012edb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0603f996-9d5e-4498-85ba-9976a06b304f:3687:1805522011853056:0@lo:400:kworker.0 00000100:00100000:0.0:1721880426.393581:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012edb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3687:1805522011853568:0@lo:400:kworker.0 00000100:00100000:1.0:1721880426.393590:0:15420:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011854080 00000100:00100000:1.0:1721880426.393595:0:15420:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011854080 00000100:00080000:3.0:1721880426.393628:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880396 00000100:00100000:1.0:1721880426.393631:0:15420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2870 00000100:00100000:1.0:1721880426.393636:0:15420:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011854080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880426.393687:0:15420:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011854080:12345-0@lo:400:kworker.0 Request processed in 50us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880426.393693:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012edb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011854080:0@lo:400:kworker.0 00000100:00100000:1.0:1721880426.393693:0:15420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2870 00000100:00100000:1.0:1721880426.440920:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800966b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011854592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1721880426.440938:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009b598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011854464:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1721880426.440997:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880426.441026:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880426.441054:0:10429:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011854592 00000100:00100000:2.0:1721880426.441064:0:10429:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011854592 00000100:00100000:0.0:1721880426.441070:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011854464 00000100:00100000:0.0:1721880426.441076:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011854464 00000100:00100000:2.0:1721880426.441110:0:10429:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 570 00000100:00100000:0.0:1721880426.441115:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 571 00000100:00100000:2.0:1721880426.441116:0:10429:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008571c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+2587:3687:x1805522011854592:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1721880426.441120:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011854464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1721880426.441147:0:10429:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00002000:00000024:0.0:1721880426.441148:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:0.0:1721880426.441209:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011854464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880426.441217:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 571 00000100:00100000:3.0:1721880426.441226:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009b598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011854464:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1721880426.441230:0:10429:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008571c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+2587:3687:x1805522011854592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880426.441235:0:10429:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 570 00000100:00100000:1.0:1721880426.441250:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800966b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011854592:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1721880426.452867:0:8270:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1721880426.620344:0:7112:0:(osp_sync.c:1600:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 838 committed 00000004:00080000:0.0:1721880426.620382:0:7112:0:(osp_sync.c:1600:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 843 committed 00000001:00080000:0.0:1721880426.622899:0:10723:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4296020654 is committed 00000001:00080000:1.0:1721880426.630636:0:9456:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0000: transno 4296061717 is committed 00010000:00010000:3.0:1721880427.454906:0:7120:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880427.826599:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880427.826662:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880427.826677:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257788288 00000100:00100000:3.0:1721880427.826687:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257788288 00000100:00100000:0.0:1721880427.826701:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880427.826775:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880427.826790:0:15420:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257788416 00000100:00100000:1.0:1721880427.826798:0:15420:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257788416 00000100:00100000:3.0:1721880427.826798:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 577 00000100:00100000:0.0:1721880427.826804:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00080000:2.0:1721880427.826806:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880397 00000100:00100000:3.0:1721880427.826808:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4976b229-99ef-4953-87e9-78e1b901883f+12:2006:x1805522257788288:12345-192.168.201.24@tcp:400:kworker.0 00000100:00080000:2.0:1721880427.826815:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880397 00000100:00100000:0.0:1721880427.826831:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880427.826840:0:15420:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257788544 00000100:00100000:1.0:1721880427.826843:0:15420:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257788544 00000100:00100000:0.0:1721880427.826867:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880427.826876:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257788672 00000100:00100000:3.0:1721880427.826881:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4976b229-99ef-4953-87e9-78e1b901883f+12:2006:x1805522257788288:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 73us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880427.826883:0:15420:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257788928 00000100:00100000:1.0:1721880427.826897:0:15420:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257788928 00000100:00100000:3.0:1721880427.826899:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 577 00000100:00100000:2.0:1721880427.826901:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257788672 00000100:00100000:1.0:1721880427.826912:0:15420:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257789056 00000100:00100000:1.0:1721880427.826914:0:15420:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257789056 00000100:00080000:2.0:1721880427.826946:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880397 00000100:00080000:2.0:1721880427.826948:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880397 00000100:00080000:2.0:1721880427.826950:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880397 00000100:00100000:1.0:1721880427.826961:0:15420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2871 00000100:00100000:1.0:1721880427.826969:0:15420:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b59b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2006:x1805522257788416:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880427.826980:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2872 00000100:00100000:2.0:1721880427.826988:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b59b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2006:x1805522257788544:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880427.826993:0:15416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2873 00000100:00100000:3.0:1721880427.827001:0:15416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:30425778-2709-4512-9d75-01ec53c4cfad+4135:2006:x1805522257788928:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880427.827013:0:15420:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b59b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2006:x1805522257788416:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 44us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880427.827019:0:15420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2871 00000100:00100000:3.0:1721880427.827036:0:15416:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:30425778-2709-4512-9d75-01ec53c4cfad+4135:2006:x1805522257788928:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 35us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880427.827042:0:15420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2874 00000100:00100000:1.0:1721880427.827046:0:15420:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:30425778-2709-4512-9d75-01ec53c4cfad+3694:2006:x1805522257789056:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880427.827047:0:15416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2873 00000100:00100000:1.0:1721880427.827067:0:15420:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:30425778-2709-4512-9d75-01ec53c4cfad+3694:2006:x1805522257789056:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 19us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880427.827067:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b59b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2006:x1805522257788544:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 78us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880427.827072:0:15420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2874 00000100:00100000:2.0:1721880427.827078:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2872 00000100:00100000:0.0:1721880427.827095:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257788800 00000100:00100000:0.0:1721880427.827101:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257788800 00000100:00100000:3.0:1721880427.827105:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00080000:1.0:1721880427.827130:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880397 00000100:00100000:2.0:1721880427.827146:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257789184 00000100:00100000:2.0:1721880427.827151:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257789184 00000100:00100000:0.0:1721880427.827155:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 296 00000100:00100000:0.0:1721880427.827163:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b59ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2006:x1805522257788800:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880427.827166:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00080000:1.0:1721880427.827171:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880397 00000100:00100000:1.0:1721880427.827177:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257789312 00000100:00100000:1.0:1721880427.827180:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257789312 00000100:00100000:2.0:1721880427.827216:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 297 00000100:00100000:0.0:1721880427.827217:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b59ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2006:x1805522257788800:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 40us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880427.827223:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 298 00000100:00100000:2.0:1721880427.827224:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:30425778-2709-4512-9d75-01ec53c4cfad+280:2006:x1805522257789184:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880427.827228:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099d28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:30425778-2709-4512-9d75-01ec53c4cfad+665:2006:x1805522257789312:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880427.827230:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 296 00000100:00100000:1.0:1721880427.827251:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:30425778-2709-4512-9d75-01ec53c4cfad+665:2006:x1805522257789312:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 23us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880427.827256:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 298 00000100:00100000:2.0:1721880427.827262:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099d29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:30425778-2709-4512-9d75-01ec53c4cfad+280:2006:x1805522257789184:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 38us (158us total) trans 0 rc 0/0 00000100:00080000:1.0:1721880427.827267:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880397 00000100:00100000:2.0:1721880427.827270:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 297 00000100:00100000:2.0:1721880427.827316:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 299 00000100:00100000:2.0:1721880427.827322:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b598e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2006:x1805522257788672:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880427.827369:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b598e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2006:x1805522257788672:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 46us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880427.827376:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 299 00000100:00100000:1.0:1721880427.912873:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1721880427.912890:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800959a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011854720:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1721880427.912966:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880427.913018:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011854720 00000100:00100000:2.0:1721880427.913031:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011854720 00000100:00100000:2.0:1721880427.913096:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101088 00000100:00100000:2.0:1721880427.913105:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3689:x1805522011854720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1721880427.913146:0:15587:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1435709440 avail 1306247168 00000100:00100000:2.0:1721880427.913238:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3689:x1805522011854720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 134us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880427.913245:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101088 00000100:00100000:1.0:1721880427.913265:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800959a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011854720:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1721880428.456939:0:15560:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880429.458928:0:11721:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880430.460998:0:7119:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1721880430.808899:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800966b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011854848:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1721880430.808964:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880430.809015:0:10429:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011854848 00000100:00100000:2.0:1721880430.809024:0:10429:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011854848 00000100:00080000:1.0:1721880430.809062:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880400 00000100:00100000:2.0:1721880430.809078:0:10429:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 572 00000100:00100000:2.0:1721880430.809083:0:10429:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011854848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1721880430.809114:0:10429:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:2.0:1721880430.809185:0:10429:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011854848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880430.809189:0:10429:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 572 00000100:00100000:1.0:1721880430.809205:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800966b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011854848:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1721880431.209057:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800966b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011854976:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1721880431.209126:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880431.209174:0:10429:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011854976 00000100:00100000:2.0:1721880431.209184:0:10429:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011854976 00000100:00080000:1.0:1721880431.209223:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880401 00000100:00100000:2.0:1721880431.209246:0:10429:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 573 00000100:00100000:2.0:1721880431.209253:0:10429:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011854976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1721880431.209279:0:10429:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:2.0:1721880431.209338:0:10429:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011854976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880431.209346:0:10429:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 573 00000100:00100000:3.0:1721880431.209413:0:3686:0:(client.c:2972:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4296061717 gen 2 00000004:00080000:3.0:1721880431.209420:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095170700, transno 4296058954 00000004:00080000:3.0:1721880431.209433:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085833100, transno 4296058955 00000004:00080000:3.0:1721880431.209435:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085831180, transno 4296058956 00000004:00080000:3.0:1721880431.209437:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095170000, transno 4296058957 00000004:00080000:3.0:1721880431.209439:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085831500, transno 4296058958 00000004:00080000:3.0:1721880431.209440:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095171500, transno 4296058959 00000004:00080000:3.0:1721880431.209442:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085832d80, transno 4296058960 00000004:00080000:3.0:1721880431.209443:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095170e00, transno 4296058961 00000004:00080000:3.0:1721880431.209446:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801362d9f80, transno 4296058962 00000004:00080000:3.0:1721880431.209449:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f021180, transno 4296058963 00000004:00080000:3.0:1721880431.209451:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f022d80, transno 4296058964 00000004:00080000:3.0:1721880431.209453:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801362d9180, transno 4296058965 00000004:00080000:3.0:1721880431.209455:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801362dad80, transno 4296058966 00000004:00080000:3.0:1721880431.209456:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801362da680, transno 4296058967 00000004:00080000:3.0:1721880431.209458:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012bd08000, transno 4296058968 00000004:00080000:3.0:1721880431.209459:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801362d8a80, transno 4296058969 00000004:00080000:3.0:1721880431.209461:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085830e00, transno 4296058970 00000004:00080000:3.0:1721880431.209463:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085830000, transno 4296058971 00000004:00080000:3.0:1721880431.209465:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fa1ed80, transno 4296058972 00000004:00080000:3.0:1721880431.209466:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085832680, transno 4296058973 00000004:00080000:3.0:1721880431.209468:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fa1dc00, transno 4296058974 00000004:00080000:3.0:1721880431.209469:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fa1f480, transno 4296058975 00000004:00080000:3.0:1721880431.209471:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085832a00, transno 4296058976 00000004:00080000:3.0:1721880431.209472:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085833480, transno 4296058977 00000004:00080000:3.0:1721880431.209474:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095aeb100, transno 4296058978 00000004:00080000:3.0:1721880431.209476:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088d7e300, transno 4296058979 00000004:00080000:3.0:1721880431.209478:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088d7f480, transno 4296058980 00000004:00080000:3.0:1721880431.209479:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c4e5880, transno 4296058981 00000004:00080000:3.0:1721880431.209481:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c4e7100, transno 4296058982 00000004:00080000:3.0:1721880431.209482:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c4e6300, transno 4296058983 00000004:00080000:3.0:1721880431.209484:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c4e4a80, transno 4296058984 00000004:00080000:3.0:1721880431.209486:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088d7ce00, transno 4296058985 00000004:00080000:3.0:1721880431.209487:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088f16d80, transno 4296058986 00000004:00080000:3.0:1721880431.209489:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088d7ed80, transno 4296058987 00000004:00080000:3.0:1721880431.209491:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088f14a80, transno 4296058988 00000004:00080000:3.0:1721880431.209492:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088f15c00, transno 4296058989 00000004:00080000:3.0:1721880431.209494:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088f17b80, transno 4296058990 00000004:00080000:3.0:1721880431.209495:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088f16300, transno 4296058991 00000004:00080000:3.0:1721880431.209497:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088f17100, transno 4296058992 00000004:00080000:3.0:1721880431.209498:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c4e4e00, transno 4296058993 00000004:00080000:3.0:1721880431.209500:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088f15880, transno 4296058994 00000004:00080000:3.0:1721880431.209501:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088f15180, transno 4296058995 00000004:00080000:3.0:1721880431.209502:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088887800, transno 4296058996 00000004:00080000:3.0:1721880431.209504:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088886a00, transno 4296058997 00000004:00080000:3.0:1721880431.209506:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095205c00, transno 4296058998 00000004:00080000:3.0:1721880431.209507:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088886680, transno 4296058999 00000004:00080000:3.0:1721880431.209509:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088884380, transno 4296059000 00000004:00080000:3.0:1721880431.209511:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088886d80, transno 4296059001 00000004:00080000:3.0:1721880431.209513:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095206a00, transno 4296059002 00000004:00080000:3.0:1721880431.209514:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095205500, transno 4296059003 00000004:00080000:3.0:1721880431.209516:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095aea680, transno 4296059004 00000004:00080000:3.0:1721880431.209518:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088f14380, transno 4296059005 00000004:00080000:3.0:1721880431.209519:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088f14000, transno 4296059006 00000004:00080000:3.0:1721880431.209521:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095ae8380, transno 4296059007 00000004:00080000:3.0:1721880431.209522:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088f14700, transno 4296059008 00000004:00080000:3.0:1721880431.209524:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ef2bb80, transno 4296059009 00000004:00080000:3.0:1721880431.209525:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088f16680, transno 4296059010 00000004:00080000:3.0:1721880431.209527:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122c1ed80, transno 4296059011 00000004:00080000:3.0:1721880431.209529:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c603b80, transno 4296059012 00000004:00080000:3.0:1721880431.209530:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c603100, transno 4296059013 00000004:00080000:3.0:1721880431.209532:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012ba66a00, transno 4296059014 00000004:00080000:3.0:1721880431.209534:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012ba64380, transno 4296059015 00000004:00080000:3.0:1721880431.209535:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012ba67100, transno 4296059016 00000004:00080000:3.0:1721880431.209537:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135754380, transno 4296059017 00000004:00080000:3.0:1721880431.209539:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012ba65c00, transno 4296059018 00000004:00080000:3.0:1721880431.209540:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012ba67480, transno 4296059019 00000004:00080000:3.0:1721880431.209542:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c07ad80, transno 4296059020 00000004:00080000:3.0:1721880431.209543:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c078e00, transno 4296059021 00000004:00080000:3.0:1721880431.209545:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135756300, transno 4296059022 00000004:00080000:3.0:1721880431.209547:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c07a680, transno 4296059023 00000004:00080000:3.0:1721880431.209548:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085833b80, transno 4296059024 00000004:00080000:3.0:1721880431.209550:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085832300, transno 4296059025 00000004:00080000:3.0:1721880431.209551:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085830700, transno 4296059026 00000004:00080000:3.0:1721880431.209553:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085831880, transno 4296059027 00000004:00080000:3.0:1721880431.209554:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088884700, transno 4296059028 00000004:00080000:3.0:1721880431.209556:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088885500, transno 4296059029 00000004:00080000:3.0:1721880431.209557:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088884a80, transno 4296059030 00000004:00080000:3.0:1721880431.209558:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c600a80, transno 4296059031 00000004:00080000:3.0:1721880431.209560:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088887b80, transno 4296059032 00000004:00080000:3.0:1721880431.209561:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800966b2300, transno 4296059033 00000004:00080000:3.0:1721880431.209563:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800966b3480, transno 4296059034 00000004:00080000:3.0:1721880431.209564:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095204a80, transno 4296059035 00000004:00080000:3.0:1721880431.209566:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fba9c00, transno 4296059036 00000004:00080000:3.0:1721880431.209567:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800966b3b80, transno 4296059037 00000004:00080000:3.0:1721880431.209568:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d7a2300, transno 4296059038 00000004:00080000:3.0:1721880431.209570:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d7a0a80, transno 4296059039 00000004:00080000:3.0:1721880431.209571:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092334380, transno 4296059040 00000004:00080000:3.0:1721880431.209573:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092334000, transno 4296059041 00000004:00080000:3.0:1721880431.209574:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095aeb800, transno 4296059042 00000004:00080000:3.0:1721880431.209576:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095ae9880, transno 4296059043 00000004:00080000:3.0:1721880431.209577:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092335f80, transno 4296059044 00000004:00080000:3.0:1721880431.209579:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092334e00, transno 4296059045 00000004:00080000:3.0:1721880431.209580:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092335180, transno 4296059046 00000004:00080000:3.0:1721880431.209582:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135755180, transno 4296059047 00000004:00080000:3.0:1721880431.209584:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012cfba300, transno 4296059048 00000004:00080000:3.0:1721880431.209585:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801312d3b80, transno 4296059049 00000004:00080000:3.0:1721880431.209587:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122c1c700, transno 4296059050 00000004:00080000:3.0:1721880431.209589:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122c1ea00, transno 4296059051 00000004:00080000:3.0:1721880431.209590:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c07b100, transno 4296059052 00000004:00080000:3.0:1721880431.209592:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122c1f480, transno 4296059053 00000004:00080000:3.0:1721880431.209593:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c07bb80, transno 4296059054 00000004:00080000:3.0:1721880431.209595:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c602300, transno 4296059055 00000004:00080000:3.0:1721880431.209596:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c079880, transno 4296059056 00000004:00080000:3.0:1721880431.209598:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c601500, transno 4296059057 00000004:00080000:3.0:1721880431.209599:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c603480, transno 4296059058 00000004:00080000:3.0:1721880431.209600:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c601f80, transno 4296059059 00000004:00080000:3.0:1721880431.209602:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012bc2ea00, transno 4296059060 00000004:00080000:3.0:1721880431.209603:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012bc2c700, transno 4296059061 00000004:00080000:3.0:1721880431.209606:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fbb6d80, transno 4296059062 00000004:00080000:3.0:1721880431.209608:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012ba65880, transno 4296059063 00000004:00080000:3.0:1721880431.209609:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fbb5880, transno 4296059064 00000004:00080000:3.0:1721880431.209611:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012bc2f100, transno 4296059065 00000004:00080000:3.0:1721880431.209613:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fbb4e00, transno 4296059066 00000004:00080000:3.0:1721880431.209614:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fbb5500, transno 4296059067 00000004:00080000:3.0:1721880431.209616:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a4ba680, transno 4296059068 00000004:00080000:3.0:1721880431.209617:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a4b9180, transno 4296059069 00000004:00080000:3.0:1721880431.209619:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f09f800, transno 4296059070 00000004:00080000:3.0:1721880431.209621:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a4bb480, transno 4296059071 00000004:00080000:3.0:1721880431.209622:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a4b9880, transno 4296059072 00000004:00080000:3.0:1721880431.209624:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088f17480, transno 4296059073 00000004:00080000:3.0:1721880431.209625:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800966b0700, transno 4296059074 00000004:00080000:3.0:1721880431.209627:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d7a3800, transno 4296059075 00000004:00080000:3.0:1721880431.209628:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095aead80, transno 4296059076 00000004:00080000:3.0:1721880431.209630:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095ae9c00, transno 4296059077 00000004:00080000:3.0:1721880431.209632:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092335880, transno 4296059078 00000004:00080000:3.0:1721880431.209633:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092336a00, transno 4296059079 00000004:00080000:3.0:1721880431.209635:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099d2bb80, transno 4296059080 00000004:00080000:3.0:1721880431.209636:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092337800, transno 4296059081 00000004:00080000:3.0:1721880431.209638:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099d28700, transno 4296059082 00000004:00080000:3.0:1721880431.209639:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d7a2a00, transno 4296059083 00000004:00080000:3.0:1721880431.209641:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095aeb480, transno 4296059084 00000004:00080000:3.0:1721880431.209643:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135757480, transno 4296059085 00000004:00080000:3.0:1721880431.209644:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012cfb9f80, transno 4296059086 00000004:00080000:3.0:1721880431.209646:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fbb7480, transno 4296059087 00000004:00080000:3.0:1721880431.209647:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fbaad80, transno 4296059088 00000004:00080000:3.0:1721880431.209648:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fbab100, transno 4296059089 00000004:00080000:3.0:1721880431.209650:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135754700, transno 4296059090 00000004:00080000:3.0:1721880431.209651:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fba9f80, transno 4296059091 00000004:00080000:3.0:1721880431.209653:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012cfb8e00, transno 4296059092 00000004:00080000:3.0:1721880431.209655:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fbb7b80, transno 4296059093 00000004:00080000:3.0:1721880431.209657:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c603800, transno 4296059094 00000004:00080000:3.0:1721880431.209658:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012bc2c000, transno 4296059095 00000004:00080000:3.0:1721880431.209660:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088f17800, transno 4296059096 00000004:00080000:3.0:1721880431.209661:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c078a80, transno 4296059097 00000004:00080000:3.0:1721880431.209663:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800966b0000, transno 4296059098 00000004:00080000:3.0:1721880431.209665:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012cfb8380, transno 4296059099 00000004:00080000:3.0:1721880431.209666:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012cfb9880, transno 4296059100 00000004:00080000:3.0:1721880431.209668:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801362dbb80, transno 4296059101 00000004:00080000:3.0:1721880431.209669:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095ae8e00, transno 4296059102 00000004:00080000:3.0:1721880431.209671:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099e75f80, transno 4296059103 00000004:00080000:3.0:1721880431.209673:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a4b8a80, transno 4296059104 00000004:00080000:3.0:1721880431.209674:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801355e1f80, transno 4296059105 00000004:00080000:3.0:1721880431.209676:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ef28700, transno 4296059106 00000004:00080000:3.0:1721880431.209678:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801355e2300, transno 4296059107 00000004:00080000:3.0:1721880431.209679:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099e77800, transno 4296059108 00000004:00080000:3.0:1721880431.209681:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801355e1c00, transno 4296059109 00000004:00080000:3.0:1721880431.209682:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801355e0a80, transno 4296059110 00000004:00080000:3.0:1721880431.209684:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801355e0380, transno 4296059111 00000004:00080000:3.0:1721880431.209685:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801355e0000, transno 4296059112 00000004:00080000:3.0:1721880431.209687:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801355db100, transno 4296059113 00000004:00080000:3.0:1721880431.209688:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801355dbb80, transno 4296059114 00000004:00080000:3.0:1721880431.209690:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801355d9880, transno 4296059115 00000004:00080000:3.0:1721880431.209692:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801355db480, transno 4296059116 00000004:00080000:3.0:1721880431.209693:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801355da680, transno 4296059117 00000004:00080000:3.0:1721880431.209695:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e22dc00, transno 4296059118 00000004:00080000:3.0:1721880431.209696:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099e74a80, transno 4296059119 00000004:00080000:3.0:1721880431.209698:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099e74e00, transno 4296059120 00000004:00080000:3.0:1721880431.209700:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801303b5c00, transno 4296059121 00000004:00080000:3.0:1721880431.209702:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801303b4000, transno 4296059122 00000004:00080000:3.0:1721880431.209704:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801303b6d80, transno 4296059123 00000004:00080000:3.0:1721880431.209705:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801303b5500, transno 4296059124 00000004:00080000:3.0:1721880431.209707:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801355d8e00, transno 4296059125 00000004:00080000:3.0:1721880431.209709:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801303b4e00, transno 4296059126 00000004:00080000:3.0:1721880431.209710:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012ba65180, transno 4296059127 00000004:00080000:3.0:1721880431.209711:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880130b64000, transno 4296059128 00000004:00080000:3.0:1721880431.209713:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880130b65180, transno 4296059129 00000004:00080000:3.0:1721880431.209715:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801357b4a80, transno 4296059130 00000004:00080000:3.0:1721880431.209716:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801357b7b80, transno 4296059131 00000004:00080000:3.0:1721880431.209718:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801357b4e00, transno 4296059132 00000004:00080000:3.0:1721880431.209719:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c737100, transno 4296059133 00000004:00080000:3.0:1721880431.209721:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801357b4700, transno 4296059134 00000004:00080000:3.0:1721880431.209722:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c734000, transno 4296059135 00000004:00080000:3.0:1721880431.209724:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c735180, transno 4296059136 00000004:00080000:3.0:1721880431.209725:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c737800, transno 4296059137 00000004:00080000:3.0:1721880431.209752:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c736300, transno 4296059138 00000004:00080000:3.0:1721880431.209754:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c736680, transno 4296059139 00000004:00080000:3.0:1721880431.209755:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c736d80, transno 4296059140 00000004:00080000:3.0:1721880431.209757:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c734700, transno 4296059141 00000004:00080000:3.0:1721880431.209759:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013107b800, transno 4296059142 00000004:00080000:3.0:1721880431.209760:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131079c00, transno 4296059143 00000004:00080000:3.0:1721880431.209762:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c735f80, transno 4296059144 00000004:00080000:3.0:1721880431.209763:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131078380, transno 4296059145 00000004:00080000:3.0:1721880431.209765:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099d2b100, transno 4296059146 00000004:00080000:3.0:1721880431.209767:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131078a80, transno 4296059147 00000004:00080000:3.0:1721880431.209768:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099d2aa00, transno 4296059148 00000004:00080000:3.0:1721880431.209769:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099d2a680, transno 4296059149 00000004:00080000:3.0:1721880431.209771:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099d2a300, transno 4296059150 00000004:00080000:3.0:1721880431.209772:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012edb2680, transno 4296059151 00000004:00080000:3.0:1721880431.209775:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131079180, transno 4296059152 00000004:00080000:3.0:1721880431.209776:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801357b5500, transno 4296059153 00000004:00080000:3.0:1721880431.209778:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801357b5180, transno 4296059154 00000004:00080000:3.0:1721880431.209780:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099e76680, transno 4296059155 00000004:00080000:3.0:1721880431.209781:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801355d8700, transno 4296059156 00000004:00080000:3.0:1721880431.209783:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801355db800, transno 4296059157 00000004:00080000:3.0:1721880431.209785:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801355dad80, transno 4296059158 00000004:00080000:3.0:1721880431.209786:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801357b5c00, transno 4296059159 00000004:00080000:3.0:1721880431.209788:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099e77480, transno 4296059160 00000004:00080000:3.0:1721880431.209790:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012380b100, transno 4296059161 00000004:00080000:3.0:1721880431.209792:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134fa4380, transno 4296059162 00000004:00080000:3.0:1721880431.209793:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123808380, transno 4296059163 00000004:00080000:3.0:1721880431.209795:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122c1fb80, transno 4296059164 00000004:00080000:3.0:1721880431.209797:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c078380, transno 4296059165 00000004:00080000:3.0:1721880431.209799:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800952a2d80, transno 4296059166 00000004:00080000:3.0:1721880431.209801:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880136399880, transno 4296059167 00000004:00080000:3.0:1721880431.209802:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800952a1500, transno 4296059168 00000004:00080000:3.0:1721880431.209804:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800952a3800, transno 4296059169 00000004:00080000:3.0:1721880431.209806:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801357b7480, transno 4296059170 00000004:00080000:3.0:1721880431.209807:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801302cbb80, transno 4296059171 00000004:00080000:3.0:1721880431.209809:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801302cad80, transno 4296059172 00000004:00080000:3.0:1721880431.209811:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122c7ce00, transno 4296059173 00000004:00080000:3.0:1721880431.209812:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801303b4a80, transno 4296059174 00000004:00080000:3.0:1721880431.209814:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880130b65f80, transno 4296059175 00000004:00080000:3.0:1721880431.209815:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c602d80, transno 4296059176 00000004:00080000:3.0:1721880431.209816:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880130b65880, transno 4296059177 00000004:00080000:3.0:1721880431.209818:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880130b66d80, transno 4296059178 00000004:00080000:3.0:1721880431.209820:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012ce11c00, transno 4296059179 00000004:00080000:3.0:1721880431.209822:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012ce11f80, transno 4296059180 00000004:00080000:3.0:1721880431.209823:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012ce13480, transno 4296059181 00000004:00080000:3.0:1721880431.209825:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f828380, transno 4296059182 00000004:00080000:3.0:1721880431.209827:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f828000, transno 4296059183 00000004:00080000:3.0:1721880431.209829:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f82a680, transno 4296059184 00000004:00080000:3.0:1721880431.209831:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012ce10000, transno 4296059185 00000004:00080000:3.0:1721880431.209832:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801303b6300, transno 4296059186 00000004:00080000:3.0:1721880431.209834:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880132c62680, transno 4296059187 00000004:00080000:3.0:1721880431.209836:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880132c63100, transno 4296059188 00000004:00080000:3.0:1721880431.209838:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013608b800, transno 4296059189 00000004:00080000:3.0:1721880431.209839:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880132c61c00, transno 4296059190 00000004:00080000:3.0:1721880431.209841:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880136088e00, transno 4296059191 00000004:00080000:3.0:1721880431.209843:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bea1f80, transno 4296059192 00000004:00080000:3.0:1721880431.209844:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013608bb80, transno 4296059193 00000004:00080000:3.0:1721880431.209846:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880132c61880, transno 4296059194 00000004:00080000:3.0:1721880431.209847:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bea1500, transno 4296059195 00000004:00080000:3.0:1721880431.209849:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bea0000, transno 4296059196 00000004:00080000:3.0:1721880431.209850:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bea1880, transno 4296059197 00000004:00080000:3.0:1721880431.209851:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bea1180, transno 4296059198 00000004:00080000:3.0:1721880431.209853:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096002d80, transno 4296059199 00000004:00080000:3.0:1721880431.209855:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096002680, transno 4296059200 00000004:00080000:3.0:1721880431.209856:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800888cdf80, transno 4296059201 00000004:00080000:3.0:1721880431.209858:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096003b80, transno 4296059202 00000004:00080000:3.0:1721880431.209859:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091210700, transno 4296059203 00000004:00080000:3.0:1721880431.209861:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096f16300, transno 4296059204 00000004:00080000:3.0:1721880431.209878:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096f14000, transno 4296059205 00000004:00080000:3.0:1721880431.209880:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091210000, transno 4296059206 00000004:00080000:3.0:1721880431.209882:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096f15880, transno 4296059207 00000004:00080000:3.0:1721880431.209883:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096f16a00, transno 4296059208 00000004:00080000:3.0:1721880431.209884:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096f14a80, transno 4296059209 00000004:00080000:3.0:1721880431.209885:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096f15c00, transno 4296059210 00000004:00080000:3.0:1721880431.209887:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091211f80, transno 4296059211 00000004:00080000:3.0:1721880431.209889:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091212d80, transno 4296059212 00000004:00080000:3.0:1721880431.209891:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094278a80, transno 4296059213 00000004:00080000:3.0:1721880431.209893:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009427b800, transno 4296059214 00000004:00080000:3.0:1721880431.209894:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009427b480, transno 4296059215 00000004:00080000:3.0:1721880431.209896:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099a3fb80, transno 4296059216 00000004:00080000:3.0:1721880431.209898:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094278000, transno 4296059217 00000004:00080000:3.0:1721880431.209911:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094278380, transno 4296059218 00000004:00080000:3.0:1721880431.209912:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f82b800, transno 4296059219 00000004:00080000:3.0:1721880431.209914:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096003800, transno 4296059220 00000004:00080000:3.0:1721880431.209915:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f82aa00, transno 4296059221 00000004:00080000:3.0:1721880431.209917:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f828700, transno 4296059222 00000004:00080000:3.0:1721880431.209919:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096001880, transno 4296059223 00000004:00080000:3.0:1721880431.209920:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013107b480, transno 4296059224 00000004:00080000:3.0:1721880431.209922:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131079880, transno 4296059225 00000004:00080000:3.0:1721880431.209923:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131078e00, transno 4296059226 00000004:00080000:3.0:1721880431.209924:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013107ad80, transno 4296059227 00000004:00080000:3.0:1721880431.209926:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a1db100, transno 4296059228 00000004:00080000:3.0:1721880431.209928:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c600700, transno 4296059229 00000004:00080000:3.0:1721880431.209929:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096f15f80, transno 4296059230 00000004:00080000:3.0:1721880431.209930:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c601880, transno 4296059231 00000004:00080000:3.0:1721880431.209932:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096003100, transno 4296059232 00000004:00080000:3.0:1721880431.209933:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a1d9500, transno 4296059233 00000004:00080000:3.0:1721880431.209935:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a1da680, transno 4296059234 00000004:00080000:3.0:1721880431.209936:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a1daa00, transno 4296059235 00000004:00080000:3.0:1721880431.209938:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a1d8e00, transno 4296059236 00000004:00080000:3.0:1721880431.209939:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a1db480, transno 4296059237 00000004:00080000:3.0:1721880431.209940:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a1da300, transno 4296059238 00000004:00080000:3.0:1721880431.209942:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096f16d80, transno 4296059239 00000004:00080000:3.0:1721880431.209943:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096f15500, transno 4296059240 00000004:00080000:3.0:1721880431.209944:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099d2ad80, transno 4296059241 00000004:00080000:3.0:1721880431.209946:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096f17100, transno 4296059242 00000004:00080000:3.0:1721880431.209948:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ea38700, transno 4296059243 00000004:00080000:3.0:1721880431.209950:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ea39f80, transno 4296059244 00000004:00080000:3.0:1721880431.209951:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ea38e00, transno 4296059245 00000004:00080000:3.0:1721880431.209953:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ea38380, transno 4296059246 00000004:00080000:3.0:1721880431.209955:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ea39500, transno 4296059247 00000004:00080000:3.0:1721880431.209956:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800888ce680, transno 4296059248 00000004:00080000:3.0:1721880431.209958:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091210380, transno 4296059249 00000004:00080000:3.0:1721880431.209959:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ea38a80, transno 4296059250 00000004:00080000:3.0:1721880431.209960:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ea3bb80, transno 4296059251 00000004:00080000:3.0:1721880431.209962:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801341d2a00, transno 4296059252 00000004:00080000:3.0:1721880431.209964:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012387d880, transno 4296059253 00000004:00080000:3.0:1721880431.209966:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012387ce00, transno 4296059254 00000004:00080000:3.0:1721880431.209967:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012387ea00, transno 4296059255 00000004:00080000:3.0:1721880431.209969:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801341d0700, transno 4296059256 00000004:00080000:3.0:1721880431.209970:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012387fb80, transno 4296059257 00000004:00080000:3.0:1721880431.209972:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012387df80, transno 4296059258 00000004:00080000:3.0:1721880431.209974:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009be58e00, transno 4296059259 00000004:00080000:3.0:1721880431.209975:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095a27800, transno 4296059260 00000004:00080000:3.0:1721880431.209977:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009be59c00, transno 4296059261 00000004:00080000:3.0:1721880431.209978:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095a24000, transno 4296059262 00000004:00080000:3.0:1721880431.209980:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009be59f80, transno 4296059263 00000004:00080000:3.0:1721880431.209981:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009be5b480, transno 4296059264 00000004:00080000:3.0:1721880431.209983:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008876e680, transno 4296059265 00000004:00080000:3.0:1721880431.209984:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008876c700, transno 4296059266 00000004:00080000:3.0:1721880431.209986:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008876fb80, transno 4296059267 00000004:00080000:3.0:1721880431.209987:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008876c380, transno 4296059268 00000004:00080000:3.0:1721880431.209989:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008571fb80, transno 4296059269 00000004:00080000:3.0:1721880431.209990:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008571e300, transno 4296059270 00000004:00080000:3.0:1721880431.209992:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b9e8700, transno 4296059271 00000004:00080000:3.0:1721880431.209994:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008876d500, transno 4296059272 00000004:00080000:3.0:1721880431.209996:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008876d180, transno 4296059273 00000004:00080000:3.0:1721880431.209998:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008571dc00, transno 4296059274 00000004:00080000:3.0:1721880431.210000:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008571d180, transno 4296059275 00000004:00080000:3.0:1721880431.210001:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008571c000, transno 4296059276 00000004:00080000:3.0:1721880431.210003:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008571ea00, transno 4296059277 00000004:00080000:3.0:1721880431.210004:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800956c8e00, transno 4296059278 00000004:00080000:3.0:1721880431.210006:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008571ce00, transno 4296059279 00000004:00080000:3.0:1721880431.210007:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800956cbb80, transno 4296059280 00000004:00080000:3.0:1721880431.210008:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800956c8700, transno 4296059281 00000004:00080000:3.0:1721880431.210010:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800956ca300, transno 4296059282 00000004:00080000:3.0:1721880431.210012:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bdc7b80, transno 4296059283 00000004:00080000:3.0:1721880431.210013:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008571ca80, transno 4296059284 00000004:00080000:3.0:1721880431.210015:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bdc5880, transno 4296059285 00000004:00080000:3.0:1721880431.210017:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c611c00, transno 4296059286 00000004:00080000:3.0:1721880431.210018:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bdc4000, transno 4296059287 00000004:00080000:3.0:1721880431.210019:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c610380, transno 4296059288 00000004:00080000:3.0:1721880431.210021:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800952a0e00, transno 4296059289 00000004:00080000:3.0:1721880431.210022:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c612d80, transno 4296059290 00000004:00080000:3.0:1721880431.210024:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801341d1f80, transno 4296059291 00000004:00080000:3.0:1721880431.210025:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801341d3b80, transno 4296059292 00000004:00080000:3.0:1721880431.210027:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801341d1c00, transno 4296059293 00000004:00080000:3.0:1721880431.210028:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801341d2d80, transno 4296059294 00000004:00080000:3.0:1721880431.210030:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ea3b480, transno 4296059295 00000004:00080000:3.0:1721880431.210031:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801341d1500, transno 4296059296 00000004:00080000:3.0:1721880431.210033:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ea38000, transno 4296059297 00000004:00080000:3.0:1721880431.210034:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ea3a300, transno 4296059298 00000004:00080000:3.0:1721880431.210036:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ea3aa00, transno 4296059299 00000004:00080000:3.0:1721880431.210038:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bd8bb80, transno 4296059300 00000004:00080000:3.0:1721880431.210039:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bd89180, transno 4296059301 00000004:00080000:3.0:1721880431.210042:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e90a300, transno 4296059302 00000004:00080000:3.0:1721880431.210044:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ad02a00, transno 4296059303 00000004:00080000:3.0:1721880431.210046:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ad01180, transno 4296059304 00000004:00080000:3.0:1721880431.210048:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e90ad80, transno 4296059305 00000004:00080000:3.0:1721880431.210049:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e909880, transno 4296059306 00000004:00080000:3.0:1721880431.210051:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800952a3480, transno 4296059307 00000004:00080000:3.0:1721880431.210052:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800952a0380, transno 4296059308 00000004:00080000:3.0:1721880431.210054:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008876ea00, transno 4296059309 00000004:00080000:3.0:1721880431.210055:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012387c380, transno 4296059310 00000004:00080000:3.0:1721880431.210057:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012387ed80, transno 4296059311 00000004:00080000:3.0:1721880431.210058:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008876ed80, transno 4296059312 00000004:00080000:3.0:1721880431.210060:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800952a2300, transno 4296059313 00000004:00080000:3.0:1721880431.210061:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800952a1c00, transno 4296059314 00000004:00080000:3.0:1721880431.210063:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094634e00, transno 4296059315 00000004:00080000:3.0:1721880431.210064:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095a24700, transno 4296059316 00000004:00080000:3.0:1721880431.210066:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009427b100, transno 4296059317 00000004:00080000:3.0:1721880431.210067:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095a25500, transno 4296059318 00000004:00080000:3.0:1721880431.210069:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094279c00, transno 4296059319 00000004:00080000:3.0:1721880431.210071:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095a25c00, transno 4296059320 00000004:00080000:3.0:1721880431.210072:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094279180, transno 4296059321 00000004:00080000:3.0:1721880431.210073:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e909500, transno 4296059322 00000004:00080000:3.0:1721880431.210075:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e90a680, transno 4296059323 00000004:00080000:3.0:1721880431.210076:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e90b480, transno 4296059324 00000004:00080000:3.0:1721880431.210077:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e909f80, transno 4296059325 00000004:00080000:3.0:1721880431.210079:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a1d9f80, transno 4296059326 00000004:00080000:3.0:1721880431.210080:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e909c00, transno 4296059327 00000004:00080000:3.0:1721880431.210082:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bd8a300, transno 4296059328 00000004:00080000:3.0:1721880431.210083:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094637b80, transno 4296059329 00000004:00080000:3.0:1721880431.210085:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a1dbb80, transno 4296059330 00000004:00080000:3.0:1721880431.210087:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094637100, transno 4296059331 00000004:00080000:3.0:1721880431.210089:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d120e00, transno 4296059332 00000004:00080000:3.0:1721880431.210090:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d120380, transno 4296059333 00000004:00080000:3.0:1721880431.210092:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d120a80, transno 4296059334 00000004:00080000:3.0:1721880431.210094:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c610700, transno 4296059335 00000004:00080000:3.0:1721880431.210096:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c613480, transno 4296059336 00000004:00080000:3.0:1721880431.210097:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d121180, transno 4296059337 00000004:00080000:3.0:1721880431.210098:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d122a00, transno 4296059338 00000004:00080000:3.0:1721880431.210100:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c612300, transno 4296059339 00000004:00080000:3.0:1721880431.210101:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c613800, transno 4296059340 00000004:00080000:3.0:1721880431.210103:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bdc7480, transno 4296059341 00000004:00080000:3.0:1721880431.210104:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bdc5180, transno 4296059342 00000004:00080000:3.0:1721880431.210106:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c611880, transno 4296059343 00000004:00080000:3.0:1721880431.210107:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801341d2680, transno 4296059344 00000004:00080000:3.0:1721880431.210109:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c613b80, transno 4296059345 00000004:00080000:3.0:1721880431.210110:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ea39180, transno 4296059346 00000004:00080000:3.0:1721880431.210112:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801341d3480, transno 4296059347 00000004:00080000:3.0:1721880431.210113:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bdc5f80, transno 4296059348 00000004:00080000:3.0:1721880431.210115:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012387d180, transno 4296059349 00000004:00080000:3.0:1721880431.210116:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088614380, transno 4296059350 00000004:00080000:3.0:1721880431.210118:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801341d0a80, transno 4296059351 00000004:00080000:3.0:1721880431.210120:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b9eb800, transno 4296059352 00000004:00080000:3.0:1721880431.210121:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b9eb100, transno 4296059353 00000004:00080000:3.0:1721880431.210123:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b9ebb80, transno 4296059354 00000004:00080000:3.0:1721880431.210124:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ad01880, transno 4296059355 00000004:00080000:3.0:1721880431.210126:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094279880, transno 4296059356 00000004:00080000:3.0:1721880431.210127:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009427a300, transno 4296059357 00000004:00080000:3.0:1721880431.210129:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b9eaa00, transno 4296059358 00000004:00080000:3.0:1721880431.210130:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094279500, transno 4296059359 00000004:00080000:3.0:1721880431.210132:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096f14e00, transno 4296059360 00000004:00080000:3.0:1721880431.210133:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091ae0000, transno 4296059361 00000004:00080000:3.0:1721880431.210135:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a1d9c00, transno 4296059362 00000004:00080000:3.0:1721880431.210137:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bf6a680, transno 4296059363 00000004:00080000:3.0:1721880431.210139:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bd89500, transno 4296059364 00000004:00080000:3.0:1721880431.210140:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e90b100, transno 4296059365 00000004:00080000:3.0:1721880431.210142:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095a24380, transno 4296059366 00000004:00080000:3.0:1721880431.210143:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e90bb80, transno 4296059367 00000004:00080000:3.0:1721880431.210145:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c610000, transno 4296059368 00000004:00080000:3.0:1721880431.210146:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d120700, transno 4296059369 00000004:00080000:3.0:1721880431.210149:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c3bc380, transno 4296059370 00000004:00080000:3.0:1721880431.210150:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091ae1180, transno 4296059371 00000004:00080000:3.0:1721880431.210151:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091ae1f80, transno 4296059372 00000004:00080000:3.0:1721880431.210153:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091ae3100, transno 4296059373 00000004:00080000:3.0:1721880431.210154:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091ae3b80, transno 4296059374 00000004:00080000:3.0:1721880431.210155:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091ae0a80, transno 4296059375 00000004:00080000:3.0:1721880431.210156:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091ae2300, transno 4296059376 00000004:00080000:3.0:1721880431.210158:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076fdf800, transno 4296059377 00000004:00080000:3.0:1721880431.210159:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076fded80, transno 4296059378 00000004:00080000:3.0:1721880431.210161:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076fdc700, transno 4296059379 00000004:00080000:3.0:1721880431.210162:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091ae1880, transno 4296059380 00000004:00080000:3.0:1721880431.210164:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fde3100, transno 4296059381 00000004:00080000:3.0:1721880431.210165:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fde2300, transno 4296059382 00000004:00080000:3.0:1721880431.210167:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091ae2a00, transno 4296059383 00000004:00080000:3.0:1721880431.210168:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091ae0e00, transno 4296059384 00000004:00080000:3.0:1721880431.210169:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094635f80, transno 4296059385 00000004:00080000:3.0:1721880431.210171:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091ae0380, transno 4296059386 00000004:00080000:3.0:1721880431.210172:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094636300, transno 4296059387 00000004:00080000:3.0:1721880431.210173:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c3bdf80, transno 4296059388 00000004:00080000:3.0:1721880431.210175:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c3bce00, transno 4296059389 00000004:00080000:3.0:1721880431.210176:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801341d3800, transno 4296059390 00000004:00080000:3.0:1721880431.210178:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c3bf100, transno 4296059391 00000004:00080000:3.0:1721880431.210180:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c3bc700, transno 4296059392 00000004:00080000:3.0:1721880431.210181:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c3bdc00, transno 4296059393 00000004:00080000:3.0:1721880431.210183:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bf69c00, transno 4296059394 00000004:00080000:3.0:1721880431.210185:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c3bd500, transno 4296059395 00000004:00080000:3.0:1721880431.210187:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b9e8380, transno 4296059396 00000004:00080000:3.0:1721880431.210189:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b084700, transno 4296059397 00000004:00080000:3.0:1721880431.210190:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b9e8e00, transno 4296059398 00000004:00080000:3.0:1721880431.210192:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b086d80, transno 4296059399 00000004:00080000:3.0:1721880431.210193:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b084380, transno 4296059400 00000004:00080000:3.0:1721880431.210195:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b087800, transno 4296059401 00000004:00080000:3.0:1721880431.210196:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cd21c00, transno 4296059402 00000004:00080000:3.0:1721880431.210198:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b086300, transno 4296059403 00000004:00080000:3.0:1721880431.210199:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088db7100, transno 4296059404 00000004:00080000:3.0:1721880431.210201:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088db4a80, transno 4296059405 00000004:00080000:3.0:1721880431.210203:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cd20700, transno 4296059406 00000004:00080000:3.0:1721880431.210204:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cd23100, transno 4296059407 00000004:00080000:3.0:1721880431.210205:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cd23480, transno 4296059408 00000004:00080000:3.0:1721880431.210207:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cd20a80, transno 4296059409 00000004:00080000:3.0:1721880431.210208:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800952a3100, transno 4296059410 00000004:00080000:3.0:1721880431.210209:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bf68a80, transno 4296059411 00000004:00080000:3.0:1721880431.210211:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bf6b100, transno 4296059412 00000004:00080000:3.0:1721880431.210212:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088dc1500, transno 4296059413 00000004:00080000:3.0:1721880431.210214:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bf69f80, transno 4296059414 00000004:00080000:3.0:1721880431.210216:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088dc2d80, transno 4296059415 00000004:00080000:3.0:1721880431.210218:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088dc1180, transno 4296059416 00000004:00080000:3.0:1721880431.210219:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b085880, transno 4296059417 00000004:00080000:3.0:1721880431.210221:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088db7800, transno 4296059418 00000004:00080000:3.0:1721880431.210222:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b7c5180, transno 4296059419 00000004:00080000:3.0:1721880431.210223:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b7c4380, transno 4296059420 00000004:00080000:3.0:1721880431.210225:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b7c4a80, transno 4296059421 00000004:00080000:3.0:1721880431.210227:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b7c7480, transno 4296059422 00000004:00080000:3.0:1721880431.210229:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088db5880, transno 4296059423 00000004:00080000:3.0:1721880431.210231:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b085f80, transno 4296059424 00000004:00080000:3.0:1721880431.210232:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e9cb800, transno 4296059425 00000004:00080000:3.0:1721880431.210234:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b7c5c00, transno 4296059426 00000004:00080000:3.0:1721880431.210236:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009fff2300, transno 4296059427 00000004:00080000:3.0:1721880431.210237:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e9cb100, transno 4296059428 00000004:00080000:3.0:1721880431.210239:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e9c9880, transno 4296059429 00000004:00080000:3.0:1721880431.210240:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009fff3b80, transno 4296059430 00000004:00080000:3.0:1721880431.210242:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084311180, transno 4296059431 00000004:00080000:3.0:1721880431.210243:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084310e00, transno 4296059432 00000004:00080000:3.0:1721880431.210244:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084311500, transno 4296059433 00000004:00080000:3.0:1721880431.210246:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084310380, transno 4296059434 00000004:00080000:3.0:1721880431.210247:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087b48000, transno 4296059435 00000004:00080000:3.0:1721880431.210249:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087b4b100, transno 4296059436 00000004:00080000:3.0:1721880431.210250:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087b4ad80, transno 4296059437 00000004:00080000:3.0:1721880431.210252:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009fff0e00, transno 4296059438 00000004:00080000:3.0:1721880431.210253:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009fff0380, transno 4296059439 00000004:00080000:3.0:1721880431.210255:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084311f80, transno 4296059440 00000004:00080000:3.0:1721880431.210256:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b085500, transno 4296059441 00000004:00080000:3.0:1721880431.210258:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076fdd500, transno 4296059442 00000004:00080000:3.0:1721880431.210259:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009fff0a80, transno 4296059443 00000004:00080000:3.0:1721880431.210260:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084311880, transno 4296059444 00000004:00080000:3.0:1721880431.210261:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088dc3100, transno 4296059445 00000004:00080000:3.0:1721880431.210263:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bf6a300, transno 4296059446 00000004:00080000:3.0:1721880431.210264:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009fff2d80, transno 4296059447 00000004:00080000:3.0:1721880431.210265:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bf6bb80, transno 4296059448 00000004:00080000:3.0:1721880431.210267:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b08ca80, transno 4296059449 00000004:00080000:3.0:1721880431.210268:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009fff0000, transno 4296059450 00000004:00080000:3.0:1721880431.210269:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b08e680, transno 4296059451 00000004:00080000:3.0:1721880431.210271:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b08c000, transno 4296059452 00000004:00080000:3.0:1721880431.210272:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b08d880, transno 4296059453 00000004:00080000:3.0:1721880431.210274:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b8bed80, transno 4296059454 00000004:00080000:3.0:1721880431.210275:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b08d500, transno 4296059455 00000004:00080000:3.0:1721880431.210277:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b8bc380, transno 4296059456 00000004:00080000:3.0:1721880431.210279:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b8bf480, transno 4296059457 00000004:00080000:3.0:1721880431.210280:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b8bf800, transno 4296059458 00000004:00080000:3.0:1721880431.210281:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b8bd880, transno 4296059459 00000004:00080000:3.0:1721880431.210283:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ea17480, transno 4296059460 00000004:00080000:3.0:1721880431.210285:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b8be680, transno 4296059461 00000004:00080000:3.0:1721880431.210286:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ea16a00, transno 4296059462 00000004:00080000:3.0:1721880431.210288:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ea14e00, transno 4296059463 00000004:00080000:3.0:1721880431.210290:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ea15180, transno 4296059464 00000004:00080000:3.0:1721880431.210291:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b7c4e00, transno 4296059465 00000004:00080000:3.0:1721880431.210293:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ea17b80, transno 4296059466 00000004:00080000:3.0:1721880431.210294:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e915880, transno 4296059467 00000004:00080000:3.0:1721880431.210296:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e917800, transno 4296059468 00000004:00080000:3.0:1721880431.210297:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e915f80, transno 4296059469 00000004:00080000:3.0:1721880431.210298:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e916680, transno 4296059470 00000004:00080000:3.0:1721880431.210300:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b7c7100, transno 4296059471 00000004:00080000:3.0:1721880431.210301:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e917480, transno 4296059472 00000004:00080000:3.0:1721880431.210303:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e914e00, transno 4296059473 00000004:00080000:3.0:1721880431.210305:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880097139c00, transno 4296059474 00000004:00080000:3.0:1721880431.210306:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880097138380, transno 4296059475 00000004:00080000:3.0:1721880431.210308:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009713b480, transno 4296059476 00000004:00080000:3.0:1721880431.210309:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087b48700, transno 4296059477 00000004:00080000:3.0:1721880431.210310:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e915180, transno 4296059478 00000004:00080000:3.0:1721880431.210312:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c408e00, transno 4296059479 00000004:00080000:3.0:1721880431.210313:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087b4a300, transno 4296059480 00000004:00080000:3.0:1721880431.210315:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c409c00, transno 4296059481 00000004:00080000:3.0:1721880431.210317:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c845500, transno 4296059482 00000004:00080000:3.0:1721880431.210318:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087b48380, transno 4296059483 00000004:00080000:3.0:1721880431.210320:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c409f80, transno 4296059484 00000004:00080000:3.0:1721880431.210321:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c847480, transno 4296059485 00000004:00080000:3.0:1721880431.210322:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c845880, transno 4296059486 00000004:00080000:3.0:1721880431.210324:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bcf6a00, transno 4296059487 00000004:00080000:3.0:1721880431.210325:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bcf5f80, transno 4296059488 00000004:00080000:3.0:1721880431.210326:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bcf4700, transno 4296059489 00000004:00080000:3.0:1721880431.210327:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bcf4e00, transno 4296059490 00000004:00080000:3.0:1721880431.210329:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c844700, transno 4296059491 00000004:00080000:3.0:1721880431.210330:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084310700, transno 4296059492 00000004:00080000:3.0:1721880431.210331:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bcf6680, transno 4296059493 00000004:00080000:3.0:1721880431.210333:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087b4bb80, transno 4296059494 00000004:00080000:3.0:1721880431.210334:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087b49180, transno 4296059495 00000004:00080000:3.0:1721880431.210335:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bcf4000, transno 4296059496 00000004:00080000:3.0:1721880431.210337:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b876300, transno 4296059497 00000004:00080000:3.0:1721880431.210338:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084313480, transno 4296059498 00000004:00080000:3.0:1721880431.210340:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b875880, transno 4296059499 00000004:00080000:3.0:1721880431.210341:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e916300, transno 4296059500 00000004:00080000:3.0:1721880431.210342:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ea16d80, transno 4296059501 00000004:00080000:3.0:1721880431.210344:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ea14a80, transno 4296059502 00000004:00080000:3.0:1721880431.210345:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b874700, transno 4296059503 00000004:00080000:3.0:1721880431.210347:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b877480, transno 4296059504 00000004:00080000:3.0:1721880431.210349:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096cb5f80, transno 4296059505 00000004:00080000:3.0:1721880431.210350:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096cb7800, transno 4296059506 00000004:00080000:3.0:1721880431.210352:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b875180, transno 4296059507 00000004:00080000:3.0:1721880431.210353:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096cb5500, transno 4296059508 00000004:00080000:3.0:1721880431.210354:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087b49880, transno 4296059509 00000004:00080000:3.0:1721880431.210356:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087b48a80, transno 4296059510 00000004:00080000:3.0:1721880431.210358:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092a4bb80, transno 4296059511 00000004:00080000:3.0:1721880431.210360:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b59b800, transno 4296059512 00000004:00080000:3.0:1721880431.210362:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ecac000, transno 4296059513 00000004:00080000:3.0:1721880431.210364:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087b4aa00, transno 4296059514 00000004:00080000:3.0:1721880431.210365:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b599c00, transno 4296059515 00000004:00080000:3.0:1721880431.210367:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b599500, transno 4296059516 00000004:00080000:3.0:1721880431.210368:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ecad880, transno 4296059517 00000004:00080000:3.0:1721880431.210370:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b599f80, transno 4296059518 00000004:00080000:3.0:1721880431.210371:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ecaea00, transno 4296059519 00000004:00080000:3.0:1721880431.210373:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ecad500, transno 4296059520 00000004:00080000:3.0:1721880431.210374:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b598000, transno 4296059521 00000004:00080000:3.0:1721880431.210376:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087b4b480, transno 4296059522 00000004:00080000:3.0:1721880431.210377:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800920aaa00, transno 4296059523 00000004:00080000:3.0:1721880431.210379:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ecadc00, transno 4296059524 00000004:00080000:3.0:1721880431.210380:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800920ab480, transno 4296059525 00000004:00080000:3.0:1721880431.210381:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b59bb80, transno 4296059526 00000004:00080000:3.0:1721880431.210383:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b598700, transno 4296059527 00000004:00080000:3.0:1721880431.210384:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b59a300, transno 4296059528 00000004:00080000:3.0:1721880431.210385:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800982d6300, transno 4296059529 00000004:00080000:3.0:1721880431.210387:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800982d5500, transno 4296059530 00000004:00080000:3.0:1721880431.210389:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099eb3b80, transno 4296059531 00000004:00080000:3.0:1721880431.210390:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800982d7800, transno 4296059532 00000004:00080000:3.0:1721880431.210392:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099eb0a80, transno 4296059533 00000004:00080000:3.0:1721880431.210394:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800982d5180, transno 4296059534 00000004:00080000:3.0:1721880431.210395:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800982d4700, transno 4296059535 00000004:00080000:3.0:1721880431.210397:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099eb1f80, transno 4296059536 00000004:00080000:3.0:1721880431.210398:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d3d7100, transno 4296059537 00000004:00080000:3.0:1721880431.210400:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099eb3800, transno 4296059538 00000004:00080000:3.0:1721880431.210402:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d3d4380, transno 4296059539 00000004:00080000:3.0:1721880431.210403:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d3d7b80, transno 4296059540 00000004:00080000:3.0:1721880431.210405:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099eb2680, transno 4296059541 00000004:00080000:3.0:1721880431.210407:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d3d5880, transno 4296059542 00000004:00080000:3.0:1721880431.210408:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d3d4700, transno 4296059543 00000004:00080000:3.0:1721880431.210410:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ea14700, transno 4296059544 00000004:00080000:3.0:1721880431.210412:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e615c00, transno 4296059545 00000004:00080000:3.0:1721880431.210413:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e615880, transno 4296059546 00000004:00080000:3.0:1721880431.210415:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e617480, transno 4296059547 00000004:00080000:3.0:1721880431.210416:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e614000, transno 4296059548 00000004:00080000:3.0:1721880431.210418:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e616680, transno 4296059549 00000004:00080000:3.0:1721880431.210420:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e615f80, transno 4296059550 00000004:00080000:3.0:1721880431.210421:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e614700, transno 4296059551 00000004:00080000:3.0:1721880431.210423:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e615500, transno 4296059552 00000004:00080000:3.0:1721880431.210424:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098d25c00, transno 4296059553 00000004:00080000:3.0:1721880431.210426:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e614a80, transno 4296059554 00000004:00080000:3.0:1721880431.210427:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008777c000, transno 4296059555 00000004:00080000:3.0:1721880431.210429:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800920a8700, transno 4296059556 00000004:00080000:3.0:1721880431.210431:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098d26d80, transno 4296059557 00000004:00080000:3.0:1721880431.210432:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008777f100, transno 4296059558 00000004:00080000:3.0:1721880431.210434:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099eb3100, transno 4296059559 00000004:00080000:3.0:1721880431.210435:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084df5180, transno 4296059560 00000004:00080000:3.0:1721880431.210437:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800920a8a80, transno 4296059561 00000004:00080000:3.0:1721880431.210438:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084df4000, transno 4296059562 00000004:00080000:3.0:1721880431.210439:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800920a8380, transno 4296059563 00000004:00080000:3.0:1721880431.210441:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084df4a80, transno 4296059564 00000004:00080000:3.0:1721880431.210442:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084df6d80, transno 4296059565 00000004:00080000:3.0:1721880431.210444:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084df7100, transno 4296059566 00000004:00080000:3.0:1721880431.210445:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084df4380, transno 4296059567 00000004:00080000:3.0:1721880431.210447:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098d27100, transno 4296059568 00000004:00080000:3.0:1721880431.210448:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084df7480, transno 4296059569 00000004:00080000:3.0:1721880431.210449:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084df5880, transno 4296059570 00000004:00080000:3.0:1721880431.210451:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084df5c00, transno 4296059571 00000004:00080000:3.0:1721880431.210453:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a052ed80, transno 4296059572 00000004:00080000:3.0:1721880431.210455:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a052ea00, transno 4296059573 00000004:00080000:3.0:1721880431.210456:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a052fb80, transno 4296059574 00000004:00080000:3.0:1721880431.210458:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a052f100, transno 4296059575 00000004:00080000:3.0:1721880431.210460:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098d26300, transno 4296059576 00000004:00080000:3.0:1721880431.210461:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098d26a00, transno 4296059577 00000004:00080000:3.0:1721880431.210463:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a052ca80, transno 4296059578 00000004:00080000:3.0:1721880431.210465:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800919c0380, transno 4296059579 00000004:00080000:3.0:1721880431.210467:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f52d500, transno 4296059580 00000004:00080000:3.0:1721880431.210468:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a052f800, transno 4296059581 00000004:00080000:3.0:1721880431.210470:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ebd8e00, transno 4296059582 00000004:00080000:3.0:1721880431.210471:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ebd9880, transno 4296059583 00000004:00080000:3.0:1721880431.210473:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ebd9f80, transno 4296059584 00000004:00080000:3.0:1721880431.210474:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d3d6d80, transno 4296059585 00000004:00080000:3.0:1721880431.210476:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ebd9c00, transno 4296059586 00000004:00080000:3.0:1721880431.210477:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800888fad80, transno 4296059587 00000004:00080000:3.0:1721880431.210479:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ebda680, transno 4296059588 00000004:00080000:3.0:1721880431.210480:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800888f9f80, transno 4296059589 00000004:00080000:3.0:1721880431.210482:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800888fa300, transno 4296059590 00000004:00080000:3.0:1721880431.210483:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800888fb100, transno 4296059591 00000004:00080000:3.0:1721880431.210484:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f52c700, transno 4296059592 00000004:00080000:3.0:1721880431.210486:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800888fbb80, transno 4296059593 00000004:00080000:3.0:1721880431.210487:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d3d4e00, transno 4296059594 00000004:00080000:3.0:1721880431.210489:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800888faa00, transno 4296059595 00000004:00080000:3.0:1721880431.210491:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800959a6680, transno 4296059596 00000004:00080000:3.0:1721880431.210492:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800888fb800, transno 4296059597 00000004:00080000:3.0:1721880431.210493:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b175500, transno 4296059598 00000004:00080000:3.0:1721880431.210495:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b175880, transno 4296059599 00000004:00080000:3.0:1721880431.210496:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b175c00, transno 4296059600 00000004:00080000:3.0:1721880431.210497:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b174000, transno 4296059601 00000004:00080000:3.0:1721880431.210499:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b174700, transno 4296059602 00000004:00080000:3.0:1721880431.210500:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b177100, transno 4296059603 00000004:00080000:3.0:1721880431.210502:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801366a0000, transno 4296059604 00000004:00080000:3.0:1721880431.210503:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f52f480, transno 4296059605 00000004:00080000:3.0:1721880431.210505:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801366a2680, transno 4296059606 00000004:00080000:3.0:1721880431.210506:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801366a1c00, transno 4296059607 00000004:00080000:3.0:1721880431.210507:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008854d180, transno 4296059608 00000004:00080000:3.0:1721880431.210509:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008854fb80, transno 4296059609 00000004:00080000:3.0:1721880431.210510:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008854f480, transno 4296059610 00000004:00080000:3.0:1721880431.210511:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008854ed80, transno 4296059611 00000004:00080000:3.0:1721880431.210513:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800959a4380, transno 4296059612 00000004:00080000:3.0:1721880431.210514:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800959a4000, transno 4296059613 00000004:00080000:3.0:1721880431.210516:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800959a5c00, transno 4296059614 00000004:00080000:3.0:1721880431.210517:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800888f9c00, transno 4296059615 00000004:00080000:3.0:1721880431.210518:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800888f9180, transno 4296059616 00000004:00080000:3.0:1721880431.210520:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800959a4a80, transno 4296059617 00000004:00080000:3.0:1721880431.210522:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800888f9880, transno 4296059618 00000004:00080000:3.0:1721880431.210523:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009231b480, transno 4296059619 00000004:00080000:3.0:1721880431.210525:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800994e9c00, transno 4296059620 00000004:00080000:3.0:1721880431.210526:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008854ca80, transno 4296059621 00000004:00080000:3.0:1721880431.210528:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009231bb80, transno 4296059622 00000004:00080000:3.0:1721880431.210529:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d041880, transno 4296059623 00000004:00080000:3.0:1721880431.210531:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800982d5880, transno 4296059624 00000004:00080000:3.0:1721880431.210533:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d041500, transno 4296059625 00000004:00080000:3.0:1721880431.210534:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f821f80, transno 4296059626 00000004:00080000:3.0:1721880431.210536:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f822a00, transno 4296059627 00000004:00080000:3.0:1721880431.210538:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f821c00, transno 4296059628 00000004:00080000:3.0:1721880431.210539:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f823100, transno 4296059629 00000004:00080000:3.0:1721880431.210541:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e848e00, transno 4296059630 00000004:00080000:3.0:1721880431.210542:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f823480, transno 4296059631 00000004:00080000:3.0:1721880431.210544:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e84aa00, transno 4296059632 00000004:00080000:3.0:1721880431.210546:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e849180, transno 4296059633 00000004:00080000:3.0:1721880431.210548:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800842a9500, transno 4296059634 00000004:00080000:3.0:1721880431.210550:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f822300, transno 4296059635 00000004:00080000:3.0:1721880431.210551:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ea17800, transno 4296059636 00000004:00080000:3.0:1721880431.210553:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800994e9880, transno 4296059637 00000004:00080000:3.0:1721880431.210554:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800842ab800, transno 4296059638 00000004:00080000:3.0:1721880431.210556:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800842a9f80, transno 4296059639 00000004:00080000:3.0:1721880431.210557:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800994e9f80, transno 4296059640 00000004:00080000:3.0:1721880431.210559:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800994e8000, transno 4296059641 00000004:00080000:3.0:1721880431.210560:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800994eb100, transno 4296059642 00000004:00080000:3.0:1721880431.210561:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800842abb80, transno 4296059643 00000004:00080000:3.0:1721880431.210563:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b877100, transno 4296059644 00000004:00080000:3.0:1721880431.210564:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800842a9880, transno 4296059645 00000004:00080000:3.0:1721880431.210565:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800842aa300, transno 4296059646 00000004:00080000:3.0:1721880431.210566:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009231a300, transno 4296059647 00000004:00080000:3.0:1721880431.210567:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801366a1880, transno 4296059648 00000004:00080000:3.0:1721880431.210569:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801366a0e00, transno 4296059649 00000004:00080000:3.0:1721880431.210571:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d040700, transno 4296059650 00000004:00080000:3.0:1721880431.210572:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009231b800, transno 4296059651 00000004:00080000:3.0:1721880431.210574:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d042d80, transno 4296059652 00000004:00080000:3.0:1721880431.210576:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092318700, transno 4296059653 00000004:00080000:3.0:1721880431.210577:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d041f80, transno 4296059654 00000004:00080000:3.0:1721880431.210579:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095b72d80, transno 4296059655 00000004:00080000:3.0:1721880431.210580:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095b73b80, transno 4296059656 00000004:00080000:3.0:1721880431.210582:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095b70380, transno 4296059657 00000004:00080000:3.0:1721880431.210584:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b145500, transno 4296059658 00000004:00080000:3.0:1721880431.210585:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b144700, transno 4296059659 00000004:00080000:3.0:1721880431.210587:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b145880, transno 4296059660 00000004:00080000:3.0:1721880431.210589:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095b71500, transno 4296059661 00000004:00080000:3.0:1721880431.210591:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b146a00, transno 4296059662 00000004:00080000:3.0:1721880431.210593:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b147480, transno 4296059663 00000004:00080000:3.0:1721880431.210594:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f820380, transno 4296059664 00000004:00080000:3.0:1721880431.210596:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e84b800, transno 4296059665 00000004:00080000:3.0:1721880431.210597:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f823800, transno 4296059666 00000004:00080000:3.0:1721880431.210599:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800994e8380, transno 4296059667 00000004:00080000:3.0:1721880431.210600:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801366a3100, transno 4296059668 00000004:00080000:3.0:1721880431.210601:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008854d500, transno 4296059669 00000004:00080000:3.0:1721880431.210603:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f822d80, transno 4296059670 00000004:00080000:3.0:1721880431.210604:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ea16300, transno 4296059671 00000004:00080000:3.0:1721880431.210605:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b145180, transno 4296059672 00000004:00080000:3.0:1721880431.210607:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088efc000, transno 4296059673 00000004:00080000:3.0:1721880431.210608:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d9eb480, transno 4296059674 00000004:00080000:3.0:1721880431.210610:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d279c00, transno 4296059675 00000004:00080000:3.0:1721880431.210611:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d278a80, transno 4296059676 00000004:00080000:3.0:1721880431.210612:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d27a680, transno 4296059677 00000004:00080000:3.0:1721880431.210614:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d278000, transno 4296059678 00000004:00080000:3.0:1721880431.210615:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b147800, transno 4296059679 00000004:00080000:3.0:1721880431.210617:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088efed80, transno 4296059680 00000004:00080000:3.0:1721880431.210618:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d27b480, transno 4296059681 00000004:00080000:3.0:1721880431.210620:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b147100, transno 4296059682 00000004:00080000:3.0:1721880431.210621:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d279880, transno 4296059683 00000004:00080000:3.0:1721880431.210622:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095b72a00, transno 4296059684 00000004:00080000:3.0:1721880431.210624:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088eff800, transno 4296059685 00000004:00080000:3.0:1721880431.210625:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c779500, transno 4296059686 00000004:00080000:3.0:1721880431.210627:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b16ed80, transno 4296059687 00000004:00080000:3.0:1721880431.210629:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b16f480, transno 4296059688 00000004:00080000:3.0:1721880431.210631:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d043800, transno 4296059689 00000004:00080000:3.0:1721880431.210632:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b16c000, transno 4296059690 00000004:00080000:3.0:1721880431.210634:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800888fb480, transno 4296059691 00000004:00080000:3.0:1721880431.210636:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d279180, transno 4296059692 00000004:00080000:3.0:1721880431.210638:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800842a8700, transno 4296059693 00000004:00080000:3.0:1721880431.210641:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125a16d80, transno 4296059694 00000004:00080000:3.0:1721880431.210642:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d3d7800, transno 4296059695 00000004:00080000:3.0:1721880431.210644:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800953c6300, transno 4296059696 00000004:00080000:3.0:1721880431.210645:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800953c4700, transno 4296059697 00000004:00080000:3.0:1721880431.210647:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800953c4000, transno 4296059698 00000004:00080000:3.0:1721880431.210648:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d043b80, transno 4296059699 00000004:00080000:3.0:1721880431.210650:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007c82c000, transno 4296059700 00000004:00080000:3.0:1721880431.210652:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800953c4e00, transno 4296059701 00000004:00080000:3.0:1721880431.210653:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c77aa00, transno 4296059702 00000004:00080000:3.0:1721880431.210654:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007c82d180, transno 4296059703 00000004:00080000:3.0:1721880431.210656:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125a16a00, transno 4296059704 00000004:00080000:3.0:1721880431.210658:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125a16680, transno 4296059705 00000004:00080000:3.0:1721880431.210659:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125a17b80, transno 4296059706 00000004:00080000:3.0:1721880431.210660:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125a15c00, transno 4296059707 00000004:00080000:3.0:1721880431.210662:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b16e680, transno 4296059708 00000004:00080000:3.0:1721880431.210663:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b16dc00, transno 4296059709 00000004:00080000:3.0:1721880431.210665:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120345500, transno 4296059710 00000004:00080000:3.0:1721880431.210666:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120344e00, transno 4296059711 00000004:00080000:3.0:1721880431.210668:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120345c00, transno 4296059712 00000004:00080000:3.0:1721880431.210669:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125a14a80, transno 4296059713 00000004:00080000:3.0:1721880431.210671:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120345180, transno 4296059714 00000004:00080000:3.0:1721880431.210672:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b16f800, transno 4296059715 00000004:00080000:3.0:1721880431.210674:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800920cb100, transno 4296059716 00000004:00080000:3.0:1721880431.210675:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800920c8000, transno 4296059717 00000004:00080000:3.0:1721880431.210677:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007c82ed80, transno 4296059718 00000004:00080000:3.0:1721880431.210679:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007c82ea00, transno 4296059719 00000004:00080000:3.0:1721880431.210680:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007c82ca80, transno 4296059720 00000004:00080000:3.0:1721880431.210682:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007c82fb80, transno 4296059721 00000004:00080000:3.0:1721880431.210684:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007c82df80, transno 4296059722 00000004:00080000:3.0:1721880431.210686:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007c82dc00, transno 4296059723 00000004:00080000:3.0:1721880431.210688:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012590a300, transno 4296059724 00000004:00080000:3.0:1721880431.210689:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007c82c380, transno 4296059725 00000004:00080000:3.0:1721880431.210691:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125909180, transno 4296059726 00000004:00080000:3.0:1721880431.210693:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012590b100, transno 4296059727 00000004:00080000:3.0:1721880431.210695:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012590b480, transno 4296059728 00000004:00080000:3.0:1721880431.210696:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012590b800, transno 4296059729 00000004:00080000:3.0:1721880431.210697:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125908e00, transno 4296059730 00000004:00080000:3.0:1721880431.210699:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007c82f100, transno 4296059731 00000004:00080000:3.0:1721880431.210700:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e274000, transno 4296059732 00000004:00080000:3.0:1721880431.210702:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e277b80, transno 4296059733 00000004:00080000:3.0:1721880431.210703:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e275500, transno 4296059734 00000004:00080000:3.0:1721880431.210704:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e277480, transno 4296059735 00000004:00080000:3.0:1721880431.210706:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e274a80, transno 4296059736 00000004:00080000:3.0:1721880431.210707:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e274700, transno 4296059737 00000004:00080000:3.0:1721880431.210709:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e276d80, transno 4296059738 00000004:00080000:3.0:1721880431.210711:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e275f80, transno 4296059739 00000004:00080000:3.0:1721880431.210712:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e277100, transno 4296059740 00000004:00080000:3.0:1721880431.210713:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e274380, transno 4296059741 00000004:00080000:3.0:1721880431.210714:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125908000, transno 4296059742 00000004:00080000:3.0:1721880431.210716:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125909f80, transno 4296059743 00000004:00080000:3.0:1721880431.210718:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098bece00, transno 4296059744 00000004:00080000:3.0:1721880431.210719:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125908a80, transno 4296059745 00000004:00080000:3.0:1721880431.210721:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098befb80, transno 4296059746 00000004:00080000:3.0:1721880431.210722:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098bee300, transno 4296059747 00000004:00080000:3.0:1721880431.210724:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098beed80, transno 4296059748 00000004:00080000:3.0:1721880431.210725:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098bedc00, transno 4296059749 00000004:00080000:3.0:1721880431.210738:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098bedf80, transno 4296059750 00000004:00080000:3.0:1721880431.210740:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098beea00, transno 4296059751 00000004:00080000:3.0:1721880431.210743:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098bed180, transno 4296059752 00000004:00080000:3.0:1721880431.210745:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098bef800, transno 4296059753 00000004:00080000:3.0:1721880431.210746:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098bed500, transno 4296059754 00000004:00080000:3.0:1721880431.210749:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120668000, transno 4296059755 00000004:00080000:3.0:1721880431.210750:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120669500, transno 4296059756 00000004:00080000:3.0:1721880431.210752:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120668a80, transno 4296059757 00000004:00080000:3.0:1721880431.210754:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120668e00, transno 4296059758 00000004:00080000:3.0:1721880431.210755:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120668700, transno 4296059759 00000004:00080000:3.0:1721880431.210757:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012066b480, transno 4296059760 00000004:00080000:3.0:1721880431.210759:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f79c000, transno 4296059761 00000004:00080000:3.0:1721880431.210760:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f79ed80, transno 4296059762 00000004:00080000:3.0:1721880431.210762:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120669880, transno 4296059763 00000004:00080000:3.0:1721880431.210763:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f79ce00, transno 4296059764 00000004:00080000:3.0:1721880431.210764:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f79ea00, transno 4296059765 00000004:00080000:3.0:1721880431.210766:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f79df80, transno 4296059766 00000004:00080000:3.0:1721880431.210768:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f79d500, transno 4296059767 00000004:00080000:3.0:1721880431.210769:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120669c00, transno 4296059768 00000004:00080000:3.0:1721880431.210770:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120668380, transno 4296059769 00000004:00080000:3.0:1721880431.210772:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800953c6680, transno 4296059770 00000004:00080000:3.0:1721880431.210773:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800953c4380, transno 4296059771 00000004:00080000:3.0:1721880431.210775:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800953c5500, transno 4296059772 00000004:00080000:3.0:1721880431.210777:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800953c5880, transno 4296059773 00000004:00080000:3.0:1721880431.210778:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800953c5180, transno 4296059774 00000004:00080000:3.0:1721880431.210779:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e914a80, transno 4296059775 00000004:00080000:3.0:1721880431.210780:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e914700, transno 4296059776 00000004:00080000:3.0:1721880431.210782:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e917b80, transno 4296059777 00000004:00080000:3.0:1721880431.210783:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800953c7100, transno 4296059778 00000004:00080000:3.0:1721880431.210785:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e914000, transno 4296059779 00000004:00080000:3.0:1721880431.210786:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e915500, transno 4296059780 00000004:00080000:3.0:1721880431.210788:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b144000, transno 4296059781 00000004:00080000:3.0:1721880431.210790:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e915c00, transno 4296059782 00000004:00080000:3.0:1721880431.210792:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087744380, transno 4296059783 00000004:00080000:3.0:1721880431.210794:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087747800, transno 4296059784 00000004:00080000:3.0:1721880431.210796:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087747480, transno 4296059785 00000004:00080000:3.0:1721880431.210798:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087745f80, transno 4296059786 00000004:00080000:3.0:1721880431.210799:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b144380, transno 4296059787 00000004:00080000:3.0:1721880431.210801:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e917100, transno 4296059788 00000004:00080000:3.0:1721880431.210802:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e86e300, transno 4296059789 00000004:00080000:3.0:1721880431.210804:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e86c380, transno 4296059790 00000004:00080000:3.0:1721880431.210805:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e86df80, transno 4296059791 00000004:00080000:3.0:1721880431.210807:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e86e680, transno 4296059792 00000004:00080000:3.0:1721880431.210808:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e86f800, transno 4296059793 00000004:00080000:3.0:1721880431.210810:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087745880, transno 4296059794 00000004:00080000:3.0:1721880431.210812:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b144a80, transno 4296059795 00000004:00080000:3.0:1721880431.210813:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f79f480, transno 4296059796 00000004:00080000:3.0:1721880431.210815:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f79e680, transno 4296059797 00000004:00080000:3.0:1721880431.210816:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f79dc00, transno 4296059798 00000004:00080000:3.0:1721880431.210817:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f79d180, transno 4296059799 00000004:00080000:3.0:1721880431.210818:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f79c700, transno 4296059800 00000004:00080000:3.0:1721880431.210820:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007c82d880, transno 4296059801 00000004:00080000:3.0:1721880431.210821:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007c82ce00, transno 4296059802 00000004:00080000:3.0:1721880431.210823:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120669f80, transno 4296059803 00000004:00080000:3.0:1721880431.210825:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125909880, transno 4296059804 00000004:00080000:3.0:1721880431.210826:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012590a680, transno 4296059805 00000004:00080000:3.0:1721880431.210828:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125909c00, transno 4296059806 00000004:00080000:3.0:1721880431.210829:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bc31c00, transno 4296059807 00000004:00080000:3.0:1721880431.210831:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bc32680, transno 4296059808 00000004:00080000:3.0:1721880431.210833:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e916d80, transno 4296059809 00000004:00080000:3.0:1721880431.210834:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e274e00, transno 4296059810 00000004:00080000:3.0:1721880431.210836:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131a44380, transno 4296059811 00000004:00080000:3.0:1721880431.210838:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131a46d80, transno 4296059812 00000004:00080000:3.0:1721880431.210839:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131a44700, transno 4296059813 00000004:00080000:3.0:1721880431.210840:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131a45500, transno 4296059814 00000004:00080000:3.0:1721880431.210842:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131a47100, transno 4296059815 00000004:00080000:3.0:1721880431.210843:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131a47480, transno 4296059816 00000004:00080000:3.0:1721880431.210844:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131a47b80, transno 4296059817 00000004:00080000:3.0:1721880431.210845:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d035500, transno 4296059818 00000004:00080000:3.0:1721880431.210847:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131a46300, transno 4296059819 00000004:00080000:3.0:1721880431.210849:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d035180, transno 4296059820 00000004:00080000:3.0:1721880431.210850:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d034000, transno 4296059821 00000004:00080000:3.0:1721880431.210852:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bca1180, transno 4296059822 00000004:00080000:3.0:1721880431.210853:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007c82e300, transno 4296059823 00000004:00080000:3.0:1721880431.210854:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d036d80, transno 4296059824 00000004:00080000:3.0:1721880431.210856:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012066ad80, transno 4296059825 00000004:00080000:3.0:1721880431.210857:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bca2300, transno 4296059826 00000004:00080000:3.0:1721880431.210859:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bca1f80, transno 4296059827 00000004:00080000:3.0:1721880431.210860:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e84a300, transno 4296059828 00000004:00080000:3.0:1721880431.210870:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131a44a80, transno 4296059829 00000004:00080000:3.0:1721880431.210872:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131a45180, transno 4296059830 00000004:00080000:3.0:1721880431.210874:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131a45c00, transno 4296059831 00000004:00080000:3.0:1721880431.210875:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007c82c700, transno 4296059832 00000004:00080000:3.0:1721880431.210877:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f79e300, transno 4296059833 00000004:00080000:3.0:1721880431.210879:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092110e00, transno 4296059834 00000004:00080000:3.0:1721880431.210880:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092110a80, transno 4296059835 00000004:00080000:3.0:1721880431.210882:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bca0a80, transno 4296059836 00000004:00080000:3.0:1721880431.210884:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131a44000, transno 4296059837 00000004:00080000:3.0:1721880431.210885:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d035880, transno 4296059838 00000004:00080000:3.0:1721880431.210887:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d034e00, transno 4296059839 00000004:00080000:3.0:1721880431.210888:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f79ca80, transno 4296059840 00000004:00080000:3.0:1721880431.210889:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007c82e680, transno 4296059841 00000004:00080000:3.0:1721880431.210891:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f79f800, transno 4296059842 00000004:00080000:3.0:1721880431.210893:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131a44e00, transno 4296059843 00000004:00080000:3.0:1721880431.210895:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800982d5f80, transno 4296059844 00000004:00080000:3.0:1721880431.210896:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d832680, transno 4296059845 00000004:00080000:3.0:1721880431.210898:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d832300, transno 4296059846 00000004:00080000:3.0:1721880431.210900:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092113b80, transno 4296059847 00000004:00080000:3.0:1721880431.210901:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800982d4a80, transno 4296059848 00000004:00080000:3.0:1721880431.210903:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800982d6a00, transno 4296059849 00000004:00080000:3.0:1721880431.210904:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099cdaa00, transno 4296059850 00000004:00080000:3.0:1721880431.210906:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f501c00, transno 4296059851 00000004:00080000:3.0:1721880431.210907:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bca0380, transno 4296059852 00000004:00080000:3.0:1721880431.210909:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bca0700, transno 4296059853 00000004:00080000:3.0:1721880431.210910:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bca2a00, transno 4296059854 00000004:00080000:3.0:1721880431.210911:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e84ad80, transno 4296059855 00000004:00080000:3.0:1721880431.210913:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f79f100, transno 4296059856 00000004:00080000:3.0:1721880431.210914:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f79fb80, transno 4296059857 00000004:00080000:3.0:1721880431.210916:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099cda680, transno 4296059858 00000004:00080000:3.0:1721880431.210917:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099cdbb80, transno 4296059859 00000004:00080000:3.0:1721880431.210919:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099cd8e00, transno 4296059860 00000004:00080000:3.0:1721880431.210920:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099cd8380, transno 4296059861 00000004:00080000:3.0:1721880431.210922:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099cd9c00, transno 4296059862 00000004:00080000:3.0:1721880431.210924:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099cd9500, transno 4296059863 00000004:00080000:3.0:1721880431.210925:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f501880, transno 4296059864 00000004:00080000:3.0:1721880431.210927:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012066b800, transno 4296059865 00000004:00080000:3.0:1721880431.210929:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bc31180, transno 4296059866 00000004:00080000:3.0:1721880431.210930:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e277800, transno 4296059867 00000004:00080000:3.0:1721880431.210932:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099cd8700, transno 4296059868 00000004:00080000:3.0:1721880431.210933:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f502a00, transno 4296059869 00000004:00080000:3.0:1721880431.210935:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800842a8380, transno 4296059870 00000004:00080000:3.0:1721880431.210936:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096cb7b80, transno 4296059871 00000004:00080000:3.0:1721880431.210939:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096cb6d80, transno 4296059872 00000004:00080000:3.0:1721880431.210941:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125908380, transno 4296059873 00000004:00080000:3.0:1721880431.210943:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c846a00, transno 4296059874 00000004:00080000:3.0:1721880431.210944:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c845180, transno 4296059875 00000004:00080000:3.0:1721880431.210946:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c844a80, transno 4296059876 00000004:00080000:3.0:1721880431.210948:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c844380, transno 4296059877 00000004:00080000:3.0:1721880431.210949:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b876680, transno 4296059878 00000004:00080000:3.0:1721880431.210951:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b877800, transno 4296059879 00000004:00080000:3.0:1721880431.210952:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b874e00, transno 4296059880 00000004:00080000:3.0:1721880431.210954:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012066bb80, transno 4296059881 00000004:00080000:3.0:1721880431.210955:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d830a80, transno 4296059882 00000004:00080000:3.0:1721880431.210956:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d832a00, transno 4296059883 00000004:00080000:3.0:1721880431.210965:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c847100, transno 4296059884 00000004:00080000:3.0:1721880431.210966:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095b71880, transno 4296059885 00000004:00080000:3.0:1721880431.210968:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d831c00, transno 4296059886 00000004:00080000:3.0:1721880431.210970:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e84a680, transno 4296059887 00000004:00080000:3.0:1721880431.210971:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bca3100, transno 4296059888 00000004:00080000:3.0:1721880431.210973:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095b70000, transno 4296059889 00000004:00080000:3.0:1721880431.210974:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095b73480, transno 4296059890 00000004:00080000:3.0:1721880431.210976:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095b73800, transno 4296059891 00000004:00080000:3.0:1721880431.210977:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095b71180, transno 4296059892 00000004:00080000:3.0:1721880431.210978:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095b70700, transno 4296059893 00000004:00080000:3.0:1721880431.210980:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095b70a80, transno 4296059894 00000004:00080000:3.0:1721880431.210981:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095b72680, transno 4296059895 00000004:00080000:3.0:1721880431.210982:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095b73100, transno 4296059896 00000004:00080000:3.0:1721880431.210984:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095b70e00, transno 4296059897 00000004:00080000:3.0:1721880431.210985:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c844000, transno 4296059898 00000004:00080000:3.0:1721880431.210988:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c846680, transno 4296059899 00000004:00080000:3.0:1721880431.210989:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bca1880, transno 4296059900 00000004:00080000:3.0:1721880431.210991:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095b72300, transno 4296059901 00000004:00080000:3.0:1721880431.210993:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c847b80, transno 4296059902 00000004:00080000:3.0:1721880431.210995:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131a46680, transno 4296059903 00000004:00080000:3.0:1721880431.210997:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c847800, transno 4296059904 00000004:00080000:3.0:1721880431.210998:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d832d80, transno 4296059905 00000004:00080000:3.0:1721880431.211000:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800947ed880, transno 4296059906 00000004:00080000:3.0:1721880431.211002:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c77a300, transno 4296059907 00000004:00080000:3.0:1721880431.211006:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c778a80, transno 4296059908 00000004:00080000:3.0:1721880431.211008:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c4df100, transno 4296059909 00000004:00080000:3.0:1721880431.211010:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b877b80, transno 4296059910 00000004:00080000:3.0:1721880431.211011:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800947ef480, transno 4296059911 00000004:00080000:3.0:1721880431.211013:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c77b800, transno 4296059912 00000004:00080000:3.0:1721880431.211015:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ecaf100, transno 4296059913 00000004:00080000:3.0:1721880431.211016:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d833800, transno 4296059914 00000004:00080000:3.0:1721880431.211018:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ecaed80, transno 4296059915 00000004:00080000:3.0:1721880431.211020:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ecae300, transno 4296059916 00000004:00080000:3.0:1721880431.211021:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ecaf480, transno 4296059917 00000004:00080000:3.0:1721880431.211023:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ecadf80, transno 4296059918 00000004:00080000:3.0:1721880431.211024:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ecaca80, transno 4296059919 00000004:00080000:3.0:1721880431.211025:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ecaf800, transno 4296059920 00000004:00080000:3.0:1721880431.211027:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c779880, transno 4296059921 00000004:00080000:3.0:1721880431.211028:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c778700, transno 4296059922 00000004:00080000:3.0:1721880431.211030:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800842aaa00, transno 4296059923 00000004:00080000:3.0:1721880431.211031:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800842a9180, transno 4296059924 00000004:00080000:3.0:1721880431.211033:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bc33b80, transno 4296059925 00000004:00080000:3.0:1721880431.211034:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f501500, transno 4296059926 00000004:00080000:3.0:1721880431.211036:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091abb480, transno 4296059927 00000004:00080000:3.0:1721880431.211037:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bca1500, transno 4296059928 00000004:00080000:3.0:1721880431.211039:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096259c00, transno 4296059929 00000004:00080000:3.0:1721880431.211041:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d034700, transno 4296059930 00000004:00080000:3.0:1721880431.211042:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c4dd180, transno 4296059931 00000004:00080000:3.0:1721880431.211045:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c4dd500, transno 4296059932 00000004:00080000:3.0:1721880431.211046:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c4df800, transno 4296059933 00000004:00080000:3.0:1721880431.211048:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c4ddc00, transno 4296059934 00000004:00080000:3.0:1721880431.211050:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b7c4000, transno 4296059935 00000004:00080000:3.0:1721880431.211052:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ecac700, transno 4296059936 00000004:00080000:3.0:1721880431.211054:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b7c5f80, transno 4296059937 00000004:00080000:3.0:1721880431.211055:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088fe4a80, transno 4296059938 00000004:00080000:3.0:1721880431.211057:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088fe5500, transno 4296059939 00000004:00080000:3.0:1721880431.211059:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088fe6d80, transno 4296059940 00000004:00080000:3.0:1721880431.211060:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088fe5880, transno 4296059941 00000004:00080000:3.0:1721880431.211061:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088fe5f80, transno 4296059942 00000004:00080000:3.0:1721880431.211063:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088fe7100, transno 4296059943 00000004:00080000:3.0:1721880431.211064:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009625a300, transno 4296059944 00000004:00080000:3.0:1721880431.211066:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009299c000, transno 4296059945 00000004:00080000:3.0:1721880431.211068:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009299f800, transno 4296059946 00000004:00080000:3.0:1721880431.211069:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ecad180, transno 4296059947 00000004:00080000:3.0:1721880431.211071:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009299ca80, transno 4296059948 00000004:00080000:3.0:1721880431.211072:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009299f480, transno 4296059949 00000004:00080000:3.0:1721880431.211074:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009625ad80, transno 4296059950 00000004:00080000:3.0:1721880431.211075:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088fe7800, transno 4296059951 00000004:00080000:3.0:1721880431.211077:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800911ed880, transno 4296059952 00000004:00080000:3.0:1721880431.211078:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088fe6a00, transno 4296059953 00000004:00080000:3.0:1721880431.211080:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088fe5180, transno 4296059954 00000004:00080000:3.0:1721880431.211081:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009625a680, transno 4296059955 00000004:00080000:3.0:1721880431.211082:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b7c6d80, transno 4296059956 00000004:00080000:3.0:1721880431.211084:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009625b100, transno 4296059957 00000004:00080000:3.0:1721880431.211086:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009625bb80, transno 4296059958 00000004:00080000:3.0:1721880431.211088:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096258380, transno 4296059959 00000004:00080000:3.0:1721880431.211090:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096258a80, transno 4296059960 00000004:00080000:3.0:1721880431.211092:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098222680, transno 4296059961 00000004:00080000:3.0:1721880431.211096:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098220e00, transno 4296059962 00000004:00080000:3.0:1721880431.211099:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098223b80, transno 4296059963 00000004:00080000:3.0:1721880431.211101:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098221c00, transno 4296059964 00000004:00080000:3.0:1721880431.211104:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098223100, transno 4296059965 00000004:00080000:3.0:1721880431.211106:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098220a80, transno 4296059966 00000004:00080000:3.0:1721880431.211109:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c778e00, transno 4296059967 00000004:00080000:3.0:1721880431.211111:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c779f80, transno 4296059968 00000004:00080000:3.0:1721880431.211113:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007c82f800, transno 4296059969 00000004:00080000:3.0:1721880431.211116:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091ab9180, transno 4296059970 00000004:00080000:3.0:1721880431.211118:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131a45880, transno 4296059971 00000004:00080000:3.0:1721880431.211121:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091aba680, transno 4296059972 00000004:00080000:3.0:1721880431.211124:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087b4a680, transno 4296059973 00000004:00080000:3.0:1721880431.211126:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b875f80, transno 4296059974 00000004:00080000:3.0:1721880431.211129:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800913bb800, transno 4296059975 00000004:00080000:3.0:1721880431.211132:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800913b9500, transno 4296059976 00000004:00080000:3.0:1721880431.211134:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800911ec000, transno 4296059977 00000004:00080000:3.0:1721880431.211136:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098223480, transno 4296059978 00000004:00080000:3.0:1721880431.211139:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800911edc00, transno 4296059979 00000004:00080000:3.0:1721880431.211142:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008774fb80, transno 4296059980 00000004:00080000:3.0:1721880431.211144:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076e5fb80, transno 4296059981 00000004:00080000:3.0:1721880431.211147:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008774ca80, transno 4296059982 00000004:00080000:3.0:1721880431.211150:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091ab9500, transno 4296059983 00000004:00080000:3.0:1721880431.211152:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120669180, transno 4296059984 00000004:00080000:3.0:1721880431.211155:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008774e680, transno 4296059985 00000004:00080000:3.0:1721880431.211157:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008774f480, transno 4296059986 00000004:00080000:3.0:1721880431.211159:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801360cd500, transno 4296059987 00000004:00080000:3.0:1721880431.211162:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801360ce300, transno 4296059988 00000004:00080000:3.0:1721880431.211164:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801360cf100, transno 4296059989 00000004:00080000:3.0:1721880431.211166:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801360cdc00, transno 4296059990 00000004:00080000:3.0:1721880431.211169:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801360cc700, transno 4296059991 00000004:00080000:3.0:1721880431.211171:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801360ced80, transno 4296059992 00000004:00080000:3.0:1721880431.211174:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801360ce680, transno 4296059993 00000004:00080000:3.0:1721880431.211177:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801360cd180, transno 4296059994 00000004:00080000:3.0:1721880431.211179:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801360cfb80, transno 4296059995 00000004:00080000:3.0:1721880431.211182:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801360cea00, transno 4296059996 00000004:00080000:3.0:1721880431.211184:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801360cce00, transno 4296059997 00000004:00080000:3.0:1721880431.211186:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009299c380, transno 4296059998 00000004:00080000:3.0:1721880431.211189:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801360cf480, transno 4296059999 00000004:00080000:3.0:1721880431.211191:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009299f100, transno 4296060000 00000004:00080000:3.0:1721880431.211194:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009299df80, transno 4296060001 00000004:00080000:3.0:1721880431.211197:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009299d180, transno 4296060002 00000004:00080000:3.0:1721880431.211199:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009299ed80, transno 4296060003 00000004:00080000:3.0:1721880431.211202:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d034a80, transno 4296060004 00000004:00080000:3.0:1721880431.211204:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076e5ea00, transno 4296060005 00000004:00080000:3.0:1721880431.211207:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076e5dc00, transno 4296060006 00000004:00080000:3.0:1721880431.211209:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076e5ed80, transno 4296060007 00000004:00080000:3.0:1721880431.211212:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076e5c380, transno 4296060008 00000004:00080000:3.0:1721880431.211214:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800913bad80, transno 4296060009 00000004:00080000:3.0:1721880431.211216:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800913baa00, transno 4296060010 00000004:00080000:3.0:1721880431.211219:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800911eca80, transno 4296060011 00000004:00080000:3.0:1721880431.211222:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b7c5500, transno 4296060012 00000004:00080000:3.0:1721880431.211225:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008774f800, transno 4296060013 00000004:00080000:3.0:1721880431.211227:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bdbb100, transno 4296060014 00000004:00080000:3.0:1721880431.211229:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bdb8000, transno 4296060015 00000004:00080000:3.0:1721880431.211231:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bdba300, transno 4296060016 00000004:00080000:3.0:1721880431.211235:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f708e00, transno 4296060017 00000004:00080000:3.0:1721880431.211237:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f709180, transno 4296060018 00000004:00080000:3.0:1721880431.211240:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098220700, transno 4296060019 00000004:00080000:3.0:1721880431.211243:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f708000, transno 4296060020 00000004:00080000:3.0:1721880431.211245:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f709c00, transno 4296060021 00000004:00080000:3.0:1721880431.211248:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008774c380, transno 4296060022 00000004:00080000:3.0:1721880431.211251:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008774d500, transno 4296060023 00000004:00080000:3.0:1721880431.211253:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008774f100, transno 4296060024 00000004:00080000:3.0:1721880431.211256:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008774ce00, transno 4296060025 00000004:00080000:3.0:1721880431.211259:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008774df80, transno 4296060026 00000004:00080000:3.0:1721880431.211262:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800942e7100, transno 4296060027 00000004:00080000:3.0:1721880431.211264:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008774dc00, transno 4296060028 00000004:00080000:3.0:1721880431.211267:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009730a300, transno 4296060029 00000004:00080000:3.0:1721880431.211269:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800942e4700, transno 4296060030 00000004:00080000:3.0:1721880431.211272:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880097309f80, transno 4296060031 00000004:00080000:3.0:1721880431.211274:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880097308380, transno 4296060032 00000004:00080000:3.0:1721880431.211276:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009730aa00, transno 4296060033 00000004:00080000:3.0:1721880431.211277:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bca3480, transno 4296060034 00000004:00080000:3.0:1721880431.211279:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f99a300, transno 4296060035 00000004:00080000:3.0:1721880431.211281:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f99b100, transno 4296060036 00000004:00080000:3.0:1721880431.211283:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f999c00, transno 4296060037 00000004:00080000:3.0:1721880431.211284:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f99aa00, transno 4296060038 00000004:00080000:3.0:1721880431.211285:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008774c000, transno 4296060039 00000004:00080000:3.0:1721880431.211287:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008774c700, transno 4296060040 00000004:00080000:3.0:1721880431.211289:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c4de680, transno 4296060041 00000004:00080000:3.0:1721880431.211292:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c4dc380, transno 4296060042 00000004:00080000:3.0:1721880431.211294:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f999180, transno 4296060043 00000004:00080000:3.0:1721880431.211296:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f998380, transno 4296060044 00000004:00080000:3.0:1721880431.211299:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f999500, transno 4296060045 00000004:00080000:3.0:1721880431.211300:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f99ad80, transno 4296060046 00000004:00080000:3.0:1721880431.211303:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801258fb480, transno 4296060047 00000004:00080000:3.0:1721880431.211306:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800995f4700, transno 4296060048 00000004:00080000:3.0:1721880431.211308:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800995f6d80, transno 4296060049 00000004:00080000:3.0:1721880431.211311:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800995f5c00, transno 4296060050 00000004:00080000:3.0:1721880431.211313:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800995f6680, transno 4296060051 00000004:00080000:3.0:1721880431.211316:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076e5d500, transno 4296060052 00000004:00080000:3.0:1721880431.211319:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076e5f800, transno 4296060053 00000004:00080000:3.0:1721880431.211321:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800995f5500, transno 4296060054 00000004:00080000:3.0:1721880431.211324:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801360cca80, transno 4296060055 00000004:00080000:3.0:1721880431.211326:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801360cc380, transno 4296060056 00000004:00080000:3.0:1721880431.211330:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800858b5500, transno 4296060057 00000004:00080000:3.0:1721880431.211332:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800858b4a80, transno 4296060058 00000004:00080000:3.0:1721880431.211334:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b874000, transno 4296060059 00000004:00080000:3.0:1721880431.211337:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f70a300, transno 4296060060 00000004:00080000:3.0:1721880431.211339:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f70ad80, transno 4296060061 00000004:00080000:3.0:1721880431.211342:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800913bbb80, transno 4296060062 00000004:00080000:3.0:1721880431.211345:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800913b8380, transno 4296060063 00000004:00080000:3.0:1721880431.211347:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800947ec380, transno 4296060064 00000004:00080000:3.0:1721880431.211350:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800911ed180, transno 4296060065 00000004:00080000:3.0:1721880431.211352:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096cb7480, transno 4296060066 00000004:00080000:3.0:1721880431.211355:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009299e300, transno 4296060067 00000004:00080000:3.0:1721880431.211357:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c778380, transno 4296060068 00000004:00080000:3.0:1721880431.211359:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880097308e00, transno 4296060069 00000004:00080000:3.0:1721880431.211362:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801258f8e00, transno 4296060070 00000004:00080000:3.0:1721880431.211364:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009730b100, transno 4296060071 00000004:00080000:3.0:1721880431.211368:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880097308a80, transno 4296060072 00000004:00080000:3.0:1721880431.211370:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801258f8700, transno 4296060073 00000004:00080000:3.0:1721880431.211373:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880097308000, transno 4296060074 00000004:00080000:3.0:1721880431.211375:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bdb9500, transno 4296060075 00000004:00080000:3.0:1721880431.211377:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801258fad80, transno 4296060076 00000004:00080000:3.0:1721880431.211379:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bdbb800, transno 4296060077 00000004:00080000:3.0:1721880431.211382:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013647fb80, transno 4296060078 00000004:00080000:3.0:1721880431.211384:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d0c3100, transno 4296060079 00000004:00080000:3.0:1721880431.211386:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013647ca80, transno 4296060080 00000004:00080000:3.0:1721880431.211389:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d0c1f80, transno 4296060081 00000004:00080000:3.0:1721880431.211393:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d0c2300, transno 4296060082 00000004:00080000:3.0:1721880431.211395:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013647d180, transno 4296060083 00000004:00080000:3.0:1721880431.211398:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013647ce00, transno 4296060084 00000004:00080000:3.0:1721880431.211401:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d0c1500, transno 4296060085 00000004:00080000:3.0:1721880431.211403:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131eef100, transno 4296060086 00000004:00080000:3.0:1721880431.211406:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013647d500, transno 4296060087 00000004:00080000:3.0:1721880431.211408:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013647ea00, transno 4296060088 00000004:00080000:3.0:1721880431.211411:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013647e300, transno 4296060089 00000004:00080000:3.0:1721880431.211412:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013647e680, transno 4296060090 00000004:00080000:3.0:1721880431.211414:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013647f800, transno 4296060091 00000004:00080000:3.0:1721880431.211416:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bdd8000, transno 4296060092 00000004:00080000:3.0:1721880431.211419:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801258f8a80, transno 4296060093 00000004:00080000:3.0:1721880431.211421:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013647c700, transno 4296060094 00000004:00080000:3.0:1721880431.211423:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013647f100, transno 4296060095 00000004:00080000:3.0:1721880431.211425:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bdd9180, transno 4296060096 00000004:00080000:3.0:1721880431.211426:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bdd9500, transno 4296060097 00000004:00080000:3.0:1721880431.211428:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091937100, transno 4296060098 00000004:00080000:3.0:1721880431.211431:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091937b80, transno 4296060099 00000004:00080000:3.0:1721880431.211433:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007c848380, transno 4296060100 00000004:00080000:3.0:1721880431.211435:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bdd8a80, transno 4296060101 00000004:00080000:3.0:1721880431.211437:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007c84ad80, transno 4296060102 00000004:00080000:3.0:1721880431.211439:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bddb100, transno 4296060103 00000004:00080000:3.0:1721880431.211441:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088b02680, transno 4296060104 00000004:00080000:3.0:1721880431.211443:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007c848700, transno 4296060105 00000004:00080000:3.0:1721880431.211445:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013647d880, transno 4296060106 00000004:00080000:3.0:1721880431.211448:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800921cd500, transno 4296060107 00000004:00080000:3.0:1721880431.211449:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bddb800, transno 4296060108 00000004:00080000:3.0:1721880431.211452:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880124805500, transno 4296060109 00000004:00080000:3.0:1721880431.211455:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880124804a80, transno 4296060110 00000004:00080000:3.0:1721880431.211457:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125986300, transno 4296060111 00000004:00080000:3.0:1721880431.211461:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880124807100, transno 4296060112 00000004:00080000:3.0:1721880431.211463:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125986680, transno 4296060113 00000004:00080000:3.0:1721880431.211466:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880124804700, transno 4296060114 00000004:00080000:3.0:1721880431.211469:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125984700, transno 4296060115 00000004:00080000:3.0:1721880431.211471:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b7c7b80, transno 4296060116 00000004:00080000:3.0:1721880431.211473:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880124804000, transno 4296060117 00000004:00080000:3.0:1721880431.211474:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bdd8700, transno 4296060118 00000004:00080000:3.0:1721880431.211476:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f999f80, transno 4296060119 00000004:00080000:3.0:1721880431.211477:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d0c2680, transno 4296060120 00000004:00080000:3.0:1721880431.211479:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d0c0a80, transno 4296060121 00000004:00080000:3.0:1721880431.211481:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ea30380, transno 4296060122 00000004:00080000:3.0:1721880431.211482:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d0c3b80, transno 4296060123 00000004:00080000:3.0:1721880431.211484:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ea31c00, transno 4296060124 00000004:00080000:3.0:1721880431.211485:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088b01f80, transno 4296060125 00000004:00080000:3.0:1721880431.211487:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007c84b480, transno 4296060126 00000004:00080000:3.0:1721880431.211488:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007c84a680, transno 4296060127 00000004:00080000:3.0:1721880431.211490:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007c84a300, transno 4296060128 00000004:00080000:3.0:1721880431.211492:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007c849500, transno 4296060129 00000004:00080000:3.0:1721880431.211493:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088b01180, transno 4296060130 00000004:00080000:3.0:1721880431.211495:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f7a9f80, transno 4296060131 00000004:00080000:3.0:1721880431.211496:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f7abb80, transno 4296060132 00000004:00080000:3.0:1721880431.211498:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f7ab100, transno 4296060133 00000004:00080000:3.0:1721880431.211499:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f7ab480, transno 4296060134 00000004:00080000:3.0:1721880431.211501:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801258f9c00, transno 4296060135 00000004:00080000:3.0:1721880431.211502:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f7ab800, transno 4296060136 00000004:00080000:3.0:1721880431.211503:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f7aa300, transno 4296060137 00000004:00080000:3.0:1721880431.211505:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801258fa300, transno 4296060138 00000004:00080000:3.0:1721880431.211506:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c4df480, transno 4296060139 00000004:00080000:3.0:1721880431.211508:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bdda300, transno 4296060140 00000004:00080000:3.0:1721880431.211509:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bddad80, transno 4296060141 00000004:00080000:3.0:1721880431.211511:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131eef480, transno 4296060142 00000004:00080000:3.0:1721880431.211513:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f7a9880, transno 4296060143 00000004:00080000:3.0:1721880431.211515:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bdd9c00, transno 4296060144 00000004:00080000:3.0:1721880431.211517:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c4e5180, transno 4296060145 00000004:00080000:3.0:1721880431.211519:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131eef800, transno 4296060146 00000004:00080000:3.0:1721880431.211520:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131eece00, transno 4296060147 00000004:00080000:3.0:1721880431.211522:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c4e4700, transno 4296060148 00000004:00080000:3.0:1721880431.211523:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131eeed80, transno 4296060149 00000004:00080000:3.0:1721880431.211525:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131eedf80, transno 4296060150 00000004:00080000:3.0:1721880431.211526:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125985c00, transno 4296060151 00000004:00080000:3.0:1721880431.211528:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125985880, transno 4296060152 00000004:00080000:3.0:1721880431.211530:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880124805f80, transno 4296060153 00000004:00080000:3.0:1721880431.211531:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800921cc380, transno 4296060154 00000004:00080000:3.0:1721880431.211533:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801258f8380, transno 4296060155 00000004:00080000:3.0:1721880431.211535:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f998700, transno 4296060156 00000004:00080000:3.0:1721880431.211536:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091935180, transno 4296060157 00000004:00080000:3.0:1721880431.211538:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091936680, transno 4296060158 00000004:00080000:3.0:1721880431.211539:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091934700, transno 4296060159 00000004:00080000:3.0:1721880431.211541:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b7c6300, transno 4296060160 00000004:00080000:3.0:1721880431.211543:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801258fa680, transno 4296060161 00000004:00080000:3.0:1721880431.211546:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f7a8380, transno 4296060162 00000004:00080000:3.0:1721880431.211549:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f7a8700, transno 4296060163 00000004:00080000:3.0:1721880431.211551:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f7a9500, transno 4296060164 00000004:00080000:3.0:1721880431.211553:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f7a9c00, transno 4296060165 00000004:00080000:3.0:1721880431.211555:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ea32680, transno 4296060166 00000004:00080000:3.0:1721880431.211558:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bdb8e00, transno 4296060167 00000004:00080000:3.0:1721880431.211560:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f998000, transno 4296060168 00000004:00080000:3.0:1721880431.211562:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d0c0e00, transno 4296060169 00000004:00080000:3.0:1721880431.211565:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088dd6a00, transno 4296060170 00000004:00080000:3.0:1721880431.211567:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091baf800, transno 4296060171 00000004:00080000:3.0:1721880431.211571:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088dd5880, transno 4296060172 00000004:00080000:3.0:1721880431.211573:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091baf100, transno 4296060173 00000004:00080000:3.0:1721880431.211576:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091bac380, transno 4296060174 00000004:00080000:3.0:1721880431.211578:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087bbf800, transno 4296060175 00000004:00080000:3.0:1721880431.211581:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087bbc380, transno 4296060176 00000004:00080000:3.0:1721880431.211584:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088dd6d80, transno 4296060177 00000004:00080000:3.0:1721880431.211586:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088dd7480, transno 4296060178 00000004:00080000:3.0:1721880431.211589:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088dd7800, transno 4296060179 00000004:00080000:3.0:1721880431.211591:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088dd4380, transno 4296060180 00000004:00080000:3.0:1721880431.211593:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087bbf480, transno 4296060181 00000004:00080000:3.0:1721880431.211596:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087bbe300, transno 4296060182 00000004:00080000:3.0:1721880431.211598:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087bbdf80, transno 4296060183 00000004:00080000:3.0:1721880431.211600:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095986680, transno 4296060184 00000004:00080000:3.0:1721880431.211602:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131eedc00, transno 4296060185 00000004:00080000:3.0:1721880431.211605:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c4ded80, transno 4296060186 00000004:00080000:3.0:1721880431.211607:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ea33100, transno 4296060187 00000004:00080000:3.0:1721880431.211609:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ea30000, transno 4296060188 00000004:00080000:3.0:1721880431.211611:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c4e4e00, transno 4296060189 00000004:00080000:3.0:1721880431.211613:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095985500, transno 4296060190 00000004:00080000:3.0:1721880431.211615:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ecace00, transno 4296060191 00000004:00080000:3.0:1721880431.211618:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087799180, transno 4296060192 00000004:00080000:3.0:1721880431.211620:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f7aad80, transno 4296060193 00000004:00080000:3.0:1721880431.211623:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013647ed80, transno 4296060194 00000004:00080000:3.0:1721880431.211625:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087bbd500, transno 4296060195 00000004:00080000:3.0:1721880431.211627:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085908380, transno 4296060196 00000004:00080000:3.0:1721880431.211629:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880124806d80, transno 4296060197 00000004:00080000:3.0:1721880431.211631:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880124806300, transno 4296060198 00000004:00080000:3.0:1721880431.211633:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800921cf480, transno 4296060199 00000004:00080000:3.0:1721880431.211635:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800921cd180, transno 4296060200 00000004:00080000:3.0:1721880431.211637:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008779b480, transno 4296060201 00000004:00080000:3.0:1721880431.211640:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091bae680, transno 4296060202 00000004:00080000:3.0:1721880431.211643:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087bbfb80, transno 4296060203 00000004:00080000:3.0:1721880431.211645:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087bbc700, transno 4296060204 00000004:00080000:3.0:1721880431.211648:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008be50e00, transno 4296060205 00000004:00080000:3.0:1721880431.211650:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095987480, transno 4296060206 00000004:00080000:3.0:1721880431.211653:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008be52680, transno 4296060207 00000004:00080000:3.0:1721880431.211655:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095987b80, transno 4296060208 00000004:00080000:3.0:1721880431.211657:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801258f9500, transno 4296060209 00000004:00080000:3.0:1721880431.211659:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013647dc00, transno 4296060210 00000004:00080000:3.0:1721880431.211661:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008be51180, transno 4296060211 00000004:00080000:3.0:1721880431.211663:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008be50700, transno 4296060212 00000004:00080000:3.0:1721880431.211665:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091bafb80, transno 4296060213 00000004:00080000:3.0:1721880431.211667:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008be51c00, transno 4296060214 00000004:00080000:3.0:1721880431.211669:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091badf80, transno 4296060215 00000004:00080000:3.0:1721880431.211672:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009fbae680, transno 4296060216 00000004:00080000:3.0:1721880431.211686:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009fbace00, transno 4296060217 00000004:00080000:3.0:1721880431.211688:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087bbca80, transno 4296060218 00000004:00080000:3.0:1721880431.211691:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008779a680, transno 4296060219 00000004:00080000:3.0:1721880431.211693:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091936300, transno 4296060220 00000004:00080000:3.0:1721880431.211695:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087bbc000, transno 4296060221 00000004:00080000:3.0:1721880431.211697:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800887a8a80, transno 4296060222 00000004:00080000:3.0:1721880431.211699:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131ea5c00, transno 4296060223 00000004:00080000:3.0:1721880431.211700:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131ea7100, transno 4296060224 00000004:00080000:3.0:1721880431.211702:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131ea4a80, transno 4296060225 00000004:00080000:3.0:1721880431.211704:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800887a8700, transno 4296060226 00000004:00080000:3.0:1721880431.211706:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800887a9500, transno 4296060227 00000004:00080000:3.0:1721880431.211707:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a05fca80, transno 4296060228 00000004:00080000:3.0:1721880431.211709:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a05fdf80, transno 4296060229 00000004:00080000:3.0:1721880431.211711:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009fbad180, transno 4296060230 00000004:00080000:3.0:1721880431.211712:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008be50380, transno 4296060231 00000004:00080000:3.0:1721880431.211715:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095985880, transno 4296060232 00000004:00080000:3.0:1721880431.211717:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008be53100, transno 4296060233 00000004:00080000:3.0:1721880431.211718:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008be51500, transno 4296060234 00000004:00080000:3.0:1721880431.211721:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008be53800, transno 4296060235 00000004:00080000:3.0:1721880431.211722:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087798e00, transno 4296060236 00000004:00080000:3.0:1721880431.211724:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085909500, transno 4296060237 00000004:00080000:3.0:1721880431.211725:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087798700, transno 4296060238 00000004:00080000:3.0:1721880431.211739:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088415180, transno 4296060239 00000004:00080000:3.0:1721880431.211741:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088416a00, transno 4296060240 00000004:00080000:3.0:1721880431.211743:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088417100, transno 4296060241 00000004:00080000:3.0:1721880431.211745:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088416300, transno 4296060242 00000004:00080000:3.0:1721880431.211746:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094690380, transno 4296060243 00000004:00080000:3.0:1721880431.211748:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800887ab480, transno 4296060244 00000004:00080000:3.0:1721880431.211749:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094692a00, transno 4296060245 00000004:00080000:3.0:1721880431.211751:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800887aad80, transno 4296060246 00000004:00080000:3.0:1721880431.211752:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800887a8000, transno 4296060247 00000004:00080000:3.0:1721880431.211755:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800887aa680, transno 4296060248 00000004:00080000:3.0:1721880431.211756:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800887a9180, transno 4296060249 00000004:00080000:3.0:1721880431.211758:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098b56d80, transno 4296060250 00000004:00080000:3.0:1721880431.211760:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131ea7b80, transno 4296060251 00000004:00080000:3.0:1721880431.211762:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131ea5180, transno 4296060252 00000004:00080000:3.0:1721880431.211763:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fc34700, transno 4296060253 00000004:00080000:3.0:1721880431.211765:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098b56a00, transno 4296060254 00000004:00080000:3.0:1721880431.211766:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094691500, transno 4296060255 00000004:00080000:3.0:1721880431.211768:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098b54700, transno 4296060256 00000004:00080000:3.0:1721880431.211769:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094690a80, transno 4296060257 00000004:00080000:3.0:1721880431.211771:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f12e300, transno 4296060258 00000004:00080000:3.0:1721880431.211772:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f12ca80, transno 4296060259 00000004:00080000:3.0:1721880431.211774:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008779aa00, transno 4296060260 00000004:00080000:3.0:1721880431.211775:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087bbed80, transno 4296060261 00000004:00080000:3.0:1721880431.211778:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008779a300, transno 4296060262 00000004:00080000:3.0:1721880431.211779:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087799f80, transno 4296060263 00000004:00080000:3.0:1721880431.211781:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d0c0380, transno 4296060264 00000004:00080000:3.0:1721880431.211783:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088dd7b80, transno 4296060265 00000004:00080000:3.0:1721880431.211785:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125985f80, transno 4296060266 00000004:00080000:3.0:1721880431.211787:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088dd5c00, transno 4296060267 00000004:00080000:3.0:1721880431.211788:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125987b80, transno 4296060268 00000004:00080000:3.0:1721880431.211790:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088dd5180, transno 4296060269 00000004:00080000:3.0:1721880431.211792:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091137480, transno 4296060270 00000004:00080000:3.0:1721880431.211793:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800997be680, transno 4296060271 00000004:00080000:3.0:1721880431.211795:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ea33800, transno 4296060272 00000004:00080000:3.0:1721880431.211796:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fc37100, transno 4296060273 00000004:00080000:3.0:1721880431.211798:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fc35c00, transno 4296060274 00000004:00080000:3.0:1721880431.211799:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088dd5f80, transno 4296060275 00000004:00080000:3.0:1721880431.211801:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ca4ca80, transno 4296060276 00000004:00080000:3.0:1721880431.211802:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ca4ea00, transno 4296060277 00000004:00080000:3.0:1721880431.211804:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f12c000, transno 4296060278 00000004:00080000:3.0:1721880431.211805:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f12dc00, transno 4296060279 00000004:00080000:3.0:1721880431.211807:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f12ce00, transno 4296060280 00000004:00080000:3.0:1721880431.211808:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ca4f100, transno 4296060281 00000004:00080000:3.0:1721880431.211809:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f12c700, transno 4296060282 00000004:00080000:3.0:1721880431.211811:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f12ed80, transno 4296060283 00000004:00080000:3.0:1721880431.211812:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f12d880, transno 4296060284 00000004:00080000:3.0:1721880431.211814:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094691180, transno 4296060285 00000004:00080000:3.0:1721880431.211815:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f12f480, transno 4296060286 00000004:00080000:3.0:1721880431.211817:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098b57480, transno 4296060287 00000004:00080000:3.0:1721880431.211818:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800887ab100, transno 4296060288 00000004:00080000:3.0:1721880431.211820:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091bace00, transno 4296060289 00000004:00080000:3.0:1721880431.211821:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094691880, transno 4296060290 00000004:00080000:3.0:1721880431.211823:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098b56680, transno 4296060291 00000004:00080000:3.0:1721880431.211825:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a05ff100, transno 4296060292 00000004:00080000:3.0:1721880431.211827:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a05fce00, transno 4296060293 00000004:00080000:3.0:1721880431.211829:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134e94700, transno 4296060294 00000004:00080000:3.0:1721880431.211830:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134e95500, transno 4296060295 00000004:00080000:3.0:1721880431.211832:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d8cea00, transno 4296060296 00000004:00080000:3.0:1721880431.211834:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d8cfb80, transno 4296060297 00000004:00080000:3.0:1721880431.211835:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134e94000, transno 4296060298 00000004:00080000:3.0:1721880431.211836:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800997bc700, transno 4296060299 00000004:00080000:3.0:1721880431.211838:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095984000, transno 4296060300 00000004:00080000:3.0:1721880431.211839:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088aaa680, transno 4296060301 00000004:00080000:3.0:1721880431.211841:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088aa9c00, transno 4296060302 00000004:00080000:3.0:1721880431.211842:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098b57b80, transno 4296060303 00000004:00080000:3.0:1721880431.211844:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088aa9f80, transno 4296060304 00000004:00080000:3.0:1721880431.211845:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088aa9500, transno 4296060305 00000004:00080000:3.0:1721880431.211846:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088aaad80, transno 4296060306 00000004:00080000:3.0:1721880431.211848:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800876e4380, transno 4296060307 00000004:00080000:3.0:1721880431.211850:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800876e6680, transno 4296060308 00000004:00080000:3.0:1721880431.211851:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800876e4000, transno 4296060309 00000004:00080000:3.0:1721880431.211853:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098b55500, transno 4296060310 00000004:00080000:3.0:1721880431.211854:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800876e6300, transno 4296060311 00000004:00080000:3.0:1721880431.211856:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e3df100, transno 4296060312 00000004:00080000:3.0:1721880431.211858:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088aaaa00, transno 4296060313 00000004:00080000:3.0:1721880431.211859:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088aab800, transno 4296060314 00000004:00080000:3.0:1721880431.211860:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088aabb80, transno 4296060315 00000004:00080000:3.0:1721880431.211876:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ca4e680, transno 4296060316 00000004:00080000:3.0:1721880431.211879:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e3dc380, transno 4296060317 00000004:00080000:3.0:1721880431.211881:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b91500, transno 4296060318 00000004:00080000:3.0:1721880431.211883:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b91180, transno 4296060319 00000004:00080000:3.0:1721880431.211885:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b90700, transno 4296060320 00000004:00080000:3.0:1721880431.211886:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b92680, transno 4296060321 00000004:00080000:3.0:1721880431.211889:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e3ddc00, transno 4296060322 00000004:00080000:3.0:1721880431.211891:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ca4e300, transno 4296060323 00000004:00080000:3.0:1721880431.211892:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d8cf100, transno 4296060324 00000004:00080000:3.0:1721880431.211894:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008be51880, transno 4296060325 00000004:00080000:3.0:1721880431.211896:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d8cf800, transno 4296060326 00000004:00080000:3.0:1721880431.211898:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ca4c000, transno 4296060327 00000004:00080000:3.0:1721880431.211899:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962afb80, transno 4296060328 00000004:00080000:3.0:1721880431.211901:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962ad500, transno 4296060329 00000004:00080000:3.0:1721880431.211902:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962ad880, transno 4296060330 00000004:00080000:3.0:1721880431.211903:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962ae680, transno 4296060331 00000004:00080000:3.0:1721880431.211905:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962adf80, transno 4296060332 00000004:00080000:3.0:1721880431.211907:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962ad180, transno 4296060333 00000004:00080000:3.0:1721880431.211908:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009fbaf800, transno 4296060334 00000004:00080000:3.0:1721880431.211910:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800994b3800, transno 4296060335 00000004:00080000:3.0:1721880431.211911:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a0bcb480, transno 4296060336 00000004:00080000:3.0:1721880431.211913:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800994b2a00, transno 4296060337 00000004:00080000:3.0:1721880431.211915:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a05fd880, transno 4296060338 00000004:00080000:3.0:1721880431.211917:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800994b1f80, transno 4296060339 00000004:00080000:3.0:1721880431.211919:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800994b1880, transno 4296060340 00000004:00080000:3.0:1721880431.211920:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a0bcb800, transno 4296060341 00000004:00080000:3.0:1721880431.211921:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ad2a300, transno 4296060342 00000004:00080000:3.0:1721880431.211923:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ad29c00, transno 4296060343 00000004:00080000:3.0:1721880431.211924:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009fbaf480, transno 4296060344 00000004:00080000:3.0:1721880431.211926:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009fbaea00, transno 4296060345 00000004:00080000:3.0:1721880431.211928:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009fbadc00, transno 4296060346 00000004:00080000:3.0:1721880431.211929:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098b55f80, transno 4296060347 00000004:00080000:3.0:1721880431.211931:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098b57800, transno 4296060348 00000004:00080000:3.0:1721880431.211932:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962ace00, transno 4296060349 00000004:00080000:3.0:1721880431.211934:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099490380, transno 4296060350 00000004:00080000:3.0:1721880431.211936:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008be52300, transno 4296060351 00000004:00080000:3.0:1721880431.211938:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a0bc8380, transno 4296060352 00000004:00080000:3.0:1721880431.211940:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009fbadf80, transno 4296060353 00000004:00080000:3.0:1721880431.211941:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099491c00, transno 4296060354 00000004:00080000:3.0:1721880431.211943:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009aff8e00, transno 4296060355 00000004:00080000:3.0:1721880431.211945:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009aff9500, transno 4296060356 00000004:00080000:3.0:1721880431.211947:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009affbb80, transno 4296060357 00000004:00080000:3.0:1721880431.211949:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a0bc9180, transno 4296060358 00000004:00080000:3.0:1721880431.211950:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ca4fb80, transno 4296060359 00000004:00080000:3.0:1721880431.211952:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088aaa300, transno 4296060360 00000004:00080000:3.0:1721880431.211953:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098b57100, transno 4296060361 00000004:00080000:3.0:1721880431.211954:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d8ce300, transno 4296060362 00000004:00080000:3.0:1721880431.211956:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d8ced80, transno 4296060363 00000004:00080000:3.0:1721880431.211957:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d8cc700, transno 4296060364 00000004:00080000:3.0:1721880431.211958:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d8ce680, transno 4296060365 00000004:00080000:3.0:1721880431.211960:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099493800, transno 4296060366 00000004:00080000:3.0:1721880431.211961:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cc71500, transno 4296060367 00000004:00080000:3.0:1721880431.211962:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cc72a00, transno 4296060368 00000004:00080000:3.0:1721880431.211963:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cc71180, transno 4296060369 00000004:00080000:3.0:1721880431.211965:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009affb800, transno 4296060370 00000004:00080000:3.0:1721880431.211966:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088aab480, transno 4296060371 00000004:00080000:3.0:1721880431.211968:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088aa8000, transno 4296060372 00000004:00080000:3.0:1721880431.211969:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009affa300, transno 4296060373 00000004:00080000:3.0:1721880431.211971:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cc70e00, transno 4296060374 00000004:00080000:3.0:1721880431.211972:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a0bc8700, transno 4296060375 00000004:00080000:3.0:1721880431.211973:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a0bcad80, transno 4296060376 00000004:00080000:3.0:1721880431.211975:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122fd2d80, transno 4296060377 00000004:00080000:3.0:1721880431.211977:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122fd3100, transno 4296060378 00000004:00080000:3.0:1721880431.211978:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122fd3800, transno 4296060379 00000004:00080000:3.0:1721880431.211979:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ca4df80, transno 4296060380 00000004:00080000:3.0:1721880431.211981:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ad2aa00, transno 4296060381 00000004:00080000:3.0:1721880431.211983:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007cbc8000, transno 4296060382 00000004:00080000:3.0:1721880431.211984:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007cbcaa00, transno 4296060383 00000004:00080000:3.0:1721880431.211986:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800994b1500, transno 4296060384 00000004:00080000:3.0:1721880431.211988:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122fd3b80, transno 4296060385 00000004:00080000:3.0:1721880431.211989:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d8cdf80, transno 4296060386 00000004:00080000:3.0:1721880431.211991:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122fd0a80, transno 4296060387 00000004:00080000:3.0:1721880431.211992:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962ae300, transno 4296060388 00000004:00080000:3.0:1721880431.211994:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099492680, transno 4296060389 00000004:00080000:3.0:1721880431.211996:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007cbc9880, transno 4296060390 00000004:00080000:3.0:1721880431.211997:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099490000, transno 4296060391 00000004:00080000:3.0:1721880431.211998:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007cbc9f80, transno 4296060392 00000004:00080000:3.0:1721880431.212000:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007cbcbb80, transno 4296060393 00000004:00080000:3.0:1721880431.212001:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007cbc9c00, transno 4296060394 00000004:00080000:3.0:1721880431.212003:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b65c00, transno 4296060395 00000004:00080000:3.0:1721880431.212004:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cc73800, transno 4296060396 00000004:00080000:3.0:1721880431.212005:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cc71f80, transno 4296060397 00000004:00080000:3.0:1721880431.212007:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009979c700, transno 4296060398 00000004:00080000:3.0:1721880431.212009:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009aff9880, transno 4296060399 00000004:00080000:3.0:1721880431.212010:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009aff9f80, transno 4296060400 00000004:00080000:3.0:1721880431.212011:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009979e300, transno 4296060401 00000004:00080000:3.0:1721880431.212013:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b65180, transno 4296060402 00000004:00080000:3.0:1721880431.212014:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b67480, transno 4296060403 00000004:00080000:3.0:1721880431.212015:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b64700, transno 4296060404 00000004:00080000:3.0:1721880431.212017:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007cbc9500, transno 4296060405 00000004:00080000:3.0:1721880431.212018:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007cbc8380, transno 4296060406 00000004:00080000:3.0:1721880431.212019:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b90380, transno 4296060407 00000004:00080000:3.0:1721880431.212021:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007cbcb800, transno 4296060408 00000004:00080000:3.0:1721880431.212022:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800876e5c00, transno 4296060409 00000004:00080000:3.0:1721880431.212024:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091b78700, transno 4296060410 00000004:00080000:3.0:1721880431.212025:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091b7b480, transno 4296060411 00000004:00080000:3.0:1721880431.212028:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091b7ad80, transno 4296060412 00000004:00080000:3.0:1721880431.212030:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b66a00, transno 4296060413 00000004:00080000:3.0:1721880431.212032:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091b7a300, transno 4296060414 00000004:00080000:3.0:1721880431.212033:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b64380, transno 4296060415 00000004:00080000:3.0:1721880431.212035:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800973f7100, transno 4296060416 00000004:00080000:3.0:1721880431.212037:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800973f6a00, transno 4296060417 00000004:00080000:3.0:1721880431.212039:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009979fb80, transno 4296060418 00000004:00080000:3.0:1721880431.212040:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009979c380, transno 4296060419 00000004:00080000:3.0:1721880431.212042:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b65500, transno 4296060420 00000004:00080000:3.0:1721880431.212043:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009979d500, transno 4296060421 00000004:00080000:3.0:1721880431.212044:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b67800, transno 4296060422 00000004:00080000:3.0:1721880431.212046:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bca5880, transno 4296060423 00000004:00080000:3.0:1721880431.212047:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bca5180, transno 4296060424 00000004:00080000:3.0:1721880431.212048:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800973f4e00, transno 4296060425 00000004:00080000:3.0:1721880431.212050:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bca6680, transno 4296060426 00000004:00080000:3.0:1721880431.212052:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bf57480, transno 4296060427 00000004:00080000:3.0:1721880431.212053:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bf55880, transno 4296060428 00000004:00080000:3.0:1721880431.212055:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bf55180, transno 4296060429 00000004:00080000:3.0:1721880431.212056:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091b7aa00, transno 4296060430 00000004:00080000:3.0:1721880431.212058:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b65880, transno 4296060431 00000004:00080000:3.0:1721880431.212059:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800973f5880, transno 4296060432 00000004:00080000:3.0:1721880431.212061:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b66d80, transno 4296060433 00000004:00080000:3.0:1721880431.212062:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007cbc8e00, transno 4296060434 00000004:00080000:3.0:1721880431.212064:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009979f100, transno 4296060435 00000004:00080000:3.0:1721880431.212065:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088d29500, transno 4296060436 00000004:00080000:3.0:1721880431.212067:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801362cb100, transno 4296060437 00000004:00080000:3.0:1721880431.212069:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088d2a680, transno 4296060438 00000004:00080000:3.0:1721880431.212070:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bf54380, transno 4296060439 00000004:00080000:3.0:1721880431.212072:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801362c9180, transno 4296060440 00000004:00080000:3.0:1721880431.212073:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801362c9c00, transno 4296060441 00000004:00080000:3.0:1721880431.212075:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800973f7b80, transno 4296060442 00000004:00080000:3.0:1721880431.212077:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088d29f80, transno 4296060443 00000004:00080000:3.0:1721880431.212079:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d3b8380, transno 4296060444 00000004:00080000:3.0:1721880431.212080:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800876e7480, transno 4296060445 00000004:00080000:3.0:1721880431.212082:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800997bca80, transno 4296060446 00000004:00080000:3.0:1721880431.212084:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800997bd180, transno 4296060447 00000004:00080000:3.0:1721880431.212085:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088d2b800, transno 4296060448 00000004:00080000:3.0:1721880431.212087:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800859ae300, transno 4296060449 00000004:00080000:3.0:1721880431.212089:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f1b4e00, transno 4296060450 00000004:00080000:3.0:1721880431.212090:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800859ad500, transno 4296060451 00000004:00080000:3.0:1721880431.212092:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f1b6680, transno 4296060452 00000004:00080000:3.0:1721880431.212093:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091b79c00, transno 4296060453 00000004:00080000:3.0:1721880431.212095:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e34df80, transno 4296060454 00000004:00080000:3.0:1721880431.212097:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091b79500, transno 4296060455 00000004:00080000:3.0:1721880431.212098:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f1b5180, transno 4296060456 00000004:00080000:3.0:1721880431.212099:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bca7100, transno 4296060457 00000004:00080000:3.0:1721880431.212101:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800886fed80, transno 4296060458 00000004:00080000:3.0:1721880431.212102:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800886fdc00, transno 4296060459 00000004:00080000:3.0:1721880431.212105:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e34ca80, transno 4296060460 00000004:00080000:3.0:1721880431.212106:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e34e680, transno 4296060461 00000004:00080000:3.0:1721880431.212108:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f1b4000, transno 4296060462 00000004:00080000:3.0:1721880431.212109:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e34dc00, transno 4296060463 00000004:00080000:3.0:1721880431.212110:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f1b6d80, transno 4296060464 00000004:00080000:3.0:1721880431.212112:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800886ffb80, transno 4296060465 00000004:00080000:3.0:1721880431.212113:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009979f480, transno 4296060466 00000004:00080000:3.0:1721880431.212115:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009979ea00, transno 4296060467 00000004:00080000:3.0:1721880431.212116:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e34fb80, transno 4296060468 00000004:00080000:3.0:1721880431.212118:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b66680, transno 4296060469 00000004:00080000:3.0:1721880431.212119:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e34f100, transno 4296060470 00000004:00080000:3.0:1721880431.212121:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e34ed80, transno 4296060471 00000004:00080000:3.0:1721880431.212123:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801362cad80, transno 4296060472 00000004:00080000:3.0:1721880431.212124:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088d2aa00, transno 4296060473 00000004:00080000:3.0:1721880431.212126:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088408700, transno 4296060474 00000004:00080000:3.0:1721880431.212128:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008840ad80, transno 4296060475 00000004:00080000:3.0:1721880431.212130:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091b7b800, transno 4296060476 00000004:00080000:3.0:1721880431.212131:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091b78380, transno 4296060477 00000004:00080000:3.0:1721880431.212133:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091b7b100, transno 4296060478 00000004:00080000:3.0:1721880431.212134:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091b7bb80, transno 4296060479 00000004:00080000:3.0:1721880431.212136:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091b79180, transno 4296060480 00000004:00080000:3.0:1721880431.212137:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009aff9c00, transno 4296060481 00000004:00080000:3.0:1721880431.212138:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bca7480, transno 4296060482 00000004:00080000:3.0:1721880431.212140:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098a59f80, transno 4296060483 00000004:00080000:3.0:1721880431.212142:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098a5aa00, transno 4296060484 00000004:00080000:3.0:1721880431.212143:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098a5a680, transno 4296060485 00000004:00080000:3.0:1721880431.212144:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098a58e00, transno 4296060486 00000004:00080000:3.0:1721880431.212146:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098a58700, transno 4296060487 00000004:00080000:3.0:1721880431.212147:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098a5b100, transno 4296060488 00000004:00080000:3.0:1721880431.212149:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bca7800, transno 4296060489 00000004:00080000:3.0:1721880431.212150:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e34c380, transno 4296060490 00000004:00080000:3.0:1721880431.212151:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009979ca80, transno 4296060491 00000004:00080000:3.0:1721880431.212152:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098a59500, transno 4296060492 00000004:00080000:3.0:1721880431.212154:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800876e4a80, transno 4296060493 00000004:00080000:3.0:1721880431.212155:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088d29880, transno 4296060494 00000004:00080000:3.0:1721880431.212157:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ad2ad80, transno 4296060495 00000004:00080000:3.0:1721880431.212158:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098a58a80, transno 4296060496 00000004:00080000:3.0:1721880431.212160:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098a5b800, transno 4296060497 00000004:00080000:3.0:1721880431.212161:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098a5a300, transno 4296060498 00000004:00080000:3.0:1721880431.212162:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800876e5180, transno 4296060499 00000004:00080000:3.0:1721880431.212164:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b985880, transno 4296060500 00000004:00080000:3.0:1721880431.212166:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b0f9880, transno 4296060501 00000004:00080000:3.0:1721880431.212168:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e34ea00, transno 4296060502 00000004:00080000:3.0:1721880431.212170:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e34c000, transno 4296060503 00000004:00080000:3.0:1721880431.212172:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d8cc380, transno 4296060504 00000004:00080000:3.0:1721880431.212173:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e34f800, transno 4296060505 00000004:00080000:3.0:1721880431.212175:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085853800, transno 4296060506 00000004:00080000:3.0:1721880431.212176:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085852a00, transno 4296060507 00000004:00080000:3.0:1721880431.212178:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085852d80, transno 4296060508 00000004:00080000:3.0:1721880431.212179:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f1b6a00, transno 4296060509 00000004:00080000:3.0:1721880431.212181:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f1b4700, transno 4296060510 00000004:00080000:3.0:1721880431.212183:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088d29c00, transno 4296060511 00000004:00080000:3.0:1721880431.212184:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098a58000, transno 4296060512 00000004:00080000:3.0:1721880431.212185:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b0fb100, transno 4296060513 00000004:00080000:3.0:1721880431.212187:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131ecd880, transno 4296060514 00000004:00080000:3.0:1721880431.212188:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131ecdc00, transno 4296060515 00000004:00080000:3.0:1721880431.212190:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131ecea00, transno 4296060516 00000004:00080000:3.0:1721880431.212191:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131ece680, transno 4296060517 00000004:00080000:3.0:1721880431.212193:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131ecc700, transno 4296060518 00000004:00080000:3.0:1721880431.212194:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b0f9c00, transno 4296060519 00000004:00080000:3.0:1721880431.212195:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088409180, transno 4296060520 00000004:00080000:3.0:1721880431.212197:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b0fb800, transno 4296060521 00000004:00080000:3.0:1721880431.212198:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008840aa00, transno 4296060522 00000004:00080000:3.0:1721880431.212199:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800973f6680, transno 4296060523 00000004:00080000:3.0:1721880431.212201:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009affb100, transno 4296060524 00000004:00080000:3.0:1721880431.212203:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bf57100, transno 4296060525 00000004:00080000:3.0:1721880431.212204:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bf57b80, transno 4296060526 00000004:00080000:3.0:1721880431.212206:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d3bbb80, transno 4296060527 00000004:00080000:3.0:1721880431.212207:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d3b9c00, transno 4296060528 00000004:00080000:3.0:1721880431.212209:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800973f7480, transno 4296060529 00000004:00080000:3.0:1721880431.212210:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800973f5c00, transno 4296060530 00000004:00080000:3.0:1721880431.212212:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800973f4700, transno 4296060531 00000004:00080000:3.0:1721880431.212214:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bca4e00, transno 4296060532 00000004:00080000:3.0:1721880431.212216:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bca6d80, transno 4296060533 00000004:00080000:3.0:1721880431.212218:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088d28380, transno 4296060534 00000004:00080000:3.0:1721880431.212219:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098a5ad80, transno 4296060535 00000004:00080000:3.0:1721880431.212221:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088d28e00, transno 4296060536 00000004:00080000:3.0:1721880431.212222:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801362c8700, transno 4296060537 00000004:00080000:3.0:1721880431.212224:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800973f4a80, transno 4296060538 00000004:00080000:3.0:1721880431.212226:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012d74d880, transno 4296060539 00000004:00080000:3.0:1721880431.212227:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012d74ca80, transno 4296060540 00000004:00080000:3.0:1721880431.212228:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012d74ea00, transno 4296060541 00000004:00080000:3.0:1721880431.212230:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098a59180, transno 4296060542 00000004:00080000:3.0:1721880431.212232:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087be0000, transno 4296060543 00000004:00080000:3.0:1721880431.212234:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098a59880, transno 4296060544 00000004:00080000:3.0:1721880431.212235:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085851500, transno 4296060545 00000004:00080000:3.0:1721880431.212237:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085851c00, transno 4296060546 00000004:00080000:3.0:1721880431.212238:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085850380, transno 4296060547 00000004:00080000:3.0:1721880431.212240:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800886fea00, transno 4296060548 00000004:00080000:3.0:1721880431.212241:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800886fd880, transno 4296060549 00000004:00080000:3.0:1721880431.212243:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091b78e00, transno 4296060550 00000004:00080000:3.0:1721880431.212245:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800973f7800, transno 4296060551 00000004:00080000:3.0:1721880431.212246:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131ecd180, transno 4296060552 00000004:00080000:3.0:1721880431.212248:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087be0a80, transno 4296060553 00000004:00080000:3.0:1721880431.212250:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008840b480, transno 4296060554 00000004:00080000:3.0:1721880431.212251:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b81c00, transno 4296060555 00000004:00080000:3.0:1721880431.212253:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bf55500, transno 4296060556 00000004:00080000:3.0:1721880431.212254:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b80380, transno 4296060557 00000004:00080000:3.0:1721880431.212256:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b83b80, transno 4296060558 00000004:00080000:3.0:1721880431.212257:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b80000, transno 4296060559 00000004:00080000:3.0:1721880431.212259:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b75c000, transno 4296060560 00000004:00080000:3.0:1721880431.212260:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012d74d500, transno 4296060561 00000004:00080000:3.0:1721880431.212262:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b75f480, transno 4296060562 00000004:00080000:3.0:1721880431.212264:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b75dc00, transno 4296060563 00000004:00080000:3.0:1721880431.212265:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b75f800, transno 4296060564 00000004:00080000:3.0:1721880431.212266:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012d74ce00, transno 4296060565 00000004:00080000:3.0:1721880431.212267:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087be2d80, transno 4296060566 00000004:00080000:3.0:1721880431.212269:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800886fd500, transno 4296060567 00000004:00080000:3.0:1721880431.212271:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125a69880, transno 4296060568 00000004:00080000:3.0:1721880431.212272:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800886fc000, transno 4296060569 00000004:00080000:3.0:1721880431.212273:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800886ff800, transno 4296060570 00000004:00080000:3.0:1721880431.212275:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087be2a00, transno 4296060571 00000004:00080000:3.0:1721880431.212276:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800886fe300, transno 4296060572 00000004:00080000:3.0:1721880431.212277:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087be1180, transno 4296060573 00000004:00080000:3.0:1721880431.212278:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087be0380, transno 4296060574 00000004:00080000:3.0:1721880431.212280:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087be0e00, transno 4296060575 00000004:00080000:3.0:1721880431.212281:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087be1c00, transno 4296060576 00000004:00080000:3.0:1721880431.212282:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087be1880, transno 4296060577 00000004:00080000:3.0:1721880431.212284:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d3b9500, transno 4296060578 00000004:00080000:3.0:1721880431.212285:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b986300, transno 4296060579 00000004:00080000:3.0:1721880431.212286:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800876e5880, transno 4296060580 00000004:00080000:3.0:1721880431.212288:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009affaa00, transno 4296060581 00000004:00080000:3.0:1721880431.212290:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b984a80, transno 4296060582 00000004:00080000:3.0:1721880431.212291:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b987100, transno 4296060583 00000004:00080000:3.0:1721880431.212293:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801362ca300, transno 4296060584 00000004:00080000:3.0:1721880431.212295:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b985f80, transno 4296060585 00000004:00080000:3.0:1721880431.212296:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088d28000, transno 4296060586 00000004:00080000:3.0:1721880431.212298:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b986d80, transno 4296060587 00000004:00080000:3.0:1721880431.212300:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092a95c00, transno 4296060588 00000004:00080000:3.0:1721880431.212301:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b984e00, transno 4296060589 00000004:00080000:3.0:1721880431.212303:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092a96a00, transno 4296060590 00000004:00080000:3.0:1721880431.212304:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092a96d80, transno 4296060591 00000004:00080000:3.0:1721880431.212306:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092a97800, transno 4296060592 00000004:00080000:3.0:1721880431.212308:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009fbda300, transno 4296060593 00000004:00080000:3.0:1721880431.212310:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009fbd8a80, transno 4296060594 00000004:00080000:3.0:1721880431.212312:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009fbd9c00, transno 4296060595 00000004:00080000:3.0:1721880431.212314:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007294e680, transno 4296060596 00000004:00080000:3.0:1721880431.212315:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125a68700, transno 4296060597 00000004:00080000:3.0:1721880431.212317:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b75c700, transno 4296060598 00000004:00080000:3.0:1721880431.212319:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125a68380, transno 4296060599 00000004:00080000:3.0:1721880431.212321:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b0f9f80, transno 4296060600 00000004:00080000:3.0:1721880431.212322:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131ecc380, transno 4296060601 00000004:00080000:3.0:1721880431.212324:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b75e300, transno 4296060602 00000004:00080000:3.0:1721880431.212325:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131ecca80, transno 4296060603 00000004:00080000:3.0:1721880431.212327:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fbc0700, transno 4296060604 00000004:00080000:3.0:1721880431.212328:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fbc3480, transno 4296060605 00000004:00080000:3.0:1721880431.212330:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fbc2300, transno 4296060606 00000004:00080000:3.0:1721880431.212331:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d33c700, transno 4296060607 00000004:00080000:3.0:1721880431.212332:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d33f800, transno 4296060608 00000004:00080000:3.0:1721880431.212334:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d3bb800, transno 4296060609 00000004:00080000:3.0:1721880431.212335:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b82680, transno 4296060610 00000004:00080000:3.0:1721880431.212337:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d33c000, transno 4296060611 00000004:00080000:3.0:1721880431.212338:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d33ed80, transno 4296060612 00000004:00080000:3.0:1721880431.212340:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d33f100, transno 4296060613 00000004:00080000:3.0:1721880431.212341:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009fbd9f80, transno 4296060614 00000004:00080000:3.0:1721880431.212343:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fd16a00, transno 4296060615 00000004:00080000:3.0:1721880431.212344:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fd14a80, transno 4296060616 00000004:00080000:3.0:1721880431.212345:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092a96680, transno 4296060617 00000004:00080000:3.0:1721880431.212347:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092a94380, transno 4296060618 00000004:00080000:3.0:1721880431.212348:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b985c00, transno 4296060619 00000004:00080000:3.0:1721880431.212349:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b82a00, transno 4296060620 00000004:00080000:3.0:1721880431.212350:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d33ea00, transno 4296060621 00000004:00080000:3.0:1721880431.212352:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d33fb80, transno 4296060622 00000004:00080000:3.0:1721880431.212353:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009745e300, transno 4296060623 00000004:00080000:3.0:1721880431.212355:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e47a300, transno 4296060624 00000004:00080000:3.0:1721880431.212356:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e47b480, transno 4296060625 00000004:00080000:3.0:1721880431.212358:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e479f80, transno 4296060626 00000004:00080000:3.0:1721880431.212359:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e479c00, transno 4296060627 00000004:00080000:3.0:1721880431.212361:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009745d880, transno 4296060628 00000004:00080000:3.0:1721880431.212363:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012c884a80, transno 4296060629 00000004:00080000:3.0:1721880431.212365:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e478380, transno 4296060630 00000004:00080000:3.0:1721880431.212366:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012c885f80, transno 4296060631 00000004:00080000:3.0:1721880431.212368:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800997be300, transno 4296060632 00000004:00080000:3.0:1721880431.212369:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098a59c00, transno 4296060633 00000004:00080000:3.0:1721880431.212371:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b67b80, transno 4296060634 00000004:00080000:3.0:1721880431.212373:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f129880, transno 4296060635 00000004:00080000:3.0:1721880431.212374:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f12b480, transno 4296060636 00000004:00080000:3.0:1721880431.212376:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f129f80, transno 4296060637 00000004:00080000:3.0:1721880431.212378:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f128e00, transno 4296060638 00000004:00080000:3.0:1721880431.212379:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092a95f80, transno 4296060639 00000004:00080000:3.0:1721880431.212381:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092a94700, transno 4296060640 00000004:00080000:3.0:1721880431.212382:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e478e00, transno 4296060641 00000004:00080000:3.0:1721880431.212383:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b75ca80, transno 4296060642 00000004:00080000:3.0:1721880431.212385:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bf55c00, transno 4296060643 00000004:00080000:3.0:1721880431.212386:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b83480, transno 4296060644 00000004:00080000:3.0:1721880431.212388:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d33d880, transno 4296060645 00000004:00080000:3.0:1721880431.212389:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b82d80, transno 4296060646 00000004:00080000:3.0:1721880431.212391:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125a6b800, transno 4296060647 00000004:00080000:3.0:1721880431.212392:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cd4d500, transno 4296060648 00000004:00080000:3.0:1721880431.212394:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cd4e680, transno 4296060649 00000004:00080000:3.0:1721880431.212395:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125a69f80, transno 4296060650 00000004:00080000:3.0:1721880431.212396:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cd4f480, transno 4296060651 00000004:00080000:3.0:1721880431.212398:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cd4c380, transno 4296060652 00000004:00080000:3.0:1721880431.212399:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cd4dc00, transno 4296060653 00000004:00080000:3.0:1721880431.212401:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d3b8000, transno 4296060654 00000004:00080000:3.0:1721880431.212402:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f128380, transno 4296060655 00000004:00080000:3.0:1721880431.212403:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cd4d880, transno 4296060656 00000004:00080000:3.0:1721880431.212405:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f12a300, transno 4296060657 00000004:00080000:3.0:1721880431.212406:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cd4f800, transno 4296060658 00000004:00080000:3.0:1721880431.212407:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f128700, transno 4296060659 00000004:00080000:3.0:1721880431.212408:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bf5df80, transno 4296060660 00000004:00080000:3.0:1721880431.212410:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bf5f100, transno 4296060661 00000004:00080000:3.0:1721880431.212411:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bf5ce00, transno 4296060662 00000004:00080000:3.0:1721880431.212413:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bf5ed80, transno 4296060663 00000004:00080000:3.0:1721880431.212414:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bf5fb80, transno 4296060664 00000004:00080000:3.0:1721880431.212416:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bf5dc00, transno 4296060665 00000004:00080000:3.0:1721880431.212418:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125a6a680, transno 4296060666 00000004:00080000:3.0:1721880431.212419:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123a9d180, transno 4296060667 00000004:00080000:3.0:1721880431.212421:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123a9f800, transno 4296060668 00000004:00080000:3.0:1721880431.212422:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cd4fb80, transno 4296060669 00000004:00080000:3.0:1721880431.212423:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cd4ed80, transno 4296060670 00000004:00080000:3.0:1721880431.212424:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f129500, transno 4296060671 00000004:00080000:3.0:1721880431.212426:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b46ea00, transno 4296060672 00000004:00080000:3.0:1721880431.212428:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b46ca80, transno 4296060673 00000004:00080000:3.0:1721880431.212429:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b82300, transno 4296060674 00000004:00080000:3.0:1721880431.212431:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bf57800, transno 4296060675 00000004:00080000:3.0:1721880431.212432:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007294f800, transno 4296060676 00000004:00080000:3.0:1721880431.212434:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b46df80, transno 4296060677 00000004:00080000:3.0:1721880431.212435:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f12b800, transno 4296060678 00000004:00080000:3.0:1721880431.212437:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092a97480, transno 4296060679 00000004:00080000:3.0:1721880431.212438:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b75ed80, transno 4296060680 00000004:00080000:3.0:1721880431.212440:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125a6b480, transno 4296060681 00000004:00080000:3.0:1721880431.212442:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fd99180, transno 4296060682 00000004:00080000:3.0:1721880431.212443:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fd99c00, transno 4296060683 00000004:00080000:3.0:1721880431.212445:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fd9b100, transno 4296060684 00000004:00080000:3.0:1721880431.212447:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012c303800, transno 4296060685 00000004:00080000:3.0:1721880431.212448:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012c302a00, transno 4296060686 00000004:00080000:3.0:1721880431.212450:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012c303b80, transno 4296060687 00000004:00080000:3.0:1721880431.212452:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012c300e00, transno 4296060688 00000004:00080000:3.0:1721880431.212453:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fd98e00, transno 4296060689 00000004:00080000:3.0:1721880431.212454:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085815c00, transno 4296060690 00000004:00080000:3.0:1721880431.212456:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085814380, transno 4296060691 00000004:00080000:3.0:1721880431.212458:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085817800, transno 4296060692 00000004:00080000:3.0:1721880431.212460:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fd99880, transno 4296060693 00000004:00080000:3.0:1721880431.212461:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fd98380, transno 4296060694 00000004:00080000:3.0:1721880431.212462:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085815880, transno 4296060695 00000004:00080000:3.0:1721880431.212464:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bc87b80, transno 4296060696 00000004:00080000:3.0:1721880431.212465:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bc85f80, transno 4296060697 00000004:00080000:3.0:1721880431.212467:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bc87800, transno 4296060698 00000004:00080000:3.0:1721880431.212468:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bc85180, transno 4296060699 00000004:00080000:3.0:1721880431.212469:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bc85c00, transno 4296060700 00000004:00080000:3.0:1721880431.212471:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134e85880, transno 4296060701 00000004:00080000:3.0:1721880431.212473:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bc84e00, transno 4296060702 00000004:00080000:3.0:1721880431.212474:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bc84a80, transno 4296060703 00000004:00080000:3.0:1721880431.212475:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085814700, transno 4296060704 00000004:00080000:3.0:1721880431.212477:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800887f6a00, transno 4296060705 00000004:00080000:3.0:1721880431.212478:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800887f4000, transno 4296060706 00000004:00080000:3.0:1721880431.212480:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800887f4a80, transno 4296060707 00000004:00080000:3.0:1721880431.212482:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800887f5500, transno 4296060708 00000004:00080000:3.0:1721880431.212483:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b414700, transno 4296060709 00000004:00080000:3.0:1721880431.212485:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b6c8700, transno 4296060710 00000004:00080000:3.0:1721880431.212486:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fd99f80, transno 4296060711 00000004:00080000:3.0:1721880431.212488:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b417100, transno 4296060712 00000004:00080000:3.0:1721880431.212489:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b6cb480, transno 4296060713 00000004:00080000:3.0:1721880431.212491:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b6c9180, transno 4296060714 00000004:00080000:3.0:1721880431.212492:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b6cad80, transno 4296060715 00000004:00080000:3.0:1721880431.212494:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134e85f80, transno 4296060716 00000004:00080000:3.0:1721880431.212495:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134e84380, transno 4296060717 00000004:00080000:3.0:1721880431.212497:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cd4ea00, transno 4296060718 00000004:00080000:3.0:1721880431.212498:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009891d880, transno 4296060719 00000004:00080000:3.0:1721880431.212500:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fbc3100, transno 4296060720 00000004:00080000:3.0:1721880431.212502:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800885eca80, transno 4296060721 00000004:00080000:3.0:1721880431.212504:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800885eea00, transno 4296060722 00000004:00080000:3.0:1721880431.212505:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123844700, transno 4296060723 00000004:00080000:3.0:1721880431.212507:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123846d80, transno 4296060724 00000004:00080000:3.0:1721880431.212509:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123845880, transno 4296060725 00000004:00080000:3.0:1721880431.212510:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123845500, transno 4296060726 00000004:00080000:3.0:1721880431.212512:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ea48000, transno 4296060727 00000004:00080000:3.0:1721880431.212513:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ea4b480, transno 4296060728 00000004:00080000:3.0:1721880431.212515:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ea49c00, transno 4296060729 00000004:00080000:3.0:1721880431.212516:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088e02680, transno 4296060730 00000004:00080000:3.0:1721880431.212518:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ea4b800, transno 4296060731 00000004:00080000:3.0:1721880431.212519:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ea49500, transno 4296060732 00000004:00080000:3.0:1721880431.212520:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ea4a680, transno 4296060733 00000004:00080000:3.0:1721880431.212522:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088e00e00, transno 4296060734 00000004:00080000:3.0:1721880431.212524:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ea4aa00, transno 4296060735 00000004:00080000:3.0:1721880431.212525:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800887f6680, transno 4296060736 00000004:00080000:3.0:1721880431.212527:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087558700, transno 4296060737 00000004:00080000:3.0:1721880431.212528:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800887f4700, transno 4296060738 00000004:00080000:3.0:1721880431.212530:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cd4df80, transno 4296060739 00000004:00080000:3.0:1721880431.212531:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800887f5c00, transno 4296060740 00000004:00080000:3.0:1721880431.212533:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123847b80, transno 4296060741 00000004:00080000:3.0:1721880431.212535:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088e03800, transno 4296060742 00000004:00080000:3.0:1721880431.212537:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ea48a80, transno 4296060743 00000004:00080000:3.0:1721880431.212538:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ce11c00, transno 4296060744 00000004:00080000:3.0:1721880431.212540:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ce12a00, transno 4296060745 00000004:00080000:3.0:1721880431.212542:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ce13b80, transno 4296060746 00000004:00080000:3.0:1721880431.212543:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f4a0e00, transno 4296060747 00000004:00080000:3.0:1721880431.212545:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ce13800, transno 4296060748 00000004:00080000:3.0:1721880431.212546:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085899500, transno 4296060749 00000004:00080000:3.0:1721880431.212548:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085898380, transno 4296060750 00000004:00080000:3.0:1721880431.212550:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085899f80, transno 4296060751 00000004:00080000:3.0:1721880431.212551:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008589a300, transno 4296060752 00000004:00080000:3.0:1721880431.212553:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009891ed80, transno 4296060753 00000004:00080000:3.0:1721880431.212554:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009891f480, transno 4296060754 00000004:00080000:3.0:1721880431.212555:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009891e300, transno 4296060755 00000004:00080000:3.0:1721880431.212557:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009891fb80, transno 4296060756 00000004:00080000:3.0:1721880431.212558:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008589b100, transno 4296060757 00000004:00080000:3.0:1721880431.212560:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f4a3480, transno 4296060758 00000004:00080000:3.0:1721880431.212561:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123846a00, transno 4296060759 00000004:00080000:3.0:1721880431.212563:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009891d500, transno 4296060760 00000004:00080000:3.0:1721880431.212565:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123a9c700, transno 4296060761 00000004:00080000:3.0:1721880431.212566:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123a9d880, transno 4296060762 00000004:00080000:3.0:1721880431.212568:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123a9dc00, transno 4296060763 00000004:00080000:3.0:1721880431.212569:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123a9f100, transno 4296060764 00000004:00080000:3.0:1721880431.212571:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085910700, transno 4296060765 00000004:00080000:3.0:1721880431.212572:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123a9f480, transno 4296060766 00000004:00080000:3.0:1721880431.212574:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085910a80, transno 4296060767 00000004:00080000:3.0:1721880431.212575:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085912680, transno 4296060768 00000004:00080000:3.0:1721880431.212576:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f4a0000, transno 4296060769 00000004:00080000:3.0:1721880431.212578:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f4a0a80, transno 4296060770 00000004:00080000:3.0:1721880431.212579:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123846680, transno 4296060771 00000004:00080000:3.0:1721880431.212581:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123845180, transno 4296060772 00000004:00080000:3.0:1721880431.212583:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123844380, transno 4296060773 00000004:00080000:3.0:1721880431.212585:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f4a2680, transno 4296060774 00000004:00080000:3.0:1721880431.212586:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962a8e00, transno 4296060775 00000004:00080000:3.0:1721880431.212588:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962ab800, transno 4296060776 00000004:00080000:3.0:1721880431.212589:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ff5d880, transno 4296060777 00000004:00080000:3.0:1721880431.212591:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b6cbb80, transno 4296060778 00000004:00080000:3.0:1721880431.212592:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009891f800, transno 4296060779 00000004:00080000:3.0:1721880431.212594:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962aa300, transno 4296060780 00000004:00080000:3.0:1721880431.212595:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b6c9880, transno 4296060781 00000004:00080000:3.0:1721880431.212596:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b6cb800, transno 4296060782 00000004:00080000:3.0:1721880431.212598:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123846300, transno 4296060783 00000004:00080000:3.0:1721880431.212599:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b707800, transno 4296060784 00000004:00080000:3.0:1721880431.212601:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008755aa00, transno 4296060785 00000004:00080000:3.0:1721880431.212602:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134e87480, transno 4296060786 00000004:00080000:3.0:1721880431.212604:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f81c700, transno 4296060787 00000004:00080000:3.0:1721880431.212605:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b6ca680, transno 4296060788 00000004:00080000:3.0:1721880431.212607:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f81fb80, transno 4296060789 00000004:00080000:3.0:1721880431.212608:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085912300, transno 4296060790 00000004:00080000:3.0:1721880431.212609:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085913800, transno 4296060791 00000004:00080000:3.0:1721880431.212611:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fbc1c00, transno 4296060792 00000004:00080000:3.0:1721880431.212612:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f81f800, transno 4296060793 00000004:00080000:3.0:1721880431.212613:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f81d180, transno 4296060794 00000004:00080000:3.0:1721880431.212615:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085912d80, transno 4296060795 00000004:00080000:3.0:1721880431.212616:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f81c380, transno 4296060796 00000004:00080000:3.0:1721880431.212617:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f81e680, transno 4296060797 00000004:00080000:3.0:1721880431.212619:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123a9e680, transno 4296060798 00000004:00080000:3.0:1721880431.212620:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f81df80, transno 4296060799 00000004:00080000:3.0:1721880431.212622:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134e86680, transno 4296060800 00000004:00080000:3.0:1721880431.212623:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134e84a80, transno 4296060801 00000004:00080000:3.0:1721880431.212625:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123934380, transno 4296060802 00000004:00080000:3.0:1721880431.212626:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123935f80, transno 4296060803 00000004:00080000:3.0:1721880431.212627:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134e87800, transno 4296060804 00000004:00080000:3.0:1721880431.212629:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123934000, transno 4296060805 00000004:00080000:3.0:1721880431.212630:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134e86300, transno 4296060806 00000004:00080000:3.0:1721880431.212632:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ce12d80, transno 4296060807 00000004:00080000:3.0:1721880431.212633:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b706a00, transno 4296060808 00000004:00080000:3.0:1721880431.212635:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b704700, transno 4296060809 00000004:00080000:3.0:1721880431.212636:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123937b80, transno 4296060810 00000004:00080000:3.0:1721880431.212637:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123936300, transno 4296060811 00000004:00080000:3.0:1721880431.212638:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ea48700, transno 4296060812 00000004:00080000:3.0:1721880431.212639:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b707b80, transno 4296060813 00000004:00080000:3.0:1721880431.212641:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085913b80, transno 4296060814 00000004:00080000:3.0:1721880431.212642:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123936d80, transno 4296060815 00000004:00080000:3.0:1721880431.212644:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800941ead80, transno 4296060816 00000004:00080000:3.0:1721880431.212646:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800941eb480, transno 4296060817 00000004:00080000:3.0:1721880431.212647:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800941ebb80, transno 4296060818 00000004:00080000:3.0:1721880431.212648:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b704e00, transno 4296060819 00000004:00080000:3.0:1721880431.212650:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b6caa00, transno 4296060820 00000004:00080000:3.0:1721880431.212652:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bdead80, transno 4296060821 00000004:00080000:3.0:1721880431.212653:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f81c000, transno 4296060822 00000004:00080000:3.0:1721880431.212655:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800932bb100, transno 4296060823 00000004:00080000:3.0:1721880431.212657:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800932b8e00, transno 4296060824 00000004:00080000:3.0:1721880431.212658:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800932b8a80, transno 4296060825 00000004:00080000:3.0:1721880431.212660:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800932b9c00, transno 4296060826 00000004:00080000:3.0:1721880431.212661:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bde9500, transno 4296060827 00000004:00080000:3.0:1721880431.212663:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008755b480, transno 4296060828 00000004:00080000:3.0:1721880431.212664:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bde8700, transno 4296060829 00000004:00080000:3.0:1721880431.212666:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f81f480, transno 4296060830 00000004:00080000:3.0:1721880431.212668:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800886fdf80, transno 4296060831 00000004:00080000:3.0:1721880431.212671:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087559180, transno 4296060832 00000004:00080000:3.0:1721880431.212672:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087559500, transno 4296060833 00000004:00080000:3.0:1721880431.212674:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f81ce00, transno 4296060834 00000004:00080000:3.0:1721880431.212675:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134946680, transno 4296060835 00000004:00080000:3.0:1721880431.212677:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134947100, transno 4296060836 00000004:00080000:3.0:1721880431.212678:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134946a00, transno 4296060837 00000004:00080000:3.0:1721880431.212680:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134945f80, transno 4296060838 00000004:00080000:3.0:1721880431.212681:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134945500, transno 4296060839 00000004:00080000:3.0:1721880431.212683:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134945c00, transno 4296060840 00000004:00080000:3.0:1721880431.212684:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088e01500, transno 4296060841 00000004:00080000:3.0:1721880431.212686:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009891d180, transno 4296060842 00000004:00080000:3.0:1721880431.212687:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800941eb100, transno 4296060843 00000004:00080000:3.0:1721880431.212688:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134944000, transno 4296060844 00000004:00080000:3.0:1721880431.212690:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800941eaa00, transno 4296060845 00000004:00080000:3.0:1721880431.212691:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f81ea00, transno 4296060846 00000004:00080000:3.0:1721880431.212693:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ea49180, transno 4296060847 00000004:00080000:3.0:1721880431.212694:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008589bb80, transno 4296060848 00000004:00080000:3.0:1721880431.212696:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013514e300, transno 4296060849 00000004:00080000:3.0:1721880431.212698:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013514d500, transno 4296060850 00000004:00080000:3.0:1721880431.212699:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087559880, transno 4296060851 00000004:00080000:3.0:1721880431.212700:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bfd0e00, transno 4296060852 00000004:00080000:3.0:1721880431.212702:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bfd2680, transno 4296060853 00000004:00080000:3.0:1721880431.212703:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bfd3800, transno 4296060854 00000004:00080000:3.0:1721880431.212705:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bdeb100, transno 4296060855 00000004:00080000:3.0:1721880431.212706:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134e87b80, transno 4296060856 00000004:00080000:3.0:1721880431.212708:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b8c6a00, transno 4296060857 00000004:00080000:3.0:1721880431.212709:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ff5ea00, transno 4296060858 00000004:00080000:3.0:1721880431.212711:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b8c6300, transno 4296060859 00000004:00080000:3.0:1721880431.212712:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134e85180, transno 4296060860 00000004:00080000:3.0:1721880431.212714:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b8c5880, transno 4296060861 00000004:00080000:3.0:1721880431.212716:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bde8a80, transno 4296060862 00000004:00080000:3.0:1721880431.212718:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a0291500, transno 4296060863 00000004:00080000:3.0:1721880431.212720:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013514ea00, transno 4296060864 00000004:00080000:3.0:1721880431.212721:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fd0b800, transno 4296060865 00000004:00080000:3.0:1721880431.212723:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fd0b100, transno 4296060866 00000004:00080000:3.0:1721880431.212725:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013514ca80, transno 4296060867 00000004:00080000:3.0:1721880431.212737:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013514f480, transno 4296060868 00000004:00080000:3.0:1721880431.212739:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013514f100, transno 4296060869 00000004:00080000:3.0:1721880431.212741:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013514df80, transno 4296060870 00000004:00080000:3.0:1721880431.212743:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013514dc00, transno 4296060871 00000004:00080000:3.0:1721880431.212744:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009891ce00, transno 4296060872 00000004:00080000:3.0:1721880431.212746:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f4a1c00, transno 4296060873 00000004:00080000:3.0:1721880431.212747:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f81e300, transno 4296060874 00000004:00080000:3.0:1721880431.212749:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b704000, transno 4296060875 00000004:00080000:3.0:1721880431.212751:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962aaa00, transno 4296060876 00000004:00080000:3.0:1721880431.212752:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800941e8a80, transno 4296060877 00000004:00080000:3.0:1721880431.212754:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b704380, transno 4296060878 00000004:00080000:3.0:1721880431.212756:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fd08700, transno 4296060879 00000004:00080000:3.0:1721880431.212757:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123936a00, transno 4296060880 00000004:00080000:3.0:1721880431.212759:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fd09180, transno 4296060881 00000004:00080000:3.0:1721880431.212760:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013514d180, transno 4296060882 00000004:00080000:3.0:1721880431.212762:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013514e680, transno 4296060883 00000004:00080000:3.0:1721880431.212763:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013514ed80, transno 4296060884 00000004:00080000:3.0:1721880431.212764:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bdeaa00, transno 4296060885 00000004:00080000:3.0:1721880431.212766:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a0293100, transno 4296060886 00000004:00080000:3.0:1721880431.212768:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b8c5f80, transno 4296060887 00000004:00080000:3.0:1721880431.212769:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b8c7800, transno 4296060888 00000004:00080000:3.0:1721880431.212771:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a0292d80, transno 4296060889 00000004:00080000:3.0:1721880431.212772:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b8c5500, transno 4296060890 00000004:00080000:3.0:1721880431.212774:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134eb1180, transno 4296060891 00000004:00080000:3.0:1721880431.212776:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008589b800, transno 4296060892 00000004:00080000:3.0:1721880431.212778:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134eb0700, transno 4296060893 00000004:00080000:3.0:1721880431.212780:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134eb0a80, transno 4296060894 00000004:00080000:3.0:1721880431.212781:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134eb1880, transno 4296060895 00000004:00080000:3.0:1721880431.212783:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134eb3800, transno 4296060896 00000004:00080000:3.0:1721880431.212785:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b8c5c00, transno 4296060897 00000004:00080000:3.0:1721880431.212787:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134eb1f80, transno 4296060898 00000004:00080000:3.0:1721880431.212788:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800878d8a80, transno 4296060899 00000004:00080000:3.0:1721880431.212790:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134944700, transno 4296060900 00000004:00080000:3.0:1721880431.212792:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009891ca80, transno 4296060901 00000004:00080000:3.0:1721880431.212793:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800878da680, transno 4296060902 00000004:00080000:3.0:1721880431.212794:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800878db800, transno 4296060903 00000004:00080000:3.0:1721880431.212796:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800878d9880, transno 4296060904 00000004:00080000:3.0:1721880431.212797:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b6ea00, transno 4296060905 00000004:00080000:3.0:1721880431.212799:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134945880, transno 4296060906 00000004:00080000:3.0:1721880431.212801:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b6c000, transno 4296060907 00000004:00080000:3.0:1721880431.212802:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b6d880, transno 4296060908 00000004:00080000:3.0:1721880431.212803:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b6f100, transno 4296060909 00000004:00080000:3.0:1721880431.212805:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123936680, transno 4296060910 00000004:00080000:3.0:1721880431.212806:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fd98700, transno 4296060911 00000004:00080000:3.0:1721880431.212808:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076e09c00, transno 4296060912 00000004:00080000:3.0:1721880431.212810:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962a8000, transno 4296060913 00000004:00080000:3.0:1721880431.212811:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076e08380, transno 4296060914 00000004:00080000:3.0:1721880431.212813:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a0293b80, transno 4296060915 00000004:00080000:3.0:1721880431.212815:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134eb3480, transno 4296060916 00000004:00080000:3.0:1721880431.212816:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076e0b800, transno 4296060917 00000004:00080000:3.0:1721880431.212818:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134eb0000, transno 4296060918 00000004:00080000:3.0:1721880431.212820:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800932bb800, transno 4296060919 00000004:00080000:3.0:1721880431.212821:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ea49f80, transno 4296060920 00000004:00080000:3.0:1721880431.212823:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013514ce00, transno 4296060921 00000004:00080000:3.0:1721880431.212825:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800932bbb80, transno 4296060922 00000004:00080000:3.0:1721880431.212827:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bfd1c00, transno 4296060923 00000004:00080000:3.0:1721880431.212828:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b609880, transno 4296060924 00000004:00080000:3.0:1721880431.212830:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a0290a80, transno 4296060925 00000004:00080000:3.0:1721880431.212832:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800929ce680, transno 4296060926 00000004:00080000:3.0:1721880431.212834:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ccc7100, transno 4296060927 00000004:00080000:3.0:1721880431.212835:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800929cc380, transno 4296060928 00000004:00080000:3.0:1721880431.212837:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800929cca80, transno 4296060929 00000004:00080000:3.0:1721880431.212838:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ccc5c00, transno 4296060930 00000004:00080000:3.0:1721880431.212839:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ccc6a00, transno 4296060931 00000004:00080000:3.0:1721880431.212841:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d285500, transno 4296060932 00000004:00080000:3.0:1721880431.212843:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d284380, transno 4296060933 00000004:00080000:3.0:1721880431.212844:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ccc4380, transno 4296060934 00000004:00080000:3.0:1721880431.212846:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d132a00, transno 4296060935 00000004:00080000:3.0:1721880431.212847:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d131c00, transno 4296060936 00000004:00080000:3.0:1721880431.212849:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d284a80, transno 4296060937 00000004:00080000:3.0:1721880431.212850:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ccc4000, transno 4296060938 00000004:00080000:3.0:1721880431.212851:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ccc6300, transno 4296060939 00000004:00080000:3.0:1721880431.212853:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800929cdf80, transno 4296060940 00000004:00080000:3.0:1721880431.212854:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800929cf800, transno 4296060941 00000004:00080000:3.0:1721880431.212856:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800929cea00, transno 4296060942 00000004:00080000:3.0:1721880431.212857:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bde9c00, transno 4296060943 00000004:00080000:3.0:1721880431.212859:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b60ad80, transno 4296060944 00000004:00080000:3.0:1721880431.212860:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ccc6d80, transno 4296060945 00000004:00080000:3.0:1721880431.212882:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a0291880, transno 4296060946 00000004:00080000:3.0:1721880431.212884:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b608a80, transno 4296060947 00000004:00080000:3.0:1721880431.212885:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800929cd180, transno 4296060948 00000004:00080000:3.0:1721880431.212886:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134eb2680, transno 4296060949 00000004:00080000:3.0:1721880431.212889:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b6fb80, transno 4296060950 00000004:00080000:3.0:1721880431.212890:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b6e680, transno 4296060951 00000004:00080000:3.0:1721880431.212893:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800918a1500, transno 4296060952 00000004:00080000:3.0:1721880431.212895:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b6e300, transno 4296060953 00000004:00080000:3.0:1721880431.212896:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b6df80, transno 4296060954 00000004:00080000:3.0:1721880431.212898:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fd09f80, transno 4296060955 00000004:00080000:3.0:1721880431.212900:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134946d80, transno 4296060956 00000004:00080000:3.0:1721880431.212901:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b6c380, transno 4296060957 00000004:00080000:3.0:1721880431.212903:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076e09180, transno 4296060958 00000004:00080000:3.0:1721880431.212905:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095288e00, transno 4296060959 00000004:00080000:3.0:1721880431.212906:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076e08700, transno 4296060960 00000004:00080000:3.0:1721880431.212908:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b608380, transno 4296060961 00000004:00080000:3.0:1721880431.212909:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ccc5880, transno 4296060962 00000004:00080000:3.0:1721880431.212911:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800932b9500, transno 4296060963 00000004:00080000:3.0:1721880431.212912:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076e09f80, transno 4296060964 00000004:00080000:3.0:1721880431.212914:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076e08a80, transno 4296060965 00000004:00080000:3.0:1721880431.212915:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d284e00, transno 4296060966 00000004:00080000:3.0:1721880431.212916:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d284700, transno 4296060967 00000004:00080000:3.0:1721880431.212918:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ccc7b80, transno 4296060968 00000004:00080000:3.0:1721880431.212919:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096e5ad80, transno 4296060969 00000004:00080000:3.0:1721880431.212921:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096e5a300, transno 4296060970 00000004:00080000:3.0:1721880431.212922:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096e59880, transno 4296060971 00000004:00080000:3.0:1721880431.212924:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009528b800, transno 4296060972 00000004:00080000:3.0:1721880431.212925:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800918a2300, transno 4296060973 00000004:00080000:3.0:1721880431.212927:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800918a1180, transno 4296060974 00000004:00080000:3.0:1721880431.212929:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b6ed80, transno 4296060975 00000004:00080000:3.0:1721880431.212930:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094661500, transno 4296060976 00000004:00080000:3.0:1721880431.212932:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b6d180, transno 4296060977 00000004:00080000:3.0:1721880431.212934:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800918a3800, transno 4296060978 00000004:00080000:3.0:1721880431.212935:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094660700, transno 4296060979 00000004:00080000:3.0:1721880431.212937:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096e59500, transno 4296060980 00000004:00080000:3.0:1721880431.212938:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800918a0a80, transno 4296060981 00000004:00080000:3.0:1721880431.212941:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ccc4a80, transno 4296060982 00000004:00080000:3.0:1721880431.212943:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b60a300, transno 4296060983 00000004:00080000:3.0:1721880431.212945:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b60b480, transno 4296060984 00000004:00080000:3.0:1721880431.212946:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bfd3100, transno 4296060985 00000004:00080000:3.0:1721880431.212948:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085a6bb80, transno 4296060986 00000004:00080000:3.0:1721880431.212949:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076e09880, transno 4296060987 00000004:00080000:3.0:1721880431.212951:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b60b800, transno 4296060988 00000004:00080000:3.0:1721880431.212952:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800918a1880, transno 4296060989 00000004:00080000:3.0:1721880431.212954:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096e5b800, transno 4296060990 00000004:00080000:3.0:1721880431.212955:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096e58700, transno 4296060991 00000004:00080000:3.0:1721880431.212957:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b60b100, transno 4296060992 00000004:00080000:3.0:1721880431.212958:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e89b100, transno 4296060993 00000004:00080000:3.0:1721880431.212960:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d287b80, transno 4296060994 00000004:00080000:3.0:1721880431.212962:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e89aa00, transno 4296060995 00000004:00080000:3.0:1721880431.212964:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e89bb80, transno 4296060996 00000004:00080000:3.0:1721880431.212965:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800918a1c00, transno 4296060997 00000004:00080000:3.0:1721880431.212967:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123913480, transno 4296060998 00000004:00080000:3.0:1721880431.212969:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094663480, transno 4296060999 00000004:00080000:3.0:1721880431.212971:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094660000, transno 4296061000 00000004:00080000:3.0:1721880431.212972:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094660380, transno 4296061001 00000004:00080000:3.0:1721880431.212973:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094662300, transno 4296061002 00000004:00080000:3.0:1721880431.212975:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094663800, transno 4296061003 00000004:00080000:3.0:1721880431.212976:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094661c00, transno 4296061004 00000004:00080000:3.0:1721880431.212977:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801348c0a80, transno 4296061005 00000004:00080000:3.0:1721880431.212979:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f41bb80, transno 4296061006 00000004:00080000:3.0:1721880431.212981:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087925880, transno 4296061007 00000004:00080000:3.0:1721880431.212983:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087926680, transno 4296061008 00000004:00080000:3.0:1721880431.212985:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800981e0380, transno 4296061009 00000004:00080000:3.0:1721880431.212987:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087927b80, transno 4296061010 00000004:00080000:3.0:1721880431.212988:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801348c3800, transno 4296061011 00000004:00080000:3.0:1721880431.212990:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f418700, transno 4296061012 00000004:00080000:3.0:1721880431.212992:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801348c2a00, transno 4296061013 00000004:00080000:3.0:1721880431.212993:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801348c1180, transno 4296061014 00000004:00080000:3.0:1721880431.212994:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801348c3b80, transno 4296061015 00000004:00080000:3.0:1721880431.212995:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801348c2d80, transno 4296061016 00000004:00080000:3.0:1721880431.212997:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135029c00, transno 4296061017 00000004:00080000:3.0:1721880431.212998:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135028700, transno 4296061018 00000004:00080000:3.0:1721880431.213000:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135300e00, transno 4296061019 00000004:00080000:3.0:1721880431.213002:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135302300, transno 4296061020 00000004:00080000:3.0:1721880431.213003:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135303100, transno 4296061021 00000004:00080000:3.0:1721880431.213004:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096e58a80, transno 4296061022 00000004:00080000:3.0:1721880431.213006:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096e58000, transno 4296061023 00000004:00080000:3.0:1721880431.213007:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800981e0000, transno 4296061024 00000004:00080000:3.0:1721880431.213009:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800981e2a00, transno 4296061025 00000004:00080000:3.0:1721880431.213010:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076e0aa00, transno 4296061026 00000004:00080000:3.0:1721880431.213012:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076e0b480, transno 4296061027 00000004:00080000:3.0:1721880431.213013:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f41aa00, transno 4296061028 00000004:00080000:3.0:1721880431.213015:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f419c00, transno 4296061029 00000004:00080000:3.0:1721880431.213016:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800981e1500, transno 4296061030 00000004:00080000:3.0:1721880431.213018:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800981e3b80, transno 4296061031 00000004:00080000:3.0:1721880431.213019:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800981e3100, transno 4296061032 00000004:00080000:3.0:1721880431.213021:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d284000, transno 4296061033 00000004:00080000:3.0:1721880431.213022:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085a6ad80, transno 4296061034 00000004:00080000:3.0:1721880431.213024:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085a6b480, transno 4296061035 00000004:00080000:3.0:1721880431.213026:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085a6b800, transno 4296061036 00000004:00080000:3.0:1721880431.213027:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085a69f80, transno 4296061037 00000004:00080000:3.0:1721880431.213029:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d310380, transno 4296061038 00000004:00080000:3.0:1721880431.213031:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d311c00, transno 4296061039 00000004:00080000:3.0:1721880431.213032:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085a69c00, transno 4296061040 00000004:00080000:3.0:1721880431.213034:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099aae680, transno 4296061041 00000004:00080000:3.0:1721880431.213036:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801349e6680, transno 4296061042 00000004:00080000:3.0:1721880431.213038:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801349e5500, transno 4296061043 00000004:00080000:3.0:1721880431.213040:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801349e6300, transno 4296061044 00000004:00080000:3.0:1721880431.213042:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a03c2a00, transno 4296061045 00000004:00080000:3.0:1721880431.213043:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a03c1180, transno 4296061046 00000004:00080000:3.0:1721880431.213045:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a03c2680, transno 4296061047 00000004:00080000:3.0:1721880431.213047:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a03c0380, transno 4296061048 00000004:00080000:3.0:1721880431.213048:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a03c1880, transno 4296061049 00000004:00080000:3.0:1721880431.213049:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801349e5c00, transno 4296061050 00000004:00080000:3.0:1721880431.213051:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801349e5180, transno 4296061051 00000004:00080000:3.0:1721880431.213053:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135088e00, transno 4296061052 00000004:00080000:3.0:1721880431.213054:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013508b480, transno 4296061053 00000004:00080000:3.0:1721880431.213056:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013508aa00, transno 4296061054 00000004:00080000:3.0:1721880431.213057:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d40fb80, transno 4296061055 00000004:00080000:3.0:1721880431.213059:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d40ea00, transno 4296061056 00000004:00080000:3.0:1721880431.213060:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d40ed80, transno 4296061057 00000004:00080000:3.0:1721880431.213061:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d40ca80, transno 4296061058 00000004:00080000:3.0:1721880431.213063:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d40d180, transno 4296061059 00000004:00080000:3.0:1721880431.213065:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d310700, transno 4296061060 00000004:00080000:3.0:1721880431.213066:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d40f100, transno 4296061061 00000004:00080000:3.0:1721880431.213068:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d313800, transno 4296061062 00000004:00080000:3.0:1721880431.213069:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d310000, transno 4296061063 00000004:00080000:3.0:1721880431.213070:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d311880, transno 4296061064 00000004:00080000:3.0:1721880431.213072:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085a6a300, transno 4296061065 00000004:00080000:3.0:1721880431.213073:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085a68380, transno 4296061066 00000004:00080000:3.0:1721880431.213075:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008599c380, transno 4296061067 00000004:00080000:3.0:1721880431.213076:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008599e680, transno 4296061068 00000004:00080000:3.0:1721880431.213078:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008599dc00, transno 4296061069 00000004:00080000:3.0:1721880431.213080:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d312d80, transno 4296061070 00000004:00080000:3.0:1721880431.213081:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084ee2680, transno 4296061071 00000004:00080000:3.0:1721880431.213083:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085a6b100, transno 4296061072 00000004:00080000:3.0:1721880431.213085:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008599ce00, transno 4296061073 00000004:00080000:3.0:1721880431.213087:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d313100, transno 4296061074 00000004:00080000:3.0:1721880431.213088:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800911a9880, transno 4296061075 00000004:00080000:3.0:1721880431.213090:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800911ab100, transno 4296061076 00000004:00080000:3.0:1721880431.213092:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085a68000, transno 4296061077 00000004:00080000:3.0:1721880431.213093:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801349e4a80, transno 4296061078 00000004:00080000:3.0:1721880431.213095:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800911a9c00, transno 4296061079 00000004:00080000:3.0:1721880431.213096:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800911a9f80, transno 4296061080 00000004:00080000:3.0:1721880431.213098:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800911a8380, transno 4296061081 00000004:00080000:3.0:1721880431.213099:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135088000, transno 4296061082 00000004:00080000:3.0:1721880431.213101:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800911aa300, transno 4296061083 00000004:00080000:3.0:1721880431.213102:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a03c1500, transno 4296061084 00000004:00080000:3.0:1721880431.213104:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800911ab800, transno 4296061085 00000004:00080000:3.0:1721880431.213105:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800911ab480, transno 4296061086 00000004:00080000:3.0:1721880431.213106:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962d9500, transno 4296061087 00000004:00080000:3.0:1721880431.213108:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962db800, transno 4296061088 00000004:00080000:3.0:1721880431.213110:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962d8380, transno 4296061089 00000004:00080000:3.0:1721880431.213111:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962d8e00, transno 4296061090 00000004:00080000:3.0:1721880431.213112:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962da680, transno 4296061091 00000004:00080000:3.0:1721880431.213114:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962d8700, transno 4296061092 00000004:00080000:3.0:1721880431.213116:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a03c0a80, transno 4296061093 00000004:00080000:3.0:1721880431.213117:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a03c1c00, transno 4296061094 00000004:00080000:3.0:1721880431.213119:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131eb2680, transno 4296061095 00000004:00080000:3.0:1721880431.213120:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131eb1880, transno 4296061096 00000004:00080000:3.0:1721880431.213122:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131eb0e00, transno 4296061097 00000004:00080000:3.0:1721880431.213123:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131eb1180, transno 4296061098 00000004:00080000:3.0:1721880431.213124:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131eb0a80, transno 4296061099 00000004:00080000:3.0:1721880431.213126:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d40c000, transno 4296061100 00000004:00080000:3.0:1721880431.213127:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131eb3800, transno 4296061101 00000004:00080000:3.0:1721880431.213129:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131eb3100, transno 4296061102 00000004:00080000:3.0:1721880431.213130:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131eb2d80, transno 4296061103 00000004:00080000:3.0:1721880431.213132:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008eba3b80, transno 4296061104 00000004:00080000:3.0:1721880431.213133:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008eba3100, transno 4296061105 00000004:00080000:3.0:1721880431.213135:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a07b4a80, transno 4296061106 00000004:00080000:3.0:1721880431.213136:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a07b7b80, transno 4296061107 00000004:00080000:3.0:1721880431.213138:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095d6c000, transno 4296061108 00000004:00080000:3.0:1721880431.213139:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a07b6680, transno 4296061109 00000004:00080000:3.0:1721880431.213141:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095d6ca80, transno 4296061110 00000004:00080000:3.0:1721880431.213142:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008eba1500, transno 4296061111 00000004:00080000:3.0:1721880431.213144:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008eba1c00, transno 4296061112 00000004:00080000:3.0:1721880431.213145:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084ee0700, transno 4296061113 00000004:00080000:3.0:1721880431.213147:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008eba2d80, transno 4296061114 00000004:00080000:3.0:1721880431.213148:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134d01c00, transno 4296061115 00000004:00080000:3.0:1721880431.213150:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085a4e300, transno 4296061116 00000004:00080000:3.0:1721880431.213152:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084ee3480, transno 4296061117 00000004:00080000:3.0:1721880431.213153:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084ee1f80, transno 4296061118 00000004:00080000:3.0:1721880431.213155:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084ee2300, transno 4296061119 00000004:00080000:3.0:1721880431.213157:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084ee3100, transno 4296061120 00000004:00080000:3.0:1721880431.213159:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085a4f480, transno 4296061121 00000004:00080000:3.0:1721880431.213160:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085a4ea00, transno 4296061122 00000004:00080000:3.0:1721880431.213162:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085a4d180, transno 4296061123 00000004:00080000:3.0:1721880431.213163:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085a4fb80, transno 4296061124 00000004:00080000:3.0:1721880431.213164:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008eba3480, transno 4296061125 00000004:00080000:3.0:1721880431.213166:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962dad80, transno 4296061126 00000004:00080000:3.0:1721880431.213168:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095d6ea00, transno 4296061127 00000004:00080000:3.0:1721880431.213169:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962d8a80, transno 4296061128 00000004:00080000:3.0:1721880431.213171:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085a4d880, transno 4296061129 00000004:00080000:3.0:1721880431.213172:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f9b2300, transno 4296061130 00000004:00080000:3.0:1721880431.213174:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962d9880, transno 4296061131 00000004:00080000:3.0:1721880431.213176:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f9b1f80, transno 4296061132 00000004:00080000:3.0:1721880431.213177:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134d03100, transno 4296061133 00000004:00080000:3.0:1721880431.213179:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131eb0000, transno 4296061134 00000004:00080000:3.0:1721880431.213180:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f9b1c00, transno 4296061135 00000004:00080000:3.0:1721880431.213182:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135089500, transno 4296061136 00000004:00080000:3.0:1721880431.213183:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f9b1500, transno 4296061137 00000004:00080000:3.0:1721880431.213185:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800911a8a80, transno 4296061138 00000004:00080000:3.0:1721880431.213186:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f9b2d80, transno 4296061139 00000004:00080000:3.0:1721880431.213188:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008599fb80, transno 4296061140 00000004:00080000:3.0:1721880431.213189:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009db71f80, transno 4296061141 00000004:00080000:3.0:1721880431.213191:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009db72680, transno 4296061142 00000004:00080000:3.0:1721880431.213192:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008599d880, transno 4296061143 00000004:00080000:3.0:1721880431.213194:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d312680, transno 4296061144 00000004:00080000:3.0:1721880431.213195:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fc50700, transno 4296061145 00000004:00080000:3.0:1721880431.213196:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f9b1880, transno 4296061146 00000004:00080000:3.0:1721880431.213198:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f9b0a80, transno 4296061147 00000004:00080000:3.0:1721880431.213199:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f9b0380, transno 4296061148 00000004:00080000:3.0:1721880431.213201:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f9b2a00, transno 4296061149 00000004:00080000:3.0:1721880431.213202:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f9b3b80, transno 4296061150 00000004:00080000:3.0:1721880431.213203:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085a4ed80, transno 4296061151 00000004:00080000:3.0:1721880431.213204:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f9b2680, transno 4296061152 00000004:00080000:3.0:1721880431.213206:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801349e6d80, transno 4296061153 00000004:00080000:3.0:1721880431.213207:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a07b7100, transno 4296061154 00000004:00080000:3.0:1721880431.213209:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801349e7480, transno 4296061155 00000004:00080000:3.0:1721880431.213211:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084ee2a00, transno 4296061156 00000004:00080000:3.0:1721880431.213212:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b6aa00, transno 4296061157 00000004:00080000:3.0:1721880431.213214:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b6b800, transno 4296061158 00000004:00080000:3.0:1721880431.213216:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b69500, transno 4296061159 00000004:00080000:3.0:1721880431.213217:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b69f80, transno 4296061160 00000004:00080000:3.0:1721880431.213219:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e4aa300, transno 4296061161 00000004:00080000:3.0:1721880431.213221:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e4a9880, transno 4296061162 00000004:00080000:3.0:1721880431.213223:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e4abb80, transno 4296061163 00000004:00080000:3.0:1721880431.213225:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b69c00, transno 4296061164 00000004:00080000:3.0:1721880431.213226:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fc53100, transno 4296061165 00000004:00080000:3.0:1721880431.213228:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fc50000, transno 4296061166 00000004:00080000:3.0:1721880431.213229:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a07b5f80, transno 4296061167 00000004:00080000:3.0:1721880431.213231:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e4aa680, transno 4296061168 00000004:00080000:3.0:1721880431.213232:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008eba0700, transno 4296061169 00000004:00080000:3.0:1721880431.213233:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b69180, transno 4296061170 00000004:00080000:3.0:1721880431.213235:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f9b1180, transno 4296061171 00000004:00080000:3.0:1721880431.213236:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e4ab480, transno 4296061172 00000004:00080000:3.0:1721880431.213237:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fc53800, transno 4296061173 00000004:00080000:3.0:1721880431.213238:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fc52680, transno 4296061174 00000004:00080000:3.0:1721880431.213240:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085a69180, transno 4296061175 00000004:00080000:3.0:1721880431.213242:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fc50380, transno 4296061176 00000004:00080000:3.0:1721880431.213243:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008791c000, transno 4296061177 00000004:00080000:3.0:1721880431.213245:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135089c00, transno 4296061178 00000004:00080000:3.0:1721880431.213246:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134d00e00, transno 4296061179 00000004:00080000:3.0:1721880431.213247:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009db73b80, transno 4296061180 00000004:00080000:3.0:1721880431.213249:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009db73480, transno 4296061181 00000004:00080000:3.0:1721880431.213250:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962da300, transno 4296061182 00000004:00080000:3.0:1721880431.213252:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962daa00, transno 4296061183 00000004:00080000:3.0:1721880431.213253:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962d8000, transno 4296061184 00000004:00080000:3.0:1721880431.213254:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088d7df80, transno 4296061185 00000004:00080000:3.0:1721880431.213255:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085830a80, transno 4296061186 00000004:00080000:3.0:1721880431.213257:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088d7dc00, transno 4296061187 00000004:00080000:3.0:1721880431.213258:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c4e6d80, transno 4296061188 00000004:00080000:3.0:1721880431.213260:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c4e7800, transno 4296061189 00000004:00080000:3.0:1721880431.213261:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c4e6680, transno 4296061190 00000004:00080000:3.0:1721880431.213263:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800912f0000, transno 4296061191 00000004:00080000:3.0:1721880431.213266:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800912f1c00, transno 4296061192 00000004:00080000:3.0:1721880431.213267:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800912f2680, transno 4296061193 00000004:00080000:3.0:1721880431.213269:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800912f3800, transno 4296061194 00000004:00080000:3.0:1721880431.213271:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800912f3b80, transno 4296061195 00000004:00080000:3.0:1721880431.213272:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800912f3480, transno 4296061196 00000004:00080000:3.0:1721880431.213274:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800912f1f80, transno 4296061197 00000004:00080000:3.0:1721880431.213275:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fa1d880, transno 4296061198 00000004:00080000:3.0:1721880431.213277:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800912f0700, transno 4296061199 00000004:00080000:3.0:1721880431.213279:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011efd2300, transno 4296061200 00000004:00080000:3.0:1721880431.213280:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095173800, transno 4296061201 00000004:00080000:3.0:1721880431.213282:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095173100, transno 4296061202 00000004:00080000:3.0:1721880431.213283:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f79ea00, transno 4296061203 00000004:00080000:3.0:1721880431.213285:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f79d880, transno 4296061204 00000004:00080000:3.0:1721880431.213287:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fa1df80, transno 4296061205 00000004:00080000:3.0:1721880431.213288:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f79e300, transno 4296061206 00000004:00080000:3.0:1721880431.213289:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fa1c700, transno 4296061207 00000004:00080000:3.0:1721880431.213291:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095170a80, transno 4296061208 00000004:00080000:3.0:1721880431.213292:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fa1e300, transno 4296061209 00000004:00080000:3.0:1721880431.213293:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fa1f100, transno 4296061210 00000004:00080000:3.0:1721880431.213295:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c4e7b80, transno 4296061211 00000004:00080000:3.0:1721880431.213296:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085831c00, transno 4296061212 00000004:00080000:3.0:1721880431.213297:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c4e6a00, transno 4296061213 00000004:00080000:3.0:1721880431.213299:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fa1ce00, transno 4296061214 00000004:00080000:3.0:1721880431.213300:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fa1ca80, transno 4296061215 00000004:00080000:3.0:1721880431.213301:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fa1e680, transno 4296061216 00000004:00080000:3.0:1721880431.213302:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135089880, transno 4296061217 00000004:00080000:3.0:1721880431.213304:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fa1ea00, transno 4296061218 00000004:00080000:3.0:1721880431.213305:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095204700, transno 4296061219 00000004:00080000:3.0:1721880431.213306:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095206d80, transno 4296061220 00000004:00080000:3.0:1721880431.213308:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095205180, transno 4296061221 00000004:00080000:3.0:1721880431.213322:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012bd09c00, transno 4296061222 00000004:00080000:3.0:1721880431.213324:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fba8000, transno 4296061223 00000004:00080000:3.0:1721880431.213325:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088887100, transno 4296061224 00000004:00080000:3.0:1721880431.213327:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fba8380, transno 4296061225 00000004:00080000:3.0:1721880431.213328:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099ad6d80, transno 4296061226 00000004:00080000:3.0:1721880431.213330:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095205f80, transno 4296061227 00000004:00080000:3.0:1721880431.213331:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fbb4700, transno 4296061228 00000004:00080000:3.0:1721880431.213333:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099ad5500, transno 4296061229 00000004:00080000:3.0:1721880431.213334:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fbab480, transno 4296061230 00000004:00080000:3.0:1721880431.213336:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fbb4380, transno 4296061231 00000004:00080000:3.0:1721880431.213337:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fbb5f80, transno 4296061232 00000004:00080000:3.0:1721880431.213338:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099ad7b80, transno 4296061233 00000004:00080000:3.0:1721880431.213340:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088884000, transno 4296061234 00000004:00080000:3.0:1721880431.213341:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008eba1880, transno 4296061235 00000004:00080000:3.0:1721880431.213343:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fbaa300, transno 4296061236 00000004:00080000:3.0:1721880431.213344:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012bd0b800, transno 4296061237 00000004:00080000:3.0:1721880431.213346:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095204000, transno 4296061238 00000004:00080000:3.0:1721880431.213347:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009db73100, transno 4296061239 00000004:00080000:3.0:1721880431.213348:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095205880, transno 4296061240 00000004:00080000:3.0:1721880431.213350:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012bc2f800, transno 4296061241 00000004:00080000:3.0:1721880431.213352:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095207b80, transno 4296061242 00000004:00080000:3.0:1721880431.213353:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fa1c000, transno 4296061243 00000004:00080000:3.0:1721880431.213354:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099ad4000, transno 4296061244 00000004:00080000:3.0:1721880431.213356:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800912f1180, transno 4296061245 00000004:00080000:3.0:1721880431.213358:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099ad7800, transno 4296061246 00000004:00080000:3.0:1721880431.213359:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099ad6300, transno 4296061247 00000004:00080000:3.0:1721880431.213361:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099ad6a00, transno 4296061248 00000004:00080000:3.0:1721880431.213362:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800912f3100, transno 4296061249 00000004:00080000:3.0:1721880431.213364:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800912f1500, transno 4296061250 00000004:00080000:3.0:1721880431.213365:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135754000, transno 4296061251 00000004:00080000:3.0:1721880431.213367:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801349e7100, transno 4296061252 00000004:00080000:3.0:1721880431.213369:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135755880, transno 4296061253 00000004:00080000:3.0:1721880431.213371:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135757b80, transno 4296061254 00000004:00080000:3.0:1721880431.213372:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011efd0e00, transno 4296061255 00000004:00080000:3.0:1721880431.213374:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011efd0a80, transno 4296061256 00000004:00080000:3.0:1721880431.213375:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135754a80, transno 4296061257 00000004:00080000:3.0:1721880431.213377:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011efd0380, transno 4296061258 00000004:00080000:3.0:1721880431.213379:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011efd1880, transno 4296061259 00000004:00080000:3.0:1721880431.213380:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095206300, transno 4296061260 00000004:00080000:3.0:1721880431.213382:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ef29500, transno 4296061261 00000004:00080000:3.0:1721880431.213383:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ef2aa00, transno 4296061262 00000004:00080000:3.0:1721880431.213384:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012bd0a300, transno 4296061263 00000004:00080000:3.0:1721880431.213386:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fba9180, transno 4296061264 00000004:00080000:3.0:1721880431.213387:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ef2b480, transno 4296061265 00000004:00080000:3.0:1721880431.213389:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012bd0bb80, transno 4296061266 00000004:00080000:3.0:1721880431.213390:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012bd0ad80, transno 4296061267 00000004:00080000:3.0:1721880431.213392:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fbaa680, transno 4296061268 00000004:00080000:3.0:1721880431.213393:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d40f800, transno 4296061269 00000004:00080000:3.0:1721880431.213394:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088d7ea00, transno 4296061270 00000004:00080000:3.0:1721880431.213396:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088d7c380, transno 4296061271 00000004:00080000:3.0:1721880431.213397:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f79c000, transno 4296061272 00000004:00080000:3.0:1721880431.213399:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095172a00, transno 4296061273 00000004:00080000:3.0:1721880431.213400:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f79df80, transno 4296061274 00000004:00080000:3.0:1721880431.213402:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096001f80, transno 4296061275 00000004:00080000:3.0:1721880431.213403:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f79f100, transno 4296061276 00000004:00080000:3.0:1721880431.213405:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096000a80, transno 4296061277 00000004:00080000:3.0:1721880431.213407:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131079f80, transno 4296061278 00000004:00080000:3.0:1721880431.213408:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095170380, transno 4296061279 00000004:00080000:3.0:1721880431.213410:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131079500, transno 4296061280 00000004:00080000:3.0:1721880431.213412:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013107bb80, transno 4296061281 00000004:00080000:3.0:1721880431.213414:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088d7ca80, transno 4296061282 00000004:00080000:3.0:1721880431.213416:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f828e00, transno 4296061283 00000004:00080000:3.0:1721880431.213418:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f82bb80, transno 4296061284 00000004:00080000:3.0:1721880431.213420:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f82b100, transno 4296061285 00000004:00080000:3.0:1721880431.213421:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f829c00, transno 4296061286 00000004:00080000:3.0:1721880431.213422:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f82ad80, transno 4296061287 00000004:00080000:3.0:1721880431.213424:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880132c62300, transno 4296061288 00000004:00080000:3.0:1721880431.213426:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880132c60380, transno 4296061289 00000004:00080000:3.0:1721880431.213428:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801303b5180, transno 4296061290 00000004:00080000:3.0:1721880431.213431:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088d7fb80, transno 4296061291 00000004:00080000:3.0:1721880431.213434:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880132c60e00, transno 4296061292 00000004:00080000:3.0:1721880431.213436:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fba8a80, transno 4296061293 00000004:00080000:3.0:1721880431.213438:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012bd09500, transno 4296061294 00000004:00080000:3.0:1721880431.213441:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bea0a80, transno 4296061295 00000004:00080000:3.0:1721880431.213443:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012bd09f80, transno 4296061296 00000004:00080000:3.0:1721880431.213445:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013608b100, transno 4296061297 00000004:00080000:3.0:1721880431.213448:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013608aa00, transno 4296061298 00000004:00080000:3.0:1721880431.213451:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880136088380, transno 4296061299 00000004:00080000:3.0:1721880431.213453:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fbb7800, transno 4296061300 00000004:00080000:3.0:1721880431.213456:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f82a300, transno 4296061301 00000004:00080000:3.0:1721880431.213458:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f829180, transno 4296061302 00000004:00080000:3.0:1721880431.213461:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f82b480, transno 4296061303 00000004:00080000:3.0:1721880431.213463:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801303b4700, transno 4296061304 00000004:00080000:3.0:1721880431.213466:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012ce11500, transno 4296061305 00000004:00080000:3.0:1721880431.213469:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012ce10a80, transno 4296061306 00000004:00080000:3.0:1721880431.213471:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ef28e00, transno 4296061307 00000004:00080000:3.0:1721880431.213473:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012ce13100, transno 4296061308 00000004:00080000:3.0:1721880431.213476:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012ce11180, transno 4296061309 00000004:00080000:3.0:1721880431.213479:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880136089f80, transno 4296061310 00000004:00080000:3.0:1721880431.213481:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801303b6a00, transno 4296061311 00000004:00080000:3.0:1721880431.213484:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012edb0000, transno 4296061312 00000004:00080000:3.0:1721880431.213487:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012edb3b80, transno 4296061313 00000004:00080000:3.0:1721880431.213489:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012edb3480, transno 4296061314 00000004:00080000:3.0:1721880431.213492:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088884e00, transno 4296061315 00000004:00080000:3.0:1721880431.213494:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012bd0a680, transno 4296061316 00000004:00080000:3.0:1721880431.213497:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ef2b100, transno 4296061317 00000004:00080000:3.0:1721880431.213500:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ef2ad80, transno 4296061318 00000004:00080000:3.0:1721880431.213502:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008791c700, transno 4296061319 00000004:00080000:3.0:1721880431.213505:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135755500, transno 4296061320 00000004:00080000:3.0:1721880431.213508:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c734e00, transno 4296061321 00000004:00080000:3.0:1721880431.213511:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c734380, transno 4296061322 00000004:00080000:3.0:1721880431.213513:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c734a80, transno 4296061323 00000004:00080000:3.0:1721880431.213516:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c735880, transno 4296061324 00000004:00080000:3.0:1721880431.213519:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009db71500, transno 4296061325 00000004:00080000:3.0:1721880431.213521:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012ce10e00, transno 4296061326 00000004:00080000:3.0:1721880431.213524:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012ce12680, transno 4296061327 00000004:00080000:3.0:1721880431.213527:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801355e2a00, transno 4296061328 00000004:00080000:3.0:1721880431.213530:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801355e3480, transno 4296061329 00000004:00080000:3.0:1721880431.213532:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801355e1880, transno 4296061330 00000004:00080000:3.0:1721880431.213535:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801355e3100, transno 4296061331 00000004:00080000:3.0:1721880431.213537:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880132c63800, transno 4296061332 00000004:00080000:3.0:1721880431.213540:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e22ce00, transno 4296061333 00000004:00080000:3.0:1721880431.213543:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012bc2c380, transno 4296061334 00000004:00080000:3.0:1721880431.213545:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012bc2d500, transno 4296061335 00000004:00080000:3.0:1721880431.213548:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011efd1500, transno 4296061336 00000004:00080000:3.0:1721880431.213550:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a4b8380, transno 4296061337 00000004:00080000:3.0:1721880431.213553:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095207800, transno 4296061338 00000004:00080000:3.0:1721880431.213555:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095171880, transno 4296061339 00000004:00080000:3.0:1721880431.213558:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a4b8000, transno 4296061340 00000004:00080000:3.0:1721880431.213560:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095173b80, transno 4296061341 00000004:00080000:3.0:1721880431.213563:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880132c61f80, transno 4296061342 00000004:00080000:3.0:1721880431.213567:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880132c60a80, transno 4296061343 00000004:00080000:3.0:1721880431.213569:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095172d80, transno 4296061344 00000004:00080000:3.0:1721880431.213572:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880132c61180, transno 4296061345 00000004:00080000:3.0:1721880431.213574:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012cfbad80, transno 4296061346 00000004:00080000:3.0:1721880431.213577:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012ce10700, transno 4296061347 00000004:00080000:3.0:1721880431.213580:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012ce12d80, transno 4296061348 00000004:00080000:3.0:1721880431.213582:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a4b9f80, transno 4296061349 00000004:00080000:3.0:1721880431.213585:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a4bbb80, transno 4296061350 00000004:00080000:3.0:1721880431.213587:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a4bad80, transno 4296061351 00000004:00080000:3.0:1721880431.213590:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012ce12300, transno 4296061352 00000004:00080000:3.0:1721880431.213592:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800912f1880, transno 4296061353 00000004:00080000:3.0:1721880431.213595:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008eba0a80, transno 4296061354 00000004:00080000:3.0:1721880431.213597:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012bc2d880, transno 4296061355 00000004:00080000:3.0:1721880431.213600:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800956c9c00, transno 4296061356 00000004:00080000:3.0:1721880431.213603:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800956cb480, transno 4296061357 00000004:00080000:3.0:1721880431.213605:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800956caa00, transno 4296061358 00000004:00080000:3.0:1721880431.213608:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a4b9500, transno 4296061359 00000004:00080000:3.0:1721880431.213611:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009be5ad80, transno 4296061360 00000004:00080000:3.0:1721880431.213614:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009be58a80, transno 4296061361 00000004:00080000:3.0:1721880431.213616:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009be58380, transno 4296061362 00000004:00080000:3.0:1721880431.213619:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009be59880, transno 4296061363 00000004:00080000:3.0:1721880431.213621:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009be5b100, transno 4296061364 00000004:00080000:3.0:1721880431.213624:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091210a80, transno 4296061365 00000004:00080000:3.0:1721880431.213626:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091213100, transno 4296061366 00000004:00080000:3.0:1721880431.213629:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091211500, transno 4296061367 00000004:00080000:3.0:1721880431.213631:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091211c00, transno 4296061368 00000004:00080000:3.0:1721880431.213634:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801302c8380, transno 4296061369 00000004:00080000:3.0:1721880431.213636:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801302c8e00, transno 4296061370 00000004:00080000:3.0:1721880431.213639:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801302c8700, transno 4296061371 00000004:00080000:3.0:1721880431.213642:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801302c9180, transno 4296061372 00000004:00080000:3.0:1721880431.213644:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801302cb800, transno 4296061373 00000004:00080000:3.0:1721880431.213647:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801302c9880, transno 4296061374 00000004:00080000:3.0:1721880431.213649:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bea2300, transno 4296061375 00000004:00080000:3.0:1721880431.213651:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801302c9f80, transno 4296061376 00000004:00080000:3.0:1721880431.213654:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801355d8380, transno 4296061377 00000004:00080000:3.0:1721880431.213656:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bea3b80, transno 4296061378 00000004:00080000:3.0:1721880431.213659:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801355d9f80, transno 4296061379 00000004:00080000:3.0:1721880431.213662:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bea2680, transno 4296061380 00000004:00080000:3.0:1721880431.213664:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801355da300, transno 4296061381 00000004:00080000:3.0:1721880431.213667:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800912f0a80, transno 4296061382 00000004:00080000:3.0:1721880431.213669:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092336680, transno 4296061383 00000004:00080000:3.0:1721880431.213672:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801302ca680, transno 4296061384 00000004:00080000:3.0:1721880431.213674:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099e75880, transno 4296061385 00000004:00080000:3.0:1721880431.213677:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099e76d80, transno 4296061386 00000004:00080000:3.0:1721880431.213679:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092336300, transno 4296061387 00000004:00080000:3.0:1721880431.213682:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099e75c00, transno 4296061388 00000004:00080000:3.0:1721880431.213684:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099e74700, transno 4296061389 00000004:00080000:3.0:1721880431.213686:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099e75180, transno 4296061390 00000004:00080000:3.0:1721880431.213689:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a4ba300, transno 4296061391 00000004:00080000:3.0:1721880431.213691:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092337480, transno 4296061392 00000004:00080000:3.0:1721880431.213693:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a4b8e00, transno 4296061393 00000004:00080000:3.0:1721880431.213695:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134fa6a00, transno 4296061394 00000004:00080000:3.0:1721880431.213698:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091211180, transno 4296061395 00000004:00080000:3.0:1721880431.213700:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880136088000, transno 4296061396 00000004:00080000:3.0:1721880431.213702:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091212a00, transno 4296061397 00000004:00080000:3.0:1721880431.213704:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096000000, transno 4296061398 00000004:00080000:3.0:1721880431.213707:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880132c63480, transno 4296061399 00000004:00080000:3.0:1721880431.213709:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012cfb8000, transno 4296061400 00000004:00080000:3.0:1721880431.213711:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012cfbb480, transno 4296061401 00000004:00080000:3.0:1721880431.213714:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099a3ea00, transno 4296061402 00000004:00080000:3.0:1721880431.213717:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099a3f480, transno 4296061403 00000004:00080000:3.0:1721880431.213719:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a4bb100, transno 4296061404 00000004:00080000:3.0:1721880431.213722:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801357b7100, transno 4296061405 00000004:00080000:3.0:1721880431.213724:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801355d9180, transno 4296061406 00000004:00080000:3.0:1721880431.213741:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801357b5880, transno 4296061407 00000004:00080000:3.0:1721880431.213745:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099a3ed80, transno 4296061408 00000004:00080000:3.0:1721880431.213747:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123809880, transno 4296061409 00000004:00080000:3.0:1721880431.213748:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a4b9c00, transno 4296061410 00000004:00080000:3.0:1721880431.213750:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123809500, transno 4296061411 00000004:00080000:3.0:1721880431.213751:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880130b64e00, transno 4296061412 00000004:00080000:3.0:1721880431.213753:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880130b67100, transno 4296061413 00000004:00080000:3.0:1721880431.213754:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880130b66300, transno 4296061414 00000004:00080000:3.0:1721880431.213756:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091210e00, transno 4296061415 00000004:00080000:3.0:1721880431.213757:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801302cb480, transno 4296061416 00000004:00080000:3.0:1721880431.213759:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c07aa00, transno 4296061417 00000004:00080000:3.0:1721880431.213760:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801357b6a00, transno 4296061418 00000004:00080000:3.0:1721880431.213762:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801355d8000, transno 4296061419 00000004:00080000:3.0:1721880431.213764:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009be58000, transno 4296061420 00000004:00080000:3.0:1721880431.213765:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880130b67b80, transno 4296061421 00000004:00080000:3.0:1721880431.213766:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c3bd180, transno 4296061422 00000004:00080000:3.0:1721880431.213768:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009be58700, transno 4296061423 00000004:00080000:3.0:1721880431.213769:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095207100, transno 4296061424 00000004:00080000:3.0:1721880431.213771:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012bc2ce00, transno 4296061425 00000004:00080000:3.0:1721880431.213772:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800888cd880, transno 4296061426 00000004:00080000:3.0:1721880431.213774:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800888cf480, transno 4296061427 00000004:00080000:3.0:1721880431.213776:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800888cd500, transno 4296061428 00000004:00080000:3.0:1721880431.213777:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bd8b480, transno 4296061429 00000004:00080000:3.0:1721880431.213779:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c3bfb80, transno 4296061430 00000004:00080000:3.0:1721880431.213781:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bd8ad80, transno 4296061431 00000004:00080000:3.0:1721880431.213783:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bd89f80, transno 4296061432 00000004:00080000:3.0:1721880431.213785:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800956c9880, transno 4296061433 00000004:00080000:3.0:1721880431.213787:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800888ce300, transno 4296061434 00000004:00080000:3.0:1721880431.213789:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801355d9c00, transno 4296061435 00000004:00080000:3.0:1721880431.213790:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801355d8a80, transno 4296061436 00000004:00080000:3.0:1721880431.213792:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bd89880, transno 4296061437 00000004:00080000:3.0:1721880431.213794:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800956c8000, transno 4296061438 00000004:00080000:3.0:1721880431.213795:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bd88700, transno 4296061439 00000004:00080000:3.0:1721880431.213797:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c07b480, transno 4296061440 00000004:00080000:3.0:1721880431.213799:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b9e9c00, transno 4296061441 00000004:00080000:3.0:1721880431.213800:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123808000, transno 4296061442 00000004:00080000:3.0:1721880431.213802:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801355e2d80, transno 4296061443 00000004:00080000:3.0:1721880431.213803:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801355e0700, transno 4296061444 00000004:00080000:3.0:1721880431.213805:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b9e9500, transno 4296061445 00000004:00080000:3.0:1721880431.213806:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fde0a80, transno 4296061446 00000004:00080000:3.0:1721880431.213808:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801355e3800, transno 4296061447 00000004:00080000:3.0:1721880431.213809:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c3bea00, transno 4296061448 00000004:00080000:3.0:1721880431.213811:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012387f480, transno 4296061449 00000004:00080000:3.0:1721880431.213813:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800956cad80, transno 4296061450 00000004:00080000:3.0:1721880431.213814:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123809180, transno 4296061451 00000004:00080000:3.0:1721880431.213816:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800956cb800, transno 4296061452 00000004:00080000:3.0:1721880431.213817:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800888cfb80, transno 4296061453 00000004:00080000:3.0:1721880431.213819:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008876f100, transno 4296061454 00000004:00080000:3.0:1721880431.213821:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013608b480, transno 4296061455 00000004:00080000:3.0:1721880431.213822:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008876dc00, transno 4296061456 00000004:00080000:3.0:1721880431.213824:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009be59500, transno 4296061457 00000004:00080000:3.0:1721880431.213825:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800888cf800, transno 4296061458 00000004:00080000:3.0:1721880431.213827:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a1d8000, transno 4296061459 00000004:00080000:3.0:1721880431.213829:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095a25180, transno 4296061460 00000004:00080000:3.0:1721880431.213830:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800956c9f80, transno 4296061461 00000004:00080000:3.0:1721880431.213833:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095a26a00, transno 4296061462 00000004:00080000:3.0:1721880431.213834:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099a3df80, transno 4296061463 00000004:00080000:3.0:1721880431.213836:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d123800, transno 4296061464 00000004:00080000:3.0:1721880431.213838:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096000700, transno 4296061465 00000004:00080000:3.0:1721880431.213840:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e908380, transno 4296061466 00000004:00080000:3.0:1721880431.213842:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d121f80, transno 4296061467 00000004:00080000:3.0:1721880431.213843:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d122d80, transno 4296061468 00000004:00080000:3.0:1721880431.213844:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095a25880, transno 4296061469 00000004:00080000:3.0:1721880431.213846:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095a26680, transno 4296061470 00000004:00080000:3.0:1721880431.213847:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a4b8700, transno 4296061471 00000004:00080000:3.0:1721880431.213849:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134fa7800, transno 4296061472 00000004:00080000:3.0:1721880431.213850:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801357b4000, transno 4296061473 00000004:00080000:3.0:1721880431.213852:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095a26d80, transno 4296061474 00000004:00080000:3.0:1721880431.213853:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801357b4380, transno 4296061475 00000004:00080000:3.0:1721880431.213854:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a4baa00, transno 4296061476 00000004:00080000:3.0:1721880431.213856:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099e75500, transno 4296061477 00000004:00080000:3.0:1721880431.213858:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092336d80, transno 4296061478 00000004:00080000:3.0:1721880431.213859:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095a26300, transno 4296061479 00000004:00080000:3.0:1721880431.213861:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008571f800, transno 4296061480 00000004:00080000:3.0:1721880431.213873:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880130b65c00, transno 4296061481 00000004:00080000:3.0:1721880431.213875:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bcf5500, transno 4296061482 00000004:00080000:3.0:1721880431.213877:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ad01c00, transno 4296061483 00000004:00080000:3.0:1721880431.213878:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bcf5880, transno 4296061484 00000004:00080000:3.0:1721880431.213880:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008571e680, transno 4296061485 00000004:00080000:3.0:1721880431.213881:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bcf6d80, transno 4296061486 00000004:00080000:3.0:1721880431.213883:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880130b67800, transno 4296061487 00000004:00080000:3.0:1721880431.213884:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bcf4a80, transno 4296061488 00000004:00080000:3.0:1721880431.213886:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084312680, transno 4296061489 00000004:00080000:3.0:1721880431.213887:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fde2d80, transno 4296061490 00000004:00080000:3.0:1721880431.213888:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bcf5c00, transno 4296061491 00000004:00080000:3.0:1721880431.213890:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084313800, transno 4296061492 00000004:00080000:3.0:1721880431.213892:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084312d80, transno 4296061493 00000004:00080000:3.0:1721880431.213893:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bcf5180, transno 4296061494 00000004:00080000:3.0:1721880431.213894:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008571f480, transno 4296061495 00000004:00080000:3.0:1721880431.213896:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ad02300, transno 4296061496 00000004:00080000:3.0:1721880431.213898:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134fa7100, transno 4296061497 00000004:00080000:3.0:1721880431.213900:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012cfb9500, transno 4296061498 00000004:00080000:3.0:1721880431.213901:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ad02680, transno 4296061499 00000004:00080000:3.0:1721880431.213903:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012cfbaa00, transno 4296061500 00000004:00080000:3.0:1721880431.213904:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008876df80, transno 4296061501 00000004:00080000:3.0:1721880431.213906:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b085180, transno 4296061502 00000004:00080000:3.0:1721880431.213907:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b084e00, transno 4296061503 00000004:00080000:3.0:1721880431.213909:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fde0380, transno 4296061504 00000004:00080000:3.0:1721880431.213910:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fde0700, transno 4296061505 00000004:00080000:3.0:1721880431.213912:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fde2680, transno 4296061506 00000004:00080000:3.0:1721880431.213913:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fde1180, transno 4296061507 00000004:00080000:3.0:1721880431.213915:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009fff1500, transno 4296061508 00000004:00080000:3.0:1721880431.213917:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b085c00, transno 4296061509 00000004:00080000:3.0:1721880431.213918:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bf68380, transno 4296061510 00000004:00080000:3.0:1721880431.213920:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fde1c00, transno 4296061511 00000004:00080000:3.0:1721880431.213921:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fde1880, transno 4296061512 00000004:00080000:3.0:1721880431.213923:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bf6aa00, transno 4296061513 00000004:00080000:3.0:1721880431.213925:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bf69500, transno 4296061514 00000004:00080000:3.0:1721880431.213926:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009fff2680, transno 4296061515 00000004:00080000:3.0:1721880431.213928:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bf68000, transno 4296061516 00000004:00080000:3.0:1721880431.213929:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bf6ad80, transno 4296061517 00000004:00080000:3.0:1721880431.213931:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009fff3800, transno 4296061518 00000004:00080000:3.0:1721880431.213932:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099e76a00, transno 4296061519 00000004:00080000:3.0:1721880431.213934:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bcf4380, transno 4296061520 00000004:00080000:3.0:1721880431.213935:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b8bca80, transno 4296061521 00000004:00080000:3.0:1721880431.213938:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b8bd500, transno 4296061522 00000004:00080000:3.0:1721880431.213940:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bcf7480, transno 4296061523 00000004:00080000:3.0:1721880431.213941:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b8bd180, transno 4296061524 00000004:00080000:3.0:1721880431.213943:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008876ce00, transno 4296061525 00000004:00080000:3.0:1721880431.213945:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d121880, transno 4296061526 00000004:00080000:3.0:1721880431.213946:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088db6d80, transno 4296061527 00000004:00080000:3.0:1721880431.213948:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d122680, transno 4296061528 00000004:00080000:3.0:1721880431.213950:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088db4e00, transno 4296061529 00000004:00080000:3.0:1721880431.213951:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cd20380, transno 4296061530 00000004:00080000:3.0:1721880431.213953:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cd21180, transno 4296061531 00000004:00080000:3.0:1721880431.213954:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cd21880, transno 4296061532 00000004:00080000:3.0:1721880431.213955:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cd21500, transno 4296061533 00000004:00080000:3.0:1721880431.213957:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088dc3b80, transno 4296061534 00000004:00080000:3.0:1721880431.213959:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088dc0a80, transno 4296061535 00000004:00080000:3.0:1721880431.213961:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b9e8000, transno 4296061536 00000004:00080000:3.0:1721880431.213963:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b9e9f80, transno 4296061537 00000004:00080000:3.0:1721880431.213965:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b08d180, transno 4296061538 00000004:00080000:3.0:1721880431.213968:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b08ea00, transno 4296061539 00000004:00080000:3.0:1721880431.213970:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b08dc00, transno 4296061540 00000004:00080000:3.0:1721880431.213972:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bd88000, transno 4296061541 00000004:00080000:3.0:1721880431.213974:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fde3b80, transno 4296061542 00000004:00080000:3.0:1721880431.213977:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b9eb480, transno 4296061543 00000004:00080000:3.0:1721880431.213979:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ebdbb80, transno 4296061544 00000004:00080000:3.0:1721880431.213981:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094634700, transno 4296061545 00000004:00080000:3.0:1721880431.213984:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e9c9f80, transno 4296061546 00000004:00080000:3.0:1721880431.213986:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094636680, transno 4296061547 00000004:00080000:3.0:1721880431.213989:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088dc0e00, transno 4296061548 00000004:00080000:3.0:1721880431.213991:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088dc0380, transno 4296061549 00000004:00080000:3.0:1721880431.213994:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094634a80, transno 4296061550 00000004:00080000:3.0:1721880431.213997:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b08fb80, transno 4296061551 00000004:00080000:3.0:1721880431.214000:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f52c000, transno 4296061552 00000004:00080000:3.0:1721880431.214003:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cd22d80, transno 4296061553 00000004:00080000:3.0:1721880431.214005:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f52dc00, transno 4296061554 00000004:00080000:3.0:1721880431.214008:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cd23b80, transno 4296061555 00000004:00080000:3.0:1721880431.214010:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088dc2680, transno 4296061556 00000004:00080000:3.0:1721880431.214013:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088dc1f80, transno 4296061557 00000004:00080000:3.0:1721880431.214015:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b08c700, transno 4296061558 00000004:00080000:3.0:1721880431.214018:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a052e680, transno 4296061559 00000004:00080000:3.0:1721880431.214020:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a052d880, transno 4296061560 00000004:00080000:3.0:1721880431.214022:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b177800, transno 4296061561 00000004:00080000:3.0:1721880431.214025:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b8bc700, transno 4296061562 00000004:00080000:3.0:1721880431.214027:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a052c700, transno 4296061563 00000004:00080000:3.0:1721880431.214029:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a052d500, transno 4296061564 00000004:00080000:3.0:1721880431.214031:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b8be300, transno 4296061565 00000004:00080000:3.0:1721880431.214033:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b8bea00, transno 4296061566 00000004:00080000:3.0:1721880431.214036:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b8bc000, transno 4296061567 00000004:00080000:3.0:1721880431.214038:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d123480, transno 4296061568 00000004:00080000:3.0:1721880431.214041:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d122300, transno 4296061569 00000004:00080000:3.0:1721880431.214043:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088db4000, transno 4296061570 00000004:00080000:3.0:1721880431.214045:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b08f100, transno 4296061571 00000004:00080000:3.0:1721880431.214047:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e614e00, transno 4296061572 00000004:00080000:3.0:1721880431.214049:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a052f480, transno 4296061573 00000004:00080000:3.0:1721880431.214051:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800919c3100, transno 4296061574 00000004:00080000:3.0:1721880431.214053:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800919c1f80, transno 4296061575 00000004:00080000:3.0:1721880431.214054:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f52ed80, transno 4296061576 00000004:00080000:3.0:1721880431.214056:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e614380, transno 4296061577 00000004:00080000:3.0:1721880431.214058:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b08f800, transno 4296061578 00000004:00080000:3.0:1721880431.214059:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cd22680, transno 4296061579 00000004:00080000:3.0:1721880431.214061:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800919c0e00, transno 4296061580 00000004:00080000:3.0:1721880431.214063:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800919c1500, transno 4296061581 00000004:00080000:3.0:1721880431.214065:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b8bf100, transno 4296061582 00000004:00080000:3.0:1721880431.214067:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b8bdc00, transno 4296061583 00000004:00080000:3.0:1721880431.214069:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088db7480, transno 4296061584 00000004:00080000:3.0:1721880431.214070:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a052c000, transno 4296061585 00000004:00080000:3.0:1721880431.214072:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088db5180, transno 4296061586 00000004:00080000:3.0:1721880431.214074:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088db4380, transno 4296061587 00000004:00080000:3.0:1721880431.214075:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088db6a00, transno 4296061588 00000004:00080000:3.0:1721880431.214077:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e9c9180, transno 4296061589 00000004:00080000:3.0:1721880431.214078:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f52c380, transno 4296061590 00000004:00080000:3.0:1721880431.214080:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e9c8700, transno 4296061591 00000004:00080000:3.0:1721880431.214082:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e9ca300, transno 4296061592 00000004:00080000:3.0:1721880431.214084:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008777e680, transno 4296061593 00000004:00080000:3.0:1721880431.214085:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008777ea00, transno 4296061594 00000004:00080000:3.0:1721880431.214087:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098d25180, transno 4296061595 00000004:00080000:3.0:1721880431.214088:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098d24000, transno 4296061596 00000004:00080000:3.0:1721880431.214090:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088db5500, transno 4296061597 00000004:00080000:3.0:1721880431.214091:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098d24700, transno 4296061598 00000004:00080000:3.0:1721880431.214092:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008777ca80, transno 4296061599 00000004:00080000:3.0:1721880431.214094:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098d27480, transno 4296061600 00000004:00080000:3.0:1721880431.214095:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098d25500, transno 4296061601 00000004:00080000:3.0:1721880431.214097:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b8bfb80, transno 4296061602 00000004:00080000:3.0:1721880431.214099:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008777e300, transno 4296061603 00000004:00080000:3.0:1721880431.214100:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098d26680, transno 4296061604 00000004:00080000:3.0:1721880431.214102:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098d24a80, transno 4296061605 00000004:00080000:3.0:1721880431.214103:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f52d880, transno 4296061606 00000004:00080000:3.0:1721880431.214105:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e617b80, transno 4296061607 00000004:00080000:3.0:1721880431.214106:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008777f480, transno 4296061608 00000004:00080000:3.0:1721880431.214108:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e617800, transno 4296061609 00000004:00080000:3.0:1721880431.214110:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084df7800, transno 4296061610 00000004:00080000:3.0:1721880431.214112:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880097139180, transno 4296061611 00000004:00080000:3.0:1721880431.214114:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009713b800, transno 4296061612 00000004:00080000:3.0:1721880431.214115:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c40b100, transno 4296061613 00000004:00080000:3.0:1721880431.214117:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c408a80, transno 4296061614 00000004:00080000:3.0:1721880431.214119:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008777fb80, transno 4296061615 00000004:00080000:3.0:1721880431.214121:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c40a680, transno 4296061616 00000004:00080000:3.0:1721880431.214122:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fde1500, transno 4296061617 00000004:00080000:3.0:1721880431.214124:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099eb0380, transno 4296061618 00000004:00080000:3.0:1721880431.214126:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098d24380, transno 4296061619 00000004:00080000:3.0:1721880431.214127:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c408700, transno 4296061620 00000004:00080000:3.0:1721880431.214129:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880097138700, transno 4296061621 00000004:00080000:3.0:1721880431.214130:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800959a7480, transno 4296061622 00000004:00080000:3.0:1721880431.214132:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800959a7100, transno 4296061623 00000004:00080000:3.0:1721880431.214133:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800959a5880, transno 4296061624 00000004:00080000:3.0:1721880431.214135:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098d24e00, transno 4296061625 00000004:00080000:3.0:1721880431.214137:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f52ca80, transno 4296061626 00000004:00080000:3.0:1721880431.214139:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880097138e00, transno 4296061627 00000004:00080000:3.0:1721880431.214140:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801312d1f80, transno 4296061628 00000004:00080000:3.0:1721880431.214141:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b59a680, transno 4296061629 00000004:00080000:3.0:1721880431.214143:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008777df80, transno 4296061630 00000004:00080000:3.0:1721880431.214144:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096003480, transno 4296061631 00000004:00080000:3.0:1721880431.214146:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008777c380, transno 4296061632 00000004:00080000:3.0:1721880431.214147:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e9c9500, transno 4296061633 00000004:00080000:3.0:1721880431.214149:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b599880, transno 4296061634 00000004:00080000:3.0:1721880431.214150:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b174380, transno 4296061635 00000004:00080000:3.0:1721880431.214163:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b174a80, transno 4296061636 00000004:00080000:3.0:1721880431.214165:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088dc3800, transno 4296061637 00000004:00080000:3.0:1721880431.214166:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800966b0e00, transno 4296061638 00000004:00080000:3.0:1721880431.214168:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d7a3480, transno 4296061639 00000004:00080000:3.0:1721880431.214170:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800966b0a80, transno 4296061640 00000004:00080000:3.0:1721880431.214171:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d7a1500, transno 4296061641 00000004:00080000:3.0:1721880431.214174:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800966b1f80, transno 4296061642 00000004:00080000:3.0:1721880431.214175:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008777d180, transno 4296061643 00000004:00080000:3.0:1721880431.214177:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008777f800, transno 4296061644 00000004:00080000:3.0:1721880431.214179:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088efdc00, transno 4296061645 00000004:00080000:3.0:1721880431.214181:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088efca80, transno 4296061646 00000004:00080000:3.0:1721880431.214182:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088efd500, transno 4296061647 00000004:00080000:3.0:1721880431.214184:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008854f100, transno 4296061648 00000004:00080000:3.0:1721880431.214185:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800919c2d80, transno 4296061649 00000004:00080000:3.0:1721880431.214187:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fde0000, transno 4296061650 00000004:00080000:3.0:1721880431.214188:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a052dc00, transno 4296061651 00000004:00080000:3.0:1721880431.214190:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092318380, transno 4296061652 00000004:00080000:3.0:1721880431.214191:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009231ad80, transno 4296061653 00000004:00080000:3.0:1721880431.214193:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088615c00, transno 4296061654 00000004:00080000:3.0:1721880431.214194:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009231a680, transno 4296061655 00000004:00080000:3.0:1721880431.214196:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092319c00, transno 4296061656 00000004:00080000:3.0:1721880431.214197:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092318a80, transno 4296061657 00000004:00080000:3.0:1721880431.214199:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088617800, transno 4296061658 00000004:00080000:3.0:1721880431.214200:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088616d80, transno 4296061659 00000004:00080000:3.0:1721880431.214202:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088616300, transno 4296061660 00000004:00080000:3.0:1721880431.214204:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801312d0a80, transno 4296061661 00000004:00080000:3.0:1721880431.214205:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801312d0380, transno 4296061662 00000004:00080000:3.0:1721880431.214207:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801312d1180, transno 4296061663 00000004:00080000:3.0:1721880431.214208:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801312d0e00, transno 4296061664 00000004:00080000:3.0:1721880431.214210:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008777d500, transno 4296061665 00000004:00080000:3.0:1721880431.214212:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801312d3480, transno 4296061666 00000004:00080000:3.0:1721880431.214213:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801312d0700, transno 4296061667 00000004:00080000:3.0:1721880431.214215:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088effb80, transno 4296061668 00000004:00080000:3.0:1721880431.214216:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008777d880, transno 4296061669 00000004:00080000:3.0:1721880431.214218:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801312d3100, transno 4296061670 00000004:00080000:3.0:1721880431.214219:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094637480, transno 4296061671 00000004:00080000:3.0:1721880431.214222:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801312d2a00, transno 4296061672 00000004:00080000:3.0:1721880431.214223:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d9ead80, transno 4296061673 00000004:00080000:3.0:1721880431.214225:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c408000, transno 4296061674 00000004:00080000:3.0:1721880431.214227:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007bb46d80, transno 4296061675 00000004:00080000:3.0:1721880431.214229:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f52ea00, transno 4296061676 00000004:00080000:3.0:1721880431.214231:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007bb46a00, transno 4296061677 00000004:00080000:3.0:1721880431.214232:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088617100, transno 4296061678 00000004:00080000:3.0:1721880431.214234:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d9e9c00, transno 4296061679 00000004:00080000:3.0:1721880431.214235:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d9eb800, transno 4296061680 00000004:00080000:3.0:1721880431.214237:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d9ea300, transno 4296061681 00000004:00080000:3.0:1721880431.214238:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088614000, transno 4296061682 00000004:00080000:3.0:1721880431.214240:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f52f800, transno 4296061683 00000004:00080000:3.0:1721880431.214242:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800952a1880, transno 4296061684 00000004:00080000:3.0:1721880431.214243:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800952a1f80, transno 4296061685 00000004:00080000:3.0:1721880431.214245:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088614a80, transno 4296061686 00000004:00080000:3.0:1721880431.214246:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088efe680, transno 4296061687 00000004:00080000:3.0:1721880431.214248:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007bb44380, transno 4296061688 00000004:00080000:3.0:1721880431.214249:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122c7f100, transno 4296061689 00000004:00080000:3.0:1721880431.214251:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122c7ca80, transno 4296061690 00000004:00080000:3.0:1721880431.214253:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135170380, transno 4296061691 00000004:00080000:3.0:1721880431.214255:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122c7d180, transno 4296061692 00000004:00080000:3.0:1721880431.214257:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122c7c380, transno 4296061693 00000004:00080000:3.0:1721880431.214258:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ebd8a80, transno 4296061694 00000004:00080000:3.0:1721880431.214260:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f023800, transno 4296061695 00000004:00080000:3.0:1721880431.214262:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009231b100, transno 4296061696 00000004:00080000:3.0:1721880431.214263:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f022300, transno 4296061697 00000004:00080000:3.0:1721880431.214265:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135171f80, transno 4296061698 00000004:00080000:3.0:1721880431.214267:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076fddf80, transno 4296061699 00000004:00080000:3.0:1721880431.214268:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f023480, transno 4296061700 00000004:00080000:3.0:1721880431.214270:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f021f80, transno 4296061701 00000004:00080000:3.0:1721880431.214272:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076fdea00, transno 4296061702 00000004:00080000:3.0:1721880431.214274:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801362daa00, transno 4296061703 00000004:00080000:3.0:1721880431.214275:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801362da300, transno 4296061704 00000004:00080000:3.0:1721880431.214277:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801362d8380, transno 4296061705 00000004:00080000:3.0:1721880431.214278:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076fddc00, transno 4296061706 00000004:00080000:3.0:1721880431.214280:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801362d9c00, transno 4296061707 00000004:00080000:3.0:1721880431.214282:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f09ce00, transno 4296061708 00000004:00080000:3.0:1721880431.214284:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f09d180, transno 4296061709 00000004:00080000:3.0:1721880431.214285:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f09fb80, transno 4296061710 00000004:00080000:3.0:1721880431.214287:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f09e680, transno 4296061711 00000004:00080000:3.0:1721880431.214288:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800952a2680, transno 4296061712 00000004:00080000:3.0:1721880431.214290:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f09c000, transno 4296061713 00000004:00080000:3.0:1721880431.214291:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122c7f800, transno 4296061714 00000004:00080000:3.0:1721880431.214292:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f09df80, transno 4296061715 00000004:00080000:3.0:1721880431.214294:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135170000, transno 4296061716 00000004:00080000:3.0:1721880431.214295:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122c7f480, transno 4296061717 00000100:00100000:3.0:1721880431.214314:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800966b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011854976:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1721880431.214470:0:10427:0:(osp_sync.c:1101:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 2754 in progress, 0 in flight, 10 done 00000040:00080000:0.0:1721880431.235222:0:10427:0:(llog_cat.c:1210:llog_cat_cleanup()) cancel plain log [0x1:0x13:0x0] at index 8 of catalog [0x1:0x2:0x0] 00000004:00080000:0.0:1721880431.239035:0:10427:0:(osp_sync.c:1101:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 2754 done 00000100:00100000:3.0:1721880431.305049:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1721880431.305072:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800959a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011855104:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1721880431.305142:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880431.305219:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011855104 00000100:00100000:2.0:1721880431.305230:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011855104 00000100:00100000:2.0:1721880431.305286:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101089 00000100:00100000:2.0:1721880431.305293:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+19:3686:x1805522011855104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1721880431.305330:0:15587:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1437519872 avail 1308057600 00000100:00100000:2.0:1721880431.305392:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+19:3686:x1805522011855104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880431.305397:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101089 00000100:00100000:3.0:1721880431.305419:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800959a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011855104:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1721880431.401029:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011855232:0@lo:400:kworker.0 00000100:00100000:0.0:1721880431.401035:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3689:1805522011855360:0@lo:400:kworker.0 00000100:00100000:1.0:1721880431.401049:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011855616:0@lo:400:kworker.0 00000100:00100000:2.0:1721880431.401051:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3686:1805522011855488:0@lo:400:kworker.0 00000100:00100000:0.0:1721880431.401108:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880431.401109:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880431.401110:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880431.401136:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3687:1805522011856128:0@lo:400:kworker.0 00000100:00100000:2.0:1721880431.401136:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011855360 00000100:00100000:3.0:1721880431.401139:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011855744:0@lo:400:kworker.0 00000100:00100000:0.0:1721880431.401141:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3689:1805522011855872:0@lo:400:kworker.0 00000100:00100000:2.0:1721880431.401143:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011855360 00000100:00100000:1.0:1721880431.401151:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880431.401165:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880431.401180:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011856128 00000100:00100000:2.0:1721880431.401182:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011856128 00000100:00100000:1.0:1721880431.401185:0:15415:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011855488 00000100:00100000:1.0:1721880431.401188:0:15415:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011855488 00000100:00100000:3.0:1721880431.401189:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011855232 00000100:00100000:3.0:1721880431.401193:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011855232 00000100:00100000:2.0:1721880431.401199:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2875 00000100:00100000:0.0:1721880431.401201:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880431.401205:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1805522011855360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880431.401209:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011856384:0@lo:400:kworker.0 00000100:00100000:1.0:1721880431.401212:0:15415:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011855872 00000100:00100000:1.0:1721880431.401213:0:15415:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011855872 00000100:00100000:3.0:1721880431.401222:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 578 00000100:00100000:0.0:1721880431.401224:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880431.401225:0:15415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2876 00000100:00100000:3.0:1721880431.401228:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011855232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880431.401229:0:15415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3687:x1805522011856128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880431.401255:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1805522011855360:12345-0@lo:400:kworker.0 Request processed in 50us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880431.401260:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2875 00000100:00100000:0.0:1721880431.401261:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009fff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3689:1805522011855360:0@lo:400:kworker.0 00000100:00100000:1.0:1721880431.401269:0:15415:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3687:x1805522011856128:12345-0@lo:400:kworker.0 Request processed in 40us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880431.401274:0:15415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2876 00000100:00100000:3.0:1721880431.401276:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011855232:12345-0@lo:400:kworker.0 Request processed in 48us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880431.401277:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2877 00000100:00100000:2.0:1721880431.401279:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-MDT0001_UUID+5:3686:x1805522011855488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880431.401280:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1721880431.401283:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 578 00000100:00100000:1.0:1721880431.401286:0:15415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2878 00000100:00100000:0.0:1721880431.401288:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3689:1805522011856256:0@lo:400:kworker.0 00000100:00100000:1.0:1721880431.401289:0:15415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1805522011855872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880431.401293:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-MDT0001_UUID+5:3686:x1805522011855488:12345-0@lo:400:kworker.0 Request processed in 12us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880431.401296:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2877 00000100:00100000:1.0:1721880431.401305:0:15415:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1805522011855872:12345-0@lo:400:kworker.0 Request processed in 16us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880431.401309:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880431.401309:0:15415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2878 00000100:00100000:1.0:1721880431.401318:0:15415:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011856256 00000100:00100000:1.0:1721880431.401320:0:15415:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011856256 00000100:00100000:2.0:1721880431.401321:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011856384 00000100:00100000:2.0:1721880431.401323:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011856384 00000100:00100000:1.0:1721880431.401330:0:15415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2879 00000100:00100000:0.0:1721880431.401331:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009fff0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3689:1805522011855872:0@lo:400:kworker.0 00000100:00100000:3.0:1721880431.401331:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880431.401332:0:15415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3689:x1805522011856256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880431.401340:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1721880431.401343:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011856384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880431.401348:0:15415:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3689:x1805522011856256:12345-0@lo:400:kworker.0 Request processed in 15us (40us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880431.401351:0:15415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2879 00000100:00100000:1.0:1721880431.401356:0:15415:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011855744 00000100:00100000:1.0:1721880431.401357:0:15415:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011855744 00000100:00100000:3.0:1721880431.401358:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009fff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011855232:0@lo:400:kworker.0 00000100:00100000:2.0:1721880431.401362:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011856384:12345-0@lo:400:kworker.0 Request processed in 18us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880431.401365:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1721880431.401367:0:15415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2880 00000100:00100000:1.0:1721880431.401370:0:15415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011855744:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1721880431.401377:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880401 00000100:00080000:2.0:1721880431.401379:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880401 00000100:00100000:0.0:1721880431.401381:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009fff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3689:1805522011856256:0@lo:400:kworker.0 00000100:00080000:2.0:1721880431.401381:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880401 00000100:00080000:2.0:1721880431.401382:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880401 00000100:00100000:1.0:1721880431.401387:0:15415:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011855744:12345-0@lo:400:kworker.0 Request processed in 17us (58us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880431.401388:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009fff2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011856384:0@lo:400:kworker.0 00000100:00100000:1.0:1721880431.401391:0:15415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2880 00000100:00100000:2.0:1721880431.401392:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011855616 00000100:00100000:2.0:1721880431.401393:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011855616 00000100:00100000:3.0:1721880431.401394:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009fff0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011855744:0@lo:400:kworker.0 00000100:00100000:0.0:1721880431.401399:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011856000:0@lo:400:kworker.0 00000100:00100000:2.0:1721880431.401410:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101090 00000100:00100000:2.0:1721880431.401412:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011855616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880431.401414:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880431.401415:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009fff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3687:1805522011856128:0@lo:400:kworker.0 00000100:00100000:0.0:1721880431.401422:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011856512:0@lo:400:kworker.0 00000100:00100000:3.0:1721880431.401429:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011856000 00000100:00100000:0.0:1721880431.401432:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880431.401432:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011856000 00000100:00100000:2.0:1721880431.401435:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011855616:12345-0@lo:400:kworker.0 Request processed in 22us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880431.401441:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101090 00000100:00100000:0.0:1721880431.401444:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011856512 00000100:00100000:0.0:1721880431.401447:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011856512 00000100:00100000:1.0:1721880431.401447:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009fff0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011855616:0@lo:400:kworker.0 00000100:00100000:3.0:1721880431.401452:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1721880431.401457:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011856000:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1721880431.401458:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880401 00000100:00100000:0.0:1721880431.401464:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1721880431.401467:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011856512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880431.401486:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011856000:12345-0@lo:400:kworker.0 Request processed in 29us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880431.401488:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011856512:12345-0@lo:400:kworker.0 Request processed in 20us (55us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880431.401492:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1721880431.401495:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1721880431.401516:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009fff3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3686:1805522011855488:0@lo:400:kworker.0 00000100:00100000:0.0:1721880431.401529:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009fff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011856000:0@lo:400:kworker.0 00000100:00100000:0.0:1721880431.401535:0:3686:0:(client.c:2972:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4296020654 gen 2 00000004:00080000:0.0:1721880431.401539:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bc30a80, transno 4296018073 00000004:00080000:0.0:1721880431.401551:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bc33480, transno 4296018074 00000004:00080000:0.0:1721880431.401553:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bc30380, transno 4296018075 00000004:00080000:0.0:1721880431.401555:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bc30e00, transno 4296018076 00000004:00080000:0.0:1721880431.401557:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bc32d80, transno 4296018077 00000004:00080000:0.0:1721880431.401559:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bc32a00, transno 4296018078 00000004:00080000:0.0:1721880431.401561:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bc32300, transno 4296018079 00000004:00080000:0.0:1721880431.401563:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bc30000, transno 4296018080 00000004:00080000:0.0:1721880431.401565:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012066a300, transno 4296018081 00000004:00080000:0.0:1721880431.401568:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012066aa00, transno 4296018082 00000004:00080000:0.0:1721880431.401572:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087747100, transno 4296018083 00000004:00080000:0.0:1721880431.401575:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f502300, transno 4296018084 00000004:00080000:0.0:1721880431.401577:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f501180, transno 4296018085 00000004:00080000:0.0:1721880431.401580:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f500700, transno 4296018086 00000004:00080000:0.0:1721880431.401583:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f500000, transno 4296018087 00000004:00080000:0.0:1721880431.401585:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f500a80, transno 4296018088 00000004:00080000:0.0:1721880431.401588:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f503b80, transno 4296018089 00000004:00080000:0.0:1721880431.401590:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f502d80, transno 4296018090 00000004:00080000:0.0:1721880431.401593:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e86d180, transno 4296018091 00000004:00080000:0.0:1721880431.401596:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f503480, transno 4296018092 00000004:00080000:0.0:1721880431.401598:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e86ce00, transno 4296018093 00000004:00080000:0.0:1721880431.401601:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e86dc00, transno 4296018094 00000004:00080000:0.0:1721880431.401603:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e86ca80, transno 4296018095 00000004:00080000:0.0:1721880431.401606:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e86ea00, transno 4296018096 00000004:00080000:0.0:1721880431.401608:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087746300, transno 4296018097 00000004:00080000:0.0:1721880431.401611:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087744a80, transno 4296018098 00000004:00080000:0.0:1721880431.401614:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f820a80, transno 4296018099 00000004:00080000:0.0:1721880431.401617:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e914380, transno 4296018100 00000004:00080000:0.0:1721880431.401620:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f821500, transno 4296018101 00000004:00080000:0.0:1721880431.401622:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800982d4000, transno 4296018102 00000004:00080000:0.0:1721880431.401625:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e916a00, transno 4296018103 00000004:00080000:0.0:1721880431.401628:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f820e00, transno 4296018104 00000004:00080000:0.0:1721880431.401631:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b145c00, transno 4296018105 00000004:00080000:0.0:1721880431.401634:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b146680, transno 4296018106 00000004:00080000:0.0:1721880431.401636:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800953c4a80, transno 4296018107 00000004:00080000:0.0:1721880431.401640:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800953c6a00, transno 4296018108 00000004:00080000:0.0:1721880431.401643:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800953c5f80, transno 4296018109 00000004:00080000:0.0:1721880431.401646:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800953c7800, transno 4296018110 00000004:00080000:0.0:1721880431.401648:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b145f80, transno 4296018111 00000004:00080000:0.0:1721880431.401651:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f820000, transno 4296018112 00000004:00080000:0.0:1721880431.401654:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f821180, transno 4296018113 00000004:00080000:0.0:1721880431.401656:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f821880, transno 4296018114 00000004:00080000:0.0:1721880431.401657:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bc31880, transno 4296018115 00000004:00080000:0.0:1721880431.401659:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800982d5c00, transno 4296018116 00000004:00080000:0.0:1721880431.401661:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800982d7100, transno 4296018117 00000004:00080000:0.0:1721880431.401663:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800982d6d80, transno 4296018118 00000004:00080000:0.0:1721880431.401682:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092111c00, transno 4296018119 00000004:00080000:0.0:1721880431.401684:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092113480, transno 4296018120 00000004:00080000:0.0:1721880431.401685:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092111f80, transno 4296018121 00000004:00080000:0.0:1721880431.401687:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092111880, transno 4296018122 00000004:00080000:0.0:1721880431.401689:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800842a9c00, transno 4296018123 00000004:00080000:0.0:1721880431.401690:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800842ab100, transno 4296018124 00000004:00080000:0.0:1721880431.401692:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131a45f80, transno 4296018125 00000004:00080000:0.0:1721880431.401694:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d037100, transno 4296018126 00000004:00080000:0.0:1721880431.401695:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d037480, transno 4296018127 00000004:00080000:0.0:1721880431.401697:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d036680, transno 4296018128 00000004:00080000:0.0:1721880431.401699:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d034380, transno 4296018129 00000004:00080000:0.0:1721880431.401700:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d035c00, transno 4296018130 00000004:00080000:0.0:1721880431.401702:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e275880, transno 4296018131 00000004:00080000:0.0:1721880431.401704:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012066a680, transno 4296018132 00000004:00080000:0.0:1721880431.401706:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e275180, transno 4296018133 00000004:00080000:0.0:1721880431.401707:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087b49c00, transno 4296018134 00000004:00080000:0.0:1721880431.401709:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087b4b800, transno 4296018135 00000004:00080000:0.0:1721880431.401711:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e848380, transno 4296018136 00000004:00080000:0.0:1721880431.401713:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087b49f80, transno 4296018137 00000004:00080000:0.0:1721880431.401715:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092113100, transno 4296018138 00000004:00080000:0.0:1721880431.401717:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092112a00, transno 4296018139 00000004:00080000:0.0:1721880431.401719:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092111500, transno 4296018140 00000004:00080000:0.0:1721880431.401721:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e849500, transno 4296018141 00000004:00080000:0.0:1721880431.401723:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e84b100, transno 4296018142 00000004:00080000:0.0:1721880431.401724:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e848000, transno 4296018143 00000004:00080000:0.0:1721880431.401726:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e848a80, transno 4296018144 00000004:00080000:0.0:1721880431.401728:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012590bb80, transno 4296018145 00000004:00080000:0.0:1721880431.401729:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012590aa00, transno 4296018146 00000004:00080000:0.0:1721880431.401731:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e84bb80, transno 4296018147 00000004:00080000:0.0:1721880431.401732:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d036a00, transno 4296018148 00000004:00080000:0.0:1721880431.401734:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f79d880, transno 4296018149 00000004:00080000:0.0:1721880431.401735:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e849f80, transno 4296018150 00000004:00080000:0.0:1721880431.401737:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092111180, transno 4296018151 00000004:00080000:0.0:1721880431.401738:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092112680, transno 4296018152 00000004:00080000:0.0:1721880431.401740:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bca0e00, transno 4296018153 00000004:00080000:0.0:1721880431.401760:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d830000, transno 4296018154 00000004:00080000:0.0:1721880431.401762:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d831500, transno 4296018155 00000004:00080000:0.0:1721880431.401763:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d831180, transno 4296018156 00000004:00080000:0.0:1721880431.401765:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099cd9f80, transno 4296018157 00000004:00080000:0.0:1721880431.401767:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d037800, transno 4296018158 00000004:00080000:0.0:1721880431.401768:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bca1c00, transno 4296018159 00000004:00080000:0.0:1721880431.401770:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800842ab480, transno 4296018160 00000004:00080000:0.0:1721880431.401771:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125909500, transno 4296018161 00000004:00080000:0.0:1721880431.401773:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125908700, transno 4296018162 00000004:00080000:0.0:1721880431.401775:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012590ad80, transno 4296018163 00000004:00080000:0.0:1721880431.401776:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800842a8e00, transno 4296018164 00000004:00080000:0.0:1721880431.401778:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092110700, transno 4296018165 00000004:00080000:0.0:1721880431.401779:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092110000, transno 4296018166 00000004:00080000:0.0:1721880431.401781:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f502680, transno 4296018167 00000004:00080000:0.0:1721880431.401784:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d830700, transno 4296018168 00000004:00080000:0.0:1721880431.401787:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800913ba680, transno 4296018169 00000004:00080000:0.0:1721880431.401789:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800913b8700, transno 4296018170 00000004:00080000:0.0:1721880431.401792:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131a47800, transno 4296018171 00000004:00080000:0.0:1721880431.401794:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f501f80, transno 4296018172 00000004:00080000:0.0:1721880431.401797:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800913b8a80, transno 4296018173 00000004:00080000:0.0:1721880431.401799:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099cdb800, transno 4296018174 00000004:00080000:0.0:1721880431.401802:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800913b9c00, transno 4296018175 00000004:00080000:0.0:1721880431.401804:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800913ba300, transno 4296018176 00000004:00080000:0.0:1721880431.401807:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e276300, transno 4296018177 00000004:00080000:0.0:1721880431.401810:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e276a00, transno 4296018178 00000004:00080000:0.0:1721880431.401812:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096cb5880, transno 4296018179 00000004:00080000:0.0:1721880431.401815:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096cb4380, transno 4296018180 00000004:00080000:0.0:1721880431.401817:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096cb5180, transno 4296018181 00000004:00080000:0.0:1721880431.401820:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096cb5c00, transno 4296018182 00000004:00080000:0.0:1721880431.401823:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096cb4a80, transno 4296018183 00000004:00080000:0.0:1721880431.401825:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c845c00, transno 4296018184 00000004:00080000:0.0:1721880431.401828:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c846300, transno 4296018185 00000004:00080000:0.0:1721880431.401830:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c845f80, transno 4296018186 00000004:00080000:0.0:1721880431.401833:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c846d80, transno 4296018187 00000004:00080000:0.0:1721880431.401836:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b876a00, transno 4296018188 00000004:00080000:0.0:1721880431.401839:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b875c00, transno 4296018189 00000004:00080000:0.0:1721880431.401842:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b874380, transno 4296018190 00000004:00080000:0.0:1721880431.401844:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bca3800, transno 4296018191 00000004:00080000:0.0:1721880431.401846:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092110380, transno 4296018192 00000004:00080000:0.0:1721880431.401849:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e276680, transno 4296018193 00000004:00080000:0.0:1721880431.401852:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800842aad80, transno 4296018194 00000004:00080000:0.0:1721880431.401854:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092113800, transno 4296018195 00000004:00080000:0.0:1721880431.401856:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d037b80, transno 4296018196 00000004:00080000:0.0:1721880431.401872:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d830380, transno 4296018197 00000004:00080000:0.0:1721880431.401875:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092112300, transno 4296018198 00000004:00080000:0.0:1721880431.401877:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bc30700, transno 4296018199 00000004:00080000:0.0:1721880431.401879:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e848700, transno 4296018200 00000004:00080000:0.0:1721880431.401881:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bc31f80, transno 4296018201 00000004:00080000:0.0:1721880431.401883:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800842aa680, transno 4296018202 00000004:00080000:0.0:1721880431.401885:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f79c380, transno 4296018203 00000004:00080000:0.0:1721880431.401886:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800982d4380, transno 4296018204 00000004:00080000:0.0:1721880431.401888:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800842a8000, transno 4296018205 00000004:00080000:0.0:1721880431.401890:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095b71f80, transno 4296018206 00000004:00080000:0.0:1721880431.401892:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c4dfb80, transno 4296018207 00000004:00080000:0.0:1721880431.401894:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bc31500, transno 4296018208 00000004:00080000:0.0:1721880431.401895:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800947ec700, transno 4296018209 00000004:00080000:0.0:1721880431.401897:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bc33800, transno 4296018210 00000004:00080000:0.0:1721880431.401898:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bca2680, transno 4296018211 00000004:00080000:0.0:1721880431.401900:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096cb4000, transno 4296018212 00000004:00080000:0.0:1721880431.401902:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096cb6680, transno 4296018213 00000004:00080000:0.0:1721880431.401903:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096cb6300, transno 4296018214 00000004:00080000:0.0:1721880431.401905:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096cb6a00, transno 4296018215 00000004:00080000:0.0:1721880431.401906:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096cb7100, transno 4296018216 00000004:00080000:0.0:1721880431.401908:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096cb4e00, transno 4296018217 00000004:00080000:0.0:1721880431.401910:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800947ed180, transno 4296018218 00000004:00080000:0.0:1721880431.401912:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b875500, transno 4296018219 00000004:00080000:0.0:1721880431.401913:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800947edc00, transno 4296018220 00000004:00080000:0.0:1721880431.401915:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800947ece00, transno 4296018221 00000004:00080000:0.0:1721880431.401916:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800947ef100, transno 4296018222 00000004:00080000:0.0:1721880431.401918:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800947ed500, transno 4296018223 00000004:00080000:0.0:1721880431.401919:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800947ec000, transno 4296018224 00000004:00080000:0.0:1721880431.401920:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800947ef800, transno 4296018225 00000004:00080000:0.0:1721880431.401922:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800947efb80, transno 4296018226 00000004:00080000:0.0:1721880431.401923:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800947ee680, transno 4296018227 00000004:00080000:0.0:1721880431.401926:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091ab8700, transno 4296018228 00000004:00080000:0.0:1721880431.401929:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091ab9c00, transno 4296018229 00000004:00080000:0.0:1721880431.401932:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091ab9f80, transno 4296018230 00000004:00080000:0.0:1721880431.401934:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091ab8380, transno 4296018231 00000004:00080000:0.0:1721880431.401936:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091abbb80, transno 4296018232 00000004:00080000:0.0:1721880431.401939:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091ab8e00, transno 4296018233 00000004:00080000:0.0:1721880431.401941:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091abad80, transno 4296018234 00000004:00080000:0.0:1721880431.401944:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091ab8000, transno 4296018235 00000004:00080000:0.0:1721880431.401946:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f503100, transno 4296018236 00000004:00080000:0.0:1721880431.401949:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091abb800, transno 4296018237 00000004:00080000:0.0:1721880431.401951:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c844e00, transno 4296018238 00000004:00080000:0.0:1721880431.401954:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091abb100, transno 4296018239 00000004:00080000:0.0:1721880431.401957:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d830e00, transno 4296018240 00000004:00080000:0.0:1721880431.401960:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d831880, transno 4296018241 00000004:00080000:0.0:1721880431.401963:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099cdad80, transno 4296018242 00000004:00080000:0.0:1721880431.401965:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800942e4380, transno 4296018243 00000004:00080000:0.0:1721880431.401968:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b7c5880, transno 4296018244 00000004:00080000:0.0:1721880431.401971:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b7c6a00, transno 4296018245 00000004:00080000:0.0:1721880431.401973:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b7c4700, transno 4296018246 00000004:00080000:0.0:1721880431.401976:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096259500, transno 4296018247 00000004:00080000:0.0:1721880431.401979:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096259180, transno 4296018248 00000004:00080000:0.0:1721880431.401981:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009625b480, transno 4296018249 00000004:00080000:0.0:1721880431.401984:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088fe6680, transno 4296018250 00000004:00080000:0.0:1721880431.401987:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096258700, transno 4296018251 00000004:00080000:0.0:1721880431.401989:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088fe4700, transno 4296018252 00000004:00080000:0.0:1721880431.401992:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009299c700, transno 4296018253 00000004:00080000:0.0:1721880431.401995:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800947eca80, transno 4296018254 00000004:00080000:0.0:1721880431.401997:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088fe4380, transno 4296018255 00000004:00080000:0.0:1721880431.401999:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800947eea00, transno 4296018256 00000004:00080000:0.0:1721880431.402002:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ecae680, transno 4296018257 00000004:00080000:0.0:1721880431.402006:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800947eed80, transno 4296018258 00000004:00080000:0.0:1721880431.402008:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b7c6680, transno 4296018259 00000004:00080000:0.0:1721880431.402010:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099cd9880, transno 4296018260 00000004:00080000:0.0:1721880431.402012:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e849c00, transno 4296018261 00000004:00080000:0.0:1721880431.402014:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800911ef800, transno 4296018262 00000004:00080000:0.0:1721880431.402016:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800911ed500, transno 4296018263 00000004:00080000:0.0:1721880431.402018:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800911efb80, transno 4296018264 00000004:00080000:0.0:1721880431.402019:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800911ee680, transno 4296018265 00000004:00080000:0.0:1721880431.402020:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800911edf80, transno 4296018266 00000004:00080000:0.0:1721880431.402022:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800911eea00, transno 4296018267 00000004:00080000:0.0:1721880431.402024:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c4ddf80, transno 4296018268 00000004:00080000:0.0:1721880431.402025:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800911ec380, transno 4296018269 00000004:00080000:0.0:1721880431.402027:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800911ef480, transno 4296018270 00000004:00080000:0.0:1721880431.402028:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096259f80, transno 4296018271 00000004:00080000:0.0:1721880431.402030:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088fe7b80, transno 4296018272 00000004:00080000:0.0:1721880431.402032:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ecac380, transno 4296018273 00000004:00080000:0.0:1721880431.402034:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e84b480, transno 4296018274 00000004:00080000:0.0:1721880431.402035:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088fe5c00, transno 4296018275 00000004:00080000:0.0:1721880431.402037:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076e5f480, transno 4296018276 00000004:00080000:0.0:1721880431.402039:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076e5ce00, transno 4296018277 00000004:00080000:0.0:1721880431.402040:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c4dca80, transno 4296018278 00000004:00080000:0.0:1721880431.402042:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091aba300, transno 4296018279 00000004:00080000:0.0:1721880431.402043:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098223800, transno 4296018280 00000004:00080000:0.0:1721880431.402045:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c4de300, transno 4296018281 00000004:00080000:0.0:1721880431.402046:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091abaa00, transno 4296018282 00000004:00080000:0.0:1721880431.402047:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800942e5180, transno 4296018283 00000004:00080000:0.0:1721880431.402049:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098222a00, transno 4296018284 00000004:00080000:0.0:1721880431.402050:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800942e4000, transno 4296018285 00000004:00080000:0.0:1721880431.402052:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800942e6300, transno 4296018286 00000004:00080000:0.0:1721880431.402054:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800942e7480, transno 4296018287 00000004:00080000:0.0:1721880431.402056:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800942e5f80, transno 4296018288 00000004:00080000:0.0:1721880431.402058:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800942e6d80, transno 4296018289 00000004:00080000:0.0:1721880431.402060:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800911ece00, transno 4296018290 00000004:00080000:0.0:1721880431.402061:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800942e7800, transno 4296018291 00000004:00080000:0.0:1721880431.402063:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800942e5c00, transno 4296018292 00000004:00080000:0.0:1721880431.402064:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800911ef100, transno 4296018293 00000004:00080000:0.0:1721880431.402066:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800995f5180, transno 4296018294 00000004:00080000:0.0:1721880431.402068:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800995f4000, transno 4296018295 00000004:00080000:0.0:1721880431.402070:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800995f6a00, transno 4296018296 00000004:00080000:0.0:1721880431.402071:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098220000, transno 4296018297 00000004:00080000:0.0:1721880431.402073:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800942e4e00, transno 4296018298 00000004:00080000:0.0:1721880431.402075:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098221500, transno 4296018299 00000004:00080000:0.0:1721880431.402076:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800942e5880, transno 4296018300 00000004:00080000:0.0:1721880431.402077:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098221f80, transno 4296018301 00000004:00080000:0.0:1721880431.402079:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c4dc000, transno 4296018302 00000004:00080000:0.0:1721880431.402081:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bc33100, transno 4296018303 00000004:00080000:0.0:1721880431.402083:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007c82d500, transno 4296018304 00000004:00080000:0.0:1721880431.402084:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d833b80, transno 4296018305 00000004:00080000:0.0:1721880431.402086:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800982d4e00, transno 4296018306 00000004:00080000:0.0:1721880431.402087:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800995f4a80, transno 4296018307 00000004:00080000:0.0:1721880431.402089:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800995f4380, transno 4296018308 00000004:00080000:0.0:1721880431.402091:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c77a680, transno 4296018309 00000004:00080000:0.0:1721880431.402092:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088fe4000, transno 4296018310 00000004:00080000:0.0:1721880431.402094:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800942e6680, transno 4296018311 00000004:00080000:0.0:1721880431.402095:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800942e4a80, transno 4296018312 00000004:00080000:0.0:1721880431.402097:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088fe7480, transno 4296018313 00000004:00080000:0.0:1721880431.402098:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800911ee300, transno 4296018314 00000004:00080000:0.0:1721880431.402100:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076e5df80, transno 4296018315 00000004:00080000:0.0:1721880431.402102:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076e5c000, transno 4296018316 00000004:00080000:0.0:1721880431.402104:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076e5c700, transno 4296018317 00000004:00080000:0.0:1721880431.402107:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800995f4e00, transno 4296018318 00000004:00080000:0.0:1721880431.402110:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800942e5500, transno 4296018319 00000004:00080000:0.0:1721880431.402112:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800913bb100, transno 4296018320 00000004:00080000:0.0:1721880431.402114:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800913b9180, transno 4296018321 00000004:00080000:0.0:1721880431.402117:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009299ea00, transno 4296018322 00000004:00080000:0.0:1721880431.402120:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f500e00, transno 4296018323 00000004:00080000:0.0:1721880431.402122:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bca0000, transno 4296018324 00000004:00080000:0.0:1721880431.402124:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bdbbb80, transno 4296018325 00000004:00080000:0.0:1721880431.402127:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bdbad80, transno 4296018326 00000004:00080000:0.0:1721880431.402130:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bdbb480, transno 4296018327 00000004:00080000:0.0:1721880431.402132:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bdb9180, transno 4296018328 00000004:00080000:0.0:1721880431.402135:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b876d80, transno 4296018329 00000004:00080000:0.0:1721880431.402137:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f503800, transno 4296018330 00000004:00080000:0.0:1721880431.402140:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f70a680, transno 4296018331 00000004:00080000:0.0:1721880431.402143:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f70aa00, transno 4296018332 00000004:00080000:0.0:1721880431.402145:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f70bb80, transno 4296018333 00000004:00080000:0.0:1721880431.402148:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800913b8e00, transno 4296018334 00000004:00080000:0.0:1721880431.402150:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f708380, transno 4296018335 00000004:00080000:0.0:1721880431.402153:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f709500, transno 4296018336 00000004:00080000:0.0:1721880431.402156:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800913b9880, transno 4296018337 00000004:00080000:0.0:1721880431.402158:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800913b8000, transno 4296018338 00000004:00080000:0.0:1721880431.402161:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c77ad80, transno 4296018339 00000004:00080000:0.0:1721880431.402164:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c779c00, transno 4296018340 00000004:00080000:0.0:1721880431.402167:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009299dc00, transno 4296018341 00000004:00080000:0.0:1721880431.402169:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091ab8a80, transno 4296018342 00000004:00080000:0.0:1721880431.402172:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009299e680, transno 4296018343 00000004:00080000:0.0:1721880431.402174:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e849880, transno 4296018344 00000004:00080000:0.0:1721880431.402176:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f99bb80, transno 4296018345 00000004:00080000:0.0:1721880431.402178:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009299d500, transno 4296018346 00000004:00080000:0.0:1721880431.402180:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880097308700, transno 4296018347 00000004:00080000:0.0:1721880431.402182:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009730bb80, transno 4296018348 00000004:00080000:0.0:1721880431.402184:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880097309880, transno 4296018349 00000004:00080000:0.0:1721880431.402185:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009730ad80, transno 4296018350 00000004:00080000:0.0:1721880431.402187:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bdba680, transno 4296018351 00000004:00080000:0.0:1721880431.402189:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bdb8380, transno 4296018352 00000004:00080000:0.0:1721880431.402190:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bdb9880, transno 4296018353 00000004:00080000:0.0:1721880431.402191:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880097309180, transno 4296018354 00000004:00080000:0.0:1721880431.402193:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801258fb100, transno 4296018355 00000004:00080000:0.0:1721880431.402195:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801258fbb80, transno 4296018356 00000004:00080000:0.0:1721880431.402196:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c4dc700, transno 4296018357 00000004:00080000:0.0:1721880431.402197:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f99b480, transno 4296018358 00000004:00080000:0.0:1721880431.402199:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800995f5f80, transno 4296018359 00000004:00080000:0.0:1721880431.402200:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800858b7100, transno 4296018360 00000004:00080000:0.0:1721880431.402202:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009299ce00, transno 4296018361 00000004:00080000:0.0:1721880431.402204:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ca5f100, transno 4296018362 00000004:00080000:0.0:1721880431.402205:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800858b4e00, transno 4296018363 00000004:00080000:0.0:1721880431.402207:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800982d7480, transno 4296018364 00000004:00080000:0.0:1721880431.402209:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ecafb80, transno 4296018365 00000004:00080000:0.0:1721880431.402210:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ca5ce00, transno 4296018366 00000004:00080000:0.0:1721880431.402212:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ca5ed80, transno 4296018367 00000004:00080000:0.0:1721880431.402213:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ca5ca80, transno 4296018368 00000004:00080000:0.0:1721880431.402215:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008774ed80, transno 4296018369 00000004:00080000:0.0:1721880431.402217:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bdb8a80, transno 4296018370 00000004:00080000:0.0:1721880431.402218:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bdbaa00, transno 4296018371 00000004:00080000:0.0:1721880431.402219:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f70b100, transno 4296018372 00000004:00080000:0.0:1721880431.402221:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099cd9180, transno 4296018373 00000004:00080000:0.0:1721880431.402222:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099cd8a80, transno 4296018374 00000004:00080000:0.0:1721880431.402224:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f708a80, transno 4296018375 00000004:00080000:0.0:1721880431.402226:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096258e00, transno 4296018376 00000004:00080000:0.0:1721880431.402227:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800982d6680, transno 4296018377 00000004:00080000:0.0:1721880431.402229:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800858b5c00, transno 4296018378 00000004:00080000:0.0:1721880431.402231:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801258f9f80, transno 4296018379 00000004:00080000:0.0:1721880431.402233:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801258f8000, transno 4296018380 00000004:00080000:0.0:1721880431.402235:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801258f9180, transno 4296018381 00000004:00080000:0.0:1721880431.402236:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880097309c00, transno 4296018382 00000004:00080000:0.0:1721880431.402238:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096259880, transno 4296018383 00000004:00080000:0.0:1721880431.402240:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f99a680, transno 4296018384 00000004:00080000:0.0:1721880431.402241:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b7c7800, transno 4296018385 00000004:00080000:0.0:1721880431.402243:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f998a80, transno 4296018386 00000004:00080000:0.0:1721880431.402244:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f999880, transno 4296018387 00000004:00080000:0.0:1721880431.402246:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d0c2a00, transno 4296018388 00000004:00080000:0.0:1721880431.402248:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c4dce00, transno 4296018389 00000004:00080000:0.0:1721880431.402250:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131eeca80, transno 4296018390 00000004:00080000:0.0:1721880431.402252:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131eed880, transno 4296018391 00000004:00080000:0.0:1721880431.402253:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d0c0000, transno 4296018392 00000004:00080000:0.0:1721880431.402255:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d0c2d80, transno 4296018393 00000004:00080000:0.0:1721880431.402257:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131eed180, transno 4296018394 00000004:00080000:0.0:1721880431.402258:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131eee680, transno 4296018395 00000004:00080000:0.0:1721880431.402260:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131eeea00, transno 4296018396 00000004:00080000:0.0:1721880431.402261:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131eed500, transno 4296018397 00000004:00080000:0.0:1721880431.402262:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131eec380, transno 4296018398 00000004:00080000:0.0:1721880431.402264:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131eec700, transno 4296018399 00000004:00080000:0.0:1721880431.402266:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091934e00, transno 4296018400 00000004:00080000:0.0:1721880431.402267:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091934380, transno 4296018401 00000004:00080000:0.0:1721880431.402269:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091935880, transno 4296018402 00000004:00080000:0.0:1721880431.402270:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091934000, transno 4296018403 00000004:00080000:0.0:1721880431.402272:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091935c00, transno 4296018404 00000004:00080000:0.0:1721880431.402273:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091937480, transno 4296018405 00000004:00080000:0.0:1721880431.402275:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880124807b80, transno 4296018406 00000004:00080000:0.0:1721880431.402277:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880124807480, transno 4296018407 00000004:00080000:0.0:1721880431.402279:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880124805180, transno 4296018408 00000004:00080000:0.0:1721880431.402281:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880124804380, transno 4296018409 00000004:00080000:0.0:1721880431.402283:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880124807800, transno 4296018410 00000004:00080000:0.0:1721880431.402284:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880124805c00, transno 4296018411 00000004:00080000:0.0:1721880431.402286:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bddaa00, transno 4296018412 00000004:00080000:0.0:1721880431.402287:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880124804e00, transno 4296018413 00000004:00080000:0.0:1721880431.402289:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007c84b800, transno 4296018414 00000004:00080000:0.0:1721880431.402290:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007c849880, transno 4296018415 00000004:00080000:0.0:1721880431.402292:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007c848e00, transno 4296018416 00000004:00080000:0.0:1721880431.402294:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007c84aa00, transno 4296018417 00000004:00080000:0.0:1721880431.402295:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007c848000, transno 4296018418 00000004:00080000:0.0:1721880431.402297:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007c848a80, transno 4296018419 00000004:00080000:0.0:1721880431.402298:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088b02a00, transno 4296018420 00000004:00080000:0.0:1721880431.402300:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088b01c00, transno 4296018421 00000004:00080000:0.0:1721880431.402301:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bdd9880, transno 4296018422 00000004:00080000:0.0:1721880431.402303:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125986a00, transno 4296018423 00000004:00080000:0.0:1721880431.402305:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125984380, transno 4296018424 00000004:00080000:0.0:1721880431.402306:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125985180, transno 4296018425 00000004:00080000:0.0:1721880431.402308:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bdda680, transno 4296018426 00000004:00080000:0.0:1721880431.402309:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800921cd880, transno 4296018427 00000004:00080000:0.0:1721880431.402312:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800921cdf80, transno 4296018428 00000004:00080000:0.0:1721880431.402313:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800921cce00, transno 4296018429 00000004:00080000:0.0:1721880431.402315:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800921ce300, transno 4296018430 00000004:00080000:0.0:1721880431.402316:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800921cea00, transno 4296018431 00000004:00080000:0.0:1721880431.402317:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800921cfb80, transno 4296018432 00000004:00080000:0.0:1721880431.402319:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013647c380, transno 4296018433 00000004:00080000:0.0:1721880431.402321:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013647df80, transno 4296018434 00000004:00080000:0.0:1721880431.402322:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800921ce680, transno 4296018435 00000004:00080000:0.0:1721880431.402324:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125986d80, transno 4296018436 00000004:00080000:0.0:1721880431.402325:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d0c3800, transno 4296018437 00000004:00080000:0.0:1721880431.402328:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ea32a00, transno 4296018438 00000004:00080000:0.0:1721880431.402329:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091936a00, transno 4296018439 00000004:00080000:0.0:1721880431.402331:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091935f80, transno 4296018440 00000004:00080000:0.0:1721880431.402333:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091936d80, transno 4296018441 00000004:00080000:0.0:1721880431.402334:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085909880, transno 4296018442 00000004:00080000:0.0:1721880431.402335:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800921cf100, transno 4296018443 00000004:00080000:0.0:1721880431.402337:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800921cdc00, transno 4296018444 00000004:00080000:0.0:1721880431.402338:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085908700, transno 4296018445 00000004:00080000:0.0:1721880431.402339:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008590a300, transno 4296018446 00000004:00080000:0.0:1721880431.402341:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085908000, transno 4296018447 00000004:00080000:0.0:1721880431.402342:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800921ced80, transno 4296018448 00000004:00080000:0.0:1721880431.402343:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800921cf800, transno 4296018449 00000004:00080000:0.0:1721880431.402345:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c4e4380, transno 4296018450 00000004:00080000:0.0:1721880431.402346:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c4e7480, transno 4296018451 00000004:00080000:0.0:1721880431.402347:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c4e5500, transno 4296018452 00000004:00080000:0.0:1721880431.402349:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c4e5c00, transno 4296018453 00000004:00080000:0.0:1721880431.402350:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c4e4a80, transno 4296018454 00000004:00080000:0.0:1721880431.402352:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c4e7b80, transno 4296018455 00000004:00080000:0.0:1721880431.402353:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c4e4000, transno 4296018456 00000004:00080000:0.0:1721880431.402355:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ea31880, transno 4296018457 00000004:00080000:0.0:1721880431.402356:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c4e6680, transno 4296018458 00000004:00080000:0.0:1721880431.402358:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ea31f80, transno 4296018459 00000004:00080000:0.0:1721880431.402360:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c4e7100, transno 4296018460 00000004:00080000:0.0:1721880431.402361:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131eefb80, transno 4296018461 00000004:00080000:0.0:1721880431.402363:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bdd8e00, transno 4296018462 00000004:00080000:0.0:1721880431.402364:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c4e5880, transno 4296018463 00000004:00080000:0.0:1721880431.402366:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ea33b80, transno 4296018464 00000004:00080000:0.0:1721880431.402368:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a05fc700, transno 4296018465 00000004:00080000:0.0:1721880431.402369:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880124806680, transno 4296018466 00000004:00080000:0.0:1721880431.402371:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bdb8700, transno 4296018467 00000004:00080000:0.0:1721880431.402373:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009730b480, transno 4296018468 00000004:00080000:0.0:1721880431.402375:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009730a680, transno 4296018469 00000004:00080000:0.0:1721880431.402376:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009730b800, transno 4296018470 00000004:00080000:0.0:1721880431.402378:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095985f80, transno 4296018471 00000004:00080000:0.0:1721880431.402380:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095985c00, transno 4296018472 00000004:00080000:0.0:1721880431.402382:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095984e00, transno 4296018473 00000004:00080000:0.0:1721880431.402383:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095984380, transno 4296018474 00000004:00080000:0.0:1721880431.402385:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095987100, transno 4296018475 00000004:00080000:0.0:1721880431.402386:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ea30700, transno 4296018476 00000004:00080000:0.0:1721880431.402387:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007c84bb80, transno 4296018477 00000004:00080000:0.0:1721880431.402389:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d0c1180, transno 4296018478 00000004:00080000:0.0:1721880431.402390:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ea32300, transno 4296018479 00000004:00080000:0.0:1721880431.402391:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007c849c00, transno 4296018480 00000004:00080000:0.0:1721880431.402393:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091935500, transno 4296018481 00000004:00080000:0.0:1721880431.402394:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007c849f80, transno 4296018482 00000004:00080000:0.0:1721880431.402396:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bdb9f80, transno 4296018483 00000004:00080000:0.0:1721880431.402397:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091bac000, transno 4296018484 00000004:00080000:0.0:1721880431.402398:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091bac700, transno 4296018485 00000004:00080000:0.0:1721880431.402399:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091bad180, transno 4296018486 00000004:00080000:0.0:1721880431.402401:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091bad500, transno 4296018487 00000004:00080000:0.0:1721880431.402402:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091baf480, transno 4296018488 00000004:00080000:0.0:1721880431.402404:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087bbf100, transno 4296018489 00000004:00080000:0.0:1721880431.402406:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087bbea00, transno 4296018490 00000004:00080000:0.0:1721880431.402407:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a05fea00, transno 4296018491 00000004:00080000:0.0:1721880431.402409:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087bbce00, transno 4296018492 00000004:00080000:0.0:1721880431.402411:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a05fe300, transno 4296018493 00000004:00080000:0.0:1721880431.402412:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091937800, transno 4296018494 00000004:00080000:0.0:1721880431.402414:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007c84b100, transno 4296018495 00000004:00080000:0.0:1721880431.402415:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087bbd880, transno 4296018496 00000004:00080000:0.0:1721880431.402417:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095986d80, transno 4296018497 00000004:00080000:0.0:1721880431.402419:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f7aa680, transno 4296018498 00000004:00080000:0.0:1721880431.402421:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095987800, transno 4296018499 00000004:00080000:0.0:1721880431.402422:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095986300, transno 4296018500 00000004:00080000:0.0:1721880431.402424:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ea31500, transno 4296018501 00000004:00080000:0.0:1721880431.402425:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ea30a80, transno 4296018502 00000004:00080000:0.0:1721880431.402427:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ea33480, transno 4296018503 00000004:00080000:0.0:1721880431.402429:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095985180, transno 4296018504 00000004:00080000:0.0:1721880431.402431:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088b03800, transno 4296018505 00000004:00080000:0.0:1721880431.402432:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ea30e00, transno 4296018506 00000004:00080000:0.0:1721880431.402434:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f7a8a80, transno 4296018507 00000004:00080000:0.0:1721880431.402435:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801258f9880, transno 4296018508 00000004:00080000:0.0:1721880431.402437:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085908a80, transno 4296018509 00000004:00080000:0.0:1721880431.402438:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bdd9f80, transno 4296018510 00000004:00080000:0.0:1721880431.402439:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085908e00, transno 4296018511 00000004:00080000:0.0:1721880431.402441:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087798a80, transno 4296018512 00000004:00080000:0.0:1721880431.402442:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087799500, transno 4296018513 00000004:00080000:0.0:1721880431.402444:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087798380, transno 4296018514 00000004:00080000:0.0:1721880431.402445:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085909180, transno 4296018515 00000004:00080000:0.0:1721880431.402446:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091bae300, transno 4296018516 00000004:00080000:0.0:1721880431.402448:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091badc00, transno 4296018517 00000004:00080000:0.0:1721880431.402449:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008be50000, transno 4296018518 00000004:00080000:0.0:1721880431.402451:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008be52d80, transno 4296018519 00000004:00080000:0.0:1721880431.402452:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008be52a00, transno 4296018520 00000004:00080000:0.0:1721880431.402454:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008be50a80, transno 4296018521 00000004:00080000:0.0:1721880431.402455:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801258faa00, transno 4296018522 00000004:00080000:0.0:1721880431.402457:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095984700, transno 4296018523 00000004:00080000:0.0:1721880431.402458:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ea31180, transno 4296018524 00000004:00080000:0.0:1721880431.402460:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bddbb80, transno 4296018525 00000004:00080000:0.0:1721880431.402461:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f7a9180, transno 4296018526 00000004:00080000:0.0:1721880431.402463:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008be51f80, transno 4296018527 00000004:00080000:0.0:1721880431.402465:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008779b100, transno 4296018528 00000004:00080000:0.0:1721880431.402467:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131ea6680, transno 4296018529 00000004:00080000:0.0:1721880431.402469:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009fbaed80, transno 4296018530 00000004:00080000:0.0:1721880431.402471:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009fbaca80, transno 4296018531 00000004:00080000:0.0:1721880431.402473:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131ea4000, transno 4296018532 00000004:00080000:0.0:1721880431.402475:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131ea5880, transno 4296018533 00000004:00080000:0.0:1721880431.402476:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131ea5f80, transno 4296018534 00000004:00080000:0.0:1721880431.402477:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131ea7800, transno 4296018535 00000004:00080000:0.0:1721880431.402479:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131ea7480, transno 4296018536 00000004:00080000:0.0:1721880431.402480:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131ea5500, transno 4296018537 00000004:00080000:0.0:1721880431.402482:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131ea6d80, transno 4296018538 00000004:00080000:0.0:1721880431.402483:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095984a80, transno 4296018539 00000004:00080000:0.0:1721880431.402485:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131ea4700, transno 4296018540 00000004:00080000:0.0:1721880431.402486:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c4e6300, transno 4296018541 00000004:00080000:0.0:1721880431.402488:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a05ffb80, transno 4296018542 00000004:00080000:0.0:1721880431.402490:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c4e6d80, transno 4296018543 00000004:00080000:0.0:1721880431.402492:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880124805880, transno 4296018544 00000004:00080000:0.0:1721880431.402494:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009fbad500, transno 4296018545 00000004:00080000:0.0:1721880431.402496:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c4e6a00, transno 4296018546 00000004:00080000:0.0:1721880431.402499:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009fbac700, transno 4296018547 00000004:00080000:0.0:1721880431.402501:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088415500, transno 4296018548 00000004:00080000:0.0:1721880431.402504:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088414e00, transno 4296018549 00000004:00080000:0.0:1721880431.402506:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088414380, transno 4296018550 00000004:00080000:0.0:1721880431.402508:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800997bc380, transno 4296018551 00000004:00080000:0.0:1721880431.402510:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800997bdc00, transno 4296018552 00000004:00080000:0.0:1721880431.402513:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088414000, transno 4296018553 00000004:00080000:0.0:1721880431.402515:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008779bb80, transno 4296018554 00000004:00080000:0.0:1721880431.402517:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008be53b80, transno 4296018555 00000004:00080000:0.0:1721880431.402520:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087798000, transno 4296018556 00000004:00080000:0.0:1721880431.402523:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a05fd500, transno 4296018557 00000004:00080000:0.0:1721880431.402526:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094691c00, transno 4296018558 00000004:00080000:0.0:1721880431.402528:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a05fed80, transno 4296018559 00000004:00080000:0.0:1721880431.402531:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094690700, transno 4296018560 00000004:00080000:0.0:1721880431.402534:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094692300, transno 4296018561 00000004:00080000:0.0:1721880431.402536:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094690000, transno 4296018562 00000004:00080000:0.0:1721880431.402539:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a05ff800, transno 4296018563 00000004:00080000:0.0:1721880431.402541:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098b54000, transno 4296018564 00000004:00080000:0.0:1721880431.402544:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098b55180, transno 4296018565 00000004:00080000:0.0:1721880431.402546:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098b54380, transno 4296018566 00000004:00080000:0.0:1721880431.402549:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098b55c00, transno 4296018567 00000004:00080000:0.0:1721880431.402551:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094693100, transno 4296018568 00000004:00080000:0.0:1721880431.402554:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098b54e00, transno 4296018569 00000004:00080000:0.0:1721880431.402557:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fc35f80, transno 4296018570 00000004:00080000:0.0:1721880431.402560:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fc36300, transno 4296018571 00000004:00080000:0.0:1721880431.402562:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fc36a00, transno 4296018572 00000004:00080000:0.0:1721880431.402564:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fc34380, transno 4296018573 00000004:00080000:0.0:1721880431.402566:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f12e680, transno 4296018574 00000004:00080000:0.0:1721880431.402567:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f12f100, transno 4296018575 00000004:00080000:0.0:1721880431.402569:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800997bd880, transno 4296018576 00000004:00080000:0.0:1721880431.402571:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d0c1880, transno 4296018577 00000004:00080000:0.0:1721880431.402573:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088dd4700, transno 4296018578 00000004:00080000:0.0:1721880431.402575:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088dd4000, transno 4296018579 00000004:00080000:0.0:1721880431.402576:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800997bfb80, transno 4296018580 00000004:00080000:0.0:1721880431.402578:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091137b80, transno 4296018581 00000004:00080000:0.0:1721880431.402579:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125985500, transno 4296018582 00000004:00080000:0.0:1721880431.402581:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125984a80, transno 4296018583 00000004:00080000:0.0:1721880431.402582:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800997bf100, transno 4296018584 00000004:00080000:0.0:1721880431.402584:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088dd6680, transno 4296018585 00000004:00080000:0.0:1721880431.402585:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800997bce00, transno 4296018586 00000004:00080000:0.0:1721880431.402587:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fc37b80, transno 4296018587 00000004:00080000:0.0:1721880431.402589:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fc35500, transno 4296018588 00000004:00080000:0.0:1721880431.402591:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fc36680, transno 4296018589 00000004:00080000:0.0:1721880431.402592:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fc34a80, transno 4296018590 00000004:00080000:0.0:1721880431.402594:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fc34000, transno 4296018591 00000004:00080000:0.0:1721880431.402595:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091136a00, transno 4296018592 00000004:00080000:0.0:1721880431.402597:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091136300, transno 4296018593 00000004:00080000:0.0:1721880431.402599:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091135c00, transno 4296018594 00000004:00080000:0.0:1721880431.402600:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800997bea00, transno 4296018595 00000004:00080000:0.0:1721880431.402602:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fc34e00, transno 4296018596 00000004:00080000:0.0:1721880431.402603:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094693800, transno 4296018597 00000004:00080000:0.0:1721880431.402605:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800997bd500, transno 4296018598 00000004:00080000:0.0:1721880431.402606:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800997bf800, transno 4296018599 00000004:00080000:0.0:1721880431.402608:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094693b80, transno 4296018600 00000004:00080000:0.0:1721880431.402609:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094692680, transno 4296018601 00000004:00080000:0.0:1721880431.402611:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f12fb80, transno 4296018602 00000004:00080000:0.0:1721880431.402612:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800887a8e00, transno 4296018603 00000004:00080000:0.0:1721880431.402613:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800887a9c00, transno 4296018604 00000004:00080000:0.0:1721880431.402615:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098b54a80, transno 4296018605 00000004:00080000:0.0:1721880431.402617:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134e95880, transno 4296018606 00000004:00080000:0.0:1721880431.402618:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134e97100, transno 4296018607 00000004:00080000:0.0:1721880431.402620:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134e95180, transno 4296018608 00000004:00080000:0.0:1721880431.402622:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134e96d80, transno 4296018609 00000004:00080000:0.0:1721880431.402623:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134e96300, transno 4296018610 00000004:00080000:0.0:1721880431.402625:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088416d80, transno 4296018611 00000004:00080000:0.0:1721880431.402626:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134e94e00, transno 4296018612 00000004:00080000:0.0:1721880431.402628:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800887abb80, transno 4296018613 00000004:00080000:0.0:1721880431.402629:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800997bf480, transno 4296018614 00000004:00080000:0.0:1721880431.402631:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800997bed80, transno 4296018615 00000004:00080000:0.0:1721880431.402632:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a05ff480, transno 4296018616 00000004:00080000:0.0:1721880431.402634:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a05fc000, transno 4296018617 00000004:00080000:0.0:1721880431.402636:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d8cc000, transno 4296018618 00000004:00080000:0.0:1721880431.402638:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d8cf480, transno 4296018619 00000004:00080000:0.0:1721880431.402640:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d8cca80, transno 4296018620 00000004:00080000:0.0:1721880431.402641:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d8cd500, transno 4296018621 00000004:00080000:0.0:1721880431.402644:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e3df800, transno 4296018622 00000004:00080000:0.0:1721880431.402645:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e3dc700, transno 4296018623 00000004:00080000:0.0:1721880431.402648:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e3dd180, transno 4296018624 00000004:00080000:0.0:1721880431.402649:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e3dce00, transno 4296018625 00000004:00080000:0.0:1721880431.402650:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800876e7800, transno 4296018626 00000004:00080000:0.0:1721880431.402652:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800876e6d80, transno 4296018627 00000004:00080000:0.0:1721880431.402654:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800876e7100, transno 4296018628 00000004:00080000:0.0:1721880431.402655:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e3dca80, transno 4296018629 00000004:00080000:0.0:1721880431.402657:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ca4ce00, transno 4296018630 00000004:00080000:0.0:1721880431.402659:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088aa8a80, transno 4296018631 00000004:00080000:0.0:1721880431.402660:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088aa8380, transno 4296018632 00000004:00080000:0.0:1721880431.402661:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088aa8e00, transno 4296018633 00000004:00080000:0.0:1721880431.402663:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800876e5500, transno 4296018634 00000004:00080000:0.0:1721880431.402664:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b92300, transno 4296018635 00000004:00080000:0.0:1721880431.402666:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b93b80, transno 4296018636 00000004:00080000:0.0:1721880431.402668:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009fbac380, transno 4296018637 00000004:00080000:0.0:1721880431.402669:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b90e00, transno 4296018638 00000004:00080000:0.0:1721880431.402671:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099490e00, transno 4296018639 00000004:00080000:0.0:1721880431.402672:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800876e4e00, transno 4296018640 00000004:00080000:0.0:1721880431.402674:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d8cdc00, transno 4296018641 00000004:00080000:0.0:1721880431.402675:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d8cd180, transno 4296018642 00000004:00080000:0.0:1721880431.402677:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ca4c700, transno 4296018643 00000004:00080000:0.0:1721880431.402678:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bdd8380, transno 4296018644 00000004:00080000:0.0:1721880431.402680:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962ac000, transno 4296018645 00000004:00080000:0.0:1721880431.402682:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962ac700, transno 4296018646 00000004:00080000:0.0:1721880431.402683:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962af480, transno 4296018647 00000004:00080000:0.0:1721880431.402685:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098b55880, transno 4296018648 00000004:00080000:0.0:1721880431.402687:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ca4d880, transno 4296018649 00000004:00080000:0.0:1721880431.402689:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009fbac000, transno 4296018650 00000004:00080000:0.0:1721880431.402690:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099492d80, transno 4296018651 00000004:00080000:0.0:1721880431.402692:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009fbaf100, transno 4296018652 00000004:00080000:0.0:1721880431.402694:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800994b3b80, transno 4296018653 00000004:00080000:0.0:1721880431.402695:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800994b1180, transno 4296018654 00000004:00080000:0.0:1721880431.402697:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800994b0380, transno 4296018655 00000004:00080000:0.0:1721880431.402699:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a05fdc00, transno 4296018656 00000004:00080000:0.0:1721880431.402701:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800994b3480, transno 4296018657 00000004:00080000:0.0:1721880431.402713:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ad29500, transno 4296018658 00000004:00080000:0.0:1721880431.402715:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ad29880, transno 4296018659 00000004:00080000:0.0:1721880431.402717:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f7a8000, transno 4296018660 00000004:00080000:0.0:1721880431.402719:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ad2a680, transno 4296018661 00000004:00080000:0.0:1721880431.402720:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ad2b800, transno 4296018662 00000004:00080000:0.0:1721880431.402722:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ad28700, transno 4296018663 00000004:00080000:0.0:1721880431.402724:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a0bca300, transno 4296018664 00000004:00080000:0.0:1721880431.402740:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a0bc9f80, transno 4296018665 00000004:00080000:0.0:1721880431.402742:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099491180, transno 4296018666 00000004:00080000:0.0:1721880431.402743:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962af100, transno 4296018667 00000004:00080000:0.0:1721880431.402745:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962aea00, transno 4296018668 00000004:00080000:0.0:1721880431.402747:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009fbae300, transno 4296018669 00000004:00080000:0.0:1721880431.402748:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009fbafb80, transno 4296018670 00000004:00080000:0.0:1721880431.402750:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009aff8380, transno 4296018671 00000004:00080000:0.0:1721880431.402751:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ca4f800, transno 4296018672 00000004:00080000:0.0:1721880431.402753:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099493b80, transno 4296018673 00000004:00080000:0.0:1721880431.402755:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ca4d500, transno 4296018674 00000004:00080000:0.0:1721880431.402757:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e3dd880, transno 4296018675 00000004:00080000:0.0:1721880431.402759:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a0bc9500, transno 4296018676 00000004:00080000:0.0:1721880431.402761:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a0bcb100, transno 4296018677 00000004:00080000:0.0:1721880431.402763:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088aa8700, transno 4296018678 00000004:00080000:0.0:1721880431.402764:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a0bc8e00, transno 4296018679 00000004:00080000:0.0:1721880431.402766:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088aa9880, transno 4296018680 00000004:00080000:0.0:1721880431.402768:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a05fd180, transno 4296018681 00000004:00080000:0.0:1721880431.402770:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962aca80, transno 4296018682 00000004:00080000:0.0:1721880431.402771:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099493100, transno 4296018683 00000004:00080000:0.0:1721880431.402772:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ad28e00, transno 4296018684 00000004:00080000:0.0:1721880431.402774:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ad28380, transno 4296018685 00000004:00080000:0.0:1721880431.402775:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ad2b480, transno 4296018686 00000004:00080000:0.0:1721880431.402777:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cc72300, transno 4296018687 00000004:00080000:0.0:1721880431.402778:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ad2b100, transno 4296018688 00000004:00080000:0.0:1721880431.402780:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009aff8700, transno 4296018689 00000004:00080000:0.0:1721880431.402781:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ad28000, transno 4296018690 00000004:00080000:0.0:1721880431.402783:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800994b2680, transno 4296018691 00000004:00080000:0.0:1721880431.402785:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800994b2300, transno 4296018692 00000004:00080000:0.0:1721880431.402786:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a0bca680, transno 4296018693 00000004:00080000:0.0:1721880431.402788:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cc70a80, transno 4296018694 00000004:00080000:0.0:1721880431.402790:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122fd1f80, transno 4296018695 00000004:00080000:0.0:1721880431.402792:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122fd2a00, transno 4296018696 00000004:00080000:0.0:1721880431.402793:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007cbca300, transno 4296018697 00000004:00080000:0.0:1721880431.402794:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007cbcb100, transno 4296018698 00000004:00080000:0.0:1721880431.402796:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007cbcb480, transno 4296018699 00000004:00080000:0.0:1721880431.402798:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b91f80, transno 4296018700 00000004:00080000:0.0:1721880431.402799:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b92a00, transno 4296018701 00000004:00080000:0.0:1721880431.402801:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b93100, transno 4296018702 00000004:00080000:0.0:1721880431.402803:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b93800, transno 4296018703 00000004:00080000:0.0:1721880431.402804:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962adc00, transno 4296018704 00000004:00080000:0.0:1721880431.402806:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f7aaa00, transno 4296018705 00000004:00080000:0.0:1721880431.402807:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099491f80, transno 4296018706 00000004:00080000:0.0:1721880431.402809:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800994b3100, transno 4296018707 00000004:00080000:0.0:1721880431.402811:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ca4d180, transno 4296018708 00000004:00080000:0.0:1721880431.402813:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800994b0700, transno 4296018709 00000004:00080000:0.0:1721880431.402815:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a0bc8000, transno 4296018710 00000004:00080000:0.0:1721880431.402816:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a0bc8a80, transno 4296018711 00000004:00080000:0.0:1721880431.402818:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cc73480, transno 4296018712 00000004:00080000:0.0:1721880431.402820:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cc70380, transno 4296018713 00000004:00080000:0.0:1721880431.402821:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009affa680, transno 4296018714 00000004:00080000:0.0:1721880431.402822:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cc73b80, transno 4296018715 00000004:00080000:0.0:1721880431.402824:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009979c000, transno 4296018716 00000004:00080000:0.0:1721880431.402825:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e3ded80, transno 4296018717 00000004:00080000:0.0:1721880431.402827:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009aff8a80, transno 4296018718 00000004:00080000:0.0:1721880431.402828:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d8cce00, transno 4296018719 00000004:00080000:0.0:1721880431.402830:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b91880, transno 4296018720 00000004:00080000:0.0:1721880431.402832:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b65f80, transno 4296018721 00000004:00080000:0.0:1721880431.402833:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b66300, transno 4296018722 00000004:00080000:0.0:1721880431.402835:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b64000, transno 4296018723 00000004:00080000:0.0:1721880431.402836:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007cbca680, transno 4296018724 00000004:00080000:0.0:1721880431.402838:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091b7a680, transno 4296018725 00000004:00080000:0.0:1721880431.402840:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cc72680, transno 4296018726 00000004:00080000:0.0:1721880431.402841:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cc70000, transno 4296018727 00000004:00080000:0.0:1721880431.402843:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091b78a80, transno 4296018728 00000004:00080000:0.0:1721880431.402844:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007cbc8a80, transno 4296018729 00000004:00080000:0.0:1721880431.402846:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800973f5500, transno 4296018730 00000004:00080000:0.0:1721880431.402848:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b67100, transno 4296018731 00000004:00080000:0.0:1721880431.402850:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009979d180, transno 4296018732 00000004:00080000:0.0:1721880431.402851:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009979f800, transno 4296018733 00000004:00080000:0.0:1721880431.402853:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800973f5f80, transno 4296018734 00000004:00080000:0.0:1721880431.402854:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800973f4000, transno 4296018735 00000004:00080000:0.0:1721880431.402856:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009979dc00, transno 4296018736 00000004:00080000:0.0:1721880431.402857:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009979e680, transno 4296018737 00000004:00080000:0.0:1721880431.402872:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bca6300, transno 4296018738 00000004:00080000:0.0:1721880431.402874:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009979d880, transno 4296018739 00000004:00080000:0.0:1721880431.402876:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bca4700, transno 4296018740 00000004:00080000:0.0:1721880431.402877:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bca7b80, transno 4296018741 00000004:00080000:0.0:1721880431.402879:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009aff8000, transno 4296018742 00000004:00080000:0.0:1721880431.402881:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009affb480, transno 4296018743 00000004:00080000:0.0:1721880431.402883:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007cbc8700, transno 4296018744 00000004:00080000:0.0:1721880431.402884:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b64a80, transno 4296018745 00000004:00080000:0.0:1721880431.402887:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091b79f80, transno 4296018746 00000004:00080000:0.0:1721880431.402888:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800973f6d80, transno 4296018747 00000004:00080000:0.0:1721880431.402890:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801362ca680, transno 4296018748 00000004:00080000:0.0:1721880431.402892:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bca4380, transno 4296018749 00000004:00080000:0.0:1721880431.402893:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801362c9880, transno 4296018750 00000004:00080000:0.0:1721880431.402895:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801362c9f80, transno 4296018751 00000004:00080000:0.0:1721880431.402896:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bf54700, transno 4296018752 00000004:00080000:0.0:1721880431.402898:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bf55f80, transno 4296018753 00000004:00080000:0.0:1721880431.402900:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bf54a80, transno 4296018754 00000004:00080000:0.0:1721880431.402901:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801362c8000, transno 4296018755 00000004:00080000:0.0:1721880431.402902:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801362caa00, transno 4296018756 00000004:00080000:0.0:1721880431.402904:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d3b8e00, transno 4296018757 00000004:00080000:0.0:1721880431.402906:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800973f4380, transno 4296018758 00000004:00080000:0.0:1721880431.402908:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088d2b480, transno 4296018759 00000004:00080000:0.0:1721880431.402909:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801362cb480, transno 4296018760 00000004:00080000:0.0:1721880431.402911:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800859adf80, transno 4296018761 00000004:00080000:0.0:1721880431.402912:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800859adc00, transno 4296018762 00000004:00080000:0.0:1721880431.402914:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800859ac380, transno 4296018763 00000004:00080000:0.0:1721880431.402915:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800859afb80, transno 4296018764 00000004:00080000:0.0:1721880431.402917:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800859ac000, transno 4296018765 00000004:00080000:0.0:1721880431.402919:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d3b8a80, transno 4296018766 00000004:00080000:0.0:1721880431.402920:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f1b5880, transno 4296018767 00000004:00080000:0.0:1721880431.402923:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801362cbb80, transno 4296018768 00000004:00080000:0.0:1721880431.402924:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bca4a80, transno 4296018769 00000004:00080000:0.0:1721880431.402926:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800859af480, transno 4296018770 00000004:00080000:0.0:1721880431.402927:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bca4000, transno 4296018771 00000004:00080000:0.0:1721880431.402929:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800886fce00, transno 4296018772 00000004:00080000:0.0:1721880431.402930:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007cbc9180, transno 4296018773 00000004:00080000:0.0:1721880431.402932:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088d28700, transno 4296018774 00000004:00080000:0.0:1721880431.402933:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f1b5500, transno 4296018775 00000004:00080000:0.0:1721880431.402935:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088d28a80, transno 4296018776 00000004:00080000:0.0:1721880431.402936:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088d2bb80, transno 4296018777 00000004:00080000:0.0:1721880431.402938:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800886ff480, transno 4296018778 00000004:00080000:0.0:1721880431.402939:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800886fd180, transno 4296018779 00000004:00080000:0.0:1721880431.402941:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e34e300, transno 4296018780 00000004:00080000:0.0:1721880431.402942:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801362c8380, transno 4296018781 00000004:00080000:0.0:1721880431.402944:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800886fc380, transno 4296018782 00000004:00080000:0.0:1721880431.402945:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800886ff100, transno 4296018783 00000004:00080000:0.0:1721880431.402947:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088408000, transno 4296018784 00000004:00080000:0.0:1721880431.402948:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088408380, transno 4296018785 00000004:00080000:0.0:1721880431.402950:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801362cb800, transno 4296018786 00000004:00080000:0.0:1721880431.402951:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088408a80, transno 4296018787 00000004:00080000:0.0:1721880431.402953:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008840b800, transno 4296018788 00000004:00080000:0.0:1721880431.402954:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088409c00, transno 4296018789 00000004:00080000:0.0:1721880431.402956:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088409f80, transno 4296018790 00000004:00080000:0.0:1721880431.402957:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e34f480, transno 4296018791 00000004:00080000:0.0:1721880431.402959:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801362c8e00, transno 4296018792 00000004:00080000:0.0:1721880431.402960:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009979ed80, transno 4296018793 00000004:00080000:0.0:1721880431.402962:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f1b5c00, transno 4296018794 00000004:00080000:0.0:1721880431.402964:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f1b7b80, transno 4296018795 00000004:00080000:0.0:1721880431.402965:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800859ac700, transno 4296018796 00000004:00080000:0.0:1721880431.402966:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098a5b480, transno 4296018797 00000004:00080000:0.0:1721880431.402969:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800859ad880, transno 4296018798 00000004:00080000:0.0:1721880431.402970:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088d29180, transno 4296018799 00000004:00080000:0.0:1721880431.402972:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088d2ad80, transno 4296018800 00000004:00080000:0.0:1721880431.402974:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098a5bb80, transno 4296018801 00000004:00080000:0.0:1721880431.402975:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800876e4700, transno 4296018802 00000004:00080000:0.0:1721880431.402977:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800997bdf80, transno 4296018803 00000004:00080000:0.0:1721880431.402978:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b986a00, transno 4296018804 00000004:00080000:0.0:1721880431.402980:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b987480, transno 4296018805 00000004:00080000:0.0:1721880431.402981:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b986680, transno 4296018806 00000004:00080000:0.0:1721880431.402983:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b987b80, transno 4296018807 00000004:00080000:0.0:1721880431.402984:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b985500, transno 4296018808 00000004:00080000:0.0:1721880431.402986:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b984700, transno 4296018809 00000004:00080000:0.0:1721880431.402987:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b985180, transno 4296018810 00000004:00080000:0.0:1721880431.402989:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800876e7b80, transno 4296018811 00000004:00080000:0.0:1721880431.402990:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b0f8700, transno 4296018812 00000004:00080000:0.0:1721880431.402992:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b0fa680, transno 4296018813 00000004:00080000:0.0:1721880431.402993:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b0f8e00, transno 4296018814 00000004:00080000:0.0:1721880431.402994:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b0fad80, transno 4296018815 00000004:00080000:0.0:1721880431.402996:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b0faa00, transno 4296018816 00000004:00080000:0.0:1721880431.402997:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b0f8a80, transno 4296018817 00000004:00080000:0.0:1721880431.402998:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b0f8000, transno 4296018818 00000004:00080000:0.0:1721880431.403000:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b0fb480, transno 4296018819 00000004:00080000:0.0:1721880431.403001:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e34d880, transno 4296018820 00000004:00080000:0.0:1721880431.403002:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131ece300, transno 4296018821 00000004:00080000:0.0:1721880431.403004:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801362c8a80, transno 4296018822 00000004:00080000:0.0:1721880431.403005:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e34ce00, transno 4296018823 00000004:00080000:0.0:1721880431.403006:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bca5500, transno 4296018824 00000004:00080000:0.0:1721880431.403008:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131ecd500, transno 4296018825 00000004:00080000:0.0:1721880431.403009:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131ecdf80, transno 4296018826 00000004:00080000:0.0:1721880431.403011:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b0fbb80, transno 4296018827 00000004:00080000:0.0:1721880431.403013:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e34d500, transno 4296018828 00000004:00080000:0.0:1721880431.403015:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012d74f480, transno 4296018829 00000004:00080000:0.0:1721880431.403017:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088408e00, transno 4296018830 00000004:00080000:0.0:1721880431.403018:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012d74c380, transno 4296018831 00000004:00080000:0.0:1721880431.403021:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008840bb80, transno 4296018832 00000004:00080000:0.0:1721880431.403023:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800859aea00, transno 4296018833 00000004:00080000:0.0:1721880431.403025:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bf54e00, transno 4296018834 00000004:00080000:0.0:1721880431.403027:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bf56300, transno 4296018835 00000004:00080000:0.0:1721880431.403030:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fbc2d80, transno 4296018836 00000004:00080000:0.0:1721880431.403033:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fbc1180, transno 4296018837 00000004:00080000:0.0:1721880431.403036:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fbc2a00, transno 4296018838 00000004:00080000:0.0:1721880431.403038:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fbc0a80, transno 4296018839 00000004:00080000:0.0:1721880431.403041:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fbc1f80, transno 4296018840 00000004:00080000:0.0:1721880431.403043:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800973f5180, transno 4296018841 00000004:00080000:0.0:1721880431.403046:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bca5c00, transno 4296018842 00000004:00080000:0.0:1721880431.403048:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d3b9880, transno 4296018843 00000004:00080000:0.0:1721880431.403051:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fbc1500, transno 4296018844 00000004:00080000:0.0:1721880431.403053:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d3b9f80, transno 4296018845 00000004:00080000:0.0:1721880431.403056:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fbc2680, transno 4296018846 00000004:00080000:0.0:1721880431.403059:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fbc3800, transno 4296018847 00000004:00080000:0.0:1721880431.403062:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fbc1880, transno 4296018848 00000004:00080000:0.0:1721880431.403065:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088409880, transno 4296018849 00000004:00080000:0.0:1721880431.403068:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008840a680, transno 4296018850 00000004:00080000:0.0:1721880431.403071:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087be2680, transno 4296018851 00000004:00080000:0.0:1721880431.403074:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008840b100, transno 4296018852 00000004:00080000:0.0:1721880431.403076:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087be3100, transno 4296018853 00000004:00080000:0.0:1721880431.403079:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087be3800, transno 4296018854 00000004:00080000:0.0:1721880431.403081:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087be3b80, transno 4296018855 00000004:00080000:0.0:1721880431.403084:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085850a80, transno 4296018856 00000004:00080000:0.0:1721880431.403087:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085850700, transno 4296018857 00000004:00080000:0.0:1721880431.403090:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012d74ed80, transno 4296018858 00000004:00080000:0.0:1721880431.403093:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012d74f100, transno 4296018859 00000004:00080000:0.0:1721880431.403095:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012d74dc00, transno 4296018860 00000004:00080000:0.0:1721880431.403097:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b0f9180, transno 4296018861 00000004:00080000:0.0:1721880431.403100:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131ecce00, transno 4296018862 00000004:00080000:0.0:1721880431.403102:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bdf9f80, transno 4296018863 00000004:00080000:0.0:1721880431.403104:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fbc0000, transno 4296018864 00000004:00080000:0.0:1721880431.403105:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800859ad180, transno 4296018865 00000004:00080000:0.0:1721880431.403108:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b75d500, transno 4296018866 00000004:00080000:0.0:1721880431.403110:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b75c380, transno 4296018867 00000004:00080000:0.0:1721880431.403111:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b75ce00, transno 4296018868 00000004:00080000:0.0:1721880431.403113:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b75e680, transno 4296018869 00000004:00080000:0.0:1721880431.403114:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b75fb80, transno 4296018870 00000004:00080000:0.0:1721880431.403116:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b75d180, transno 4296018871 00000004:00080000:0.0:1721880431.403117:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b81180, transno 4296018872 00000004:00080000:0.0:1721880431.403119:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012d74df80, transno 4296018873 00000004:00080000:0.0:1721880431.403120:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012d74c000, transno 4296018874 00000004:00080000:0.0:1721880431.403122:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b83800, transno 4296018875 00000004:00080000:0.0:1721880431.403124:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087be0700, transno 4296018876 00000004:00080000:0.0:1721880431.403126:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125a69180, transno 4296018877 00000004:00080000:0.0:1721880431.403128:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125a6bb80, transno 4296018878 00000004:00080000:0.0:1721880431.403129:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125a6ad80, transno 4296018879 00000004:00080000:0.0:1721880431.403131:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087be1f80, transno 4296018880 00000004:00080000:0.0:1721880431.403132:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085850e00, transno 4296018881 00000004:00080000:0.0:1721880431.403134:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085851f80, transno 4296018882 00000004:00080000:0.0:1721880431.403136:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087be2300, transno 4296018883 00000004:00080000:0.0:1721880431.403137:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bca5f80, transno 4296018884 00000004:00080000:0.0:1721880431.403139:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800859ae680, transno 4296018885 00000004:00080000:0.0:1721880431.403141:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125a68e00, transno 4296018886 00000004:00080000:0.0:1721880431.403142:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091b78000, transno 4296018887 00000004:00080000:0.0:1721880431.403144:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012d74d180, transno 4296018888 00000004:00080000:0.0:1721880431.403147:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b75df80, transno 4296018889 00000004:00080000:0.0:1721880431.403149:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b75f100, transno 4296018890 00000004:00080000:0.0:1721880431.403150:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012d74c700, transno 4296018891 00000004:00080000:0.0:1721880431.403152:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125a69c00, transno 4296018892 00000004:00080000:0.0:1721880431.403154:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007294c000, transno 4296018893 00000004:00080000:0.0:1721880431.403155:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007294d500, transno 4296018894 00000004:00080000:0.0:1721880431.403157:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007294d180, transno 4296018895 00000004:00080000:0.0:1721880431.403159:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092a95500, transno 4296018896 00000004:00080000:0.0:1721880431.403160:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007294c380, transno 4296018897 00000004:00080000:0.0:1721880431.403162:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009fbdb100, transno 4296018898 00000004:00080000:0.0:1721880431.403163:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092a95880, transno 4296018899 00000004:00080000:0.0:1721880431.403165:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092a97b80, transno 4296018900 00000004:00080000:0.0:1721880431.403167:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007294ed80, transno 4296018901 00000004:00080000:0.0:1721880431.403168:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007294d880, transno 4296018902 00000004:00080000:0.0:1721880431.403170:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007294df80, transno 4296018903 00000004:00080000:0.0:1721880431.403171:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007294ea00, transno 4296018904 00000004:00080000:0.0:1721880431.403172:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009fbdad80, transno 4296018905 00000004:00080000:0.0:1721880431.403174:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007294fb80, transno 4296018906 00000004:00080000:0.0:1721880431.403176:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009fbd8380, transno 4296018907 00000004:00080000:0.0:1721880431.403178:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009fbdaa00, transno 4296018908 00000004:00080000:0.0:1721880431.403180:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009fbd8000, transno 4296018909 00000004:00080000:0.0:1721880431.403181:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009fbd8e00, transno 4296018910 00000004:00080000:0.0:1721880431.403183:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009fbd9180, transno 4296018911 00000004:00080000:0.0:1721880431.403184:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009fbda680, transno 4296018912 00000004:00080000:0.0:1721880431.403186:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009fbd9880, transno 4296018913 00000004:00080000:0.0:1721880431.403187:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009fbd8700, transno 4296018914 00000004:00080000:0.0:1721880431.403188:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b987800, transno 4296018915 00000004:00080000:0.0:1721880431.403189:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b80e00, transno 4296018916 00000004:00080000:0.0:1721880431.403191:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b81500, transno 4296018917 00000004:00080000:0.0:1721880431.403193:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d33d500, transno 4296018918 00000004:00080000:0.0:1721880431.403195:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d33e680, transno 4296018919 00000004:00080000:0.0:1721880431.403197:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012d74f800, transno 4296018920 00000004:00080000:0.0:1721880431.403199:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009fbdb480, transno 4296018921 00000004:00080000:0.0:1721880431.403200:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092a96300, transno 4296018922 00000004:00080000:0.0:1721880431.403202:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d33ce00, transno 4296018923 00000004:00080000:0.0:1721880431.403203:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bf56d80, transno 4296018924 00000004:00080000:0.0:1721880431.403205:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085851180, transno 4296018925 00000004:00080000:0.0:1721880431.403206:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fd14380, transno 4296018926 00000004:00080000:0.0:1721880431.403208:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fd17480, transno 4296018927 00000004:00080000:0.0:1721880431.403209:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009745ca80, transno 4296018928 00000004:00080000:0.0:1721880431.403211:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fd15c00, transno 4296018929 00000004:00080000:0.0:1721880431.403212:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fd15f80, transno 4296018930 00000004:00080000:0.0:1721880431.403214:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009745c700, transno 4296018931 00000004:00080000:0.0:1721880431.403215:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d33f480, transno 4296018932 00000004:00080000:0.0:1721880431.403217:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009745d180, transno 4296018933 00000004:00080000:0.0:1721880431.403219:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085852300, transno 4296018934 00000004:00080000:0.0:1721880431.403220:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e47aa00, transno 4296018935 00000004:00080000:0.0:1721880431.403222:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e47bb80, transno 4296018936 00000004:00080000:0.0:1721880431.403223:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012c885c00, transno 4296018937 00000004:00080000:0.0:1721880431.403225:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085853b80, transno 4296018938 00000004:00080000:0.0:1721880431.403226:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012c885180, transno 4296018939 00000004:00080000:0.0:1721880431.403227:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012c884e00, transno 4296018940 00000004:00080000:0.0:1721880431.403229:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008840a300, transno 4296018941 00000004:00080000:0.0:1721880431.403230:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f128a80, transno 4296018942 00000004:00080000:0.0:1721880431.403232:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f1b7480, transno 4296018943 00000004:00080000:0.0:1721880431.403233:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f129c00, transno 4296018944 00000004:00080000:0.0:1721880431.403235:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f12bb80, transno 4296018945 00000004:00080000:0.0:1721880431.403236:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f12a680, transno 4296018946 00000004:00080000:0.0:1721880431.403237:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012c884380, transno 4296018947 00000004:00080000:0.0:1721880431.403239:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012c887b80, transno 4296018948 00000004:00080000:0.0:1721880431.403240:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012c884000, transno 4296018949 00000004:00080000:0.0:1721880431.403241:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012c886a00, transno 4296018950 00000004:00080000:0.0:1721880431.403243:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131eced80, transno 4296018951 00000004:00080000:0.0:1721880431.403244:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bf56a00, transno 4296018952 00000004:00080000:0.0:1721880431.403246:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d33c380, transno 4296018953 00000004:00080000:0.0:1721880431.403247:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092a97100, transno 4296018954 00000004:00080000:0.0:1721880431.403248:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012c885880, transno 4296018955 00000004:00080000:0.0:1721880431.403249:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b75d880, transno 4296018956 00000004:00080000:0.0:1721880431.403251:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085853100, transno 4296018957 00000004:00080000:0.0:1721880431.403252:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e47b800, transno 4296018958 00000004:00080000:0.0:1721880431.403254:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e479500, transno 4296018959 00000004:00080000:0.0:1721880431.403255:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b0f8380, transno 4296018960 00000004:00080000:0.0:1721880431.403256:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d3b9180, transno 4296018961 00000004:00080000:0.0:1721880431.403258:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d3ba680, transno 4296018962 00000004:00080000:0.0:1721880431.403259:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cd4e300, transno 4296018963 00000004:00080000:0.0:1721880431.403261:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e478a80, transno 4296018964 00000004:00080000:0.0:1721880431.403262:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cd4ca80, transno 4296018965 00000004:00080000:0.0:1721880431.403264:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800886fca80, transno 4296018966 00000004:00080000:0.0:1721880431.403265:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007294dc00, transno 4296018967 00000004:00080000:0.0:1721880431.403267:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085851880, transno 4296018968 00000004:00080000:0.0:1721880431.403269:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007294f100, transno 4296018969 00000004:00080000:0.0:1721880431.403270:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b46e300, transno 4296018970 00000004:00080000:0.0:1721880431.403272:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092a94000, transno 4296018971 00000004:00080000:0.0:1721880431.403273:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123a9fb80, transno 4296018972 00000004:00080000:0.0:1721880431.403275:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123a9ea00, transno 4296018973 00000004:00080000:0.0:1721880431.403277:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123a9c380, transno 4296018974 00000004:00080000:0.0:1721880431.403278:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123a9c000, transno 4296018975 00000004:00080000:0.0:1721880431.403280:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123a9ce00, transno 4296018976 00000004:00080000:0.0:1721880431.403282:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123a9df80, transno 4296018977 00000004:00080000:0.0:1721880431.403284:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008755b100, transno 4296018978 00000004:00080000:0.0:1721880431.403286:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123a9ca80, transno 4296018979 00000004:00080000:0.0:1721880431.403288:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087559f80, transno 4296018980 00000004:00080000:0.0:1721880431.403290:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125a6a300, transno 4296018981 00000004:00080000:0.0:1721880431.403291:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b80a80, transno 4296018982 00000004:00080000:0.0:1721880431.403293:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b46c700, transno 4296018983 00000004:00080000:0.0:1721880431.403295:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b46ed80, transno 4296018984 00000004:00080000:0.0:1721880431.403296:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bf56680, transno 4296018985 00000004:00080000:0.0:1721880431.403298:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b46d500, transno 4296018986 00000004:00080000:0.0:1721880431.403299:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800886fc700, transno 4296018987 00000004:00080000:0.0:1721880431.403301:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f129180, transno 4296018988 00000004:00080000:0.0:1721880431.403303:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007294e300, transno 4296018989 00000004:00080000:0.0:1721880431.403304:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fd98000, transno 4296018990 00000004:00080000:0.0:1721880431.403305:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fd98a80, transno 4296018991 00000004:00080000:0.0:1721880431.403307:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125a68000, transno 4296018992 00000004:00080000:0.0:1721880431.403308:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fd9b480, transno 4296018993 00000004:00080000:0.0:1721880431.403309:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fd9ad80, transno 4296018994 00000004:00080000:0.0:1721880431.403311:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e478000, transno 4296018995 00000004:00080000:0.0:1721880431.403312:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fd9bb80, transno 4296018996 00000004:00080000:0.0:1721880431.403314:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085816a00, transno 4296018997 00000004:00080000:0.0:1721880431.403316:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085815f80, transno 4296018998 00000004:00080000:0.0:1721880431.403318:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085815180, transno 4296018999 00000004:00080000:0.0:1721880431.403319:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085814000, transno 4296019000 00000004:00080000:0.0:1721880431.403321:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fbc0e00, transno 4296019001 00000004:00080000:0.0:1721880431.403322:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085816300, transno 4296019002 00000004:00080000:0.0:1721880431.403324:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b80700, transno 4296019003 00000004:00080000:0.0:1721880431.403325:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087558e00, transno 4296019004 00000004:00080000:0.0:1721880431.403327:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087558a80, transno 4296019005 00000004:00080000:0.0:1721880431.403328:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087558380, transno 4296019006 00000004:00080000:0.0:1721880431.403330:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008755a300, transno 4296019007 00000004:00080000:0.0:1721880431.403333:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bc85880, transno 4296019008 00000004:00080000:0.0:1721880431.403336:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b81f80, transno 4296019009 00000004:00080000:0.0:1721880431.403339:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f12ad80, transno 4296019010 00000004:00080000:0.0:1721880431.403341:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f12aa00, transno 4296019011 00000004:00080000:0.0:1721880431.403343:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134e86d80, transno 4296019012 00000004:00080000:0.0:1721880431.403346:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bc87480, transno 4296019013 00000004:00080000:0.0:1721880431.403348:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b415f80, transno 4296019014 00000004:00080000:0.0:1721880431.403351:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b414a80, transno 4296019015 00000004:00080000:0.0:1721880431.403353:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b415880, transno 4296019016 00000004:00080000:0.0:1721880431.403356:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b417b80, transno 4296019017 00000004:00080000:0.0:1721880431.403358:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fd99500, transno 4296019018 00000004:00080000:0.0:1721880431.403360:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fd9aa00, transno 4296019019 00000004:00080000:0.0:1721880431.403363:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fd9b800, transno 4296019020 00000004:00080000:0.0:1721880431.403365:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fd9a300, transno 4296019021 00000004:00080000:0.0:1721880431.403368:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b416300, transno 4296019022 00000004:00080000:0.0:1721880431.403370:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b6c8e00, transno 4296019023 00000004:00080000:0.0:1721880431.403373:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b6c9c00, transno 4296019024 00000004:00080000:0.0:1721880431.403375:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b6c9500, transno 4296019025 00000004:00080000:0.0:1721880431.403378:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800887f5180, transno 4296019026 00000004:00080000:0.0:1721880431.403380:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800887f7800, transno 4296019027 00000004:00080000:0.0:1721880431.403383:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009891c700, transno 4296019028 00000004:00080000:0.0:1721880431.403386:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cd4c000, transno 4296019029 00000004:00080000:0.0:1721880431.403401:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009891ea00, transno 4296019030 00000004:00080000:0.0:1721880431.403404:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800885ef480, transno 4296019031 00000004:00080000:0.0:1721880431.403406:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fbc3b80, transno 4296019032 00000004:00080000:0.0:1721880431.403408:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009891f100, transno 4296019033 00000004:00080000:0.0:1721880431.403410:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009891c000, transno 4296019034 00000004:00080000:0.0:1721880431.403412:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ea4ad80, transno 4296019035 00000004:00080000:0.0:1721880431.403413:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ea4a300, transno 4296019036 00000004:00080000:0.0:1721880431.403416:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123845c00, transno 4296019037 00000004:00080000:0.0:1721880431.403418:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ea49880, transno 4296019038 00000004:00080000:0.0:1721880431.403420:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123844e00, transno 4296019039 00000004:00080000:0.0:1721880431.403421:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123845f80, transno 4296019040 00000004:00080000:0.0:1721880431.403423:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088e03b80, transno 4296019041 00000004:00080000:0.0:1721880431.403425:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088e00a80, transno 4296019042 00000004:00080000:0.0:1721880431.403427:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ffe1880, transno 4296019043 00000004:00080000:0.0:1721880431.403428:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ffe0a80, transno 4296019044 00000004:00080000:0.0:1721880431.403430:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ffe1180, transno 4296019045 00000004:00080000:0.0:1721880431.403431:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088e02d80, transno 4296019046 00000004:00080000:0.0:1721880431.403433:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088e00380, transno 4296019047 00000004:00080000:0.0:1721880431.403434:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ffe1c00, transno 4296019048 00000004:00080000:0.0:1721880431.403435:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ffe3480, transno 4296019049 00000004:00080000:0.0:1721880431.403437:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800887f4380, transno 4296019050 00000004:00080000:0.0:1721880431.403438:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123844000, transno 4296019051 00000004:00080000:0.0:1721880431.403440:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123847100, transno 4296019052 00000004:00080000:0.0:1721880431.403442:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088e02a00, transno 4296019053 00000004:00080000:0.0:1721880431.403443:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ffe2d80, transno 4296019054 00000004:00080000:0.0:1721880431.403445:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f4a2300, transno 4296019055 00000004:00080000:0.0:1721880431.403447:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ea48e00, transno 4296019056 00000004:00080000:0.0:1721880431.403448:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ce11880, transno 4296019057 00000004:00080000:0.0:1721880431.403450:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ce11f80, transno 4296019058 00000004:00080000:0.0:1721880431.403451:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f4a3800, transno 4296019059 00000004:00080000:0.0:1721880431.403454:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f4a0380, transno 4296019060 00000004:00080000:0.0:1721880431.403455:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f4a1f80, transno 4296019061 00000004:00080000:0.0:1721880431.403457:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008589b480, transno 4296019062 00000004:00080000:0.0:1721880431.403458:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123847800, transno 4296019063 00000004:00080000:0.0:1721880431.403459:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085898000, transno 4296019064 00000004:00080000:0.0:1721880431.403461:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008589a680, transno 4296019065 00000004:00080000:0.0:1721880431.403463:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085898700, transno 4296019066 00000004:00080000:0.0:1721880431.403464:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087559c00, transno 4296019067 00000004:00080000:0.0:1721880431.403466:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f4a1880, transno 4296019068 00000004:00080000:0.0:1721880431.403468:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008755ad80, transno 4296019069 00000004:00080000:0.0:1721880431.403470:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087558000, transno 4296019070 00000004:00080000:0.0:1721880431.403472:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085913480, transno 4296019071 00000004:00080000:0.0:1721880431.403474:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ff5ca80, transno 4296019072 00000004:00080000:0.0:1721880431.403475:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ea4b100, transno 4296019073 00000004:00080000:0.0:1721880431.403477:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ff5ed80, transno 4296019074 00000004:00080000:0.0:1721880431.403478:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085910380, transno 4296019075 00000004:00080000:0.0:1721880431.403480:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088e02300, transno 4296019076 00000004:00080000:0.0:1721880431.403482:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f4a2a00, transno 4296019077 00000004:00080000:0.0:1721880431.403483:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009891c380, transno 4296019078 00000004:00080000:0.0:1721880431.403485:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088e01880, transno 4296019079 00000004:00080000:0.0:1721880431.403487:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088e03100, transno 4296019080 00000004:00080000:0.0:1721880431.403488:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123a9e300, transno 4296019081 00000004:00080000:0.0:1721880431.403490:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962aad80, transno 4296019082 00000004:00080000:0.0:1721880431.403491:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962a9880, transno 4296019083 00000004:00080000:0.0:1721880431.403493:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962aa680, transno 4296019084 00000004:00080000:0.0:1721880431.403494:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962a9c00, transno 4296019085 00000004:00080000:0.0:1721880431.403495:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962a8380, transno 4296019086 00000004:00080000:0.0:1721880431.403497:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962abb80, transno 4296019087 00000004:00080000:0.0:1721880431.403499:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ff5e680, transno 4296019088 00000004:00080000:0.0:1721880431.403500:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962ab480, transno 4296019089 00000004:00080000:0.0:1721880431.403503:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b6ca300, transno 4296019090 00000004:00080000:0.0:1721880431.403505:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ff5c700, transno 4296019091 00000004:00080000:0.0:1721880431.403508:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b6cb100, transno 4296019092 00000004:00080000:0.0:1721880431.403510:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ff5f100, transno 4296019093 00000004:00080000:0.0:1721880431.403512:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ff5e300, transno 4296019094 00000004:00080000:0.0:1721880431.403514:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b6c8380, transno 4296019095 00000004:00080000:0.0:1721880431.403516:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123a9ed80, transno 4296019096 00000004:00080000:0.0:1721880431.403518:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085911c00, transno 4296019097 00000004:00080000:0.0:1721880431.403521:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ff5d180, transno 4296019098 00000004:00080000:0.0:1721880431.403524:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088e01180, transno 4296019099 00000004:00080000:0.0:1721880431.403526:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085911180, transno 4296019100 00000004:00080000:0.0:1721880431.403528:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088e00700, transno 4296019101 00000004:00080000:0.0:1721880431.403531:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088e01c00, transno 4296019102 00000004:00080000:0.0:1721880431.403533:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cd4c700, transno 4296019103 00000004:00080000:0.0:1721880431.403535:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ce12680, transno 4296019104 00000004:00080000:0.0:1721880431.403538:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800885ee680, transno 4296019105 00000004:00080000:0.0:1721880431.403541:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ce13480, transno 4296019106 00000004:00080000:0.0:1721880431.403544:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134e84e00, transno 4296019107 00000004:00080000:0.0:1721880431.403547:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085910000, transno 4296019108 00000004:00080000:0.0:1721880431.403550:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123935880, transno 4296019109 00000004:00080000:0.0:1721880431.403552:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134e84000, transno 4296019110 00000004:00080000:0.0:1721880431.403555:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085911f80, transno 4296019111 00000004:00080000:0.0:1721880431.403557:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123934e00, transno 4296019112 00000004:00080000:0.0:1721880431.403560:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ea4bb80, transno 4296019113 00000004:00080000:0.0:1721880431.403562:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123937100, transno 4296019114 00000004:00080000:0.0:1721880431.403564:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123935180, transno 4296019115 00000004:00080000:0.0:1721880431.403566:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123937800, transno 4296019116 00000004:00080000:0.0:1721880431.403567:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085898e00, transno 4296019117 00000004:00080000:0.0:1721880431.403569:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ff5dc00, transno 4296019118 00000004:00080000:0.0:1721880431.403571:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ff5fb80, transno 4296019119 00000004:00080000:0.0:1721880431.403573:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085910e00, transno 4296019120 00000004:00080000:0.0:1721880431.403574:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962a8700, transno 4296019121 00000004:00080000:0.0:1721880431.403576:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800941e8e00, transno 4296019122 00000004:00080000:0.0:1721880431.403578:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ce13100, transno 4296019123 00000004:00080000:0.0:1721880431.403580:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800941e9f80, transno 4296019124 00000004:00080000:0.0:1721880431.403581:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800941e8700, transno 4296019125 00000004:00080000:0.0:1721880431.403582:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800941e9500, transno 4296019126 00000004:00080000:0.0:1721880431.403584:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800941ea680, transno 4296019127 00000004:00080000:0.0:1721880431.403586:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ce12300, transno 4296019128 00000004:00080000:0.0:1721880431.403588:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b6c8000, transno 4296019129 00000004:00080000:0.0:1721880431.403590:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f81d880, transno 4296019130 00000004:00080000:0.0:1721880431.403592:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f81d500, transno 4296019131 00000004:00080000:0.0:1721880431.403593:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f81f100, transno 4296019132 00000004:00080000:0.0:1721880431.403594:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f81dc00, transno 4296019133 00000004:00080000:0.0:1721880431.403596:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f81ca80, transno 4296019134 00000004:00080000:0.0:1721880431.403598:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800932b9880, transno 4296019135 00000004:00080000:0.0:1721880431.403599:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800932bad80, transno 4296019136 00000004:00080000:0.0:1721880431.403601:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800941ea300, transno 4296019137 00000004:00080000:0.0:1721880431.403602:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800941eb800, transno 4296019138 00000004:00080000:0.0:1721880431.403604:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f4a1180, transno 4296019139 00000004:00080000:0.0:1721880431.403607:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085911880, transno 4296019140 00000004:00080000:0.0:1721880431.403609:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b705500, transno 4296019141 00000004:00080000:0.0:1721880431.403612:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962a9500, transno 4296019142 00000004:00080000:0.0:1721880431.403614:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123937480, transno 4296019143 00000004:00080000:0.0:1721880431.403616:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f4a3b80, transno 4296019144 00000004:00080000:0.0:1721880431.403619:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f4a3100, transno 4296019145 00000004:00080000:0.0:1721880431.403621:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800932b8380, transno 4296019146 00000004:00080000:0.0:1721880431.403623:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f4a2d80, transno 4296019147 00000004:00080000:0.0:1721880431.403626:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013514d880, transno 4296019148 00000004:00080000:0.0:1721880431.403629:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009891dc00, transno 4296019149 00000004:00080000:0.0:1721880431.403632:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013514c380, transno 4296019150 00000004:00080000:0.0:1721880431.403634:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ff5c000, transno 4296019151 00000004:00080000:0.0:1721880431.403636:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ff5f480, transno 4296019152 00000004:00080000:0.0:1721880431.403639:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134944a80, transno 4296019153 00000004:00080000:0.0:1721880431.403642:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134e85500, transno 4296019154 00000004:00080000:0.0:1721880431.403644:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ff5c380, transno 4296019155 00000004:00080000:0.0:1721880431.403646:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bde8380, transno 4296019156 00000004:00080000:0.0:1721880431.403649:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bde8e00, transno 4296019157 00000004:00080000:0.0:1721880431.403651:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bde9180, transno 4296019158 00000004:00080000:0.0:1721880431.403654:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008589ad80, transno 4296019159 00000004:00080000:0.0:1721880431.403656:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085898a80, transno 4296019160 00000004:00080000:0.0:1721880431.403659:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bde9f80, transno 4296019161 00000004:00080000:0.0:1721880431.403662:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085911500, transno 4296019162 00000004:00080000:0.0:1721880431.403664:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134e87100, transno 4296019163 00000004:00080000:0.0:1721880431.403667:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b8c7b80, transno 4296019164 00000004:00080000:0.0:1721880431.403669:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b8c4700, transno 4296019165 00000004:00080000:0.0:1721880431.403672:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b8c4e00, transno 4296019166 00000004:00080000:0.0:1721880431.403675:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b8c4380, transno 4296019167 00000004:00080000:0.0:1721880431.403677:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a0290380, transno 4296019168 00000004:00080000:0.0:1721880431.403679:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fd09880, transno 4296019169 00000004:00080000:0.0:1721880431.403681:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fd09c00, transno 4296019170 00000004:00080000:0.0:1721880431.403683:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a0290e00, transno 4296019171 00000004:00080000:0.0:1721880431.403685:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bfd0a80, transno 4296019172 00000004:00080000:0.0:1721880431.403686:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bfd3b80, transno 4296019173 00000004:00080000:0.0:1721880431.403688:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bfd1180, transno 4296019174 00000004:00080000:0.0:1721880431.403689:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bfd0000, transno 4296019175 00000004:00080000:0.0:1721880431.403690:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008755b800, transno 4296019176 00000004:00080000:0.0:1721880431.403692:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bfd3480, transno 4296019177 00000004:00080000:0.0:1721880431.403693:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123934a80, transno 4296019178 00000004:00080000:0.0:1721880431.403695:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bfd2a00, transno 4296019179 00000004:00080000:0.0:1721880431.403697:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008755a680, transno 4296019180 00000004:00080000:0.0:1721880431.403698:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962a9f80, transno 4296019181 00000004:00080000:0.0:1721880431.403700:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a0290000, transno 4296019182 00000004:00080000:0.0:1721880431.403701:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fd0b480, transno 4296019183 00000004:00080000:0.0:1721880431.403702:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ff5ce00, transno 4296019184 00000004:00080000:0.0:1721880431.403704:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ff5df80, transno 4296019185 00000004:00080000:0.0:1721880431.403705:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ff5f800, transno 4296019186 00000004:00080000:0.0:1721880431.403707:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a0291f80, transno 4296019187 00000004:00080000:0.0:1721880431.403709:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a0293480, transno 4296019188 00000004:00080000:0.0:1721880431.403711:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a0293800, transno 4296019189 00000004:00080000:0.0:1721880431.403712:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a0291180, transno 4296019190 00000004:00080000:0.0:1721880431.403714:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008589aa00, transno 4296019191 00000004:00080000:0.0:1721880431.403716:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bde9880, transno 4296019192 00000004:00080000:0.0:1721880431.403717:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b8c7100, transno 4296019193 00000004:00080000:0.0:1721880431.403719:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134e85c00, transno 4296019194 00000004:00080000:0.0:1721880431.403720:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b6c8a80, transno 4296019195 00000004:00080000:0.0:1721880431.403722:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b8c7480, transno 4296019196 00000004:00080000:0.0:1721880431.403723:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bdea680, transno 4296019197 00000004:00080000:0.0:1721880431.403725:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bfd2d80, transno 4296019198 00000004:00080000:0.0:1721880431.403740:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fd09500, transno 4296019199 00000004:00080000:0.0:1721880431.403742:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bfd1500, transno 4296019200 00000004:00080000:0.0:1721880431.403743:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fd0bb80, transno 4296019201 00000004:00080000:0.0:1721880431.403745:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fd0a300, transno 4296019202 00000004:00080000:0.0:1721880431.403746:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fd08000, transno 4296019203 00000004:00080000:0.0:1721880431.403748:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009891df80, transno 4296019204 00000004:00080000:0.0:1721880431.403749:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085899180, transno 4296019205 00000004:00080000:0.0:1721880431.403751:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134946300, transno 4296019206 00000004:00080000:0.0:1721880431.403753:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134947800, transno 4296019207 00000004:00080000:0.0:1721880431.403754:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134945180, transno 4296019208 00000004:00080000:0.0:1721880431.403756:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fd0a680, transno 4296019209 00000004:00080000:0.0:1721880431.403757:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bfd2300, transno 4296019210 00000004:00080000:0.0:1721880431.403759:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800878d8000, transno 4296019211 00000004:00080000:0.0:1721880431.403761:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800878dad80, transno 4296019212 00000004:00080000:0.0:1721880431.403763:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800878db100, transno 4296019213 00000004:00080000:0.0:1721880431.403765:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b609180, transno 4296019214 00000004:00080000:0.0:1721880431.403767:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800929cfb80, transno 4296019215 00000004:00080000:0.0:1721880431.403768:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076e0ad80, transno 4296019216 00000004:00080000:0.0:1721880431.403770:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123935500, transno 4296019217 00000004:00080000:0.0:1721880431.403772:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b8c6680, transno 4296019218 00000004:00080000:0.0:1721880431.403774:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800932bb480, transno 4296019219 00000004:00080000:0.0:1721880431.403776:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a0290700, transno 4296019220 00000004:00080000:0.0:1721880431.403778:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800941e9c00, transno 4296019221 00000004:00080000:0.0:1721880431.403779:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bdeb800, transno 4296019222 00000004:00080000:0.0:1721880431.403781:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a0292a00, transno 4296019223 00000004:00080000:0.0:1721880431.403782:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800932b9f80, transno 4296019224 00000004:00080000:0.0:1721880431.403784:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b609c00, transno 4296019225 00000004:00080000:0.0:1721880431.403785:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800932b9180, transno 4296019226 00000004:00080000:0.0:1721880431.403787:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b6ca80, transno 4296019227 00000004:00080000:0.0:1721880431.403789:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bfd1880, transno 4296019228 00000004:00080000:0.0:1721880431.403790:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800932ba300, transno 4296019229 00000004:00080000:0.0:1721880431.403792:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800929cc700, transno 4296019230 00000004:00080000:0.0:1721880431.403793:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800929cc000, transno 4296019231 00000004:00080000:0.0:1721880431.403795:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bfd0700, transno 4296019232 00000004:00080000:0.0:1721880431.403798:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d133100, transno 4296019233 00000004:00080000:0.0:1721880431.403800:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d131500, transno 4296019234 00000004:00080000:0.0:1721880431.403803:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d130e00, transno 4296019235 00000004:00080000:0.0:1721880431.403805:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d286300, transno 4296019236 00000004:00080000:0.0:1721880431.403807:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d285c00, transno 4296019237 00000004:00080000:0.0:1721880431.403810:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d133b80, transno 4296019238 00000004:00080000:0.0:1721880431.403812:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d287100, transno 4296019239 00000004:00080000:0.0:1721880431.403814:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d132680, transno 4296019240 00000004:00080000:0.0:1721880431.403817:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ccc7800, transno 4296019241 00000004:00080000:0.0:1721880431.403819:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ccc5f80, transno 4296019242 00000004:00080000:0.0:1721880431.403821:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800929cdc00, transno 4296019243 00000004:00080000:0.0:1721880431.403823:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ccc6680, transno 4296019244 00000004:00080000:0.0:1721880431.403826:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bfd1f80, transno 4296019245 00000004:00080000:0.0:1721880431.403828:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ccc4e00, transno 4296019246 00000004:00080000:0.0:1721880431.403830:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d286a00, transno 4296019247 00000004:00080000:0.0:1721880431.403833:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a0291c00, transno 4296019248 00000004:00080000:0.0:1721880431.403836:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ccc5500, transno 4296019249 00000004:00080000:0.0:1721880431.403838:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b609500, transno 4296019250 00000004:00080000:0.0:1721880431.403841:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a0292300, transno 4296019251 00000004:00080000:0.0:1721880431.403844:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b6dc00, transno 4296019252 00000004:00080000:0.0:1721880431.403847:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800918a0e00, transno 4296019253 00000004:00080000:0.0:1721880431.403849:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b6d500, transno 4296019254 00000004:00080000:0.0:1721880431.403852:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800918a1f80, transno 4296019255 00000004:00080000:0.0:1721880431.403854:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800918a2a00, transno 4296019256 00000004:00080000:0.0:1721880431.403857:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b6c700, transno 4296019257 00000004:00080000:0.0:1721880431.403874:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fd08a80, transno 4296019258 00000004:00080000:0.0:1721880431.403876:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134944380, transno 4296019259 00000004:00080000:0.0:1721880431.403878:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800918a0380, transno 4296019260 00000004:00080000:0.0:1721880431.403880:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800918a3100, transno 4296019261 00000004:00080000:0.0:1721880431.403882:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800918a2680, transno 4296019262 00000004:00080000:0.0:1721880431.403884:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800918a2d80, transno 4296019263 00000004:00080000:0.0:1721880431.403885:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076e0a680, transno 4296019264 00000004:00080000:0.0:1721880431.403887:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076e09500, transno 4296019265 00000004:00080000:0.0:1721880431.403889:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b416d80, transno 4296019266 00000004:00080000:0.0:1721880431.403890:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076e0b100, transno 4296019267 00000004:00080000:0.0:1721880431.403892:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f419180, transno 4296019268 00000004:00080000:0.0:1721880431.403893:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d285f80, transno 4296019269 00000004:00080000:0.0:1721880431.403895:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d286d80, transno 4296019270 00000004:00080000:0.0:1721880431.403896:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009528a680, transno 4296019271 00000004:00080000:0.0:1721880431.403898:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009528aa00, transno 4296019272 00000004:00080000:0.0:1721880431.403899:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f419f80, transno 4296019273 00000004:00080000:0.0:1721880431.403901:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f419500, transno 4296019274 00000004:00080000:0.0:1721880431.403903:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095289180, transno 4296019275 00000004:00080000:0.0:1721880431.403904:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f418380, transno 4296019276 00000004:00080000:0.0:1721880431.403906:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096e59f80, transno 4296019277 00000004:00080000:0.0:1721880431.403908:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f418e00, transno 4296019278 00000004:00080000:0.0:1721880431.403910:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801348c1f80, transno 4296019279 00000004:00080000:0.0:1721880431.403911:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801348c1880, transno 4296019280 00000004:00080000:0.0:1721880431.403913:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800932baa00, transno 4296019281 00000004:00080000:0.0:1721880431.403915:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fd0aa00, transno 4296019282 00000004:00080000:0.0:1721880431.403916:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fd08e00, transno 4296019283 00000004:00080000:0.0:1721880431.403918:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800932b8000, transno 4296019284 00000004:00080000:0.0:1721880431.403920:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b608700, transno 4296019285 00000004:00080000:0.0:1721880431.403921:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b608000, transno 4296019286 00000004:00080000:0.0:1721880431.403923:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ccc7480, transno 4296019287 00000004:00080000:0.0:1721880431.403924:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800932b8700, transno 4296019288 00000004:00080000:0.0:1721880431.403925:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d285180, transno 4296019289 00000004:00080000:0.0:1721880431.403927:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b415c00, transno 4296019290 00000004:00080000:0.0:1721880431.403928:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d285880, transno 4296019291 00000004:00080000:0.0:1721880431.403930:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096e5aa00, transno 4296019292 00000004:00080000:0.0:1721880431.403931:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096e5bb80, transno 4296019293 00000004:00080000:0.0:1721880431.403933:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e899f80, transno 4296019294 00000004:00080000:0.0:1721880431.403935:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800918a0000, transno 4296019295 00000004:00080000:0.0:1721880431.403936:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e899c00, transno 4296019296 00000004:00080000:0.0:1721880431.403938:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e898e00, transno 4296019297 00000004:00080000:0.0:1721880431.403939:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e899880, transno 4296019298 00000004:00080000:0.0:1721880431.403941:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e89b800, transno 4296019299 00000004:00080000:0.0:1721880431.403942:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e89a300, transno 4296019300 00000004:00080000:0.0:1721880431.403943:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e899500, transno 4296019301 00000004:00080000:0.0:1721880431.403945:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800918a3480, transno 4296019302 00000004:00080000:0.0:1721880431.403946:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123912680, transno 4296019303 00000004:00080000:0.0:1721880431.403960:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087927100, transno 4296019304 00000004:00080000:0.0:1721880431.403962:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e898700, transno 4296019305 00000004:00080000:0.0:1721880431.403963:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087925180, transno 4296019306 00000004:00080000:0.0:1721880431.403965:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087926300, transno 4296019307 00000004:00080000:0.0:1721880431.403967:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f418a80, transno 4296019308 00000004:00080000:0.0:1721880431.403969:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f418000, transno 4296019309 00000004:00080000:0.0:1721880431.403970:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087927800, transno 4296019310 00000004:00080000:0.0:1721880431.403972:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088680700, transno 4296019311 00000004:00080000:0.0:1721880431.403974:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088680a80, transno 4296019312 00000004:00080000:0.0:1721880431.403975:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088680e00, transno 4296019313 00000004:00080000:0.0:1721880431.403976:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f419880, transno 4296019314 00000004:00080000:0.0:1721880431.403978:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f41b480, transno 4296019315 00000004:00080000:0.0:1721880431.403980:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800981e1f80, transno 4296019316 00000004:00080000:0.0:1721880431.403982:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f41a300, transno 4296019317 00000004:00080000:0.0:1721880431.403983:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800981e1c00, transno 4296019318 00000004:00080000:0.0:1721880431.403985:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800981e2d80, transno 4296019319 00000004:00080000:0.0:1721880431.403986:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f41b100, transno 4296019320 00000004:00080000:0.0:1721880431.403988:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135301880, transno 4296019321 00000004:00080000:0.0:1721880431.403989:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135302680, transno 4296019322 00000004:00080000:0.0:1721880431.403991:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135303b80, transno 4296019323 00000004:00080000:0.0:1721880431.403993:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800918a0700, transno 4296019324 00000004:00080000:0.0:1721880431.403994:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d286680, transno 4296019325 00000004:00080000:0.0:1721880431.403995:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096e58e00, transno 4296019326 00000004:00080000:0.0:1721880431.403997:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b60a680, transno 4296019327 00000004:00080000:0.0:1721880431.403998:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096e5b480, transno 4296019328 00000004:00080000:0.0:1721880431.404000:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076e0bb80, transno 4296019329 00000004:00080000:0.0:1721880431.404001:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135301500, transno 4296019330 00000004:00080000:0.0:1721880431.404003:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f41a680, transno 4296019331 00000004:00080000:0.0:1721880431.404004:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135300700, transno 4296019332 00000004:00080000:0.0:1721880431.404006:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135300380, transno 4296019333 00000004:00080000:0.0:1721880431.404008:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013502bb80, transno 4296019334 00000004:00080000:0.0:1721880431.404009:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800981e1180, transno 4296019335 00000004:00080000:0.0:1721880431.404011:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800981e0e00, transno 4296019336 00000004:00080000:0.0:1721880431.404012:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ccc4700, transno 4296019337 00000004:00080000:0.0:1721880431.404014:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085a68a80, transno 4296019338 00000004:00080000:0.0:1721880431.404016:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135029500, transno 4296019339 00000004:00080000:0.0:1721880431.404018:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135029f80, transno 4296019340 00000004:00080000:0.0:1721880431.404019:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135300a80, transno 4296019341 00000004:00080000:0.0:1721880431.404021:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135302a00, transno 4296019342 00000004:00080000:0.0:1721880431.404022:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135028380, transno 4296019343 00000004:00080000:0.0:1721880431.404024:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099aac380, transno 4296019344 00000004:00080000:0.0:1721880431.404026:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801349e7b80, transno 4296019345 00000004:00080000:0.0:1721880431.404027:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801349e7800, transno 4296019346 00000004:00080000:0.0:1721880431.404029:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a03c0000, transno 4296019347 00000004:00080000:0.0:1721880431.404031:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099aaf100, transno 4296019348 00000004:00080000:0.0:1721880431.404033:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013502ad80, transno 4296019349 00000004:00080000:0.0:1721880431.404034:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801349e5880, transno 4296019350 00000004:00080000:0.0:1721880431.404035:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013502a300, transno 4296019351 00000004:00080000:0.0:1721880431.404037:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801348c1c00, transno 4296019352 00000004:00080000:0.0:1721880431.404038:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801348c0000, transno 4296019353 00000004:00080000:0.0:1721880431.404040:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801348c1500, transno 4296019354 00000004:00080000:0.0:1721880431.404042:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135088a80, transno 4296019355 00000004:00080000:0.0:1721880431.404043:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013508a300, transno 4296019356 00000004:00080000:0.0:1721880431.404045:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013508b800, transno 4296019357 00000004:00080000:0.0:1721880431.404047:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013508bb80, transno 4296019358 00000004:00080000:0.0:1721880431.404048:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135028e00, transno 4296019359 00000004:00080000:0.0:1721880431.404050:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135028a80, transno 4296019360 00000004:00080000:0.0:1721880431.404051:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013502b480, transno 4296019361 00000004:00080000:0.0:1721880431.404052:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d40e300, transno 4296019362 00000004:00080000:0.0:1721880431.404054:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d310a80, transno 4296019363 00000004:00080000:0.0:1721880431.404056:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d40f480, transno 4296019364 00000004:00080000:0.0:1721880431.404057:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d40dc00, transno 4296019365 00000004:00080000:0.0:1721880431.404059:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d313480, transno 4296019366 00000004:00080000:0.0:1721880431.404060:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d311500, transno 4296019367 00000004:00080000:0.0:1721880431.404063:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d311180, transno 4296019368 00000004:00080000:0.0:1721880431.404065:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801348c2300, transno 4296019369 00000004:00080000:0.0:1721880431.404067:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d40ce00, transno 4296019370 00000004:00080000:0.0:1721880431.404069:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095d6e300, transno 4296019371 00000004:00080000:0.0:1721880431.404071:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095d6f800, transno 4296019372 00000004:00080000:0.0:1721880431.404072:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095d6c380, transno 4296019373 00000004:00080000:0.0:1721880431.404074:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008599ca80, transno 4296019374 00000004:00080000:0.0:1721880431.404075:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801348c0e00, transno 4296019375 00000004:00080000:0.0:1721880431.404077:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134d03800, transno 4296019376 00000004:00080000:0.0:1721880431.404078:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095d6fb80, transno 4296019377 00000004:00080000:0.0:1721880431.404079:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008599c000, transno 4296019378 00000004:00080000:0.0:1721880431.404081:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084ee1500, transno 4296019379 00000004:00080000:0.0:1721880431.404083:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134d00000, transno 4296019380 00000004:00080000:0.0:1721880431.404084:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134d01500, transno 4296019381 00000004:00080000:0.0:1721880431.404086:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d312300, transno 4296019382 00000004:00080000:0.0:1721880431.404089:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801349e5f80, transno 4296019383 00000004:00080000:0.0:1721880431.404091:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013508a680, transno 4296019384 00000004:00080000:0.0:1721880431.404093:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013508b100, transno 4296019385 00000004:00080000:0.0:1721880431.404095:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135089f80, transno 4296019386 00000004:00080000:0.0:1721880431.404098:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801349e4000, transno 4296019387 00000004:00080000:0.0:1721880431.404100:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800911a8000, transno 4296019388 00000004:00080000:0.0:1721880431.404102:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a03c3800, transno 4296019389 00000004:00080000:0.0:1721880431.404105:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800911aad80, transno 4296019390 00000004:00080000:0.0:1721880431.404107:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134d01f80, transno 4296019391 00000004:00080000:0.0:1721880431.404109:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134d01180, transno 4296019392 00000004:00080000:0.0:1721880431.404111:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134d00700, transno 4296019393 00000004:00080000:0.0:1721880431.404114:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962d9f80, transno 4296019394 00000004:00080000:0.0:1721880431.404117:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134d02d80, transno 4296019395 00000004:00080000:0.0:1721880431.404119:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135029880, transno 4296019396 00000004:00080000:0.0:1721880431.404122:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013502aa00, transno 4296019397 00000004:00080000:0.0:1721880431.404126:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013502b100, transno 4296019398 00000004:00080000:0.0:1721880431.404128:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800911a8e00, transno 4296019399 00000004:00080000:0.0:1721880431.404131:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a03c3480, transno 4296019400 00000004:00080000:0.0:1721880431.404134:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013508ad80, transno 4296019401 00000004:00080000:0.0:1721880431.404137:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a07b5500, transno 4296019402 00000004:00080000:0.0:1721880431.404140:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a03c2d80, transno 4296019403 00000004:00080000:0.0:1721880431.404142:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131eb2a00, transno 4296019404 00000004:00080000:0.0:1721880431.404145:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131eb1500, transno 4296019405 00000004:00080000:0.0:1721880431.404148:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801349e4700, transno 4296019406 00000004:00080000:0.0:1721880431.404151:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131eb3480, transno 4296019407 00000004:00080000:0.0:1721880431.404153:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131eb2300, transno 4296019408 00000004:00080000:0.0:1721880431.404155:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008eba0e00, transno 4296019409 00000004:00080000:0.0:1721880431.404157:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008eba0380, transno 4296019410 00000004:00080000:0.0:1721880431.404159:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084ee1c00, transno 4296019411 00000004:00080000:0.0:1721880431.404161:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134d02680, transno 4296019412 00000004:00080000:0.0:1721880431.404162:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134d02300, transno 4296019413 00000004:00080000:0.0:1721880431.404163:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008eba1f80, transno 4296019414 00000004:00080000:0.0:1721880431.404165:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095d6dc00, transno 4296019415 00000004:00080000:0.0:1721880431.404166:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134d00380, transno 4296019416 00000004:00080000:0.0:1721880431.404168:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a07b6d80, transno 4296019417 00000004:00080000:0.0:1721880431.404169:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095d6f480, transno 4296019418 00000004:00080000:0.0:1721880431.404171:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095d6e680, transno 4296019419 00000004:00080000:0.0:1721880431.404172:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008eba3800, transno 4296019420 00000004:00080000:0.0:1721880431.404174:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084ee0e00, transno 4296019421 00000004:00080000:0.0:1721880431.404175:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a03c2300, transno 4296019422 00000004:00080000:0.0:1721880431.404177:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a03c0e00, transno 4296019423 00000004:00080000:0.0:1721880431.404179:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085a4c700, transno 4296019424 00000004:00080000:0.0:1721880431.404180:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084ee3b80, transno 4296019425 00000004:00080000:0.0:1721880431.404182:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013502a680, transno 4296019426 00000004:00080000:0.0:1721880431.404183:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084ee1180, transno 4296019427 00000004:00080000:0.0:1721880431.404185:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d310e00, transno 4296019428 00000004:00080000:0.0:1721880431.404188:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d40df80, transno 4296019429 00000004:00080000:0.0:1721880431.404189:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095d6ce00, transno 4296019430 00000004:00080000:0.0:1721880431.404191:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084ee3800, transno 4296019431 00000004:00080000:0.0:1721880431.404193:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131eb0380, transno 4296019432 00000004:00080000:0.0:1721880431.404194:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085a69500, transno 4296019433 00000004:00080000:0.0:1721880431.404196:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084ee2d80, transno 4296019434 00000004:00080000:0.0:1721880431.404197:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084ee1880, transno 4296019435 00000004:00080000:0.0:1721880431.404198:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134d02a00, transno 4296019436 00000004:00080000:0.0:1721880431.404199:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134d03b80, transno 4296019437 00000004:00080000:0.0:1721880431.404201:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134d00a80, transno 4296019438 00000004:00080000:0.0:1721880431.404202:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801349e6a00, transno 4296019439 00000004:00080000:0.0:1721880431.404204:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f9b0700, transno 4296019440 00000004:00080000:0.0:1721880431.404206:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f9b3480, transno 4296019441 00000004:00080000:0.0:1721880431.404207:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084ee0a80, transno 4296019442 00000004:00080000:0.0:1721880431.404209:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800911a9180, transno 4296019443 00000004:00080000:0.0:1721880431.404210:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800911abb80, transno 4296019444 00000004:00080000:0.0:1721880431.404212:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008599f100, transno 4296019445 00000004:00080000:0.0:1721880431.404214:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008599ed80, transno 4296019446 00000004:00080000:0.0:1721880431.404215:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135088700, transno 4296019447 00000004:00080000:0.0:1721880431.404217:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009db70e00, transno 4296019448 00000004:00080000:0.0:1721880431.404218:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fc53b80, transno 4296019449 00000004:00080000:0.0:1721880431.404220:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fc52300, transno 4296019450 00000004:00080000:0.0:1721880431.404221:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fc52a00, transno 4296019451 00000004:00080000:0.0:1721880431.404222:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800911aa680, transno 4296019452 00000004:00080000:0.0:1721880431.404224:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008599c700, transno 4296019453 00000004:00080000:0.0:1721880431.404226:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085a4dc00, transno 4296019454 00000004:00080000:0.0:1721880431.404227:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800911a9500, transno 4296019455 00000004:00080000:0.0:1721880431.404228:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085a4f800, transno 4296019456 00000004:00080000:0.0:1721880431.404230:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085a4ce00, transno 4296019457 00000004:00080000:0.0:1721880431.404233:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a07b5180, transno 4296019458 00000004:00080000:0.0:1721880431.404234:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801348c0380, transno 4296019459 00000004:00080000:0.0:1721880431.404236:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a07b4000, transno 4296019460 00000004:00080000:0.0:1721880431.404238:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801348c0700, transno 4296019461 00000004:00080000:0.0:1721880431.404240:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801348c2680, transno 4296019462 00000004:00080000:0.0:1721880431.404242:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a07b7480, transno 4296019463 00000004:00080000:0.0:1721880431.404244:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b68000, transno 4296019464 00000004:00080000:0.0:1721880431.404245:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b68380, transno 4296019465 00000004:00080000:0.0:1721880431.404246:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fc52d80, transno 4296019466 00000004:00080000:0.0:1721880431.404248:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b6a680, transno 4296019467 00000004:00080000:0.0:1721880431.404249:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fc50e00, transno 4296019468 00000004:00080000:0.0:1721880431.404251:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fc53480, transno 4296019469 00000004:00080000:0.0:1721880431.404252:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d311f80, transno 4296019470 00000004:00080000:0.0:1721880431.404254:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d312a00, transno 4296019471 00000004:00080000:0.0:1721880431.404256:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a07b7800, transno 4296019472 00000004:00080000:0.0:1721880431.404257:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b68e00, transno 4296019473 00000004:00080000:0.0:1721880431.404258:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b6b100, transno 4296019474 00000004:00080000:0.0:1721880431.404260:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f9b0000, transno 4296019475 00000004:00080000:0.0:1721880431.404261:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f9b3800, transno 4296019476 00000004:00080000:0.0:1721880431.404263:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009db73800, transno 4296019477 00000004:00080000:0.0:1721880431.404265:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009db70700, transno 4296019478 00000004:00080000:0.0:1721880431.404266:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009db72d80, transno 4296019479 00000004:00080000:0.0:1721880431.404268:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008791d500, transno 4296019480 00000004:00080000:0.0:1721880431.404270:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e4a8380, transno 4296019481 00000004:00080000:0.0:1721880431.404271:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e4a8000, transno 4296019482 00000004:00080000:0.0:1721880431.404273:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088885180, transno 4296019483 00000004:00080000:0.0:1721880431.404275:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088886300, transno 4296019484 00000004:00080000:0.0:1721880431.404277:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135088380, transno 4296019485 00000004:00080000:0.0:1721880431.404279:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008791e680, transno 4296019486 00000004:00080000:0.0:1721880431.404280:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088d7c000, transno 4296019487 00000004:00080000:0.0:1721880431.404282:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f9b0e00, transno 4296019488 00000004:00080000:0.0:1721880431.404284:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088d7d180, transno 4296019489 00000004:00080000:0.0:1721880431.404286:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962d9c00, transno 4296019490 00000004:00080000:0.0:1721880431.404288:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088d7c700, transno 4296019491 00000004:00080000:0.0:1721880431.404289:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c4e5180, transno 4296019492 00000004:00080000:0.0:1721880431.404291:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c4e5500, transno 4296019493 00000004:00080000:0.0:1721880431.404292:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c4e5f80, transno 4296019494 00000004:00080000:0.0:1721880431.404294:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c4e7480, transno 4296019495 00000004:00080000:0.0:1721880431.404296:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088d7f100, transno 4296019496 00000004:00080000:0.0:1721880431.404298:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c4e5c00, transno 4296019497 00000004:00080000:0.0:1721880431.404299:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c4e4380, transno 4296019498 00000004:00080000:0.0:1721880431.404301:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011efd1f80, transno 4296019499 00000004:00080000:0.0:1721880431.404303:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011efd1c00, transno 4296019500 00000004:00080000:0.0:1721880431.404305:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011efd2d80, transno 4296019501 00000004:00080000:0.0:1721880431.404306:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011efd0700, transno 4296019502 00000004:00080000:0.0:1721880431.404308:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011efd3100, transno 4296019503 00000004:00080000:0.0:1721880431.404310:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011efd2a00, transno 4296019504 00000004:00080000:0.0:1721880431.404311:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095171180, transno 4296019505 00000004:00080000:0.0:1721880431.404313:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095173480, transno 4296019506 00000004:00080000:0.0:1721880431.404315:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f79d180, transno 4296019507 00000004:00080000:0.0:1721880431.404316:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012bd08a80, transno 4296019508 00000004:00080000:0.0:1721880431.404318:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f79fb80, transno 4296019509 00000004:00080000:0.0:1721880431.404320:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fa1fb80, transno 4296019510 00000004:00080000:0.0:1721880431.404321:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f79ed80, transno 4296019511 00000004:00080000:0.0:1721880431.404323:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095171f80, transno 4296019512 00000004:00080000:0.0:1721880431.404325:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012bd08380, transno 4296019513 00000004:00080000:0.0:1721880431.404326:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009db71180, transno 4296019514 00000004:00080000:0.0:1721880431.404327:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009db70380, transno 4296019515 00000004:00080000:0.0:1721880431.404329:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085833800, transno 4296019516 00000004:00080000:0.0:1721880431.404331:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c4e4700, transno 4296019517 00000004:00080000:0.0:1721880431.404333:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c4e4000, transno 4296019518 00000004:00080000:0.0:1721880431.404334:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800912f2a00, transno 4296019519 00000004:00080000:0.0:1721880431.404336:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008791fb80, transno 4296019520 00000004:00080000:0.0:1721880431.404338:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088d7f800, transno 4296019521 00000004:00080000:0.0:1721880431.404340:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008791ed80, transno 4296019522 00000004:00080000:0.0:1721880431.404341:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008791e300, transno 4296019523 00000004:00080000:0.0:1721880431.404343:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008791ea00, transno 4296019524 00000004:00080000:0.0:1721880431.404345:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008791d880, transno 4296019525 00000004:00080000:0.0:1721880431.404347:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008eba0000, transno 4296019526 00000004:00080000:0.0:1721880431.404349:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008eba2680, transno 4296019527 00000004:00080000:0.0:1721880431.404351:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962dbb80, transno 4296019528 00000004:00080000:0.0:1721880431.404354:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012bd09180, transno 4296019529 00000004:00080000:0.0:1721880431.404356:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095204380, transno 4296019530 00000004:00080000:0.0:1721880431.404358:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095204e00, transno 4296019531 00000004:00080000:0.0:1721880431.404361:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099ad5f80, transno 4296019532 00000004:00080000:0.0:1721880431.404363:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099ad7480, transno 4296019533 00000004:00080000:0.0:1721880431.404366:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099ad5180, transno 4296019534 00000004:00080000:0.0:1721880431.404368:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099ad4a80, transno 4296019535 00000004:00080000:0.0:1721880431.404371:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fba9500, transno 4296019536 00000004:00080000:0.0:1721880431.404373:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099ad7100, transno 4296019537 00000004:00080000:0.0:1721880431.404376:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fba8700, transno 4296019538 00000004:00080000:0.0:1721880431.404379:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fbab800, transno 4296019539 00000004:00080000:0.0:1721880431.404381:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008eba1180, transno 4296019540 00000004:00080000:0.0:1721880431.404383:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fbaaa00, transno 4296019541 00000004:00080000:0.0:1721880431.404386:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fbb6300, transno 4296019542 00000004:00080000:0.0:1721880431.404388:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fbb4a80, transno 4296019543 00000004:00080000:0.0:1721880431.404390:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008791df80, transno 4296019544 00000004:00080000:0.0:1721880431.404393:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008eba2300, transno 4296019545 00000004:00080000:0.0:1721880431.404395:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012bc2dc00, transno 4296019546 00000004:00080000:0.0:1721880431.404398:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012bc2d180, transno 4296019547 00000004:00080000:0.0:1721880431.404401:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012bc2e680, transno 4296019548 00000004:00080000:0.0:1721880431.404404:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012bc2fb80, transno 4296019549 00000004:00080000:0.0:1721880431.404406:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012bc2df80, transno 4296019550 00000004:00080000:0.0:1721880431.404408:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fa1d500, transno 4296019551 00000004:00080000:0.0:1721880431.404411:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008791ce00, transno 4296019552 00000004:00080000:0.0:1721880431.404414:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012bc2ed80, transno 4296019553 00000004:00080000:0.0:1721880431.404416:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008791d180, transno 4296019554 00000004:00080000:0.0:1721880431.404419:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012cfb9c00, transno 4296019555 00000004:00080000:0.0:1721880431.404420:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012cfbbb80, transno 4296019556 00000004:00080000:0.0:1721880431.404422:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135757100, transno 4296019557 00000004:00080000:0.0:1721880431.404424:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012cfbb100, transno 4296019558 00000004:00080000:0.0:1721880431.404426:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012cfb8a80, transno 4296019559 00000004:00080000:0.0:1721880431.404428:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fa1f800, transno 4296019560 00000004:00080000:0.0:1721880431.404430:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ef29880, transno 4296019561 00000004:00080000:0.0:1721880431.404431:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099ad5c00, transno 4296019562 00000004:00080000:0.0:1721880431.404433:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ef2a680, transno 4296019563 00000004:00080000:0.0:1721880431.404435:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095ae8000, transno 4296019564 00000004:00080000:0.0:1721880431.404436:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011efd0000, transno 4296019565 00000004:00080000:0.0:1721880431.404438:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ef28a80, transno 4296019566 00000004:00080000:0.0:1721880431.404440:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135756d80, transno 4296019567 00000004:00080000:0.0:1721880431.404442:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962db100, transno 4296019568 00000004:00080000:0.0:1721880431.404443:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fbb4000, transno 4296019569 00000004:00080000:0.0:1721880431.404445:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012bd0b480, transno 4296019570 00000004:00080000:0.0:1721880431.404447:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095207480, transno 4296019571 00000004:00080000:0.0:1721880431.404449:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095aeaa00, transno 4296019572 00000004:00080000:0.0:1721880431.404450:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012bd09880, transno 4296019573 00000004:00080000:0.0:1721880431.404452:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088d7d880, transno 4296019574 00000004:00080000:0.0:1721880431.404453:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011efd1180, transno 4296019575 00000004:00080000:0.0:1721880431.404455:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d40e680, transno 4296019576 00000004:00080000:0.0:1721880431.404457:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095ae9500, transno 4296019577 00000004:00080000:0.0:1721880431.404459:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f79e680, transno 4296019578 00000004:00080000:0.0:1721880431.404461:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f79dc00, transno 4296019579 00000004:00080000:0.0:1721880431.404463:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f79c700, transno 4296019580 00000004:00080000:0.0:1721880431.404464:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fbb5c00, transno 4296019581 00000004:00080000:0.0:1721880431.404466:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fbb6680, transno 4296019582 00000004:00080000:0.0:1721880431.404468:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013107a680, transno 4296019583 00000004:00080000:0.0:1721880431.404469:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013107aa00, transno 4296019584 00000004:00080000:0.0:1721880431.404471:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fbb6a00, transno 4296019585 00000004:00080000:0.0:1721880431.404472:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096001c00, transno 4296019586 00000004:00080000:0.0:1721880431.404474:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801355e1500, transno 4296019587 00000004:00080000:0.0:1721880431.404476:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801355e1180, transno 4296019588 00000004:00080000:0.0:1721880431.404477:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bea0380, transno 4296019589 00000004:00080000:0.0:1721880431.404479:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bea3100, transno 4296019590 00000004:00080000:0.0:1721880431.404481:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f829f80, transno 4296019591 00000004:00080000:0.0:1721880431.404483:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880132c63b80, transno 4296019592 00000004:00080000:0.0:1721880431.404485:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f829500, transno 4296019593 00000004:00080000:0.0:1721880431.404487:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880132c60000, transno 4296019594 00000004:00080000:0.0:1721880431.404488:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880132c60700, transno 4296019595 00000004:00080000:0.0:1721880431.404489:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880132c61500, transno 4296019596 00000004:00080000:0.0:1721880431.404491:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801303b7800, transno 4296019597 00000004:00080000:0.0:1721880431.404493:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013107b100, transno 4296019598 00000004:00080000:0.0:1721880431.404495:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088d7d500, transno 4296019599 00000004:00080000:0.0:1721880431.404497:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801303b4380, transno 4296019600 00000004:00080000:0.0:1721880431.404498:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012bd08700, transno 4296019601 00000004:00080000:0.0:1721880431.404500:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f79ce00, transno 4296019602 00000004:00080000:0.0:1721880431.404501:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f79f480, transno 4296019603 00000004:00080000:0.0:1721880431.404503:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013608a680, transno 4296019604 00000004:00080000:0.0:1721880431.404505:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013608ad80, transno 4296019605 00000004:00080000:0.0:1721880431.404506:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801349e4e00, transno 4296019606 00000004:00080000:0.0:1721880431.404508:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f79f800, transno 4296019607 00000004:00080000:0.0:1721880431.404510:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f79d500, transno 4296019608 00000004:00080000:0.0:1721880431.404512:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135755f80, transno 4296019609 00000004:00080000:0.0:1721880431.404514:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801303b6680, transno 4296019610 00000004:00080000:0.0:1721880431.404515:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801303b5f80, transno 4296019611 00000004:00080000:0.0:1721880431.404517:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bea1c00, transno 4296019612 00000004:00080000:0.0:1721880431.404519:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ef2a300, transno 4296019613 00000004:00080000:0.0:1721880431.404520:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131078700, transno 4296019614 00000004:00080000:0.0:1721880431.404522:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880136089180, transno 4296019615 00000004:00080000:0.0:1721880431.404523:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bea0700, transno 4296019616 00000004:00080000:0.0:1721880431.404525:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801303b7480, transno 4296019617 00000004:00080000:0.0:1721880431.404526:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fba8e00, transno 4296019618 00000004:00080000:0.0:1721880431.404528:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fba9880, transno 4296019619 00000004:00080000:0.0:1721880431.404529:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012edb3100, transno 4296019620 00000004:00080000:0.0:1721880431.404531:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012edb0700, transno 4296019621 00000004:00080000:0.0:1721880431.404533:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012edb1c00, transno 4296019622 00000004:00080000:0.0:1721880431.404535:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012bd0aa00, transno 4296019623 00000004:00080000:0.0:1721880431.404536:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012edb1880, transno 4296019624 00000004:00080000:0.0:1721880431.404538:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008791f480, transno 4296019625 00000004:00080000:0.0:1721880431.404539:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008791f800, transno 4296019626 00000004:00080000:0.0:1721880431.404541:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ef28000, transno 4296019627 00000004:00080000:0.0:1721880431.404542:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008791ca80, transno 4296019628 00000004:00080000:0.0:1721880431.404544:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c735c00, transno 4296019629 00000004:00080000:0.0:1721880431.404546:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e22c000, transno 4296019630 00000004:00080000:0.0:1721880431.404548:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e22e680, transno 4296019631 00000004:00080000:0.0:1721880431.404549:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880136089500, transno 4296019632 00000004:00080000:0.0:1721880431.404550:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e22d500, transno 4296019633 00000004:00080000:0.0:1721880431.404552:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e22ea00, transno 4296019634 00000004:00080000:0.0:1721880431.404553:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009db72a00, transno 4296019635 00000004:00080000:0.0:1721880431.404555:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e22df80, transno 4296019636 00000004:00080000:0.0:1721880431.404557:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e22ca80, transno 4296019637 00000004:00080000:0.0:1721880431.404559:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e22d180, transno 4296019638 00000004:00080000:0.0:1721880431.404561:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880132c62a00, transno 4296019639 00000004:00080000:0.0:1721880431.404562:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012ce11880, transno 4296019640 00000004:00080000:0.0:1721880431.404564:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095206680, transno 4296019641 00000004:00080000:0.0:1721880431.404566:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011efd3b80, transno 4296019642 00000004:00080000:0.0:1721880431.404567:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801355e2680, transno 4296019643 00000004:00080000:0.0:1721880431.404569:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096002300, transno 4296019644 00000004:00080000:0.0:1721880431.404571:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096001500, transno 4296019645 00000004:00080000:0.0:1721880431.404573:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096002a00, transno 4296019646 00000004:00080000:0.0:1721880431.404574:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096000e00, transno 4296019647 00000004:00080000:0.0:1721880431.404576:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f828a80, transno 4296019648 00000004:00080000:0.0:1721880431.404577:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801303b7100, transno 4296019649 00000004:00080000:0.0:1721880431.404579:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f829880, transno 4296019650 00000004:00080000:0.0:1721880431.404580:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801303b7b80, transno 4296019651 00000004:00080000:0.0:1721880431.404582:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880136088a80, transno 4296019652 00000004:00080000:0.0:1721880431.404583:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801303b5880, transno 4296019653 00000004:00080000:0.0:1721880431.404585:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880136089c00, transno 4296019654 00000004:00080000:0.0:1721880431.404586:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880136089880, transno 4296019655 00000004:00080000:0.0:1721880431.404588:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bea2d80, transno 4296019656 00000004:00080000:0.0:1721880431.404590:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091212680, transno 4296019657 00000004:00080000:0.0:1721880431.404591:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800912f0380, transno 4296019658 00000004:00080000:0.0:1721880431.404593:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012cfbb800, transno 4296019659 00000004:00080000:0.0:1721880431.404594:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800912f0e00, transno 4296019660 00000004:00080000:0.0:1721880431.404596:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012bc2e300, transno 4296019661 00000004:00080000:0.0:1721880431.404597:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012cfb8700, transno 4296019662 00000004:00080000:0.0:1721880431.404600:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012bc2ca80, transno 4296019663 00000004:00080000:0.0:1721880431.404602:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096001180, transno 4296019664 00000004:00080000:0.0:1721880431.404605:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009be5aa00, transno 4296019665 00000004:00080000:0.0:1721880431.404607:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009be5bb80, transno 4296019666 00000004:00080000:0.0:1721880431.404610:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009be5a300, transno 4296019667 00000004:00080000:0.0:1721880431.404613:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099d29c00, transno 4296019668 00000004:00080000:0.0:1721880431.404615:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099d2b480, transno 4296019669 00000004:00080000:0.0:1721880431.404618:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099d28e00, transno 4296019670 00000004:00080000:0.0:1721880431.404621:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801355e3b80, transno 4296019671 00000004:00080000:0.0:1721880431.404624:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099d29180, transno 4296019672 00000004:00080000:0.0:1721880431.404626:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bea3480, transno 4296019673 00000004:00080000:0.0:1721880431.404629:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099d29f80, transno 4296019674 00000004:00080000:0.0:1721880431.404632:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bea2a00, transno 4296019675 00000004:00080000:0.0:1721880431.404635:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801302c8000, transno 4296019676 00000004:00080000:0.0:1721880431.404638:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880130b66680, transno 4296019677 00000004:00080000:0.0:1721880431.404640:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880130b67480, transno 4296019678 00000004:00080000:0.0:1721880431.404643:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880130b64380, transno 4296019679 00000004:00080000:0.0:1721880431.404645:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880130b64a80, transno 4296019680 00000004:00080000:0.0:1721880431.404648:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801357b6300, transno 4296019681 00000004:00080000:0.0:1721880431.404650:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801302c9500, transno 4296019682 00000004:00080000:0.0:1721880431.404653:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801357b6680, transno 4296019683 00000004:00080000:0.0:1721880431.404656:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091213480, transno 4296019684 00000004:00080000:0.0:1721880431.404659:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091213800, transno 4296019685 00000004:00080000:0.0:1721880431.404662:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099a3d500, transno 4296019686 00000004:00080000:0.0:1721880431.404665:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099a3c000, transno 4296019687 00000004:00080000:0.0:1721880431.404667:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099a3e300, transno 4296019688 00000004:00080000:0.0:1721880431.404670:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092337100, transno 4296019689 00000004:00080000:0.0:1721880431.404672:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092334700, transno 4296019690 00000004:00080000:0.0:1721880431.404675:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091212300, transno 4296019691 00000004:00080000:0.0:1721880431.404678:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134fa4700, transno 4296019692 00000004:00080000:0.0:1721880431.404680:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134fa6300, transno 4296019693 00000004:00080000:0.0:1721880431.404682:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134fa6d80, transno 4296019694 00000004:00080000:0.0:1721880431.404683:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134fa5500, transno 4296019695 00000004:00080000:0.0:1721880431.404685:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134fa6680, transno 4296019696 00000004:00080000:0.0:1721880431.404687:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134fa5880, transno 4296019697 00000004:00080000:0.0:1721880431.404690:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134fa7480, transno 4296019698 00000004:00080000:0.0:1721880431.404691:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092335500, transno 4296019699 00000004:00080000:0.0:1721880431.404693:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880136088700, transno 4296019700 00000004:00080000:0.0:1721880431.404695:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099e74000, transno 4296019701 00000004:00080000:0.0:1721880431.404697:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134fa5180, transno 4296019702 00000004:00080000:0.0:1721880431.404698:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134fa4a80, transno 4296019703 00000004:00080000:0.0:1721880431.404700:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099a3c700, transno 4296019704 00000004:00080000:0.0:1721880431.404701:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801302c9c00, transno 4296019705 00000004:00080000:0.0:1721880431.404703:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091213b80, transno 4296019706 00000004:00080000:0.0:1721880431.404705:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801357b5f80, transno 4296019707 00000004:00080000:0.0:1721880431.404706:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099a3f100, transno 4296019708 00000004:00080000:0.0:1721880431.404708:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099a3d180, transno 4296019709 00000004:00080000:0.0:1721880431.404709:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801357b7800, transno 4296019710 00000004:00080000:0.0:1721880431.404711:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134fa4000, transno 4296019711 00000004:00080000:0.0:1721880431.404712:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134fa5f80, transno 4296019712 00000004:00080000:0.0:1721880431.404714:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134fa7b80, transno 4296019713 00000004:00080000:0.0:1721880431.404715:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801355daa00, transno 4296019714 00000004:00080000:0.0:1721880431.404717:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099e77100, transno 4296019715 00000004:00080000:0.0:1721880431.404718:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099e77b80, transno 4296019716 00000004:00080000:0.0:1721880431.404720:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801355d9500, transno 4296019717 00000004:00080000:0.0:1721880431.404722:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123808e00, transno 4296019718 00000004:00080000:0.0:1721880431.404723:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012380bb80, transno 4296019719 00000004:00080000:0.0:1721880431.404725:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123808a80, transno 4296019720 00000004:00080000:0.0:1721880431.404740:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123809f80, transno 4296019721 00000004:00080000:0.0:1721880431.404742:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092334a80, transno 4296019722 00000004:00080000:0.0:1721880431.404744:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880130b64700, transno 4296019723 00000004:00080000:0.0:1721880431.404746:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880132c62d80, transno 4296019724 00000004:00080000:0.0:1721880431.404748:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c079500, transno 4296019725 00000004:00080000:0.0:1721880431.404749:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c07b800, transno 4296019726 00000004:00080000:0.0:1721880431.404751:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013608a300, transno 4296019727 00000004:00080000:0.0:1721880431.404753:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009be5b800, transno 4296019728 00000004:00080000:0.0:1721880431.404755:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bea0e00, transno 4296019729 00000004:00080000:0.0:1721880431.404757:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c079c00, transno 4296019730 00000004:00080000:0.0:1721880431.404759:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800888cc380, transno 4296019731 00000004:00080000:0.0:1721880431.404760:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f79c380, transno 4296019732 00000004:00080000:0.0:1721880431.404762:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800888cf100, transno 4296019733 00000004:00080000:0.0:1721880431.404763:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bd88e00, transno 4296019734 00000004:00080000:0.0:1721880431.404765:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800956c8a80, transno 4296019735 00000004:00080000:0.0:1721880431.404767:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800956c9180, transno 4296019736 00000004:00080000:0.0:1721880431.404768:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800888cea00, transno 4296019737 00000004:00080000:0.0:1721880431.404770:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012ce12a00, transno 4296019738 00000004:00080000:0.0:1721880431.404772:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800956c9500, transno 4296019739 00000004:00080000:0.0:1721880431.404773:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800956cb100, transno 4296019740 00000004:00080000:0.0:1721880431.404775:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c3bf480, transno 4296019741 00000004:00080000:0.0:1721880431.404777:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c3bca80, transno 4296019742 00000004:00080000:0.0:1721880431.404778:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c078700, transno 4296019743 00000004:00080000:0.0:1721880431.404780:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b9ea300, transno 4296019744 00000004:00080000:0.0:1721880431.404782:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c079f80, transno 4296019745 00000004:00080000:0.0:1721880431.404783:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099d28380, transno 4296019746 00000004:00080000:0.0:1721880431.404785:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012bd0b100, transno 4296019747 00000004:00080000:0.0:1721880431.404786:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c079180, transno 4296019748 00000004:00080000:0.0:1721880431.404788:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099d28a80, transno 4296019749 00000004:00080000:0.0:1721880431.404790:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012387e300, transno 4296019750 00000004:00080000:0.0:1721880431.404791:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012380b480, transno 4296019751 00000004:00080000:0.0:1721880431.404793:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800956ca680, transno 4296019752 00000004:00080000:0.0:1721880431.404795:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012380a300, transno 4296019753 00000004:00080000:0.0:1721880431.404796:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800888ced80, transno 4296019754 00000004:00080000:0.0:1721880431.404797:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800888cc700, transno 4296019755 00000004:00080000:0.0:1721880431.404798:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800888cca80, transno 4296019756 00000004:00080000:0.0:1721880431.404800:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008876e300, transno 4296019757 00000004:00080000:0.0:1721880431.404802:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800888cc000, transno 4296019758 00000004:00080000:0.0:1721880431.404805:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008876f480, transno 4296019759 00000004:00080000:0.0:1721880431.404806:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012380a680, transno 4296019760 00000004:00080000:0.0:1721880431.404808:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a1dad80, transno 4296019761 00000004:00080000:0.0:1721880431.404810:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099a3e680, transno 4296019762 00000004:00080000:0.0:1721880431.404812:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008876f800, transno 4296019763 00000004:00080000:0.0:1721880431.404813:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d121500, transno 4296019764 00000004:00080000:0.0:1721880431.404815:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e90b800, transno 4296019765 00000004:00080000:0.0:1721880431.404817:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e908000, transno 4296019766 00000004:00080000:0.0:1721880431.404818:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801302cb100, transno 4296019767 00000004:00080000:0.0:1721880431.404820:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d123100, transno 4296019768 00000004:00080000:0.0:1721880431.404822:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099a3d880, transno 4296019769 00000004:00080000:0.0:1721880431.404823:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099a3ce00, transno 4296019770 00000004:00080000:0.0:1721880431.404825:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a4bb800, transno 4296019771 00000004:00080000:0.0:1721880431.404826:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099a3ca80, transno 4296019772 00000004:00080000:0.0:1721880431.404828:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095a27480, transno 4296019773 00000004:00080000:0.0:1721880431.404830:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095a24e00, transno 4296019774 00000004:00080000:0.0:1721880431.404831:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134fa5c00, transno 4296019775 00000004:00080000:0.0:1721880431.404833:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012cfba680, transno 4296019776 00000004:00080000:0.0:1721880431.404835:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801357b6d80, transno 4296019777 00000004:00080000:0.0:1721880431.404836:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095a25f80, transno 4296019778 00000004:00080000:0.0:1721880431.404838:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092337b80, transno 4296019779 00000004:00080000:0.0:1721880431.404840:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ad03100, transno 4296019780 00000004:00080000:0.0:1721880431.404842:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ad01500, transno 4296019781 00000004:00080000:0.0:1721880431.404843:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012ce10380, transno 4296019782 00000004:00080000:0.0:1721880431.404845:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bcf7b80, transno 4296019783 00000004:00080000:0.0:1721880431.404847:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008571ed80, transno 4296019784 00000004:00080000:0.0:1721880431.404848:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012ce13800, transno 4296019785 00000004:00080000:0.0:1721880431.404850:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008571df80, transno 4296019786 00000004:00080000:0.0:1721880431.404851:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095a24a80, transno 4296019787 00000004:00080000:0.0:1721880431.404854:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084313100, transno 4296019788 00000004:00080000:0.0:1721880431.404855:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008571c700, transno 4296019789 00000004:00080000:0.0:1721880431.404857:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008571f100, transno 4296019790 00000004:00080000:0.0:1721880431.404870:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ad01f80, transno 4296019791 00000004:00080000:0.0:1721880431.404872:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ad03800, transno 4296019792 00000004:00080000:0.0:1721880431.404874:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ad00a80, transno 4296019793 00000004:00080000:0.0:1721880431.404876:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ad00e00, transno 4296019794 00000004:00080000:0.0:1721880431.404879:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ad00380, transno 4296019795 00000004:00080000:0.0:1721880431.404881:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c07a300, transno 4296019796 00000004:00080000:0.0:1721880431.404884:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c078000, transno 4296019797 00000004:00080000:0.0:1721880431.404887:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084311c00, transno 4296019798 00000004:00080000:0.0:1721880431.404890:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092335c00, transno 4296019799 00000004:00080000:0.0:1721880431.404892:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880130b66a00, transno 4296019800 00000004:00080000:0.0:1721880431.404894:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b084a80, transno 4296019801 00000004:00080000:0.0:1721880431.404897:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b087480, transno 4296019802 00000004:00080000:0.0:1721880431.404900:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b084000, transno 4296019803 00000004:00080000:0.0:1721880431.404902:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ad02d80, transno 4296019804 00000004:00080000:0.0:1721880431.404904:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b086680, transno 4296019805 00000004:00080000:0.0:1721880431.404907:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008876d880, transno 4296019806 00000004:00080000:0.0:1721880431.404909:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bcf7800, transno 4296019807 00000004:00080000:0.0:1721880431.404911:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008876ca80, transno 4296019808 00000004:00080000:0.0:1721880431.404914:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ad03b80, transno 4296019809 00000004:00080000:0.0:1721880431.404917:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099e76300, transno 4296019810 00000004:00080000:0.0:1721880431.404920:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099e74380, transno 4296019811 00000004:00080000:0.0:1721880431.404923:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fde3800, transno 4296019812 00000004:00080000:0.0:1721880431.404926:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d121c00, transno 4296019813 00000004:00080000:0.0:1721880431.404928:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b9ead80, transno 4296019814 00000004:00080000:0.0:1721880431.404931:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b9e9180, transno 4296019815 00000004:00080000:0.0:1721880431.404933:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fde1f80, transno 4296019816 00000004:00080000:0.0:1721880431.404936:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009fff1f80, transno 4296019817 00000004:00080000:0.0:1721880431.404940:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009fff0700, transno 4296019818 00000004:00080000:0.0:1721880431.404942:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fde0e00, transno 4296019819 00000004:00080000:0.0:1721880431.404945:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009fff3480, transno 4296019820 00000004:00080000:0.0:1721880431.404947:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091ae0700, transno 4296019821 00000004:00080000:0.0:1721880431.404949:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009fff1180, transno 4296019822 00000004:00080000:0.0:1721880431.404951:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009fff2a00, transno 4296019823 00000004:00080000:0.0:1721880431.404952:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091ae1c00, transno 4296019824 00000004:00080000:0.0:1721880431.404954:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b08e300, transno 4296019825 00000004:00080000:0.0:1721880431.404956:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096000380, transno 4296019826 00000004:00080000:0.0:1721880431.404958:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b9ea680, transno 4296019827 00000004:00080000:0.0:1721880431.404959:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084312a00, transno 4296019828 00000004:00080000:0.0:1721880431.404961:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084312300, transno 4296019829 00000004:00080000:0.0:1721880431.404962:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b8bdf80, transno 4296019830 00000004:00080000:0.0:1721880431.404964:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088db6300, transno 4296019831 00000004:00080000:0.0:1721880431.404965:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088db7b80, transno 4296019832 00000004:00080000:0.0:1721880431.404967:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088db6680, transno 4296019833 00000004:00080000:0.0:1721880431.404969:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e9c8e00, transno 4296019834 00000004:00080000:0.0:1721880431.404970:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fde3480, transno 4296019835 00000004:00080000:0.0:1721880431.404972:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b08df80, transno 4296019836 00000004:00080000:0.0:1721880431.404973:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084310a80, transno 4296019837 00000004:00080000:0.0:1721880431.404975:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e9ca680, transno 4296019838 00000004:00080000:0.0:1721880431.404977:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bd8b800, transno 4296019839 00000004:00080000:0.0:1721880431.404978:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bd8b100, transno 4296019840 00000004:00080000:0.0:1721880431.404980:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bd89c00, transno 4296019841 00000004:00080000:0.0:1721880431.404982:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b9e8a80, transno 4296019842 00000004:00080000:0.0:1721880431.404983:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e9cad80, transno 4296019843 00000004:00080000:0.0:1721880431.404985:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088db5f80, transno 4296019844 00000004:00080000:0.0:1721880431.404986:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088db5c00, transno 4296019845 00000004:00080000:0.0:1721880431.404988:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cd22300, transno 4296019846 00000004:00080000:0.0:1721880431.404990:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ebdad80, transno 4296019847 00000004:00080000:0.0:1721880431.404992:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e9caa00, transno 4296019848 00000004:00080000:0.0:1721880431.404993:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ebd8380, transno 4296019849 00000004:00080000:0.0:1721880431.404995:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094635500, transno 4296019850 00000004:00080000:0.0:1721880431.404997:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ebd9180, transno 4296019851 00000004:00080000:0.0:1721880431.404999:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094635c00, transno 4296019852 00000004:00080000:0.0:1721880431.405000:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ebda300, transno 4296019853 00000004:00080000:0.0:1721880431.405002:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bd88a80, transno 4296019854 00000004:00080000:0.0:1721880431.405003:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cd21f80, transno 4296019855 00000004:00080000:0.0:1721880431.405005:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cd20000, transno 4296019856 00000004:00080000:0.0:1721880431.405006:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cd20e00, transno 4296019857 00000004:00080000:0.0:1721880431.405008:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b9e9880, transno 4296019858 00000004:00080000:0.0:1721880431.405009:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b08f480, transno 4296019859 00000004:00080000:0.0:1721880431.405011:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b08c380, transno 4296019860 00000004:00080000:0.0:1721880431.405013:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b08ed80, transno 4296019861 00000004:00080000:0.0:1721880431.405016:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a052c380, transno 4296019862 00000004:00080000:0.0:1721880431.405018:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b177480, transno 4296019863 00000004:00080000:0.0:1721880431.405021:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b175180, transno 4296019864 00000004:00080000:0.0:1721880431.405023:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b176d80, transno 4296019865 00000004:00080000:0.0:1721880431.405026:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b175f80, transno 4296019866 00000004:00080000:0.0:1721880431.405028:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a052ce00, transno 4296019867 00000004:00080000:0.0:1721880431.405031:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a052df80, transno 4296019868 00000004:00080000:0.0:1721880431.405033:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bd8a680, transno 4296019869 00000004:00080000:0.0:1721880431.405036:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b8bce00, transno 4296019870 00000004:00080000:0.0:1721880431.405038:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088dc2a00, transno 4296019871 00000004:00080000:0.0:1721880431.405041:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088dc0700, transno 4296019872 00000004:00080000:0.0:1721880431.405044:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b087b80, transno 4296019873 00000004:00080000:0.0:1721880431.405047:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088db4700, transno 4296019874 00000004:00080000:0.0:1721880431.405049:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b087100, transno 4296019875 00000004:00080000:0.0:1721880431.405052:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800919c0a80, transno 4296019876 00000004:00080000:0.0:1721880431.405055:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e617100, transno 4296019877 00000004:00080000:0.0:1721880431.405058:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800919c2a00, transno 4296019878 00000004:00080000:0.0:1721880431.405061:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099eb1180, transno 4296019879 00000004:00080000:0.0:1721880431.405063:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094635180, transno 4296019880 00000004:00080000:0.0:1721880431.405066:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094634380, transno 4296019881 00000004:00080000:0.0:1721880431.405069:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800919c2300, transno 4296019882 00000004:00080000:0.0:1721880431.405071:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094636d80, transno 4296019883 00000004:00080000:0.0:1721880431.405073:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099eb2d80, transno 4296019884 00000004:00080000:0.0:1721880431.405075:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f52e680, transno 4296019885 00000004:00080000:0.0:1721880431.405077:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f52e300, transno 4296019886 00000004:00080000:0.0:1721880431.405079:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099eb0700, transno 4296019887 00000004:00080000:0.0:1721880431.405080:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099eb0e00, transno 4296019888 00000004:00080000:0.0:1721880431.405082:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099eb2a00, transno 4296019889 00000004:00080000:0.0:1721880431.405083:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099eb3480, transno 4296019890 00000004:00080000:0.0:1721880431.405085:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f52ce00, transno 4296019891 00000004:00080000:0.0:1721880431.405086:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ebd8000, transno 4296019892 00000004:00080000:0.0:1721880431.405088:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ebdb800, transno 4296019893 00000004:00080000:0.0:1721880431.405089:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ebdaa00, transno 4296019894 00000004:00080000:0.0:1721880431.405091:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f52f100, transno 4296019895 00000004:00080000:0.0:1721880431.405093:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ebd8700, transno 4296019896 00000004:00080000:0.0:1721880431.405094:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c409180, transno 4296019897 00000004:00080000:0.0:1721880431.405096:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ebdb480, transno 4296019898 00000004:00080000:0.0:1721880431.405097:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c40b800, transno 4296019899 00000004:00080000:0.0:1721880431.405099:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c40a300, transno 4296019900 00000004:00080000:0.0:1721880431.405101:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c40ad80, transno 4296019901 00000004:00080000:0.0:1721880431.405103:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c40bb80, transno 4296019902 00000004:00080000:0.0:1721880431.405105:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c408380, transno 4296019903 00000004:00080000:0.0:1721880431.405107:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008777ed80, transno 4296019904 00000004:00080000:0.0:1721880431.405108:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a052e300, transno 4296019905 00000004:00080000:0.0:1721880431.405110:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ebd9500, transno 4296019906 00000004:00080000:0.0:1721880431.405112:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008777c700, transno 4296019907 00000004:00080000:0.0:1721880431.405114:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084310000, transno 4296019908 00000004:00080000:0.0:1721880431.405116:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084df5f80, transno 4296019909 00000004:00080000:0.0:1721880431.405118:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084313b80, transno 4296019910 00000004:00080000:0.0:1721880431.405120:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f52df80, transno 4296019911 00000004:00080000:0.0:1721880431.405121:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084df4e00, transno 4296019912 00000004:00080000:0.0:1721880431.405123:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f52fb80, transno 4296019913 00000004:00080000:0.0:1721880431.405125:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b598a80, transno 4296019914 00000004:00080000:0.0:1721880431.405126:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008777dc00, transno 4296019915 00000004:00080000:0.0:1721880431.405128:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084df6300, transno 4296019916 00000004:00080000:0.0:1721880431.405129:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b086a00, transno 4296019917 00000004:00080000:0.0:1721880431.405131:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008876c000, transno 4296019918 00000004:00080000:0.0:1721880431.405133:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fde2a00, transno 4296019919 00000004:00080000:0.0:1721880431.405134:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009ebdb100, transno 4296019920 00000004:00080000:0.0:1721880431.405136:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009713b100, transno 4296019921 00000004:00080000:0.0:1721880431.405139:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009713aa00, transno 4296019922 00000004:00080000:0.0:1721880431.405141:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009713a300, transno 4296019923 00000004:00080000:0.0:1721880431.405144:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880097139f80, transno 4296019924 00000004:00080000:0.0:1721880431.405146:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009713bb80, transno 4296019925 00000004:00080000:0.0:1721880431.405149:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880097139880, transno 4296019926 00000004:00080000:0.0:1721880431.405151:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009713ad80, transno 4296019927 00000004:00080000:0.0:1721880431.405154:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800959a4e00, transno 4296019928 00000004:00080000:0.0:1721880431.405156:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800959a5180, transno 4296019929 00000004:00080000:0.0:1721880431.405158:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800959a6a00, transno 4296019930 00000004:00080000:0.0:1721880431.405161:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800919c0700, transno 4296019931 00000004:00080000:0.0:1721880431.405163:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b08ce00, transno 4296019932 00000004:00080000:0.0:1721880431.405166:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800959a5500, transno 4296019933 00000004:00080000:0.0:1721880431.405169:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801312d1880, transno 4296019934 00000004:00080000:0.0:1721880431.405172:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099eb1500, transno 4296019935 00000004:00080000:0.0:1721880431.405174:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801312d0000, transno 4296019936 00000004:00080000:0.0:1721880431.405177:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801312d2d80, transno 4296019937 00000004:00080000:0.0:1721880431.405181:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088dc1880, transno 4296019938 00000004:00080000:0.0:1721880431.405184:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088dc0000, transno 4296019939 00000004:00080000:0.0:1721880431.405186:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088dc3480, transno 4296019940 00000004:00080000:0.0:1721880431.405189:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bd88380, transno 4296019941 00000004:00080000:0.0:1721880431.405192:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b176300, transno 4296019942 00000004:00080000:0.0:1721880431.405194:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800966b1c00, transno 4296019943 00000004:00080000:0.0:1721880431.405197:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800966b3100, transno 4296019944 00000004:00080000:0.0:1721880431.405199:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800966b0380, transno 4296019945 00000004:00080000:0.0:1721880431.405202:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d7a3100, transno 4296019946 00000004:00080000:0.0:1721880431.405205:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d7a0000, transno 4296019947 00000004:00080000:0.0:1721880431.405207:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d7a1c00, transno 4296019948 00000004:00080000:0.0:1721880431.405209:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d7a1880, transno 4296019949 00000004:00080000:0.0:1721880431.405211:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008854ce00, transno 4296019950 00000004:00080000:0.0:1721880431.405212:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d7a1f80, transno 4296019951 00000004:00080000:0.0:1721880431.405214:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008854c700, transno 4296019952 00000004:00080000:0.0:1721880431.405215:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e9cbb80, transno 4296019953 00000004:00080000:0.0:1721880431.405217:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088efce00, transno 4296019954 00000004:00080000:0.0:1721880431.405219:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088efc700, transno 4296019955 00000004:00080000:0.0:1721880431.405220:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088efdf80, transno 4296019956 00000004:00080000:0.0:1721880431.405221:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c409880, transno 4296019957 00000004:00080000:0.0:1721880431.405223:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088efea00, transno 4296019958 00000004:00080000:0.0:1721880431.405225:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c409500, transno 4296019959 00000004:00080000:0.0:1721880431.405227:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092319500, transno 4296019960 00000004:00080000:0.0:1721880431.405228:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008854d880, transno 4296019961 00000004:00080000:0.0:1721880431.405230:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008854c000, transno 4296019962 00000004:00080000:0.0:1721880431.405231:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007bb45500, transno 4296019963 00000004:00080000:0.0:1721880431.405233:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135173800, transno 4296019964 00000004:00080000:0.0:1721880431.405235:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088615500, transno 4296019965 00000004:00080000:0.0:1721880431.405237:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088614e00, transno 4296019966 00000004:00080000:0.0:1721880431.405239:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007bb44e00, transno 4296019967 00000004:00080000:0.0:1721880431.405241:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007bb45c00, transno 4296019968 00000004:00080000:0.0:1721880431.405243:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007bb46680, transno 4296019969 00000004:00080000:0.0:1721880431.405245:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007bb45f80, transno 4296019970 00000004:00080000:0.0:1721880431.405247:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007bb45180, transno 4296019971 00000004:00080000:0.0:1721880431.405248:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800919c3480, transno 4296019972 00000004:00080000:0.0:1721880431.405250:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800919c3800, transno 4296019973 00000004:00080000:0.0:1721880431.405251:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800919c3b80, transno 4296019974 00000004:00080000:0.0:1721880431.405253:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088eff100, transno 4296019975 00000004:00080000:0.0:1721880431.405254:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088efe300, transno 4296019976 00000004:00080000:0.0:1721880431.405255:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088efd180, transno 4296019977 00000004:00080000:0.0:1721880431.405257:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800919c1880, transno 4296019978 00000004:00080000:0.0:1721880431.405259:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d9e9500, transno 4296019979 00000004:00080000:0.0:1721880431.405260:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d9e8000, transno 4296019980 00000004:00080000:0.0:1721880431.405262:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cd22a00, transno 4296019981 00000004:00080000:0.0:1721880431.405263:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a052d180, transno 4296019982 00000004:00080000:0.0:1721880431.405265:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f52d180, transno 4296019983 00000004:00080000:0.0:1721880431.405266:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d9e8700, transno 4296019984 00000004:00080000:0.0:1721880431.405268:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d9eb100, transno 4296019985 00000004:00080000:0.0:1721880431.405270:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d9e9f80, transno 4296019986 00000004:00080000:0.0:1721880431.405272:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d9e9180, transno 4296019987 00000004:00080000:0.0:1721880431.405273:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d9ebb80, transno 4296019988 00000004:00080000:0.0:1721880431.405275:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801341d1180, transno 4296019989 00000004:00080000:0.0:1721880431.405277:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088617480, transno 4296019990 00000004:00080000:0.0:1721880431.405278:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801341d0000, transno 4296019991 00000004:00080000:0.0:1721880431.405280:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008854ea00, transno 4296019992 00000004:00080000:0.0:1721880431.405282:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088616a00, transno 4296019993 00000004:00080000:0.0:1721880431.405284:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801341d1880, transno 4296019994 00000004:00080000:0.0:1721880431.405285:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007bb47800, transno 4296019995 00000004:00080000:0.0:1721880431.405287:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008854f800, transno 4296019996 00000004:00080000:0.0:1721880431.405289:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f021c00, transno 4296019997 00000004:00080000:0.0:1721880431.405292:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135170a80, transno 4296019998 00000004:00080000:0.0:1721880431.405294:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009231aa00, transno 4296019999 00000004:00080000:0.0:1721880431.405296:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f020000, transno 4296020000 00000004:00080000:0.0:1721880431.405297:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f020a80, transno 4296020001 00000004:00080000:0.0:1721880431.405299:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f023b80, transno 4296020002 00000004:00080000:0.0:1721880431.405300:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076fdf100, transno 4296020003 00000004:00080000:0.0:1721880431.405302:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f021880, transno 4296020004 00000004:00080000:0.0:1721880431.405303:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076fdf480, transno 4296020005 00000004:00080000:0.0:1721880431.405305:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088615f80, transno 4296020006 00000004:00080000:0.0:1721880431.405306:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076fdca80, transno 4296020007 00000004:00080000:0.0:1721880431.405308:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076fdc380, transno 4296020008 00000004:00080000:0.0:1721880431.405310:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012ba64700, transno 4296020009 00000004:00080000:0.0:1721880431.405311:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800919c0000, transno 4296020010 00000004:00080000:0.0:1721880431.405314:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801362d8e00, transno 4296020011 00000004:00080000:0.0:1721880431.405315:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f09e300, transno 4296020012 00000004:00080000:0.0:1721880431.405317:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f09d500, transno 4296020013 00000004:00080000:0.0:1721880431.405320:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f09c380, transno 4296020014 00000004:00080000:0.0:1721880431.405323:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f09f480, transno 4296020015 00000004:00080000:0.0:1721880431.405325:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c40b480, transno 4296020016 00000004:00080000:0.0:1721880431.405328:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800952a0a80, transno 4296020017 00000004:00080000:0.0:1721880431.405330:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801362db480, transno 4296020018 00000004:00080000:0.0:1721880431.405332:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800919c2680, transno 4296020019 00000004:00080000:0.0:1721880431.405335:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f09ed80, transno 4296020020 00000004:00080000:0.0:1721880431.405337:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f09d880, transno 4296020021 00000004:00080000:0.0:1721880431.405340:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f09c700, transno 4296020022 00000004:00080000:0.0:1721880431.405342:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801341d0380, transno 4296020023 00000004:00080000:0.0:1721880431.405345:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800952a0700, transno 4296020024 00000004:00080000:0.0:1721880431.405347:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008854df80, transno 4296020025 00000004:00080000:0.0:1721880431.405350:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801341d2300, transno 4296020026 00000004:00080000:0.0:1721880431.405352:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008854c380, transno 4296020027 00000004:00080000:0.0:1721880431.405356:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092318e00, transno 4296020028 00000004:00080000:0.0:1721880431.405358:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008777ce00, transno 4296020029 00000004:00080000:0.0:1721880431.405361:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076fde680, transno 4296020030 00000004:00080000:0.0:1721880431.405363:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076fdce00, transno 4296020031 00000004:00080000:0.0:1721880431.405366:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012ba65500, transno 4296020032 00000004:00080000:0.0:1721880431.405368:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012ba66680, transno 4296020033 00000004:00080000:0.0:1721880431.405371:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076fdd880, transno 4296020034 00000004:00080000:0.0:1721880431.405374:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092318000, transno 4296020035 00000004:00080000:0.0:1721880431.405376:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cd23800, transno 4296020036 00000004:00080000:0.0:1721880431.405379:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880136398a80, transno 4296020037 00000004:00080000:0.0:1721880431.405381:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094635880, transno 4296020038 00000004:00080000:0.0:1721880431.405384:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880136398e00, transno 4296020039 00000004:00080000:0.0:1721880431.405386:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013639b800, transno 4296020040 00000004:00080000:0.0:1721880431.405388:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013639b100, transno 4296020041 00000004:00080000:0.0:1721880431.405390:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092319f80, transno 4296020042 00000004:00080000:0.0:1721880431.405392:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088efc380, transno 4296020043 00000004:00080000:0.0:1721880431.405395:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013639a680, transno 4296020044 00000004:00080000:0.0:1721880431.405397:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012ba64a80, transno 4296020045 00000004:00080000:0.0:1721880431.405399:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f09dc00, transno 4296020046 00000004:00080000:0.0:1721880431.405402:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f09f100, transno 4296020047 00000004:00080000:0.0:1721880431.405404:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122c7e300, transno 4296020048 00000004:00080000:0.0:1721880431.405407:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122c7e680, transno 4296020049 00000004:00080000:0.0:1721880431.405410:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f021500, transno 4296020050 00000004:00080000:0.0:1721880431.405412:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122c7d500, transno 4296020051 00000004:00080000:0.0:1721880431.405415:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122c7c700, transno 4296020052 00000004:00080000:0.0:1721880431.405418:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122c7ed80, transno 4296020053 00000004:00080000:0.0:1721880431.405420:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f020e00, transno 4296020054 00000004:00080000:0.0:1721880431.405422:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f022a00, transno 4296020055 00000004:00080000:0.0:1721880431.405425:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d9eaa00, transno 4296020056 00000004:00080000:0.0:1721880431.405427:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801312d1c00, transno 4296020057 00000004:00080000:0.0:1721880431.405431:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d9e8a80, transno 4296020058 00000004:00080000:0.0:1721880431.405434:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801312d3800, transno 4296020059 00000004:00080000:0.0:1721880431.405437:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122c1ce00, transno 4296020060 00000004:00080000:0.0:1721880431.405439:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122c1c000, transno 4296020061 00000004:00080000:0.0:1721880431.405442:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092319180, transno 4296020062 00000004:00080000:0.0:1721880431.405445:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d9e8380, transno 4296020063 00000004:00080000:0.0:1721880431.405448:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008854dc00, transno 4296020064 00000004:00080000:0.0:1721880431.405450:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122c1d880, transno 4296020065 00000004:00080000:0.0:1721880431.405453:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012ba64e00, transno 4296020066 00000004:00080000:0.0:1721880431.405456:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012ba67b80, transno 4296020067 00000004:00080000:0.0:1721880431.405458:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076fdfb80, transno 4296020068 00000004:00080000:0.0:1721880431.405460:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076fdc000, transno 4296020069 00000004:00080000:0.0:1721880431.405462:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801362db800, transno 4296020070 00000004:00080000:0.0:1721880431.405464:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076fde300, transno 4296020071 00000004:00080000:0.0:1721880431.405465:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088617b80, transno 4296020072 00000004:00080000:0.0:1721880431.405467:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088615880, transno 4296020073 00000004:00080000:0.0:1721880431.405469:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f020700, transno 4296020074 00000004:00080000:0.0:1721880431.405470:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801362d9880, transno 4296020075 00000004:00080000:0.0:1721880431.405472:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801362d8700, transno 4296020076 00000004:00080000:0.0:1721880431.405473:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012ba66300, transno 4296020077 00000004:00080000:0.0:1721880431.405475:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800994e8700, transno 4296020078 00000004:00080000:0.0:1721880431.405477:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800994e8e00, transno 4296020079 00000004:00080000:0.0:1721880431.405478:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800994ebb80, transno 4296020080 00000004:00080000:0.0:1721880431.405480:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088616680, transno 4296020081 00000004:00080000:0.0:1721880431.405481:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880136399180, transno 4296020082 00000004:00080000:0.0:1721880431.405483:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880136399c00, transno 4296020083 00000004:00080000:0.0:1721880431.405484:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800994e8a80, transno 4296020084 00000004:00080000:0.0:1721880431.405486:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013639a300, transno 4296020085 00000004:00080000:0.0:1721880431.405487:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800994ea300, transno 4296020086 00000004:00080000:0.0:1721880431.405489:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c40aa00, transno 4296020087 00000004:00080000:0.0:1721880431.405491:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013639ad80, transno 4296020088 00000004:00080000:0.0:1721880431.405493:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800994e9500, transno 4296020089 00000004:00080000:0.0:1721880431.405495:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801366a3800, transno 4296020090 00000004:00080000:0.0:1721880431.405496:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801366a2a00, transno 4296020091 00000004:00080000:0.0:1721880431.405498:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800952a3b80, transno 4296020092 00000004:00080000:0.0:1721880431.405500:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122c1f800, transno 4296020093 00000004:00080000:0.0:1721880431.405501:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801366a1180, transno 4296020094 00000004:00080000:0.0:1721880431.405503:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122c1dc00, transno 4296020095 00000004:00080000:0.0:1721880431.405504:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122c1d180, transno 4296020096 00000004:00080000:0.0:1721880431.405506:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122c1e680, transno 4296020097 00000004:00080000:0.0:1721880431.405507:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801341d0e00, transno 4296020098 00000004:00080000:0.0:1721880431.405509:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122c7dc00, transno 4296020099 00000004:00080000:0.0:1721880431.405510:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801366a1f80, transno 4296020100 00000004:00080000:0.0:1721880431.405512:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801366a0a80, transno 4296020101 00000004:00080000:0.0:1721880431.405513:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801362db100, transno 4296020102 00000004:00080000:0.0:1721880431.405515:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800919c1180, transno 4296020103 00000004:00080000:0.0:1721880431.405517:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801366a3480, transno 4296020104 00000004:00080000:0.0:1721880431.405518:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801362d9500, transno 4296020105 00000004:00080000:0.0:1721880431.405520:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800920cb480, transno 4296020106 00000004:00080000:0.0:1721880431.405521:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007bb47100, transno 4296020107 00000004:00080000:0.0:1721880431.405523:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801366a0700, transno 4296020108 00000004:00080000:0.0:1721880431.405525:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007bb46300, transno 4296020109 00000004:00080000:0.0:1721880431.405526:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122c1ca80, transno 4296020110 00000004:00080000:0.0:1721880431.405528:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125a17100, transno 4296020111 00000004:00080000:0.0:1721880431.405529:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088615180, transno 4296020112 00000004:00080000:0.0:1721880431.405531:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012ba67800, transno 4296020113 00000004:00080000:0.0:1721880431.405533:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800920ca300, transno 4296020114 00000004:00080000:0.0:1721880431.405534:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800920c9c00, transno 4296020115 00000004:00080000:0.0:1721880431.405536:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125a15f80, transno 4296020116 00000004:00080000:0.0:1721880431.405537:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800920cb800, transno 4296020117 00000004:00080000:0.0:1721880431.405539:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007bb44700, transno 4296020118 00000004:00080000:0.0:1721880431.405541:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800920c9500, transno 4296020119 00000004:00080000:0.0:1721880431.405543:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007bb44a80, transno 4296020120 00000004:00080000:0.0:1721880431.405545:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125a15500, transno 4296020121 00000004:00080000:0.0:1721880431.405547:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007bb47480, transno 4296020122 00000004:00080000:0.0:1721880431.405548:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007bb47b80, transno 4296020123 00000004:00080000:0.0:1721880431.405549:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007bb44000, transno 4296020124 00000004:00080000:0.0:1721880431.405551:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125a14380, transno 4296020125 00000004:00080000:0.0:1721880431.405553:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d3d4a80, transno 4296020126 00000004:00080000:0.0:1721880431.405554:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d3d4000, transno 4296020127 00000004:00080000:0.0:1721880431.405556:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d3d5f80, transno 4296020128 00000004:00080000:0.0:1721880431.405557:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125a14700, transno 4296020129 00000004:00080000:0.0:1721880431.405559:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d3d5500, transno 4296020130 00000004:00080000:0.0:1721880431.405560:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bdc4700, transno 4296020131 00000004:00080000:0.0:1721880431.405562:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bdc7100, transno 4296020132 00000004:00080000:0.0:1721880431.405563:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bdc7800, transno 4296020133 00000004:00080000:0.0:1721880431.405565:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088efd880, transno 4296020134 00000004:00080000:0.0:1721880431.405566:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094637800, transno 4296020135 00000004:00080000:0.0:1721880431.405568:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bdc5500, transno 4296020136 00000004:00080000:0.0:1721880431.405569:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801312d2300, transno 4296020137 00000004:00080000:0.0:1721880431.405571:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bdc6a00, transno 4296020138 00000004:00080000:0.0:1721880431.405573:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800920c9880, transno 4296020139 00000004:00080000:0.0:1721880431.405574:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800994ead80, transno 4296020140 00000004:00080000:0.0:1721880431.405576:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122c1e300, transno 4296020141 00000004:00080000:0.0:1721880431.405577:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800994eb480, transno 4296020142 00000004:00080000:0.0:1721880431.405579:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b16e300, transno 4296020143 00000004:00080000:0.0:1721880431.405581:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b16d180, transno 4296020144 00000004:00080000:0.0:1721880431.405582:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125a17800, transno 4296020145 00000004:00080000:0.0:1721880431.405584:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b16c700, transno 4296020146 00000004:00080000:0.0:1721880431.405585:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125a14000, transno 4296020147 00000004:00080000:0.0:1721880431.405588:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d040a80, transno 4296020148 00000004:00080000:0.0:1721880431.405590:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f022680, transno 4296020149 00000004:00080000:0.0:1721880431.405592:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125a16300, transno 4296020150 00000004:00080000:0.0:1721880431.405594:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800920caa00, transno 4296020151 00000004:00080000:0.0:1721880431.405595:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800994eb800, transno 4296020152 00000004:00080000:0.0:1721880431.405597:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ea14000, transno 4296020153 00000004:00080000:0.0:1721880431.405599:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800919c1c00, transno 4296020154 00000004:00080000:0.0:1721880431.405600:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ea14380, transno 4296020155 00000004:00080000:0.0:1721880431.405602:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ea15f80, transno 4296020156 00000004:00080000:0.0:1721880431.405603:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800920cbb80, transno 4296020157 00000004:00080000:0.0:1721880431.405605:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800888f8a80, transno 4296020158 00000004:00080000:0.0:1721880431.405607:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800920c9180, transno 4296020159 00000004:00080000:0.0:1721880431.405609:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800920c8380, transno 4296020160 00000004:00080000:0.0:1721880431.405611:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800920aa680, transno 4296020161 00000004:00080000:0.0:1721880431.405612:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d043100, transno 4296020162 00000004:00080000:0.0:1721880431.405614:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122c1df80, transno 4296020163 00000004:00080000:0.0:1721880431.405616:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122c1f100, transno 4296020164 00000004:00080000:0.0:1721880431.405617:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122c7df80, transno 4296020165 00000004:00080000:0.0:1721880431.405619:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d041c00, transno 4296020166 00000004:00080000:0.0:1721880431.405621:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800920ab800, transno 4296020167 00000004:00080000:0.0:1721880431.405622:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801366a2300, transno 4296020168 00000004:00080000:0.0:1721880431.405624:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800920ab100, transno 4296020169 00000004:00080000:0.0:1721880431.405625:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800920a8000, transno 4296020170 00000004:00080000:0.0:1721880431.405627:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800920a9500, transno 4296020171 00000004:00080000:0.0:1721880431.405628:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c610a80, transno 4296020172 00000004:00080000:0.0:1721880431.405630:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122c7ea00, transno 4296020173 00000004:00080000:0.0:1721880431.405631:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c612680, transno 4296020174 00000004:00080000:0.0:1721880431.405633:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c611f80, transno 4296020175 00000004:00080000:0.0:1721880431.405635:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096f17480, transno 4296020176 00000004:00080000:0.0:1721880431.405636:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ea15500, transno 4296020177 00000004:00080000:0.0:1721880431.405639:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800920c8e00, transno 4296020178 00000004:00080000:0.0:1721880431.405640:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800920c9f80, transno 4296020179 00000004:00080000:0.0:1721880431.405642:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ea16680, transno 4296020180 00000004:00080000:0.0:1721880431.405644:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013639b480, transno 4296020181 00000004:00080000:0.0:1721880431.405646:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125a15180, transno 4296020182 00000004:00080000:0.0:1721880431.405648:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800888fa680, transno 4296020183 00000004:00080000:0.0:1721880431.405650:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800888f8700, transno 4296020184 00000004:00080000:0.0:1721880431.405653:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800888f8380, transno 4296020185 00000004:00080000:0.0:1721880431.405655:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d3d5180, transno 4296020186 00000004:00080000:0.0:1721880431.405657:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801312d2680, transno 4296020187 00000004:00080000:0.0:1721880431.405661:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d3d5c00, transno 4296020188 00000004:00080000:0.0:1721880431.405663:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801341d3100, transno 4296020189 00000004:00080000:0.0:1721880431.405666:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122c1c380, transno 4296020190 00000004:00080000:0.0:1721880431.405668:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800994e9180, transno 4296020191 00000004:00080000:0.0:1721880431.405671:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012ba66d80, transno 4296020192 00000004:00080000:0.0:1721880431.405674:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bdc6680, transno 4296020193 00000004:00080000:0.0:1721880431.405676:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bdc4a80, transno 4296020194 00000004:00080000:0.0:1721880431.405678:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d3d6680, transno 4296020195 00000004:00080000:0.0:1721880431.405681:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d040000, transno 4296020196 00000004:00080000:0.0:1721880431.405683:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bdc6d80, transno 4296020197 00000004:00080000:0.0:1721880431.405686:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d3d6a00, transno 4296020198 00000004:00080000:0.0:1721880431.405689:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d3d7480, transno 4296020199 00000004:00080000:0.0:1721880431.405691:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d041180, transno 4296020200 00000004:00080000:0.0:1721880431.405694:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bdc5c00, transno 4296020201 00000004:00080000:0.0:1721880431.405697:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b16c380, transno 4296020202 00000004:00080000:0.0:1721880431.405700:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d3d6300, transno 4296020203 00000004:00080000:0.0:1721880431.405702:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d9e9880, transno 4296020204 00000004:00080000:0.0:1721880431.405705:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ea3ad80, transno 4296020205 00000004:00080000:0.0:1721880431.405707:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076fdd180, transno 4296020206 00000004:00080000:0.0:1721880431.405710:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f09ca80, transno 4296020207 00000004:00080000:0.0:1721880431.405713:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c613100, transno 4296020208 00000004:00080000:0.0:1721880431.405714:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ea3b800, transno 4296020209 00000004:00080000:0.0:1721880431.405716:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f09ea00, transno 4296020210 00000004:00080000:0.0:1721880431.405718:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b146300, transno 4296020211 00000004:00080000:0.0:1721880431.405720:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801366a3b80, transno 4296020212 00000004:00080000:0.0:1721880431.405722:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b16fb80, transno 4296020213 00000004:00080000:0.0:1721880431.405723:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b16d880, transno 4296020214 00000004:00080000:0.0:1721880431.405725:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125a17480, transno 4296020215 00000004:00080000:0.0:1721880431.405740:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125a15880, transno 4296020216 00000004:00080000:0.0:1721880431.405741:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b16f100, transno 4296020217 00000004:00080000:0.0:1721880431.405743:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b16ce00, transno 4296020218 00000004:00080000:0.0:1721880431.405744:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880136399500, transno 4296020219 00000004:00080000:0.0:1721880431.405746:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880136399f80, transno 4296020220 00000004:00080000:0.0:1721880431.405748:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122c7d880, transno 4296020221 00000004:00080000:0.0:1721880431.405749:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880136398700, transno 4296020222 00000004:00080000:0.0:1721880431.405751:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122c7c000, transno 4296020223 00000004:00080000:0.0:1721880431.405753:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800920aad80, transno 4296020224 00000004:00080000:0.0:1721880431.405755:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800920a9f80, transno 4296020225 00000004:00080000:0.0:1721880431.405756:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ea17100, transno 4296020226 00000004:00080000:0.0:1721880431.405759:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d042a00, transno 4296020227 00000004:00080000:0.0:1721880431.405760:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800920a9c00, transno 4296020228 00000004:00080000:0.0:1721880431.405762:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800920aa300, transno 4296020229 00000004:00080000:0.0:1721880431.405764:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ea15c00, transno 4296020230 00000004:00080000:0.0:1721880431.405766:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ea15880, transno 4296020231 00000004:00080000:0.0:1721880431.405767:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096f17b80, transno 4296020232 00000004:00080000:0.0:1721880431.405768:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d042680, transno 4296020233 00000004:00080000:0.0:1721880431.405770:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096f16680, transno 4296020234 00000004:00080000:0.0:1721880431.405772:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096f14700, transno 4296020235 00000004:00080000:0.0:1721880431.405773:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096f15180, transno 4296020236 00000004:00080000:0.0:1721880431.405775:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c0d3480, transno 4296020237 00000004:00080000:0.0:1721880431.405778:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c0d0e00, transno 4296020238 00000004:00080000:0.0:1721880431.405780:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c0d1f80, transno 4296020239 00000004:00080000:0.0:1721880431.405781:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800952a2a00, transno 4296020240 00000004:00080000:0.0:1721880431.405783:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087744000, transno 4296020241 00000004:00080000:0.0:1721880431.405785:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b144e00, transno 4296020242 00000004:00080000:0.0:1721880431.405787:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087745180, transno 4296020243 00000004:00080000:0.0:1721880431.405789:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b146d80, transno 4296020244 00000004:00080000:0.0:1721880431.405791:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092a4b480, transno 4296020245 00000004:00080000:0.0:1721880431.405792:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e86c700, transno 4296020246 00000004:00080000:0.0:1721880431.405794:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800920c8a80, transno 4296020247 00000004:00080000:0.0:1721880431.405796:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088f14e00, transno 4296020248 00000004:00080000:0.0:1721880431.405798:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088f15500, transno 4296020249 00000004:00080000:0.0:1721880431.405799:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135172680, transno 4296020250 00000004:00080000:0.0:1721880431.405801:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d27a300, transno 4296020251 00000004:00080000:0.0:1721880431.405803:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e86d880, transno 4296020252 00000004:00080000:0.0:1721880431.405805:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088f16a00, transno 4296020253 00000004:00080000:0.0:1721880431.405806:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801366a2d80, transno 4296020254 00000004:00080000:0.0:1721880431.405808:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801366a0380, transno 4296020255 00000004:00080000:0.0:1721880431.405809:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800920cad80, transno 4296020256 00000004:00080000:0.0:1721880431.405811:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e86f100, transno 4296020257 00000004:00080000:0.0:1721880431.405812:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c602a00, transno 4296020258 00000004:00080000:0.0:1721880431.405814:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087746680, transno 4296020259 00000004:00080000:0.0:1721880431.405816:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120346680, transno 4296020260 00000004:00080000:0.0:1721880431.405817:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120345880, transno 4296020261 00000004:00080000:0.0:1721880431.405819:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c602680, transno 4296020262 00000004:00080000:0.0:1721880431.405820:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120345f80, transno 4296020263 00000004:00080000:0.0:1721880431.405821:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120344000, transno 4296020264 00000004:00080000:0.0:1721880431.405823:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120347800, transno 4296020265 00000004:00080000:0.0:1721880431.405825:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120344380, transno 4296020266 00000004:00080000:0.0:1721880431.405827:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013076ad80, transno 4296020267 00000004:00080000:0.0:1721880431.405829:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120344700, transno 4296020268 00000004:00080000:0.0:1721880431.405830:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120346300, transno 4296020269 00000004:00080000:0.0:1721880431.405832:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800858b4000, transno 4296020270 00000004:00080000:0.0:1721880431.405834:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800858b4380, transno 4296020271 00000004:00080000:0.0:1721880431.405835:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f709f80, transno 4296020272 00000004:00080000:0.0:1721880431.405837:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800858b7b80, transno 4296020273 00000004:00080000:0.0:1721880431.405839:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098220380, transno 4296020274 00000004:00080000:0.0:1721880431.405840:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800858b7800, transno 4296020275 00000004:00080000:0.0:1721880431.405842:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098222300, transno 4296020276 00000004:00080000:0.0:1721880431.405843:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800858b6300, transno 4296020277 00000004:00080000:0.0:1721880431.405845:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120346a00, transno 4296020278 00000004:00080000:0.0:1721880431.405846:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c0d3800, transno 4296020279 00000004:00080000:0.0:1721880431.405848:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c0d2680, transno 4296020280 00000004:00080000:0.0:1721880431.405850:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c0d2d80, transno 4296020281 00000004:00080000:0.0:1721880431.405851:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800858b6d80, transno 4296020282 00000004:00080000:0.0:1721880431.405853:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c0d1c00, transno 4296020283 00000004:00080000:0.0:1721880431.405854:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c0d0a80, transno 4296020284 00000004:00080000:0.0:1721880431.405856:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076e5e680, transno 4296020285 00000004:00080000:0.0:1721880431.405858:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880130769180, transno 4296020286 00000004:00080000:0.0:1721880431.405871:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009625aa00, transno 4296020287 00000004:00080000:0.0:1721880431.405874:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b874a80, transno 4296020288 00000004:00080000:0.0:1721880431.405876:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009625b800, transno 4296020289 00000004:00080000:0.0:1721880431.405878:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076e5e300, transno 4296020290 00000004:00080000:0.0:1721880431.405880:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076e5ca80, transno 4296020291 00000004:00080000:0.0:1721880431.405881:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076e5d180, transno 4296020292 00000004:00080000:0.0:1721880431.405883:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f70b480, transno 4296020293 00000004:00080000:0.0:1721880431.405885:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ca5df80, transno 4296020294 00000004:00080000:0.0:1721880431.405886:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800911eed80, transno 4296020295 00000004:00080000:0.0:1721880431.405888:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098221180, transno 4296020296 00000004:00080000:0.0:1721880431.405890:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880120347100, transno 4296020297 00000004:00080000:0.0:1721880431.405892:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800920a8e00, transno 4296020298 00000004:00080000:0.0:1721880431.405894:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098bec380, transno 4296020299 00000004:00080000:0.0:1721880431.405896:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098beca80, transno 4296020300 00000004:00080000:0.0:1721880431.405897:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098bef480, transno 4296020301 00000004:00080000:0.0:1721880431.405899:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ca5e300, transno 4296020302 00000004:00080000:0.0:1721880431.405901:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800920a9180, transno 4296020303 00000004:00080000:0.0:1721880431.405902:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ca5dc00, transno 4296020304 00000004:00080000:0.0:1721880431.405904:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011f822680, transno 4296020305 00000004:00080000:0.0:1721880431.405905:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800920a9880, transno 4296020306 00000004:00080000:0.0:1721880431.405907:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094693480, transno 4296020307 00000004:00080000:0.0:1721880431.405908:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ca5ea00, transno 4296020308 00000004:00080000:0.0:1721880431.405909:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095b71c00, transno 4296020309 00000004:00080000:0.0:1721880431.405911:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800858b5880, transno 4296020310 00000004:00080000:0.0:1721880431.405913:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800887ab800, transno 4296020311 00000004:00080000:0.0:1721880431.405914:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800887aaa00, transno 4296020312 00000004:00080000:0.0:1721880431.405916:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880130769880, transno 4296020313 00000004:00080000:0.0:1721880431.405918:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098bec000, transno 4296020314 00000004:00080000:0.0:1721880431.405919:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098bec700, transno 4296020315 00000004:00080000:0.0:1721880431.405920:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098bee680, transno 4296020316 00000004:00080000:0.0:1721880431.405922:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094692d80, transno 4296020317 00000004:00080000:0.0:1721880431.405924:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880098bed880, transno 4296020318 00000004:00080000:0.0:1721880431.405925:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ca5e680, transno 4296020319 00000004:00080000:0.0:1721880431.405927:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ca5d180, transno 4296020320 00000004:00080000:0.0:1721880431.405929:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ca5d880, transno 4296020321 00000004:00080000:0.0:1721880431.405930:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009b147b80, transno 4296020322 00000004:00080000:0.0:1721880431.405931:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ca5fb80, transno 4296020323 00000004:00080000:0.0:1721880431.405933:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800995f6300, transno 4296020324 00000004:00080000:0.0:1721880431.405935:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122c7fb80, transno 4296020325 00000004:00080000:0.0:1721880431.405936:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ca5d500, transno 4296020326 00000004:00080000:0.0:1721880431.405938:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f12d180, transno 4296020327 00000004:00080000:0.0:1721880431.405940:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800995f7800, transno 4296020328 00000004:00080000:0.0:1721880431.405942:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fc35180, transno 4296020329 00000004:00080000:0.0:1721880431.405944:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f12c380, transno 4296020330 00000004:00080000:0.0:1721880431.405945:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fc35880, transno 4296020331 00000004:00080000:0.0:1721880431.405947:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fc37800, transno 4296020332 00000004:00080000:0.0:1721880431.405949:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088dd5500, transno 4296020333 00000004:00080000:0.0:1721880431.405951:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125987100, transno 4296020334 00000004:00080000:0.0:1721880431.405953:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091137100, transno 4296020335 00000004:00080000:0.0:1721880431.405954:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880125987800, transno 4296020336 00000004:00080000:0.0:1721880431.405955:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091134a80, transno 4296020337 00000004:00080000:0.0:1721880431.405957:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091136d80, transno 4296020338 00000004:00080000:0.0:1721880431.405959:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091134e00, transno 4296020339 00000004:00080000:0.0:1721880431.405960:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091137800, transno 4296020340 00000004:00080000:0.0:1721880431.405961:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091135500, transno 4296020341 00000004:00080000:0.0:1721880431.405963:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091134700, transno 4296020342 00000004:00080000:0.0:1721880431.405965:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091135880, transno 4296020343 00000004:00080000:0.0:1721880431.405966:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d0c0700, transno 4296020344 00000004:00080000:0.0:1721880431.405967:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091136680, transno 4296020345 00000004:00080000:0.0:1721880431.405969:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ca4f480, transno 4296020346 00000004:00080000:0.0:1721880431.405971:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091135180, transno 4296020347 00000004:00080000:0.0:1721880431.405972:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131ea6300, transno 4296020348 00000004:00080000:0.0:1721880431.405974:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ca4c380, transno 4296020349 00000004:00080000:0.0:1721880431.405975:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d0c3480, transno 4296020350 00000004:00080000:0.0:1721880431.405977:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801360cf800, transno 4296020351 00000004:00080000:0.0:1721880431.405979:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e3ddf80, transno 4296020352 00000004:00080000:0.0:1721880431.405980:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962aed80, transno 4296020353 00000004:00080000:0.0:1721880431.405982:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e3df480, transno 4296020354 00000004:00080000:0.0:1721880431.405984:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e3de680, transno 4296020355 00000004:00080000:0.0:1721880431.405985:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008cc72d80, transno 4296020356 00000004:00080000:0.0:1721880431.405987:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e3de300, transno 4296020357 00000004:00080000:0.0:1721880431.405989:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122fd1180, transno 4296020358 00000004:00080000:0.0:1721880431.405991:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b91c00, transno 4296020359 00000004:00080000:0.0:1721880431.405992:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d278e00, transno 4296020360 00000004:00080000:0.0:1721880431.405994:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134e96680, transno 4296020361 00000004:00080000:0.0:1721880431.405996:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122fd0e00, transno 4296020362 00000004:00080000:0.0:1721880431.405998:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122fd2300, transno 4296020363 00000004:00080000:0.0:1721880431.405999:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122fd1500, transno 4296020364 00000004:00080000:0.0:1721880431.406001:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e3dc000, transno 4296020365 00000004:00080000:0.0:1721880431.406002:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009299d880, transno 4296020366 00000004:00080000:0.0:1721880431.406004:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d27b800, transno 4296020367 00000004:00080000:0.0:1721880431.406005:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134e95c00, transno 4296020368 00000004:00080000:0.0:1721880431.406007:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134e97b80, transno 4296020369 00000004:00080000:0.0:1721880431.406009:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134e97480, transno 4296020370 00000004:00080000:0.0:1721880431.406010:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d33ca80, transno 4296020371 00000004:00080000:0.0:1721880431.406012:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099491500, transno 4296020372 00000004:00080000:0.0:1721880431.406014:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fd16300, transno 4296020373 00000004:00080000:0.0:1721880431.406015:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fd17b80, transno 4296020374 00000004:00080000:0.0:1721880431.406016:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fd14000, transno 4296020375 00000004:00080000:0.0:1721880431.406018:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fd15880, transno 4296020376 00000004:00080000:0.0:1721880431.406019:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bdfad80, transno 4296020377 00000004:00080000:0.0:1721880431.406021:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099492a00, transno 4296020378 00000004:00080000:0.0:1721880431.406022:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099490700, transno 4296020379 00000004:00080000:0.0:1721880431.406024:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962ac380, transno 4296020380 00000004:00080000:0.0:1721880431.406026:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e34c700, transno 4296020381 00000004:00080000:0.0:1721880431.406027:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fd17800, transno 4296020382 00000004:00080000:0.0:1721880431.406028:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fd14e00, transno 4296020383 00000004:00080000:0.0:1721880431.406030:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b92d80, transno 4296020384 00000004:00080000:0.0:1721880431.406031:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d3b8700, transno 4296020385 00000004:00080000:0.0:1721880431.406033:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007ca4ed80, transno 4296020386 00000004:00080000:0.0:1721880431.406035:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d3ba300, transno 4296020387 00000004:00080000:0.0:1721880431.406037:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b90000, transno 4296020388 00000004:00080000:0.0:1721880431.406039:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085850000, transno 4296020389 00000004:00080000:0.0:1721880431.406040:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f1b7800, transno 4296020390 00000004:00080000:0.0:1721880431.406042:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099490a80, transno 4296020391 00000004:00080000:0.0:1721880431.406044:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122fd1c00, transno 4296020392 00000004:00080000:0.0:1721880431.406045:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800887f7b80, transno 4296020393 00000004:00080000:0.0:1721880431.406047:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d3bb100, transno 4296020394 00000004:00080000:0.0:1721880431.406049:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122fd2680, transno 4296020395 00000004:00080000:0.0:1721880431.406050:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085817100, transno 4296020396 00000004:00080000:0.0:1721880431.406052:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085814e00, transno 4296020397 00000004:00080000:0.0:1721880431.406054:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122fd0380, transno 4296020398 00000004:00080000:0.0:1721880431.406055:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122fd1880, transno 4296020399 00000004:00080000:0.0:1721880431.406057:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012c884700, transno 4296020400 00000004:00080000:0.0:1721880431.406058:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012c887100, transno 4296020401 00000004:00080000:0.0:1721880431.406060:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012c887800, transno 4296020402 00000004:00080000:0.0:1721880431.406061:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012c886300, transno 4296020403 00000004:00080000:0.0:1721880431.406062:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134e95f80, transno 4296020404 00000004:00080000:0.0:1721880431.406064:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085817480, transno 4296020405 00000004:00080000:0.0:1721880431.406065:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134e97800, transno 4296020406 00000004:00080000:0.0:1721880431.406067:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099493480, transno 4296020407 00000004:00080000:0.0:1721880431.406068:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ffe0000, transno 4296020408 00000004:00080000:0.0:1721880431.406070:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ffe3b80, transno 4296020409 00000004:00080000:0.0:1721880431.406071:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ffe3100, transno 4296020410 00000004:00080000:0.0:1721880431.406072:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ffe1500, transno 4296020411 00000004:00080000:0.0:1721880431.406073:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ffe0700, transno 4296020412 00000004:00080000:0.0:1721880431.406075:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009745df80, transno 4296020413 00000004:00080000:0.0:1721880431.406076:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008ffe0e00, transno 4296020414 00000004:00080000:0.0:1721880431.406077:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bc84000, transno 4296020415 00000004:00080000:0.0:1721880431.406079:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bc86680, transno 4296020416 00000004:00080000:0.0:1721880431.406081:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bc86d80, transno 4296020417 00000004:00080000:0.0:1721880431.406083:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bc84700, transno 4296020418 00000004:00080000:0.0:1721880431.406084:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094691f80, transno 4296020419 00000004:00080000:0.0:1721880431.406086:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bc85500, transno 4296020420 00000004:00080000:0.0:1721880431.406088:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bf5c380, transno 4296020421 00000004:00080000:0.0:1721880431.406089:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bc86a00, transno 4296020422 00000004:00080000:0.0:1721880431.406090:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bc84380, transno 4296020423 00000004:00080000:0.0:1721880431.406092:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bf5f480, transno 4296020424 00000004:00080000:0.0:1721880431.406094:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bf5e300, transno 4296020425 00000004:00080000:0.0:1721880431.406095:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bf5c000, transno 4296020426 00000004:00080000:0.0:1721880431.406097:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012c886d80, transno 4296020427 00000004:00080000:0.0:1721880431.406098:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bf5d500, transno 4296020428 00000004:00080000:0.0:1721880431.406100:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008bf5ca80, transno 4296020429 00000004:00080000:0.0:1721880431.406101:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880122fd0000, transno 4296020430 00000004:00080000:0.0:1721880431.406103:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012c886680, transno 4296020431 00000004:00080000:0.0:1721880431.406104:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099492300, transno 4296020432 00000004:00080000:0.0:1721880431.406106:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f1b7100, transno 4296020433 00000004:00080000:0.0:1721880431.406107:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012c887480, transno 4296020434 00000004:00080000:0.0:1721880431.406109:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b8c4000, transno 4296020435 00000004:00080000:0.0:1721880431.406110:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091135f80, transno 4296020436 00000004:00080000:0.0:1721880431.406112:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007b8c5180, transno 4296020437 00000004:00080000:0.0:1721880431.406114:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091134380, transno 4296020438 00000004:00080000:0.0:1721880431.406115:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009528b480, transno 4296020439 00000004:00080000:0.0:1721880431.406117:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095288380, transno 4296020440 00000004:00080000:0.0:1721880431.406118:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095289f80, transno 4296020441 00000004:00080000:0.0:1721880431.406120:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013514fb80, transno 4296020442 00000004:00080000:0.0:1721880431.406121:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800941e8380, transno 4296020443 00000004:00080000:0.0:1721880431.406123:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013514c000, transno 4296020444 00000004:00080000:0.0:1721880431.406125:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b83100, transno 4296020445 00000004:00080000:0.0:1721880431.406126:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012f4a1500, transno 4296020446 00000004:00080000:0.0:1721880431.406128:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088e00000, transno 4296020447 00000004:00080000:0.0:1721880431.406130:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095288a80, transno 4296020448 00000004:00080000:0.0:1721880431.406132:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085817b80, transno 4296020449 00000004:00080000:0.0:1721880431.406134:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085816d80, transno 4296020450 00000004:00080000:0.0:1721880431.406136:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085815500, transno 4296020451 00000004:00080000:0.0:1721880431.406137:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800878d9f80, transno 4296020452 00000004:00080000:0.0:1721880431.406139:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092a95180, transno 4296020453 00000004:00080000:0.0:1721880431.406141:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800878d8380, transno 4296020454 00000004:00080000:0.0:1721880431.406143:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d131180, transno 4296020455 00000004:00080000:0.0:1721880431.406146:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d130700, transno 4296020456 00000004:00080000:0.0:1721880431.406148:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d131880, transno 4296020457 00000004:00080000:0.0:1721880431.406150:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800878d8e00, transno 4296020458 00000004:00080000:0.0:1721880431.406153:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800878dbb80, transno 4296020459 00000004:00080000:0.0:1721880431.406155:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d132d80, transno 4296020460 00000004:00080000:0.0:1721880431.406157:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800878daa00, transno 4296020461 00000004:00080000:0.0:1721880431.406159:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d131f80, transno 4296020462 00000004:00080000:0.0:1721880431.406162:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c4e7800, transno 4296020463 00000004:00080000:0.0:1721880431.406164:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009528ad80, transno 4296020464 00000004:00080000:0.0:1721880431.406167:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007294f480, transno 4296020465 00000004:00080000:0.0:1721880431.406170:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134e94a80, transno 4296020466 00000004:00080000:0.0:1721880431.406172:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009993a300, transno 4296020467 00000004:00080000:0.0:1721880431.406175:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099939880, transno 4296020468 00000004:00080000:0.0:1721880431.406179:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123844a80, transno 4296020469 00000004:00080000:0.0:1721880431.406181:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009affad80, transno 4296020470 00000004:00080000:0.0:1721880431.406184:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d33d180, transno 4296020471 00000004:00080000:0.0:1721880431.406187:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962a8a80, transno 4296020472 00000004:00080000:0.0:1721880431.406190:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800941e8000, transno 4296020473 00000004:00080000:0.0:1721880431.406192:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134944e00, transno 4296020474 00000004:00080000:0.0:1721880431.406195:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88007294ce00, transno 4296020475 00000004:00080000:0.0:1721880431.406197:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800962ab100, transno 4296020476 00000004:00080000:0.0:1721880431.406200:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009f1b4380, transno 4296020477 00000004:00080000:0.0:1721880431.406204:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134eb1c00, transno 4296020478 00000004:00080000:0.0:1721880431.406207:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099aad500, transno 4296020479 00000004:00080000:0.0:1721880431.406210:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099aac700, transno 4296020480 00000004:00080000:0.0:1721880431.406213:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099aaed80, transno 4296020481 00000004:00080000:0.0:1721880431.406215:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099aaca80, transno 4296020482 00000004:00080000:0.0:1721880431.406217:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099aaf800, transno 4296020483 00000004:00080000:0.0:1721880431.406218:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099aac000, transno 4296020484 00000004:00080000:0.0:1721880431.406220:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800981e3800, transno 4296020485 00000004:00080000:0.0:1721880431.406222:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800981e1880, transno 4296020486 00000004:00080000:0.0:1721880431.406224:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800981e0700, transno 4296020487 00000004:00080000:0.0:1721880431.406226:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099aafb80, transno 4296020488 00000004:00080000:0.0:1721880431.406227:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099aad880, transno 4296020489 00000004:00080000:0.0:1721880431.406229:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135301c00, transno 4296020490 00000004:00080000:0.0:1721880431.406230:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800981e2300, transno 4296020491 00000004:00080000:0.0:1721880431.406232:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800981e3480, transno 4296020492 00000004:00080000:0.0:1721880431.406233:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096e58380, transno 4296020493 00000004:00080000:0.0:1721880431.406235:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076e08000, transno 4296020494 00000004:00080000:0.0:1721880431.406236:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880096e5b100, transno 4296020495 00000004:00080000:0.0:1721880431.406238:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e898380, transno 4296020496 00000004:00080000:0.0:1721880431.406239:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e89b480, transno 4296020497 00000004:00080000:0.0:1721880431.406241:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123913100, transno 4296020498 00000004:00080000:0.0:1721880431.406243:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123912300, transno 4296020499 00000004:00080000:0.0:1721880431.406244:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123911500, transno 4296020500 00000004:00080000:0.0:1721880431.406246:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088682a00, transno 4296020501 00000004:00080000:0.0:1721880431.406247:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088682d80, transno 4296020502 00000004:00080000:0.0:1721880431.406249:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088681500, transno 4296020503 00000004:00080000:0.0:1721880431.406251:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088681c00, transno 4296020504 00000004:00080000:0.0:1721880431.406252:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012fd0ad80, transno 4296020505 00000004:00080000:0.0:1721880431.406254:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088681f80, transno 4296020506 00000004:00080000:0.0:1721880431.406255:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087927480, transno 4296020507 00000004:00080000:0.0:1721880431.406258:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087924700, transno 4296020508 00000004:00080000:0.0:1721880431.406260:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087924380, transno 4296020509 00000004:00080000:0.0:1721880431.406262:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087926a00, transno 4296020510 00000004:00080000:0.0:1721880431.406263:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094663b80, transno 4296020511 00000004:00080000:0.0:1721880431.406266:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087924e00, transno 4296020512 00000004:00080000:0.0:1721880431.406267:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094661880, transno 4296020513 00000004:00080000:0.0:1721880431.406269:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094660e00, transno 4296020514 00000004:00080000:0.0:1721880431.406270:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094661f80, transno 4296020515 00000004:00080000:0.0:1721880431.406272:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094662d80, transno 4296020516 00000004:00080000:0.0:1721880431.406273:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099939500, transno 4296020517 00000004:00080000:0.0:1721880431.406275:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e4a8a80, transno 4296020518 00000004:00080000:0.0:1721880431.406277:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008599df80, transno 4296020519 00000004:00080000:0.0:1721880431.406278:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134d01880, transno 4296020520 00000004:00080000:0.0:1721880431.406280:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131eb1c00, transno 4296020521 00000004:00080000:0.0:1721880431.406282:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009993b480, transno 4296020522 00000004:00080000:0.0:1721880431.406283:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800929cd880, transno 4296020523 00000004:00080000:0.0:1721880431.406285:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800929cce00, transno 4296020524 00000004:00080000:0.0:1721880431.406286:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009993aa00, transno 4296020525 00000004:00080000:0.0:1721880431.406288:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800929ced80, transno 4296020526 00000004:00080000:0.0:1721880431.406289:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099938700, transno 4296020527 00000004:00080000:0.0:1721880431.406291:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009993b800, transno 4296020528 00000004:00080000:0.0:1721880431.406292:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009993b100, transno 4296020529 00000004:00080000:0.0:1721880431.406293:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e4ab100, transno 4296020530 00000004:00080000:0.0:1721880431.406295:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e4ab800, transno 4296020531 00000004:00080000:0.0:1721880431.406296:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800981e0a80, transno 4296020532 00000004:00080000:0.0:1721880431.406298:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087925500, transno 4296020533 00000004:00080000:0.0:1721880431.406299:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e898000, transno 4296020534 00000004:00080000:0.0:1721880431.406301:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fc51500, transno 4296020535 00000004:00080000:0.0:1721880431.406302:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fc51c00, transno 4296020536 00000004:00080000:0.0:1721880431.406303:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087924a80, transno 4296020537 00000004:00080000:0.0:1721880431.406306:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e4aad80, transno 4296020538 00000004:00080000:0.0:1721880431.406308:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e89a680, transno 4296020539 00000004:00080000:0.0:1721880431.406309:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e899180, transno 4296020540 00000004:00080000:0.0:1721880431.406311:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135303480, transno 4296020541 00000004:00080000:0.0:1721880431.406313:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a07b6a00, transno 4296020542 00000004:00080000:0.0:1721880431.406315:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088683b80, transno 4296020543 00000004:00080000:0.0:1721880431.406317:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800878d9500, transno 4296020544 00000004:00080000:0.0:1721880431.406318:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800878da300, transno 4296020545 00000004:00080000:0.0:1721880431.406320:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087925c00, transno 4296020546 00000004:00080000:0.0:1721880431.406322:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880087925f80, transno 4296020547 00000004:00080000:0.0:1721880431.406323:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b6a300, transno 4296020548 00000004:00080000:0.0:1721880431.406325:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b68a80, transno 4296020549 00000004:00080000:0.0:1721880431.406326:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b69880, transno 4296020550 00000004:00080000:0.0:1721880431.406328:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088680380, transno 4296020551 00000004:00080000:0.0:1721880431.406329:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b6f480, transno 4296020552 00000004:00080000:0.0:1721880431.406331:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085a4c000, transno 4296020553 00000004:00080000:0.0:1721880431.406332:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085a4d500, transno 4296020554 00000004:00080000:0.0:1721880431.406334:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880076e08e00, transno 4296020555 00000004:00080000:0.0:1721880431.406335:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008599d500, transno 4296020556 00000004:00080000:0.0:1721880431.406337:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088680000, transno 4296020557 00000004:00080000:0.0:1721880431.406339:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123910700, transno 4296020558 00000004:00080000:0.0:1721880431.406341:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085a4f100, transno 4296020559 00000004:00080000:0.0:1721880431.406343:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085a4ca80, transno 4296020560 00000004:00080000:0.0:1721880431.406344:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e4a9180, transno 4296020561 00000004:00080000:0.0:1721880431.406346:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e22f100, transno 4296020562 00000004:00080000:0.0:1721880431.406347:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e22e300, transno 4296020563 00000004:00080000:0.0:1721880431.406349:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123b6ad80, transno 4296020564 00000004:00080000:0.0:1721880431.406350:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e22fb80, transno 4296020565 00000004:00080000:0.0:1721880431.406352:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e22f480, transno 4296020566 00000004:00080000:0.0:1721880431.406353:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880088887480, transno 4296020567 00000004:00080000:0.0:1721880431.406356:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099939c00, transno 4296020568 00000004:00080000:0.0:1721880431.406357:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e22c380, transno 4296020569 00000004:00080000:0.0:1721880431.406359:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009993a680, transno 4296020570 00000004:00080000:0.0:1721880431.406361:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009993ad80, transno 4296020571 00000004:00080000:0.0:1721880431.406362:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099939180, transno 4296020572 00000004:00080000:0.0:1721880431.406364:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a07b4e00, transno 4296020573 00000004:00080000:0.0:1721880431.406365:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085a4e680, transno 4296020574 00000004:00080000:0.0:1721880431.406367:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a07b4700, transno 4296020575 00000004:00080000:0.0:1721880431.406368:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a07b6300, transno 4296020576 00000004:00080000:0.0:1721880431.406370:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094663100, transno 4296020577 00000004:00080000:0.0:1721880431.406372:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008d130a80, transno 4296020578 00000004:00080000:0.0:1721880431.406374:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135303800, transno 4296020579 00000004:00080000:0.0:1721880431.406375:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800878d9180, transno 4296020580 00000004:00080000:0.0:1721880431.406377:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135302d80, transno 4296020581 00000004:00080000:0.0:1721880431.406378:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800878d9c00, transno 4296020582 00000004:00080000:0.0:1721880431.406379:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135301f80, transno 4296020583 00000004:00080000:0.0:1721880431.406381:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a05fe680, transno 4296020584 00000004:00080000:0.0:1721880431.406383:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099938380, transno 4296020585 00000004:00080000:0.0:1721880431.406384:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ef28380, transno 4296020586 00000004:00080000:0.0:1721880431.406386:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88013107a300, transno 4296020587 00000004:00080000:0.0:1721880431.406388:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ef29f80, transno 4296020588 00000004:00080000:0.0:1721880431.406390:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099ad4380, transno 4296020589 00000004:00080000:0.0:1721880431.406391:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88011ef29c00, transno 4296020590 00000004:00080000:0.0:1721880431.406393:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099ad4e00, transno 4296020591 00000004:00080000:0.0:1721880431.406394:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012380ad80, transno 4296020592 00000004:00080000:0.0:1721880431.406395:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880085830380, transno 4296020593 00000004:00080000:0.0:1721880431.406397:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e22f800, transno 4296020594 00000004:00080000:0.0:1721880431.406398:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fc50a80, transno 4296020595 00000004:00080000:0.0:1721880431.406400:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c736a00, transno 4296020596 00000004:00080000:0.0:1721880431.406402:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a1d9880, transno 4296020597 00000004:00080000:0.0:1721880431.406404:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e22c700, transno 4296020598 00000004:00080000:0.0:1721880431.406406:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e22d880, transno 4296020599 00000004:00080000:0.0:1721880431.406408:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135757800, transno 4296020600 00000004:00080000:0.0:1721880431.406410:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a1d8380, transno 4296020601 00000004:00080000:0.0:1721880431.406412:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a1db800, transno 4296020602 00000004:00080000:0.0:1721880431.406413:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a1d9180, transno 4296020603 00000004:00080000:0.0:1721880431.406415:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012edb1f80, transno 4296020604 00000004:00080000:0.0:1721880431.406416:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009be59180, transno 4296020605 00000004:00080000:0.0:1721880431.406418:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135756a00, transno 4296020606 00000004:00080000:0.0:1721880431.406419:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012387c000, transno 4296020607 00000004:00080000:0.0:1721880431.406421:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a1d8700, transno 4296020608 00000004:00080000:0.0:1721880431.406422:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135755c00, transno 4296020609 00000004:00080000:0.0:1721880431.406424:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e909180, transno 4296020610 00000004:00080000:0.0:1721880431.406425:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012387ca80, transno 4296020611 00000004:00080000:0.0:1721880431.406427:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e90aa00, transno 4296020612 00000004:00080000:0.0:1721880431.406428:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e908a80, transno 4296020613 00000004:00080000:0.0:1721880431.406430:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012387c700, transno 4296020614 00000004:00080000:0.0:1721880431.406431:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880135756680, transno 4296020615 00000004:00080000:0.0:1721880431.406433:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012387dc00, transno 4296020616 00000004:00080000:0.0:1721880431.406434:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e908e00, transno 4296020617 00000004:00080000:0.0:1721880431.406436:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880134e96a00, transno 4296020618 00000004:00080000:0.0:1721880431.406438:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880123809c00, transno 4296020619 00000004:00080000:0.0:1721880431.406440:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012ce13b80, transno 4296020620 00000004:00080000:0.0:1721880431.406441:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091ae3480, transno 4296020621 00000004:00080000:0.0:1721880431.406443:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009e908700, transno 4296020622 00000004:00080000:0.0:1721880431.406445:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091ae2680, transno 4296020623 00000004:00080000:0.0:1721880431.406446:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091ae1500, transno 4296020624 00000004:00080000:0.0:1721880431.406448:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091ae2d80, transno 4296020625 00000004:00080000:0.0:1721880431.406449:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bf68700, transno 4296020626 00000004:00080000:0.0:1721880431.406451:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bf69880, transno 4296020627 00000004:00080000:0.0:1721880431.406454:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bf6b480, transno 4296020628 00000004:00080000:0.0:1721880431.406456:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bf6b800, transno 4296020629 00000004:00080000:0.0:1721880431.406457:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094279f80, transno 4296020630 00000004:00080000:0.0:1721880431.406459:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800876b2d80, transno 4296020631 00000004:00080000:0.0:1721880431.406461:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800876b1c00, transno 4296020632 00000004:00080000:0.0:1721880431.406463:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094278e00, transno 4296020633 00000004:00080000:0.0:1721880431.406465:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800876b3480, transno 4296020634 00000004:00080000:0.0:1721880431.406466:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800876b3100, transno 4296020635 00000004:00080000:0.0:1721880431.406468:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800956c8380, transno 4296020636 00000004:00080000:0.0:1721880431.406470:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800876b1880, transno 4296020637 00000004:00080000:0.0:1721880431.406471:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800876b0a80, transno 4296020638 00000004:00080000:0.0:1721880431.406473:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009427a680, transno 4296020639 00000004:00080000:0.0:1721880431.406475:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099d2b800, transno 4296020640 00000004:00080000:0.0:1721880431.406477:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800876b0700, transno 4296020641 00000004:00080000:0.0:1721880431.406479:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880095a27100, transno 4296020642 00000004:00080000:0.0:1721880431.406481:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880094278700, transno 4296020643 00000004:00080000:0.0:1721880431.406484:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009bd8aa00, transno 4296020644 00000004:00080000:0.0:1721880431.406486:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e616a00, transno 4296020645 00000004:00080000:0.0:1721880431.406488:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800888cce00, transno 4296020646 00000004:00080000:0.0:1721880431.406490:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e9c8380, transno 4296020647 00000004:00080000:0.0:1721880431.406492:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e9c9c00, transno 4296020648 00000004:00080000:0.0:1721880431.406495:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800966b2680, transno 4296020649 00000004:00080000:0.0:1721880431.406498:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e615180, transno 4296020650 00000004:00080000:0.0:1721880431.406500:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d7a1180, transno 4296020651 00000004:00080000:0.0:1721880431.406503:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d7a0700, transno 4296020652 00000004:00080000:0.0:1721880431.406506:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880084df4700, transno 4296020653 00000004:00080000:0.0:1721880431.406509:0:3686:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009d7a2680, transno 4296020654 00000100:00100000:0.0:1721880431.406526:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009fff3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011856512:0@lo:400:kworker.0 00000004:00080000:2.0:1721880431.406681:0:11338:0:(osp_sync.c:1101:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 2573 in progress, 0 in flight, 9 done 00000004:00080000:2.0:1721880431.421519:0:11338:0:(osp_sync.c:1101:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 2573 done 00000100:00100000:1.0:1721880431.448923:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012edb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011856640:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1721880431.448923:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800966b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011856768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1721880431.448989:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880431.449012:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880431.449038:0:10429:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011856640 00000100:00100000:0.0:1721880431.449048:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011856768 00000100:00100000:2.0:1721880431.449048:0:10429:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011856640 00000100:00100000:0.0:1721880431.449054:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011856768 00000100:00100000:0.0:1721880431.449094:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 574 00000100:00100000:0.0:1721880431.449099:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3688:x1805522011856768:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1721880431.449107:0:10429:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 575 00000100:00100000:2.0:1721880431.449113:0:10429:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3687:x1805522011856640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1721880431.449129:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00002000:00000024:2.0:1721880431.449129:0:10429:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:0.0:1721880431.449182:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3688:x1805522011856768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880431.449187:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 574 00000100:00100000:2.0:1721880431.449188:0:10429:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3687:x1805522011856640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880431.449191:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800966b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011856768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1721880431.449193:0:10429:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 575 00000100:00100000:1.0:1721880431.449199:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012edb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011856640:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1721880431.462920:0:8270:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721880432.464985:0:7120:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880432.834013:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880432.834052:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880432.834070:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880432.834084:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880432.834089:0:7124:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257789440 00000100:00100000:0.0:1721880432.834098:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880432.834098:0:7124:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257789440 00000100:00100000:1.0:1721880432.834104:0:15420:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257789568 00000100:00100000:1.0:1721880432.834109:0:15420:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257789568 00000100:00100000:0.0:1721880432.834117:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880432.834127:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880432.834137:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880432.834140:0:15420:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257789696 00000100:00100000:1.0:1721880432.834141:0:15420:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257789696 00000100:00100000:3.0:1721880432.834141:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 579 00000100:00100000:3.0:1721880432.834146:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2006:x1805522257789440:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880432.834152:0:15420:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257790080 00000100:00080000:2.0:1721880432.834152:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880402 00000100:00100000:1.0:1721880432.834153:0:15420:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257790080 00000100:00080000:2.0:1721880432.834156:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880402 00000100:00080000:2.0:1721880432.834157:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880402 00000100:00100000:0.0:1721880432.834162:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880432.834162:0:15420:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257790208 00000100:00100000:1.0:1721880432.834163:0:15420:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257790208 00000100:00100000:2.0:1721880432.834176:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2881 00000100:00100000:0.0:1721880432.834181:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257789824 00000100:00100000:2.0:1721880432.834181:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2007:x1805522257789568:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880432.834182:0:15420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2882 00000100:00100000:0.0:1721880432.834184:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257789824 00000100:00100000:1.0:1721880432.834188:0:15420:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2006:x1805522257789696:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880432.834200:0:7124:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2006:x1805522257789440:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 54us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880432.834204:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 579 00000100:00100000:0.0:1721880432.834206:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257789952 00000100:00100000:0.0:1721880432.834208:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257789952 00000100:00100000:1.0:1721880432.834219:0:15420:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2006:x1805522257789696:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 31us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880432.834221:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257790336 00000100:00100000:0.0:1721880432.834223:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257790336 00000100:00100000:1.0:1721880432.834224:0:15420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2882 00000100:00100000:2.0:1721880432.834230:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2007:x1805522257789568:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 48us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880432.834235:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257790464 00000100:00100000:0.0:1721880432.834236:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257790464 00000100:00100000:3.0:1721880432.834237:0:15416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2883 00000100:00100000:3.0:1721880432.834241:0:15416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:30425778-2709-4512-9d75-01ec53c4cfad+4135:2007:x1805522257790080:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880432.834242:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2881 00000100:00100000:1.0:1721880432.834245:0:15420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2884 00000100:00100000:1.0:1721880432.834250:0:15420:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:30425778-2709-4512-9d75-01ec53c4cfad+3694:2006:x1805522257790208:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880432.834251:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 303 00000100:00100000:0.0:1721880432.834257:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2007:x1805522257789824:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880432.834264:0:15416:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:30425778-2709-4512-9d75-01ec53c4cfad+4135:2007:x1805522257790080:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 22us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880432.834269:0:15416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2883 00000100:00100000:2.0:1721880432.834276:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 304 00000100:00100000:1.0:1721880432.834278:0:15420:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:30425778-2709-4512-9d75-01ec53c4cfad+3694:2006:x1805522257790208:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 27us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880432.834281:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2006:x1805522257789952:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880432.834284:0:15420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2884 00000100:00100000:0.0:1721880432.834285:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2007:x1805522257789824:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 28us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880432.834295:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 303 00000100:00100000:2.0:1721880432.834308:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2006:x1805522257789952:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 26us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880432.834313:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 305 00000100:00100000:0.0:1721880432.834317:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:30425778-2709-4512-9d75-01ec53c4cfad+280:2007:x1805522257790336:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880432.834318:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 306 00000100:00100000:2.0:1721880432.834321:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 304 00000100:00100000:1.0:1721880432.834322:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:30425778-2709-4512-9d75-01ec53c4cfad+665:2006:x1805522257790464:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880432.834338:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:30425778-2709-4512-9d75-01ec53c4cfad+280:2007:x1805522257790336:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 20us (200us total) trans 0 rc 0/0 00000100:00080000:2.0:1721880432.834340:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880402 00000100:00100000:1.0:1721880432.834341:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:30425778-2709-4512-9d75-01ec53c4cfad+665:2006:x1805522257790464:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 19us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880432.834342:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 305 00000100:00080000:2.0:1721880432.834343:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880402 00000100:00100000:1.0:1721880432.834345:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 306 00000100:00080000:2.0:1721880432.834345:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880402 00000100:00100000:2.0:1721880432.920997:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011856896:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1721880432.921067:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880432.921136:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011856896 00000100:00100000:0.0:1721880432.921144:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011856896 00000100:00100000:0.0:1721880432.921188:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101091 00000100:00100000:0.0:1721880432.921194:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3689:x1805522011856896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1721880432.921224:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1435709440 avail 1306247168 00000100:00100000:0.0:1721880432.921272:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3689:x1805522011856896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880432.921276:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101091 00000100:00100000:2.0:1721880432.921290:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011856896:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1721880433.466960:0:15560:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880434.469044:0:11721:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880435.471020:0:7119:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880435.816913:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099a3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011857024:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1721880435.816978:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880435.817014:0:10429:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011857024 00000100:00100000:2.0:1721880435.817022:0:10429:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011857024 00000100:00080000:0.0:1721880435.817065:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880405 00000100:00100000:2.0:1721880435.817073:0:10429:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 576 00000100:00100000:2.0:1721880435.817079:0:10429:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011857024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1721880435.817110:0:10429:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:2.0:1721880435.817157:0:10429:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011857024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880435.817162:0:10429:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 576 00000100:00100000:0.0:1721880435.817177:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099a3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011857024:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1721880436.216967:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800966b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011857152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1721880436.217039:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880436.217087:0:10429:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011857152 00000100:00100000:2.0:1721880436.217095:0:10429:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011857152 00000100:00080000:0.0:1721880436.217118:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880406 00000100:00100000:2.0:1721880436.217143:0:10429:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 577 00000100:00100000:2.0:1721880436.217149:0:10429:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011857152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1721880436.217171:0:10429:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:2.0:1721880436.217227:0:10429:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011857152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880436.217235:0:10429:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 577 00000100:00100000:0.0:1721880436.217256:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800966b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011857152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1721880436.313080:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012edb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011857280:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1721880436.313149:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880436.313186:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011857280 00000100:00100000:2.0:1721880436.313195:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011857280 00000100:00100000:2.0:1721880436.313243:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101092 00000100:00100000:2.0:1721880436.313248:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3688:x1805522011857280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1721880436.313281:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1437519872 avail 1308057600 00000100:00100000:2.0:1721880436.313332:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3688:x1805522011857280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880436.313337:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101092 00000100:00100000:0.0:1721880436.313351:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012edb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011857280:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1721880436.409047:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099a3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3687:1805522011857664:0@lo:400:kworker.0 00000100:00100000:2.0:1721880436.409047:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099a3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0603f996-9d5e-4498-85ba-9976a06b304f:3689:1805522011857408:0@lo:400:kworker.0 00000100:00100000:1.0:1721880436.409076:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099a3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3686:1805522011857536:0@lo:400:kworker.0 00000100:00100000:0.0:1721880436.409124:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880436.409126:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880436.409141:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099a3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011857792:0@lo:400:kworker.0 00000100:00100000:0.0:1721880436.409172:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099a3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011858176:0@lo:400:kworker.0 00000100:00100000:2.0:1721880436.409175:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3689:1805522011857920:0@lo:400:kworker.0 00000100:00100000:1.0:1721880436.409176:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880436.409198:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099a3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3688:1805522011858304:0@lo:400:kworker.0 00000100:00100000:2.0:1721880436.409200:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880436.409201:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880436.409209:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011857408 00000100:00100000:0.0:1721880436.409216:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011858688:0@lo:400:kworker.0 00000100:00100000:2.0:1721880436.409216:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099a3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3689:1805522011858432:0@lo:400:kworker.0 00000100:00100000:1.0:1721880436.409218:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880436.409219:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011857408 00000100:00100000:0.0:1721880436.409232:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880436.409232:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880436.409256:0:15432:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011857920 00000100:00100000:1.0:1721880436.409256:0:15415:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011857664 00000100:00100000:2.0:1721880436.409257:0:15431:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011858304 00000100:00100000:0.0:1721880436.409260:0:15432:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011857920 00000100:00100000:1.0:1721880436.409260:0:15415:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011857664 00000100:00100000:2.0:1721880436.409260:0:15431:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011858304 00000100:00100000:3.0:1721880436.409271:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 580 00000100:00100000:3.0:1721880436.409279:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3689:x1805522011857408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880436.409283:0:15431:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2885 00000100:00100000:0.0:1721880436.409286:0:15432:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011858432 00000100:00100000:2.0:1721880436.409287:0:15431:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-OST0001_UUID+5:3688:x1805522011858304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880436.409288:0:15432:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011858432 00000100:00100000:1.0:1721880436.409295:0:15415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2886 00000100:00100000:1.0:1721880436.409301:0:15415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3689:x1805522011857920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880436.409304:0:15432:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2887 00000100:00100000:0.0:1721880436.409308:0:15432:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-MDT0001_UUID+5:3687:x1805522011857664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880436.409317:0:15431:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-OST0001_UUID+5:3688:x1805522011858304:12345-0@lo:400:kworker.0 Request processed in 30us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880436.409322:0:15431:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2885 00000100:00100000:3.0:1721880436.409332:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3689:x1805522011857408:12345-0@lo:400:kworker.0 Request processed in 54us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880436.409339:0:15415:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3689:x1805522011857920:12345-0@lo:400:kworker.0 Request processed in 37us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880436.409340:0:15432:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-MDT0001_UUID+5:3687:x1805522011857664:12345-0@lo:400:kworker.0 Request processed in 30us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880436.409340:0:15431:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2888 00000100:00100000:3.0:1721880436.409340:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 580 00000100:00100000:2.0:1721880436.409342:0:15431:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001-lwp-OST0001_UUID+5:3689:x1805522011858432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880436.409344:0:15415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2886 00000100:00100000:0.0:1721880436.409346:0:15432:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2887 00000100:00100000:2.0:1721880436.409356:0:15431:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001-lwp-OST0001_UUID+5:3689:x1805522011858432:12345-0@lo:400:kworker.0 Request processed in 13us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880436.409360:0:15431:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2888 00000100:00080000:3.0:1721880436.409369:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880406 00000100:00100000:1.0:1721880436.409371:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880436.409372:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011858176 00000100:00080000:3.0:1721880436.409373:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880406 00000100:00100000:0.0:1721880436.409374:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011858176 00000100:00080000:3.0:1721880436.409375:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880406 00000100:00100000:2.0:1721880436.409376:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011858688 00000100:00100000:2.0:1721880436.409378:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011858688 00000100:00100000:3.0:1721880436.409384:0:15416:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011857536 00000100:00100000:1.0:1721880436.409385:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099a3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3686:1805522011858048:0@lo:400:kworker.0 00000100:00100000:3.0:1721880436.409387:0:15416:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011857536 00000100:00100000:0.0:1721880436.409390:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1721880436.409393:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+5:3687:x1805522011858176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880436.409394:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1721880436.409397:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011858688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880436.409398:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880436.409403:0:15416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2889 00000100:00100000:1.0:1721880436.409405:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011858560:0@lo:400:kworker.0 00000100:00100000:3.0:1721880436.409407:0:15416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3686:x1805522011857536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880436.409411:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+5:3687:x1805522011858176:12345-0@lo:400:kworker.0 Request processed in 18us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880436.409414:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011858688:12345-0@lo:400:kworker.0 Request processed in 16us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880436.409415:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1721880436.409417:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1721880436.409420:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880436.409426:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011858560 00000100:00100000:2.0:1721880436.409428:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011858560 00000100:00100000:3.0:1721880436.409428:0:15416:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3686:x1805522011857536:12345-0@lo:400:kworker.0 Request processed in 20us (56us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880436.409433:0:15416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2889 00000100:00100000:0.0:1721880436.409436:0:15420:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011858048 00000100:00100000:0.0:1721880436.409437:0:15420:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011858048 00000100:00100000:2.0:1721880436.409437:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1721880436.409439:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011858560:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1721880436.409445:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880406 00000100:00080000:3.0:1721880436.409448:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880406 00000100:00100000:0.0:1721880436.409450:0:15420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2890 00000100:00100000:1.0:1721880436.409452:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099a3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3686:1805522011857536:0@lo:400:kworker.0 00000100:00100000:2.0:1721880436.409452:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011858560:12345-0@lo:400:kworker.0 Request processed in 12us (32us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880436.409453:0:15420:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-lwp-OST0000_UUID+5:3686:x1805522011858048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880436.409456:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1721880436.409463:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011858560:0@lo:400:kworker.0 00000100:00100000:0.0:1721880436.409468:0:15420:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-lwp-OST0000_UUID+5:3686:x1805522011858048:12345-0@lo:400:kworker.0 Request processed in 15us (70us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880436.409472:0:15420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2890 00000100:00100000:2.0:1721880436.409476:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099a3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3689:1805522011858432:0@lo:400:kworker.0 00000100:00100000:3.0:1721880436.409477:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011857792 00000100:00100000:3.0:1721880436.409480:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011857792 00000100:00100000:2.0:1721880436.409484:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099a3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0603f996-9d5e-4498-85ba-9976a06b304f:3689:1805522011857408:0@lo:400:kworker.0 00000100:00100000:1.0:1721880436.409489:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099a3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3686:1805522011858048:0@lo:400:kworker.0 00000100:00100000:2.0:1721880436.409494:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3689:1805522011857920:0@lo:400:kworker.0 00000100:00100000:0.0:1721880436.409495:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011858688:0@lo:400:kworker.0 00000100:00100000:0.0:1721880436.409501:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099a3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3687:1805522011857664:0@lo:400:kworker.0 00000100:00100000:3.0:1721880436.409505:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101093 00000100:00100000:0.0:1721880436.409506:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099a3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011858176:0@lo:400:kworker.0 00000100:00100000:3.0:1721880436.409510:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011857792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880436.409519:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099a3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3688:1805522011858304:0@lo:400:kworker.0 00000100:00100000:3.0:1721880436.409539:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011857792:12345-0@lo:400:kworker.0 Request processed in 28us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880436.409544:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101093 00000100:00100000:1.0:1721880436.409546:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099a3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011857792:0@lo:400:kworker.0 00000100:00100000:1.0:1721880436.456980:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012edb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011858816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1721880436.457007:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011858944:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1721880436.457068:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880436.457107:0:10429:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011858816 00000100:00100000:2.0:1721880436.457116:0:10429:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011858816 00000100:00100000:3.0:1721880436.457119:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880436.457153:0:10429:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011858944 00000100:00100000:2.0:1721880436.457156:0:10429:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011858944 00000100:00100000:0.0:1721880436.457163:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 578 00000100:00100000:0.0:1721880436.457172:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3688:x1805522011858816:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1721880436.457173:0:9462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 579 00000100:00100000:1.0:1721880436.457178:0:9462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011858944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1721880436.457204:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00002000:00000024:1.0:1721880436.457204:0:9462:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:1.0:1721880436.457239:0:9462:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011858944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880436.457246:0:9462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 579 00000100:00100000:0.0:1721880436.457254:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3688:x1805522011858816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880436.457257:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011858944:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1721880436.457259:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 578 00000100:00100000:1.0:1721880436.457289:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012edb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011858816:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1721880436.473021:0:8270:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721880437.474985:0:7120:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880437.842216:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880437.842253:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880437.842273:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880437.842277:0:7124:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257790592 00000100:00100000:3.0:1721880437.842287:0:7124:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257790592 00000100:00100000:0.0:1721880437.842289:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880437.842305:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880437.842319:0:15477:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257790720 00000100:00100000:0.0:1721880437.842323:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880437.842325:0:15477:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257790720 00000100:00100000:0.0:1721880437.842332:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880437.842340:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 581 00000100:00100000:0.0:1721880437.842342:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880437.842348:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2006:x1805522257790592:12345-192.168.201.24@tcp:400:kworker.0 00000100:00080000:2.0:1721880437.842355:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880407 00000100:00080000:2.0:1721880437.842360:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880407 00000100:00100000:1.0:1721880437.842366:0:15477:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257790848 00000100:00100000:1.0:1721880437.842369:0:15477:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257790848 00000100:00100000:2.0:1721880437.842374:0:15431:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257791232 00000100:00100000:2.0:1721880437.842378:0:15431:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257791232 00000100:00100000:1.0:1721880437.842386:0:15477:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257791360 00000100:00100000:1.0:1721880437.842388:0:15477:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257791360 00000100:00100000:2.0:1721880437.842406:0:15431:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2891 00000100:00100000:3.0:1721880437.842409:0:7124:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2006:x1805522257790592:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 62us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880437.842413:0:15477:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2892 00000100:00100000:2.0:1721880437.842413:0:15431:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2006:x1805522257790720:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880437.842415:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 581 00000100:00100000:1.0:1721880437.842419:0:15477:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2006:x1805522257790848:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880437.842426:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880437.842446:0:15431:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2006:x1805522257790720:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 34us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880437.842447:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2893 00000100:00100000:3.0:1721880437.842451:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:30425778-2709-4512-9d75-01ec53c4cfad+4135:2006:x1805522257791232:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880437.842452:0:15477:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2006:x1805522257790848:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 33us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880437.842453:0:15431:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2891 00000100:00100000:1.0:1721880437.842459:0:15477:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2892 00000100:00100000:3.0:1721880437.842472:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:30425778-2709-4512-9d75-01ec53c4cfad+4135:2006:x1805522257791232:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 19us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880437.842473:0:15431:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2894 00000100:00100000:2.0:1721880437.842477:0:15431:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:30425778-2709-4512-9d75-01ec53c4cfad+3694:2006:x1805522257791360:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880437.842478:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2893 00000100:00100000:1.0:1721880437.842491:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257790976 00000100:00100000:1.0:1721880437.842493:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257790976 00000100:00100000:2.0:1721880437.842494:0:15431:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:30425778-2709-4512-9d75-01ec53c4cfad+3694:2006:x1805522257791360:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 15us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880437.842499:0:15431:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2894 00000100:00100000:1.0:1721880437.842515:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257791104 00000100:00100000:1.0:1721880437.842516:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257791104 00000100:00100000:2.0:1721880437.842519:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257791488 00000100:00100000:2.0:1721880437.842521:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257791488 00000100:00100000:3.0:1721880437.842523:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257791616 00000100:00100000:3.0:1721880437.842525:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257791616 00000100:00100000:1.0:1721880437.842532:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 310 00000100:00100000:1.0:1721880437.842537:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2006:x1805522257790976:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880437.842544:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 311 00000100:00100000:0.0:1721880437.842550:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2006:x1805522257791104:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880437.842550:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 312 00000100:00100000:2.0:1721880437.842554:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:30425778-2709-4512-9d75-01ec53c4cfad+280:2006:x1805522257791488:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880437.842554:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 313 00000100:00100000:3.0:1721880437.842557:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:30425778-2709-4512-9d75-01ec53c4cfad+665:2006:x1805522257791616:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880437.842565:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2006:x1805522257790976:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 27us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880437.842571:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 310 00000100:00100000:2.0:1721880437.842573:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:30425778-2709-4512-9d75-01ec53c4cfad+280:2006:x1805522257791488:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 19us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880437.842576:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2006:x1805522257791104:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 28us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880437.842578:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:30425778-2709-4512-9d75-01ec53c4cfad+665:2006:x1805522257791616:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 20us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880437.842579:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 312 00000100:00100000:0.0:1721880437.842582:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 311 00000100:00100000:3.0:1721880437.842585:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 313 00000100:00080000:2.0:1721880437.842599:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880407 00000100:00080000:2.0:1721880437.842601:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880407 00000100:00080000:2.0:1721880437.842603:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880407 00000100:00080000:2.0:1721880437.842605:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880407 00000100:00100000:1.0:1721880437.929026:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800966b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011859072:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1721880437.929106:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880437.929175:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011859072 00000100:00100000:3.0:1721880437.929186:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011859072 00000100:00100000:3.0:1721880437.929236:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101094 00000100:00100000:3.0:1721880437.929243:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3686:x1805522011859072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1721880437.929279:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1435709440 avail 1306247168 00000100:00100000:3.0:1721880437.929353:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3686:x1805522011859072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880437.929358:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101094 00000100:00100000:1.0:1721880437.929400:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800966b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011859072:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1721880438.476973:0:15560:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880439.478911:0:11721:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880440.480927:0:7119:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1721880440.824920:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011859200:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1721880440.824971:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880440.825009:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011859200 00000100:00100000:0.0:1721880440.825016:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011859200 00000100:00080000:2.0:1721880440.825033:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880410 00000100:00100000:0.0:1721880440.825056:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 580 00000100:00100000:0.0:1721880440.825061:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3687:x1805522011859200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1721880440.825083:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:0.0:1721880440.825119:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3687:x1805522011859200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880440.825127:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 580 00000100:00100000:2.0:1721880440.825147:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009fff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011859200:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1721880441.224922:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1721880441.224944:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011859328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1721880441.224998:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880441.225039:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011859328 00000100:00100000:0.0:1721880441.225046:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011859328 00000100:00100000:0.0:1721880441.225091:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 581 00000100:00080000:2.0:1721880441.225092:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880411 00000100:00100000:0.0:1721880441.225096:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011859328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1721880441.225113:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:0.0:1721880441.225152:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011859328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880441.225159:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 581 00000100:00100000:3.0:1721880441.225183:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009fff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011859328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1721880441.320938:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011859456:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1721880441.321001:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880441.321063:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011859456 00000100:00100000:0.0:1721880441.321071:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011859456 00000100:00100000:0.0:1721880441.321120:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101095 00000100:00100000:0.0:1721880441.321127:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3689:x1805522011859456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1721880441.321157:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1437519872 avail 1308057600 00000100:00100000:0.0:1721880441.321232:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3689:x1805522011859456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880441.321245:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101095 00000100:00100000:3.0:1721880441.321274:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009fff0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011859456:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1721880441.416965:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0603f996-9d5e-4498-85ba-9976a06b304f:3686:1805522011859584:0@lo:400:kworker.0 00000100:00100000:0.0:1721880441.416984:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3688:1805522011859840:0@lo:400:kworker.0 00000100:00100000:1.0:1721880441.416993:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011859968:0@lo:400:kworker.0 00000100:00100000:3.0:1721880441.417009:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3687:1805522011859712:0@lo:400:kworker.0 00000100:00100000:2.0:1721880441.417029:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880441.417032:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880441.417034:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880441.417054:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880441.417069:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3686:1805522011860096:0@lo:400:kworker.0 00000100:00100000:0.0:1721880441.417070:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011860352:0@lo:400:kworker.0 00000100:00100000:1.0:1721880441.417072:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3689:1805522011860480:0@lo:400:kworker.0 00000100:00100000:3.0:1721880441.417080:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3687:1805522011860224:0@lo:400:kworker.0 00000100:00100000:2.0:1721880441.417089:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880441.417099:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880441.417103:0:15415:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011859840 00000100:00100000:3.0:1721880441.417103:0:15432:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011859712 00000100:00100000:1.0:1721880441.417108:0:15415:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011859840 00000100:00100000:3.0:1721880441.417108:0:15432:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011859712 00000100:00100000:2.0:1721880441.417112:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3686:1805522011860608:0@lo:400:kworker.0 00000100:00100000:0.0:1721880441.417115:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011860864:0@lo:400:kworker.0 00000100:00100000:2.0:1721880441.417124:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880441.417136:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880441.417139:0:15415:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011860096 00000100:00100000:1.0:1721880441.417141:0:15415:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011860096 00000100:00100000:3.0:1721880441.417143:0:15432:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011860608 00000100:00100000:3.0:1721880441.417145:0:15432:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011860608 00000100:00100000:2.0:1721880441.417152:0:15431:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2895 00000100:00100000:2.0:1721880441.417157:0:15431:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-MDT0001_UUID+5:3688:x1805522011859840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880441.417162:0:15415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2896 00000100:00100000:1.0:1721880441.417167:0:15415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3687:x1805522011859712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880441.417167:0:15432:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2897 00000100:00100000:3.0:1721880441.417171:0:15432:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-OST0000_UUID+5:3686:x1805522011860096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880441.417175:0:15420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2898 00000100:00100000:0.0:1721880441.417182:0:15420:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-lwp-OST0001_UUID+5:3686:x1805522011860608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880441.417200:0:15415:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3687:x1805522011859712:12345-0@lo:400:kworker.0 Request processed in 32us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880441.417201:0:15431:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-MDT0001_UUID+5:3688:x1805522011859840:12345-0@lo:400:kworker.0 Request processed in 43us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880441.417204:0:15432:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-OST0000_UUID+5:3686:x1805522011860096:12345-0@lo:400:kworker.0 Request processed in 33us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880441.417205:0:15415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2896 00000100:00100000:2.0:1721880441.417208:0:15431:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2895 00000100:00100000:3.0:1721880441.417210:0:15432:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2897 00000100:00100000:0.0:1721880441.417218:0:15420:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-lwp-OST0001_UUID+5:3686:x1805522011860608:12345-0@lo:400:kworker.0 Request processed in 36us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880441.417224:0:15420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2898 00000100:00100000:1.0:1721880441.417228:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1721880441.417231:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880411 00000100:00080000:2.0:1721880441.417233:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880411 00000100:00100000:3.0:1721880441.417234:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011860352 00000100:00100000:3.0:1721880441.417236:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011860352 00000100:00100000:0.0:1721880441.417239:0:15420:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011860480 00000100:00100000:2.0:1721880441.417239:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880441.417243:0:15420:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011860480 00000100:00100000:1.0:1721880441.417249:0:15431:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011860224 00000100:00100000:2.0:1721880441.417250:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011860736:0@lo:400:kworker.0 00000100:00100000:3.0:1721880441.417250:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011860864 00000100:00100000:1.0:1721880441.417251:0:15431:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011860224 00000100:00100000:3.0:1721880441.417252:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011860864 00000100:00100000:0.0:1721880441.417261:0:15420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2899 00000100:00100000:3.0:1721880441.417263:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1721880441.417266:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880441.417267:0:15420:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-OST0001_UUID+5:3689:x1805522011860480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880441.417267:0:15431:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2900 00000100:00100000:3.0:1721880441.417268:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011860352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880441.417270:0:15431:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001-lwp-OST0000_UUID+5:3687:x1805522011860224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880441.417293:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3687:1805522011859712:0@lo:400:kworker.0 00000100:00100000:3.0:1721880441.417297:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011860352:12345-0@lo:400:kworker.0 Request processed in 30us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880441.417299:0:15431:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001-lwp-OST0000_UUID+5:3687:x1805522011860224:12345-0@lo:400:kworker.0 Request processed in 29us (59us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880441.417300:0:15420:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-OST0001_UUID+5:3689:x1805522011860480:12345-0@lo:400:kworker.0 Request processed in 35us (72us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880441.417301:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3687:1805522011860224:0@lo:400:kworker.0 00000100:00100000:3.0:1721880441.417302:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1721880441.417304:0:15431:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2900 00000100:00100000:0.0:1721880441.417306:0:15420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2899 00000100:00100000:3.0:1721880441.417308:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011860736 00000100:00100000:3.0:1721880441.417310:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011860736 00000100:00100000:3.0:1721880441.417321:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1721880441.417323:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3688:x1805522011860864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880441.417327:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3689:1805522011860480:0@lo:400:kworker.0 00000100:00100000:0.0:1721880441.417333:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1721880441.417337:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0001-mdtlov_UUID+5:3687:x1805522011860736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880441.417338:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3688:x1805522011860864:12345-0@lo:400:kworker.0 Request processed in 14us (203us total) trans 0 rc 0/0 00000100:00080000:2.0:1721880441.417342:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880411 00000100:00100000:3.0:1721880441.417342:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00080000:2.0:1721880441.417344:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880411 00000100:00080000:2.0:1721880441.417347:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880411 00000100:00100000:0.0:1721880441.417358:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0001-mdtlov_UUID+5:3687:x1805522011860736:12345-0@lo:400:kworker.0 Request processed in 21us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880441.417358:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011859968 00000100:00100000:2.0:1721880441.417358:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3686:1805522011860608:0@lo:400:kworker.0 00000100:00100000:1.0:1721880441.417360:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011859968 00000100:00100000:0.0:1721880441.417362:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1721880441.417363:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011859584 00000100:00100000:2.0:1721880441.417364:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3686:1805522011860096:0@lo:400:kworker.0 00000100:00100000:3.0:1721880441.417365:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011859584 00000100:00100000:1.0:1721880441.417381:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101096 00000100:00100000:2.0:1721880441.417383:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011860736:0@lo:400:kworker.0 00000100:00100000:3.0:1721880441.417383:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 582 00000100:00100000:0.0:1721880441.417385:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3688:1805522011859840:0@lo:400:kworker.0 00000100:00100000:1.0:1721880441.417386:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3689:x1805522011859968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880441.417387:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3686:x1805522011859584:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1721880441.417400:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880411 00000100:00100000:0.0:1721880441.417406:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011860352:0@lo:400:kworker.0 00000100:00100000:3.0:1721880441.417407:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3686:x1805522011859584:12345-0@lo:400:kworker.0 Request processed in 20us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880441.417411:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 582 00000100:00100000:2.0:1721880441.417414:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0603f996-9d5e-4498-85ba-9976a06b304f:3686:1805522011859584:0@lo:400:kworker.0 00000100:00100000:0.0:1721880441.417417:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011860864:0@lo:400:kworker.0 00000100:00100000:1.0:1721880441.417424:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3689:x1805522011859968:12345-0@lo:400:kworker.0 Request processed in 37us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880441.417430:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101096 00000100:00100000:1.0:1721880441.417458:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011859968:0@lo:400:kworker.0 00000100:00100000:3.0:1721880441.464871:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1721880441.464882:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1721880441.464889:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012edb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011860992:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1721880441.464893:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011861120:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1721880441.464945:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880441.464970:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880441.464990:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011861120 00000100:00100000:2.0:1721880441.464996:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011861120 00000100:00100000:1.0:1721880441.465003:0:9462:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011860992 00000100:00100000:1.0:1721880441.465007:0:9462:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011860992 00000100:00100000:2.0:1721880441.465032:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 582 00000100:00100000:2.0:1721880441.465037:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011861120:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1721880441.465047:0:9462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 583 00000100:00100000:1.0:1721880441.465053:0:9462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011860992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1721880441.465065:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00002000:00000024:1.0:1721880441.465067:0:9462:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:1.0:1721880441.465101:0:9462:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011860992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880441.465108:0:9462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 583 00000100:00100000:2.0:1721880441.465121:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011861120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880441.465126:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 582 00000100:00100000:3.0:1721880441.465128:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012edb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011860992:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1721880441.465133:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011861120:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1721880441.482922:0:8270:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880442.485027:0:7120:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880442.850257:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880442.850310:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880442.850331:0:15416:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257791872 00000100:00100000:3.0:1721880442.850340:0:15416:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257791872 00000100:00100000:0.0:1721880442.850349:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880442.850364:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257792128 00000100:00100000:1.0:1721880442.850370:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257792128 00000100:00100000:0.0:1721880442.850378:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880442.850389:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00080000:2.0:1721880442.850393:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880412 00000100:00100000:3.0:1721880442.850393:0:15416:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257792384 00000100:00100000:3.0:1721880442.850394:0:15416:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257792384 00000100:00080000:2.0:1721880442.850397:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880412 00000100:00100000:0.0:1721880442.850398:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880442.850398:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 317 00000100:00100000:1.0:1721880442.850404:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2007:x1805522257792128:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880442.850405:0:15416:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257792000 00000100:00100000:3.0:1721880442.850406:0:15416:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257792000 00000100:00100000:0.0:1721880442.850408:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880442.850409:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257791744 00000100:00100000:2.0:1721880442.850412:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257791744 00000100:00100000:0.0:1721880442.850416:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880442.850419:0:15416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2901 00000100:00100000:3.0:1721880442.850423:0:15416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2007:x1805522257791872:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880442.850435:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880442.850436:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 583 00000100:00100000:2.0:1721880442.850440:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4976b229-99ef-4953-87e9-78e1b901883f+12:2006:x1805522257791744:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880442.850454:0:15420:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257792512 00000100:00100000:0.0:1721880442.850457:0:15420:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257792512 00000100:00100000:1.0:1721880442.850458:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2007:x1805522257792128:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 54us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880442.850459:0:15416:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2007:x1805522257791872:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 36us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880442.850462:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4976b229-99ef-4953-87e9-78e1b901883f+12:2006:x1805522257791744:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 22us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880442.850463:0:15416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2901 00000100:00100000:1.0:1721880442.850464:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 317 00000100:00100000:2.0:1721880442.850466:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 583 00000100:00100000:0.0:1721880442.850474:0:15420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2902 00000100:00100000:3.0:1721880442.850477:0:15416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2903 00000100:00100000:0.0:1721880442.850479:0:15420:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:30425778-2709-4512-9d75-01ec53c4cfad+4135:2007:x1805522257792384:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880442.850480:0:15416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2006:x1805522257792000:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880442.850482:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257792640 00000100:00100000:1.0:1721880442.850485:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257792640 00000100:00100000:2.0:1721880442.850490:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257792256 00000100:00100000:2.0:1721880442.850492:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257792256 00000100:00100000:3.0:1721880442.850494:0:15416:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2006:x1805522257792000:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 13us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880442.850497:0:15416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2903 00000100:00100000:1.0:1721880442.850498:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257792768 00000100:00100000:1.0:1721880442.850499:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257792768 00000100:00100000:0.0:1721880442.850500:0:15420:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880095aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:30425778-2709-4512-9d75-01ec53c4cfad+4135:2007:x1805522257792384:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 21us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880442.850504:0:15420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2902 00000100:00100000:2.0:1721880442.850505:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 318 00000100:00100000:3.0:1721880442.850506:0:15416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2904 00000100:00100000:2.0:1721880442.850508:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095aeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:30425778-2709-4512-9d75-01ec53c4cfad+280:2007:x1805522257792640:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880442.850509:0:15416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ae8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:30425778-2709-4512-9d75-01ec53c4cfad+3694:2006:x1805522257792512:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880442.850514:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 319 00000100:00100000:1.0:1721880442.850519:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095aea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2006:x1805522257792256:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880442.850519:0:15416:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ae8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:30425778-2709-4512-9d75-01ec53c4cfad+3694:2006:x1805522257792512:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 10us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880442.850522:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880095aeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:30425778-2709-4512-9d75-01ec53c4cfad+280:2007:x1805522257792640:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 14us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880442.850523:0:15416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2904 00000100:00100000:0.0:1721880442.850526:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 320 00000100:00100000:0.0:1721880442.850530:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095aeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:30425778-2709-4512-9d75-01ec53c4cfad+665:2006:x1805522257792768:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880442.850533:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 318 00000100:00080000:2.0:1721880442.850547:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880412 00000100:00080000:2.0:1721880442.850548:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880412 00000100:00080000:2.0:1721880442.850550:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880412 00000100:00100000:0.0:1721880442.850551:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880095aeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:30425778-2709-4512-9d75-01ec53c4cfad+665:2006:x1805522257792768:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 21us (115us total) trans 0 rc 0/0 00000100:00080000:2.0:1721880442.850551:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880412 00000100:00100000:1.0:1721880442.850555:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880095aea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2006:x1805522257792256:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 34us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880442.850558:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 320 00000100:00100000:1.0:1721880442.850560:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 319 00000100:00100000:0.0:1721880442.936915:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011861248:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1721880442.936968:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880442.937002:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011861248 00000100:00100000:1.0:1721880442.937009:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011861248 00000100:00100000:1.0:1721880442.937046:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101097 00000100:00100000:1.0:1721880442.937052:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ae9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011861248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1721880442.937077:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1435709440 avail 1306247168 00000100:00100000:1.0:1721880442.937121:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ae9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011861248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880442.937125:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101097 00000100:00100000:0.0:1721880442.937140:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011861248:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1721880443.486929:0:15560:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880444.488952:0:11721:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880445.490942:0:7119:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1721880445.832977:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800966b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011861376:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1721880445.833038:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880445.833097:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011861376 00000100:00100000:2.0:1721880445.833106:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011861376 00000100:00080000:0.0:1721880445.833170:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880415 00000100:00100000:2.0:1721880445.833172:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 584 00000100:00100000:2.0:1721880445.833179:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011861376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1721880445.833209:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:2.0:1721880445.833282:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011861376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880445.833291:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 584 00000100:00100000:3.0:1721880445.833313:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800966b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011861376:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1721880446.232951:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1721880446.232975:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012edb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011861504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1721880446.233035:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880446.233145:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011861504 00000100:00100000:0.0:1721880446.233154:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011861504 00000100:00080000:2.0:1721880446.233198:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880416 00000100:00100000:0.0:1721880446.233205:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 585 00000100:00100000:0.0:1721880446.233211:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3688:x1805522011861504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1721880446.233233:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:0.0:1721880446.233276:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3688:x1805522011861504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880446.233281:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 585 00000100:00100000:2.0:1721880446.233296:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012edb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011861504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1721880446.328912:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012edb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011861632:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1721880446.328969:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880446.329020:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011861632 00000100:00100000:1.0:1721880446.329027:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011861632 00000100:00100000:1.0:1721880446.329059:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101098 00000100:00100000:1.0:1721880446.329064:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3686:x1805522011861632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1721880446.329091:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1437519872 avail 1308057600 00000100:00100000:1.0:1721880446.329136:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3686:x1805522011861632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880446.329140:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101098 00000100:00100000:2.0:1721880446.329156:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012edb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011861632:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1721880446.424959:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0603f996-9d5e-4498-85ba-9976a06b304f:3687:1805522011861760:0@lo:400:kworker.0 00000100:00100000:2.0:1721880446.424960:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011862144:0@lo:400:kworker.0 00000100:00100000:3.0:1721880446.424975:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3688:1805522011861888:0@lo:400:kworker.0 00000100:00100000:1.0:1721880446.424979:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3689:1805522011862016:0@lo:400:kworker.0 00000100:00100000:0.0:1721880446.425026:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880446.425028:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880446.425030:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880446.425058:0:7124:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011861760 00000100:00100000:0.0:1721880446.425060:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3687:1805522011862272:0@lo:400:kworker.0 00000100:00100000:1.0:1721880446.425066:0:7124:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011861760 00000100:00100000:3.0:1721880446.425070:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3688:1805522011862400:0@lo:400:kworker.0 00000100:00100000:2.0:1721880446.425071:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3686:1805522011862656:0@lo:400:kworker.0 00000100:00100000:0.0:1721880446.425075:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880446.425093:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880446.425094:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011862784:0@lo:400:kworker.0 00000100:00100000:2.0:1721880446.425109:0:15431:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011861888 00000100:00100000:0.0:1721880446.425110:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880446.425112:0:15431:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011861888 00000100:00100000:3.0:1721880446.425112:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011862912:0@lo:400:kworker.0 00000100:00100000:1.0:1721880446.425118:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 584 00000100:00100000:1.0:1721880446.425124:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0603f996-9d5e-4498-85ba-9976a06b304f+23:3687:x1805522011861760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880446.425134:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880446.425138:0:15431:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011862272 00000100:00100000:2.0:1721880446.425140:0:15431:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011862272 00000100:00100000:0.0:1721880446.425145:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011862144 00000100:00100000:0.0:1721880446.425149:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011862144 00000100:00100000:2.0:1721880446.425150:0:15431:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011862400 00000100:00100000:2.0:1721880446.425152:0:15431:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011862400 00000100:00100000:2.0:1721880446.425161:0:15431:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011862784 00000100:00100000:2.0:1721880446.425163:0:15431:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011862784 00000100:00100000:3.0:1721880446.425170:0:15477:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2905 00000100:00100000:0.0:1721880446.425172:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101099 00000100:00100000:1.0:1721880446.425173:0:7124:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0603f996-9d5e-4498-85ba-9976a06b304f+23:3687:x1805522011861760:12345-0@lo:400:kworker.0 Request processed in 49us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880446.425175:0:15431:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2906 00000100:00100000:0.0:1721880446.425176:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3686:x1805522011862144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880446.425177:0:15477:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-lwp-MDT0000_UUID+5:3688:x1805522011861888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880446.425179:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 584 00000100:00100000:2.0:1721880446.425180:0:15431:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095aead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-OST0000_UUID+5:3687:x1805522011862272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880446.425208:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3686:x1805522011862144:12345-0@lo:400:kworker.0 Request processed in 32us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880446.425213:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101099 00000100:00100000:2.0:1721880446.425220:0:15431:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880095aead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-OST0000_UUID+5:3687:x1805522011862272:12345-0@lo:400:kworker.0 Request processed in 40us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880446.425222:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0603f996-9d5e-4498-85ba-9976a06b304f:3687:1805522011861760:0@lo:400:kworker.0 00000100:00100000:3.0:1721880446.425222:0:15477:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-lwp-MDT0000_UUID+5:3688:x1805522011861888:12345-0@lo:400:kworker.0 Request processed in 45us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880446.425225:0:15431:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2906 00000100:00100000:3.0:1721880446.425229:0:15477:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2905 00000100:00100000:1.0:1721880446.425232:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3687:1805522011862272:0@lo:400:kworker.0 00000100:00100000:0.0:1721880446.425236:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011862912 00000100:00100000:0.0:1721880446.425238:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011862912 00000100:00100000:2.0:1721880446.425240:0:15431:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2907 00000100:00100000:2.0:1721880446.425243:0:15431:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001-lwp-OST0000_UUID+5:3688:x1805522011862400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880446.425249:0:15477:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2908 00000100:00100000:3.0:1721880446.425253:0:15477:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011862784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880446.425255:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1721880446.425259:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011862912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880446.425260:0:15431:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001-lwp-OST0000_UUID+5:3688:x1805522011862400:12345-0@lo:400:kworker.0 Request processed in 16us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880446.425264:0:15431:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2907 00000100:00100000:0.0:1721880446.425281:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011862912:12345-0@lo:400:kworker.0 Request processed in 21us (147us total) trans 0 rc 0/0 00000100:00080000:2.0:1721880446.425281:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880416 00000100:00080000:2.0:1721880446.425284:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880416 00000100:00100000:0.0:1721880446.425285:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1721880446.425285:0:15477:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011862784:12345-0@lo:400:kworker.0 Request processed in 31us (174us total) trans 0 rc 0/0 00000100:00080000:2.0:1721880446.425286:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880416 00000100:00100000:1.0:1721880446.425287:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011862784:0@lo:400:kworker.0 00000100:00080000:2.0:1721880446.425288:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880416 00000100:00100000:3.0:1721880446.425290:0:15477:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2908 00000100:00100000:1.0:1721880446.425299:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880446.425324:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880446.425328:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3688:1805522011861888:0@lo:400:kworker.0 00000100:00100000:1.0:1721880446.425331:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011862144:0@lo:400:kworker.0 00000100:00100000:0.0:1721880446.425336:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011862528:0@lo:400:kworker.0 00000100:00100000:3.0:1721880446.425341:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3688:1805522011862400:0@lo:400:kworker.0 00000100:00100000:2.0:1721880446.425342:0:15416:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011862656 00000100:00100000:2.0:1721880446.425346:0:15416:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011862656 00000100:00100000:0.0:1721880446.425354:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880446.425354:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011862912:0@lo:400:kworker.0 00000100:00100000:0.0:1721880446.425361:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011863040:0@lo:400:kworker.0 00000100:00100000:2.0:1721880446.425366:0:15416:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011862016 00000100:00100000:1.0:1721880446.425367:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011862528 00000100:00100000:1.0:1721880446.425369:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011862528 00000100:00100000:2.0:1721880446.425369:0:15416:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011862016 00000100:00100000:0.0:1721880446.425372:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880446.425381:0:15416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2909 00000100:00100000:3.0:1721880446.425386:0:15477:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2910 00000100:00100000:2.0:1721880446.425387:0:15416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3686:x1805522011862656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880446.425390:0:15477:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095aeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-lwp-MDT0001_UUID+5:3689:x1805522011862016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880446.425398:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011863040 00000100:00100000:1.0:1721880446.425400:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011863040 00000100:00100000:1.0:1721880446.425417:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1721880446.425421:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011862528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880446.425423:0:15477:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880095aeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-lwp-MDT0001_UUID+5:3689:x1805522011862016:12345-0@lo:400:kworker.0 Request processed in 33us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880446.425427:0:15416:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3686:x1805522011862656:12345-0@lo:400:kworker.0 Request processed in 40us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880446.425427:0:15477:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2910 00000100:00100000:2.0:1721880446.425433:0:15416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2909 00000100:00100000:0.0:1721880446.425440:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1721880446.425444:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011863040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880446.425447:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011862528:12345-0@lo:400:kworker.0 Request processed in 25us (93us total) trans 0 rc 0/0 00000100:00080000:2.0:1721880446.425453:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880416 00000100:00100000:1.0:1721880446.425455:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00080000:2.0:1721880446.425456:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880416 00000100:00100000:0.0:1721880446.425485:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011863040:12345-0@lo:400:kworker.0 Request processed in 40us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880446.425489:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1721880446.425495:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3686:1805522011862656:0@lo:400:kworker.0 00000100:00100000:0.0:1721880446.425513:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3689:1805522011862016:0@lo:400:kworker.0 00000100:00100000:0.0:1721880446.425520:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011862528:0@lo:400:kworker.0 00000100:00100000:0.0:1721880446.425525:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011863040:0@lo:400:kworker.0 00000100:00100000:0.0:1721880446.472881:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011863168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1721880446.472881:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012edb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011863296:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1721880446.472931:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880446.472965:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880446.472997:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011863168 00000100:00100000:1.0:1721880446.473001:0:9462:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011863296 00000100:00100000:2.0:1721880446.473006:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011863168 00000100:00100000:1.0:1721880446.473007:0:9462:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011863296 00000100:00100000:2.0:1721880446.473048:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 586 00000100:00100000:1.0:1721880446.473053:0:9462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 587 00000100:00100000:2.0:1721880446.473055:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011863168:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1721880446.473059:0:9462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011863296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1721880446.473082:0:9462:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00002000:00000024:2.0:1721880446.473082:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:1.0:1721880446.473126:0:9462:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011863296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880446.473130:0:9462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 587 00000100:00100000:3.0:1721880446.473134:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012edb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011863296:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1721880446.473135:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011863168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1721880446.473140:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011863168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880446.473146:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 586 00010000:00010000:2.0:1721880446.492985:0:8270:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880447.494957:0:7120:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880447.858166:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880447.858203:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880447.858223:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880447.858226:0:7124:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257792896 00000100:00100000:1.0:1721880447.858235:0:7124:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257792896 00000100:00100000:0.0:1721880447.858246:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880447.858260:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880447.858273:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880447.858274:0:15432:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257793024 00000100:00100000:1.0:1721880447.858275:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 585 00000100:00100000:1.0:1721880447.858280:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2007:x1805522257792896:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880447.858280:0:15432:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257793024 00000100:00100000:0.0:1721880447.858286:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880447.858298:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880447.858307:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257793152 00000100:00100000:3.0:1721880447.858312:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257793152 00000100:00100000:2.0:1721880447.858314:0:15432:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257793664 00000100:00100000:2.0:1721880447.858317:0:15432:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257793664 00000100:00100000:1.0:1721880447.858326:0:7124:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2007:x1805522257792896:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 46us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880447.858330:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 585 00000100:00100000:3.0:1721880447.858332:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257793536 00000100:00100000:3.0:1721880447.858334:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257793536 00000100:00100000:0.0:1721880447.858335:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880447.858342:0:15432:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2911 00000100:00100000:2.0:1721880447.858346:0:15432:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2006:x1805522257793024:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880447.858347:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2912 00000100:00100000:3.0:1721880447.858351:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2007:x1805522257793152:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880447.858361:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257793280 00000100:00100000:1.0:1721880447.858363:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257793280 00000100:00100000:3.0:1721880447.858376:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2007:x1805522257793152:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 25us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880447.858378:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257793408 00000100:00100000:1.0:1721880447.858379:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257793408 00000100:00100000:2.0:1721880447.858379:0:15432:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2006:x1805522257793024:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 33us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880447.858380:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2912 00000100:00100000:2.0:1721880447.858383:0:15432:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2911 00000100:00100000:1.0:1721880447.858387:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257793920 00000100:00100000:1.0:1721880447.858389:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257793920 00000100:00100000:3.0:1721880447.858394:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2913 00000100:00100000:1.0:1721880447.858396:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257793792 00000100:00100000:1.0:1721880447.858397:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257793792 00000100:00100000:2.0:1721880447.858397:0:15432:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2914 00000100:00100000:3.0:1721880447.858399:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:30425778-2709-4512-9d75-01ec53c4cfad+3694:2007:x1805522257793664:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880447.858400:0:15432:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:30425778-2709-4512-9d75-01ec53c4cfad+4135:2006:x1805522257793536:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880447.858405:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 324 00000100:00100000:1.0:1721880447.858408:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2006:x1805522257793280:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880447.858412:0:15432:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:30425778-2709-4512-9d75-01ec53c4cfad+4135:2006:x1805522257793536:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 11us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880447.858415:0:15432:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2914 00000100:00100000:1.0:1721880447.858422:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2006:x1805522257793280:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 14us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880447.858426:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 324 00000100:00080000:2.0:1721880447.858426:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880417 00000100:00100000:3.0:1721880447.858428:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:30425778-2709-4512-9d75-01ec53c4cfad+3694:2007:x1805522257793664:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 28us (154us total) trans 0 rc 0/0 00000100:00080000:2.0:1721880447.858429:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880417 00000100:00080000:2.0:1721880447.858430:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880417 00000100:00100000:1.0:1721880447.858432:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 325 00000100:00080000:2.0:1721880447.858432:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880417 00000100:00080000:2.0:1721880447.858434:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880417 00000100:00100000:3.0:1721880447.858434:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2913 00000100:00100000:1.0:1721880447.858435:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2007:x1805522257793408:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880447.858446:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2007:x1805522257793408:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 11us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880447.858449:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 325 00000100:00100000:2.0:1721880447.858463:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 326 00000100:00100000:1.0:1721880447.858467:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 327 00000100:00100000:2.0:1721880447.858468:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:30425778-2709-4512-9d75-01ec53c4cfad+665:2007:x1805522257793920:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880447.858473:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:30425778-2709-4512-9d75-01ec53c4cfad+280:2006:x1805522257793792:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880447.858488:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:30425778-2709-4512-9d75-01ec53c4cfad+280:2006:x1805522257793792:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 15us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880447.858491:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 327 00000100:00100000:2.0:1721880447.858491:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:30425778-2709-4512-9d75-01ec53c4cfad+665:2007:x1805522257793920:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 23us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880447.858497:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 326 00000100:00100000:3.0:1721880447.944960:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011863424:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1721880447.945012:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880447.945060:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011863424 00000100:00100000:0.0:1721880447.945067:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011863424 00000100:00100000:0.0:1721880447.945119:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101100 00000100:00100000:0.0:1721880447.945126:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011863424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1721880447.945174:0:15587:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1435709440 avail 1306247168 00000100:00100000:0.0:1721880447.945260:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011863424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 131us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880447.945268:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101100 00000100:00100000:3.0:1721880447.945296:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011863424:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1721880448.497011:0:15560:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880449.498966:0:11721:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880450.501009:0:7119:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1721880450.841021:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1721880450.841047:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800966b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011863552:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1721880450.841112:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880450.841162:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011863552 00000100:00100000:2.0:1721880450.841170:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011863552 00000100:00100000:2.0:1721880450.841228:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 588 00000100:00100000:2.0:1721880450.841234:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011863552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1721880450.841264:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00080000:0.0:1721880450.841286:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880420 00000100:00100000:2.0:1721880450.841328:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011863552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880450.841334:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 588 00000100:00100000:3.0:1721880450.841378:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800966b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011863552:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1721880451.240931:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800966b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011863680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1721880451.240990:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880451.241035:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011863680 00000100:00100000:2.0:1721880451.241042:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011863680 00000100:00080000:0.0:1721880451.241083:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880421 00000100:00100000:2.0:1721880451.241085:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 589 00000100:00100000:2.0:1721880451.241090:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011863680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1721880451.241108:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:2.0:1721880451.241155:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011863680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880451.241159:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 589 00000100:00100000:3.0:1721880451.241184:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800966b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011863680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1721880451.336944:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800966b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011863808:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1721880451.336995:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880451.337036:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011863808 00000100:00100000:2.0:1721880451.337043:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011863808 00000100:00100000:2.0:1721880451.337080:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101101 00000100:00100000:2.0:1721880451.337085:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+19:3687:x1805522011863808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1721880451.337112:0:15587:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1437519872 avail 1308057600 00000100:00100000:2.0:1721880451.337161:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+19:3687:x1805522011863808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880451.337165:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101101 00000100:00100000:0.0:1721880451.337177:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800966b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011863808:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1721880451.432983:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011863936:0@lo:400:kworker.0 00000100:00100000:0.0:1721880451.433008:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3689:1805522011864064:0@lo:400:kworker.0 00000100:00100000:2.0:1721880451.433020:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3686:1805522011864192:0@lo:400:kworker.0 00000100:00100000:1.0:1721880451.433030:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011864320:0@lo:400:kworker.0 00000100:00100000:3.0:1721880451.433053:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880451.433060:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880451.433071:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880451.433080:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011863936 00000100:00100000:3.0:1721880451.433082:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011864448:0@lo:400:kworker.0 00000100:00100000:2.0:1721880451.433085:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011863936 00000100:00100000:0.0:1721880451.433089:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3689:1805522011864576:0@lo:400:kworker.0 00000100:00100000:1.0:1721880451.433089:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3687:1805522011864832:0@lo:400:kworker.0 00000100:00100000:3.0:1721880451.433099:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880451.433111:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880451.433111:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011864320 00000100:00100000:1.0:1721880451.433113:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011864320 00000100:00100000:3.0:1721880451.433113:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3688:1805522011864960:0@lo:400:kworker.0 00000100:00100000:2.0:1721880451.433122:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 586 00000100:00100000:2.0:1721880451.433128:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011863936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880451.433128:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880451.433130:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011865088:0@lo:400:kworker.0 00000100:00100000:1.0:1721880451.433135:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101102 00000100:00100000:1.0:1721880451.433138:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011864320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880451.433150:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880451.433153:0:15415:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011864064 00000100:00100000:3.0:1721880451.433157:0:15415:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011864064 00000100:00100000:1.0:1721880451.433174:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011864320:12345-0@lo:400:kworker.0 Request processed in 35us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880451.433178:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101102 00000100:00100000:2.0:1721880451.433178:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011863936:12345-0@lo:400:kworker.0 Request processed in 51us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880451.433180:0:15415:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011864448 00000100:00100000:2.0:1721880451.433185:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 586 00000100:00100000:3.0:1721880451.433190:0:15415:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011864448 00000100:00100000:0.0:1721880451.433201:0:15420:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011864576 00000100:00100000:1.0:1721880451.433201:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880451.433206:0:15420:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011864576 00000100:00100000:3.0:1721880451.433206:0:15415:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011864960 00000100:00100000:3.0:1721880451.433208:0:15415:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011864960 00000100:00100000:2.0:1721880451.433212:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011865088 00000100:00100000:2.0:1721880451.433214:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011865088 00000100:00100000:3.0:1721880451.433219:0:15415:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011864832 00000100:00100000:3.0:1721880451.433221:0:15415:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011864832 00000100:00100000:1.0:1721880451.433222:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011864320:0@lo:400:kworker.0 00000100:00100000:0.0:1721880451.433229:0:15420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2915 00000100:00100000:2.0:1721880451.433230:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1721880451.433233:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011865088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880451.433235:0:15420:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1805522011864064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880451.433244:0:15415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2916 00000100:00100000:1.0:1721880451.433248:0:15416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2917 00000100:00100000:3.0:1721880451.433249:0:15415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011864448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880451.433251:0:15416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3688:x1805522011864960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880451.433252:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011865088:12345-0@lo:400:kworker.0 Request processed in 18us (101us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880451.433255:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1721880451.433267:0:15431:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2918 00000100:00100000:0.0:1721880451.433268:0:15420:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1805522011864064:12345-0@lo:400:kworker.0 Request processed in 33us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880451.433269:0:15431:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1805522011864576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880451.433272:0:15416:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3688:x1805522011864960:12345-0@lo:400:kworker.0 Request processed in 21us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880451.433274:0:15420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2915 00000100:00100000:1.0:1721880451.433277:0:15416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2917 00000100:00100000:3.0:1721880451.433280:0:15415:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011864448:12345-0@lo:400:kworker.0 Request processed in 31us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880451.433283:0:15431:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1805522011864576:12345-0@lo:400:kworker.0 Request processed in 13us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880451.433285:0:15415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2916 00000100:00100000:2.0:1721880451.433288:0:15431:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2918 00000100:00100000:1.0:1721880451.433290:0:15416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2919 00000100:00100000:1.0:1721880451.433292:0:15416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3687:x1805522011864832:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1721880451.433305:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880421 00000100:00100000:1.0:1721880451.433305:0:15416:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3687:x1805522011864832:12345-0@lo:400:kworker.0 Request processed in 13us (104us total) trans 0 rc 0/0 00000100:00080000:0.0:1721880451.433308:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880421 00000100:00100000:1.0:1721880451.433309:0:15416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2919 00000100:00080000:0.0:1721880451.433310:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880421 00000100:00080000:0.0:1721880451.433312:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880421 00000100:00100000:2.0:1721880451.433315:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880451.433322:0:15434:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011864192 00000100:00100000:1.0:1721880451.433323:0:15434:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011864192 00000100:00100000:3.0:1721880451.433323:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011864448:0@lo:400:kworker.0 00000100:00100000:0.0:1721880451.433329:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011865088:0@lo:400:kworker.0 00000100:00100000:3.0:1721880451.433332:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3688:1805522011864960:0@lo:400:kworker.0 00000100:00100000:1.0:1721880451.433334:0:15434:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2920 00000100:00100000:2.0:1721880451.433334:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011864704:0@lo:400:kworker.0 00000100:00100000:1.0:1721880451.433336:0:15434:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0000-lwp-MDT0001_UUID+5:3686:x1805522011864192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880451.433339:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3689:1805522011864064:0@lo:400:kworker.0 00000100:00100000:3.0:1721880451.433339:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011863936:0@lo:400:kworker.0 00000100:00100000:0.0:1721880451.433348:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3689:1805522011864576:0@lo:400:kworker.0 00000100:00100000:2.0:1721880451.433348:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880451.433351:0:15434:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0000-lwp-MDT0001_UUID+5:3686:x1805522011864192:12345-0@lo:400:kworker.0 Request processed in 15us (36us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880451.433354:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011865216:0@lo:400:kworker.0 00000100:00100000:1.0:1721880451.433357:0:15434:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2920 00000100:00100000:2.0:1721880451.433364:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880451.433367:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011864704 00000100:00100000:1.0:1721880451.433369:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011864704 00000100:00100000:1.0:1721880451.433378:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011865216 00000100:00100000:2.0:1721880451.433378:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3686:1805522011864192:0@lo:400:kworker.0 00000100:00100000:1.0:1721880451.433379:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011865216 00000100:00100000:3.0:1721880451.433386:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1721880451.433391:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011864704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880451.433395:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1721880451.433398:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011865216:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1721880451.433407:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880421 00000100:00100000:1.0:1721880451.433423:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011865216:12345-0@lo:400:kworker.0 Request processed in 24us (58us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880451.433424:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011864704:0@lo:400:kworker.0 00000100:00100000:1.0:1721880451.433426:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1721880451.433426:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011864704:12345-0@lo:400:kworker.0 Request processed in 34us (76us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880451.433430:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011865216:0@lo:400:kworker.0 00000100:00100000:3.0:1721880451.433431:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1721880451.433440:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3687:1805522011864832:0@lo:400:kworker.0 00000100:00100000:0.0:1721880451.480880:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1721880451.480881:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1721880451.480897:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e9ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011865472:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1721880451.480899:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011865344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1721880451.480944:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880451.480961:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880451.480983:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011865472 00000100:00100000:1.0:1721880451.480990:0:9462:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011865344 00000100:00100000:2.0:1721880451.480990:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011865472 00000100:00100000:1.0:1721880451.480995:0:9462:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011865344 00000100:00100000:1.0:1721880451.481031:0:9462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 590 00000100:00100000:1.0:1721880451.481035:0:9462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011865344:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1721880451.481042:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 591 00000100:00100000:2.0:1721880451.481048:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011865472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1721880451.481058:0:9462:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00002000:00000024:2.0:1721880451.481060:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:1.0:1721880451.481101:0:9462:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011865344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880451.481105:0:9462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 590 00000100:00100000:0.0:1721880451.481110:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e9ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011865472:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1721880451.481110:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011865344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1721880451.481111:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011865472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880451.481117:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 591 00010000:00010000:2.0:1721880451.502922:0:8270:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880452.505037:0:7120:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880452.866216:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880452.866254:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880452.866281:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880452.866282:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257794048 00000100:00100000:2.0:1721880452.866291:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257794048 00000100:00100000:0.0:1721880452.866316:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880452.866319:0:15416:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257794176 00000100:00100000:3.0:1721880452.866326:0:15416:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257794176 00000100:00100000:0.0:1721880452.866336:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880452.866340:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 587 00000100:00100000:2.0:1721880452.866347:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4976b229-99ef-4953-87e9-78e1b901883f+12:2007:x1805522257794048:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880452.866348:0:15434:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257794304 00000100:00100000:0.0:1721880452.866352:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880452.866352:0:15434:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257794304 00000100:00100000:3.0:1721880452.866357:0:15416:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257794688 00000100:00100000:3.0:1721880452.866359:0:15416:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257794688 00000100:00100000:0.0:1721880452.866366:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880452.866378:0:15434:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257794816 00000100:00100000:1.0:1721880452.866380:0:15434:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257794816 00000100:00100000:3.0:1721880452.866384:0:15416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2921 00000100:00100000:3.0:1721880452.866390:0:15416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2007:x1805522257794176:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880452.866393:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880452.866395:0:15434:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2922 00000100:00100000:1.0:1721880452.866399:0:15434:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2007:x1805522257794304:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880452.866401:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4976b229-99ef-4953-87e9-78e1b901883f+12:2007:x1805522257794048:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 54us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880452.866407:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 587 00000100:00100000:1.0:1721880452.866424:0:15434:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2007:x1805522257794304:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 25us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880452.866424:0:15416:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2007:x1805522257794176:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 34us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880452.866430:0:15416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2921 00000100:00100000:1.0:1721880452.866433:0:15434:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2922 00000100:00100000:2.0:1721880452.866442:0:15432:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2923 00000100:00100000:3.0:1721880452.866446:0:15416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2924 00000100:00100000:2.0:1721880452.866447:0:15432:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800953c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:30425778-2709-4512-9d75-01ec53c4cfad+4135:2007:x1805522257794688:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880452.866450:0:15416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800953c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:30425778-2709-4512-9d75-01ec53c4cfad+3694:2006:x1805522257794816:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880452.866462:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257794432 00000100:00100000:1.0:1721880452.866464:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257794432 00000100:00100000:2.0:1721880452.866469:0:15432:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800953c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:30425778-2709-4512-9d75-01ec53c4cfad+4135:2007:x1805522257794688:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 22us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880452.866471:0:15416:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800953c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:30425778-2709-4512-9d75-01ec53c4cfad+3694:2006:x1805522257794816:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 21us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880452.866474:0:15432:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2923 00000100:00100000:3.0:1721880452.866480:0:15416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2924 00000100:00100000:1.0:1721880452.866483:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257794560 00000100:00100000:1.0:1721880452.866484:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257794560 00000100:00100000:1.0:1721880452.866495:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257794944 00000100:00100000:1.0:1721880452.866497:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257794944 00000100:00100000:0.0:1721880452.866520:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880452.866523:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 331 00000100:00100000:3.0:1721880452.866528:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800953c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2007:x1805522257794432:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880452.866532:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257795072 00000100:00100000:1.0:1721880452.866534:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257795072 00000100:00100000:2.0:1721880452.866545:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 332 00000100:00100000:1.0:1721880452.866550:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 333 00000100:00100000:2.0:1721880452.866551:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800953c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2007:x1805522257794560:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880452.866551:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800953c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2007:x1805522257794432:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 23us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880452.866554:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800953c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:30425778-2709-4512-9d75-01ec53c4cfad+280:2007:x1805522257794944:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880452.866556:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 331 00000100:00100000:3.0:1721880452.866568:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 334 00000100:00100000:3.0:1721880452.866571:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800953c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:30425778-2709-4512-9d75-01ec53c4cfad+665:2007:x1805522257795072:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880452.866574:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800953c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2007:x1805522257794560:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 23us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880452.866576:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800953c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:30425778-2709-4512-9d75-01ec53c4cfad+280:2007:x1805522257794944:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 22us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880452.866579:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 332 00000100:00100000:1.0:1721880452.866582:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 333 00000100:00100000:3.0:1721880452.866587:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800953c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:30425778-2709-4512-9d75-01ec53c4cfad+665:2007:x1805522257795072:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 14us (68us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880452.866591:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 334 00000100:00080000:0.0:1721880452.866628:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880422 00000100:00080000:0.0:1721880452.866633:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880422 00000100:00080000:0.0:1721880452.866635:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880422 00000100:00080000:0.0:1721880452.866636:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880422 00000100:00080000:0.0:1721880452.866637:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880422 00000100:00100000:3.0:1721880452.952929:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1721880452.952950:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800953c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011865600:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1721880452.953004:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880452.953043:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011865600 00000100:00100000:0.0:1721880452.953050:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011865600 00000100:00100000:0.0:1721880452.953097:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101103 00000100:00100000:0.0:1721880452.953103:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011865600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1721880452.953133:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1435709440 avail 1306247168 00000100:00100000:0.0:1721880452.953181:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011865600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880452.953187:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101103 00000100:00100000:3.0:1721880452.953207:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800953c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011865600:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1721880453.506907:0:15560:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880454.508903:0:11721:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880455.511047:0:7119:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1721880455.848907:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008bdf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011865728:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1721880455.848959:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880455.848994:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011865728 00000100:00100000:2.0:1721880455.849000:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011865728 00000100:00100000:2.0:1721880455.849041:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 592 00000100:00100000:2.0:1721880455.849046:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011865728:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1721880455.849064:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880425 00002000:00000024:2.0:1721880455.849067:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:2.0:1721880455.849115:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011865728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880455.849120:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 592 00000100:00100000:3.0:1721880455.849139:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008bdf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011865728:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1721880456.248949:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e9c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011865856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1721880456.249012:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880456.249061:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011865856 00000100:00100000:2.0:1721880456.249070:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011865856 00000100:00100000:2.0:1721880456.249138:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 593 00000100:00100000:2.0:1721880456.249145:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011865856:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1721880456.249149:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880426 00002000:00000024:2.0:1721880456.249165:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:2.0:1721880456.249213:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011865856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880456.249219:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 593 00000100:00100000:1.0:1721880456.249226:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e9c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011865856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1721880456.344977:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800953c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011865984:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1721880456.345034:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880456.345071:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011865984 00000100:00100000:0.0:1721880456.345078:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011865984 00000100:00100000:0.0:1721880456.345117:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101104 00000100:00100000:0.0:1721880456.345121:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3688:x1805522011865984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1721880456.345148:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1437519872 avail 1308057600 00000100:00100000:0.0:1721880456.345193:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3688:x1805522011865984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880456.345200:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101104 00000100:00100000:3.0:1721880456.345222:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800953c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011865984:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1721880456.440963:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099a3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0603f996-9d5e-4498-85ba-9976a06b304f:3689:1805522011866112:0@lo:400:kworker.0 00000100:00100000:3.0:1721880456.440964:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099a3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011866496:0@lo:400:kworker.0 00000100:00100000:0.0:1721880456.440986:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3687:1805522011866368:0@lo:400:kworker.0 00000100:00100000:1.0:1721880456.441004:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3686:1805522011866240:0@lo:400:kworker.0 00000100:00100000:3.0:1721880456.441052:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880456.441060:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880456.441060:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880456.441084:0:7124:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011866112 00000100:00100000:3.0:1721880456.441088:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099a3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3688:1805522011867008:0@lo:400:kworker.0 00000100:00100000:1.0:1721880456.441090:0:7124:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011866112 00000100:00100000:0.0:1721880456.441095:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011866880:0@lo:400:kworker.0 00000100:00100000:2.0:1721880456.441096:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099a3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3689:1805522011866624:0@lo:400:kworker.0 00000100:00100000:3.0:1721880456.441104:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880456.441112:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880456.441119:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880456.441121:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011867392:0@lo:400:kworker.0 00000100:00100000:1.0:1721880456.441128:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 588 00000100:00100000:2.0:1721880456.441132:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3689:1805522011867136:0@lo:400:kworker.0 00000100:00100000:1.0:1721880456.441134:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0603f996-9d5e-4498-85ba-9976a06b304f+23:3689:x1805522011866112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880456.441138:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880456.441138:0:15477:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011866368 00000100:00100000:3.0:1721880456.441140:0:15477:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011866368 00000100:00100000:2.0:1721880456.441149:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880456.441162:0:15477:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2925 00000100:00100000:0.0:1721880456.441163:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011866880 00000100:00100000:0.0:1721880456.441165:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011866880 00000100:00100000:3.0:1721880456.441166:0:15477:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800953c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-lwp-MDT0001_UUID+5:3687:x1805522011866368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880456.441173:0:15431:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011867008 00000100:00100000:2.0:1721880456.441175:0:15431:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011867008 00000100:00100000:1.0:1721880456.441184:0:7124:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0603f996-9d5e-4498-85ba-9976a06b304f+23:3689:x1805522011866112:12345-0@lo:400:kworker.0 Request processed in 50us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880456.441185:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011867392 00000100:00100000:0.0:1721880456.441188:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011867392 00000100:00100000:2.0:1721880456.441190:0:15431:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011866624 00000100:00100000:2.0:1721880456.441191:0:15431:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011866624 00000100:00100000:3.0:1721880456.441192:0:15477:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800953c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-lwp-MDT0001_UUID+5:3687:x1805522011866368:12345-0@lo:400:kworker.0 Request processed in 25us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880456.441194:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 588 00000100:00100000:3.0:1721880456.441196:0:15477:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2925 00000100:00100000:2.0:1721880456.441203:0:15431:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011867136 00000100:00100000:0.0:1721880456.441205:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1721880456.441205:0:15431:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011867136 00000100:00100000:0.0:1721880456.441209:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800953c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+5:3687:x1805522011866880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880456.441213:0:15477:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2926 00000100:00100000:3.0:1721880456.441216:0:15477:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-lwp-OST0001_UUID+5:3688:x1805522011867008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880456.441223:0:15431:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2927 00000100:00100000:2.0:1721880456.441227:0:15431:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bdfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-OST0000_UUID+5:3689:x1805522011866624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880456.441228:0:15415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2928 00000100:00100000:1.0:1721880456.441232:0:15415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bdf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3689:x1805522011867136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880456.441242:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800953c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+5:3687:x1805522011866880:12345-0@lo:400:kworker.0 Request processed in 32us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880456.441242:0:15477:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-lwp-OST0001_UUID+5:3688:x1805522011867008:12345-0@lo:400:kworker.0 Request processed in 25us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880456.441247:0:15477:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2926 00000100:00100000:0.0:1721880456.441248:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1721880456.441254:0:15415:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bdf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3689:x1805522011867136:12345-0@lo:400:kworker.0 Request processed in 21us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880456.441259:0:15415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2928 00000100:00100000:2.0:1721880456.441260:0:15431:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bdfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-OST0000_UUID+5:3689:x1805522011866624:12345-0@lo:400:kworker.0 Request processed in 31us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880456.441266:0:15431:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2927 00000100:00100000:0.0:1721880456.441267:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1721880456.441271:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800953c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011867392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880456.441279:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880456.441284:0:15416:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011866240 00000100:00100000:3.0:1721880456.441286:0:15416:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011866240 00000100:00100000:1.0:1721880456.441290:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099a3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3686:1805522011866752:0@lo:400:kworker.0 00000100:00100000:0.0:1721880456.441293:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800953c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011867392:12345-0@lo:400:kworker.0 Request processed in 21us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880456.441296:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1721880456.441301:0:15416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2929 00000100:00100000:3.0:1721880456.441305:0:15416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3686:x1805522011866240:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1721880456.441308:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880426 00000100:00100000:1.0:1721880456.441308:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1721880456.441311:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880426 00000100:00080000:0.0:1721880456.441312:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880426 00000100:00080000:0.0:1721880456.441313:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880426 00000100:00100000:2.0:1721880456.441313:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099a3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3689:1805522011866624:0@lo:400:kworker.0 00000100:00100000:1.0:1721880456.441318:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011867264:0@lo:400:kworker.0 00000100:00100000:0.0:1721880456.441320:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011866496 00000100:00100000:0.0:1721880456.441323:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011866496 00000100:00100000:2.0:1721880456.441323:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3689:1805522011867136:0@lo:400:kworker.0 00000100:00100000:3.0:1721880456.441326:0:15416:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3686:x1805522011866240:12345-0@lo:400:kworker.0 Request processed in 20us (47us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880456.441330:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099a3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0603f996-9d5e-4498-85ba-9976a06b304f:3689:1805522011866112:0@lo:400:kworker.0 00000100:00100000:3.0:1721880456.441331:0:15416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2929 00000100:00100000:1.0:1721880456.441332:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880456.441339:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101105 00000100:00100000:3.0:1721880456.441339:0:15416:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011866752 00000100:00100000:3.0:1721880456.441341:0:15416:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011866752 00000100:00100000:0.0:1721880456.441342:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011866496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880456.441352:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3686:1805522011866240:0@lo:400:kworker.0 00000100:00100000:3.0:1721880456.441355:0:15416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2930 00000100:00100000:0.0:1721880456.441357:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011866496:12345-0@lo:400:kworker.0 Request processed in 15us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880456.441359:0:15416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3686:x1805522011866752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880456.441361:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101105 00000100:00080000:2.0:1721880456.441371:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880426 00000100:00100000:0.0:1721880456.441374:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011867264 00000100:00100000:0.0:1721880456.441375:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011867264 00000100:00100000:3.0:1721880456.441385:0:15416:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3686:x1805522011866752:12345-0@lo:400:kworker.0 Request processed in 24us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880456.441386:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1721880456.441387:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099a3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3686:1805522011866752:0@lo:400:kworker.0 00000100:00100000:0.0:1721880456.441388:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011867264:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1721880456.441390:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880426 00000100:00100000:3.0:1721880456.441390:0:15416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2930 00000100:00100000:0.0:1721880456.441403:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011867264:12345-0@lo:400:kworker.0 Request processed in 14us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880456.441406:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1721880456.441411:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099a3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3688:1805522011867008:0@lo:400:kworker.0 00000100:00100000:1.0:1721880456.441412:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011867264:0@lo:400:kworker.0 00000100:00100000:0.0:1721880456.441422:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3687:1805522011866368:0@lo:400:kworker.0 00000100:00100000:3.0:1721880456.441422:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099a3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011866496:0@lo:400:kworker.0 00000100:00100000:0.0:1721880456.441427:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011866880:0@lo:400:kworker.0 00000100:00100000:0.0:1721880456.441433:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011867392:0@lo:400:kworker.0 00000100:00100000:3.0:1721880456.488877:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800953c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011867520:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1721880456.488900:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e9c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011867648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1721880456.488924:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880456.488945:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880456.488979:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011867520 00000100:00100000:0.0:1721880456.488986:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011867520 00000100:00100000:1.0:1721880456.489008:0:9462:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011867648 00000100:00100000:1.0:1721880456.489011:0:9462:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011867648 00000100:00100000:0.0:1721880456.489027:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 594 00000100:00100000:0.0:1721880456.489032:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011867520:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1721880456.489037:0:9462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 595 00000100:00100000:1.0:1721880456.489042:0:9462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3688:x1805522011867648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1721880456.489059:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00002000:00000024:1.0:1721880456.489059:0:9462:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:1.0:1721880456.489109:0:9462:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3688:x1805522011867648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880456.489111:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011867520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880456.489115:0:9462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 595 00000100:00100000:0.0:1721880456.489118:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 594 00000100:00100000:3.0:1721880456.489119:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800953c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011867520:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1721880456.489120:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e9c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011867648:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1721880456.512929:0:8270:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880457.514915:0:7120:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880457.874149:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880457.874190:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880457.874213:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880457.874224:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257795328 00000100:00100000:0.0:1721880457.874228:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880457.874233:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257795328 00000100:00100000:0.0:1721880457.874238:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880457.874247:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880457.874248:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257795200 00000100:00100000:2.0:1721880457.874252:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257795200 00000100:00100000:0.0:1721880457.874256:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880457.874265:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880457.874277:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257795456 00000100:00100000:1.0:1721880457.874278:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257795584 00000100:00100000:3.0:1721880457.874279:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257795456 00000100:00100000:2.0:1721880457.874280:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 589 00000100:00100000:1.0:1721880457.874283:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257795584 00000100:00100000:2.0:1721880457.874285:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4976b229-99ef-4953-87e9-78e1b901883f+12:2007:x1805522257795200:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880457.874288:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880457.874294:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257795840 00000100:00100000:3.0:1721880457.874296:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257795840 00000100:00100000:1.0:1721880457.874311:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257795712 00000100:00100000:3.0:1721880457.874311:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257795968 00000100:00100000:1.0:1721880457.874313:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257795712 00000100:00100000:3.0:1721880457.874313:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257795968 00000100:00100000:0.0:1721880457.874317:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257796096 00000100:00100000:0.0:1721880457.874321:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257796096 00000100:00100000:1.0:1721880457.874327:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257796224 00000100:00100000:2.0:1721880457.874328:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4976b229-99ef-4953-87e9-78e1b901883f+12:2007:x1805522257795200:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 44us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880457.874329:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257796224 00000100:00100000:3.0:1721880457.874329:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2931 00000100:00100000:2.0:1721880457.874332:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 589 00000100:00100000:3.0:1721880457.874334:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800953c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2006:x1805522257795328:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880457.874343:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 338 00000100:00100000:0.0:1721880457.874348:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800953c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2006:x1805522257795584:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880457.874353:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 339 00000100:00080000:2.0:1721880457.874354:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880427 00000100:00080000:2.0:1721880457.874357:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880427 00000100:00080000:2.0:1721880457.874358:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880427 00000100:00100000:1.0:1721880457.874359:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800953c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2007:x1805522257795712:12345-192.168.201.24@tcp:400:kworker.0 00000100:00080000:2.0:1721880457.874359:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880427 00000100:00080000:2.0:1721880457.874360:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880427 00000100:00100000:3.0:1721880457.874367:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800953c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2006:x1805522257795328:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 32us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880457.874368:0:15432:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2932 00000100:00100000:2.0:1721880457.874371:0:15432:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800953c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2007:x1805522257795456:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880457.874373:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800953c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2006:x1805522257795584:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 24us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880457.874373:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2931 00000100:00100000:0.0:1721880457.874380:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 338 00000100:00100000:2.0:1721880457.874386:0:15432:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800953c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2007:x1805522257795456:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 14us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880457.874387:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800953c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2007:x1805522257795712:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 28us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880457.874387:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2933 00000100:00100000:2.0:1721880457.874390:0:15432:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2932 00000100:00100000:3.0:1721880457.874392:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800953c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:30425778-2709-4512-9d75-01ec53c4cfad+4135:2006:x1805522257795840:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880457.874393:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 339 00000100:00100000:0.0:1721880457.874399:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 340 00000100:00100000:2.0:1721880457.874399:0:15432:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2934 00000100:00100000:2.0:1721880457.874401:0:15432:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800953c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:30425778-2709-4512-9d75-01ec53c4cfad+3694:2007:x1805522257795968:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880457.874403:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800953c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:30425778-2709-4512-9d75-01ec53c4cfad+280:2006:x1805522257796096:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880457.874408:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 341 00000100:00100000:1.0:1721880457.874412:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800953c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:30425778-2709-4512-9d75-01ec53c4cfad+665:2007:x1805522257796224:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880457.874412:0:15432:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800953c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:30425778-2709-4512-9d75-01ec53c4cfad+3694:2007:x1805522257795968:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 10us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880457.874412:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800953c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:30425778-2709-4512-9d75-01ec53c4cfad+4135:2006:x1805522257795840:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 19us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880457.874434:0:15432:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2934 00000100:00100000:3.0:1721880457.874439:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2933 00000100:00100000:0.0:1721880457.874457:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800953c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:30425778-2709-4512-9d75-01ec53c4cfad+280:2006:x1805522257796096:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 52us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880457.874459:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800953c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:30425778-2709-4512-9d75-01ec53c4cfad+665:2007:x1805522257796224:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 45us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880457.874464:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 340 00000100:00100000:1.0:1721880457.874468:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 341 00000100:00100000:1.0:1721880457.960981:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800994e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011867776:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1721880457.961034:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880457.961090:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011867776 00000100:00100000:2.0:1721880457.961097:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011867776 00000100:00100000:2.0:1721880457.961143:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101106 00000100:00100000:2.0:1721880457.961150:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3686:x1805522011867776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1721880457.961180:0:15587:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1435709440 avail 1306247168 00000100:00100000:2.0:1721880457.961231:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3686:x1805522011867776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880457.961236:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101106 00000100:00100000:1.0:1721880457.961276:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800994e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011867776:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1721880458.516936:0:15560:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880459.518908:0:11721:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880460.520911:0:7119:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880460.856946:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011867904:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1721880460.856997:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880460.857041:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011867904 00000100:00100000:2.0:1721880460.857048:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011867904 00000100:00080000:0.0:1721880460.857086:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880430 00000100:00100000:2.0:1721880460.857102:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 596 00000100:00100000:2.0:1721880460.857109:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800994e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3687:x1805522011867904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1721880460.857136:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:2.0:1721880460.857189:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800994e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3687:x1805522011867904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880460.857194:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 596 00000100:00100000:0.0:1721880460.857212:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011867904:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1721880461.256931:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011868032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1721880461.256980:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880461.257047:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011868032 00000100:00100000:0.0:1721880461.257054:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011868032 00000100:00080000:2.0:1721880461.257097:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880431 00000100:00100000:0.0:1721880461.257102:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 597 00000100:00100000:0.0:1721880461.257107:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3688:x1805522011868032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1721880461.257124:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:0.0:1721880461.257167:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3688:x1805522011868032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880461.257172:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 597 00000100:00100000:2.0:1721880461.257184:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011868032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1721880461.352947:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e9c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011868160:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1721880461.352999:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880461.353042:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011868160 00000100:00100000:2.0:1721880461.353050:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011868160 00000100:00100000:2.0:1721880461.353093:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101107 00000100:00100000:2.0:1721880461.353098:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800994ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+19:3689:x1805522011868160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1721880461.353124:0:15587:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1437519872 avail 1308057600 00000100:00100000:2.0:1721880461.353175:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800994ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+19:3689:x1805522011868160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880461.353176:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e9c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011868160:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1721880461.353179:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101107 00000100:00100000:0.0:1721880461.448940:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3687:1805522011868416:0@lo:400:kworker.0 00000100:00100000:2.0:1721880461.448940:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0603f996-9d5e-4498-85ba-9976a06b304f:3686:1805522011868288:0@lo:400:kworker.0 00000100:00100000:3.0:1721880461.448946:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3688:1805522011868544:0@lo:400:kworker.0 00000100:00100000:2.0:1721880461.449004:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880461.449004:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880461.449010:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011868672:0@lo:400:kworker.0 00000100:00100000:2.0:1721880461.449034:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3686:1805522011868800:0@lo:400:kworker.0 00000100:00100000:3.0:1721880461.449037:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011869056:0@lo:400:kworker.0 00000100:00100000:0.0:1721880461.449045:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880461.449047:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011868544 00000100:00100000:2.0:1721880461.449047:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880461.449054:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011868544 00000100:00100000:2.0:1721880461.449062:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3686:1805522011869312:0@lo:400:kworker.0 00000100:00100000:3.0:1721880461.449069:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880461.449071:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3689:1805522011869184:0@lo:400:kworker.0 00000100:00100000:2.0:1721880461.449071:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880461.449082:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1721880461.449085:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011869568:0@lo:400:kworker.0 00000100:00100000:2.0:1721880461.449086:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011869440:0@lo:400:kworker.0 00000100:00100000:1.0:1721880461.449088:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011868800 00000100:00100000:0.0:1721880461.449091:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880461.449091:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011868800 00000100:00100000:2.0:1721880461.449097:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880461.449105:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880461.449108:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011869312 00000100:00100000:1.0:1721880461.449110:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011869312 00000100:00100000:2.0:1721880461.449121:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011868288 00000100:00100000:1.0:1721880461.449122:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011869184 00000100:00100000:2.0:1721880461.449123:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011868288 00000100:00100000:1.0:1721880461.449124:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011869184 00000100:00100000:0.0:1721880461.449125:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011869056 00000100:00100000:0.0:1721880461.449129:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011869056 00000100:00100000:1.0:1721880461.449136:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2935 00000100:00100000:3.0:1721880461.449140:0:15415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2936 00000100:00100000:1.0:1721880461.449141:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3688:x1805522011868544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880461.449144:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 590 00000100:00100000:3.0:1721880461.449145:0:15415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3686:x1805522011868800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880461.449147:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3686:x1805522011868288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880461.449152:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011869440 00000100:00100000:0.0:1721880461.449155:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011869440 00000100:00100000:0.0:1721880461.449169:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011869568 00000100:00100000:0.0:1721880461.449171:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011869568 00000100:00100000:2.0:1721880461.449180:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3686:x1805522011868288:12345-0@lo:400:kworker.0 Request processed in 31us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880461.449184:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 590 00000100:00100000:3.0:1721880461.449184:0:15415:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3686:x1805522011868800:12345-0@lo:400:kworker.0 Request processed in 39us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880461.449185:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1721880461.449188:0:7129:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3688:x1805522011868544:12345-0@lo:400:kworker.0 Request processed in 47us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880461.449189:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011869056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880461.449189:0:15415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2936 00000100:00100000:1.0:1721880461.449192:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2935 00000100:00100000:2.0:1721880461.449208:0:15431:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2937 00000100:00100000:2.0:1721880461.449210:0:15431:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001-lwp-OST0001_UUID+5:3686:x1805522011869312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880461.449211:0:15415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2938 00000100:00100000:3.0:1721880461.449215:0:15415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800994ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3689:x1805522011869184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880461.449220:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011869056:12345-0@lo:400:kworker.0 Request processed in 30us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880461.449226:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1721880461.449229:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1721880461.449230:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011869440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880461.449233:0:15431:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001-lwp-OST0001_UUID+5:3686:x1805522011869312:12345-0@lo:400:kworker.0 Request processed in 21us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880461.449238:0:15431:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2937 00000100:00100000:3.0:1721880461.449242:0:15415:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800994ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3689:x1805522011869184:12345-0@lo:400:kworker.0 Request processed in 27us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880461.449249:0:15415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2938 00000100:00100000:0.0:1721880461.449250:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1721880461.449253:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011869440:12345-0@lo:400:kworker.0 Request processed in 22us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880461.449254:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3688:x1805522011869568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880461.449258:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1721880461.449261:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011868672 00000100:00100000:2.0:1721880461.449264:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011868672 00000100:00080000:1.0:1721880461.449273:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880431 00000100:00100000:0.0:1721880461.449276:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3688:x1805522011869568:12345-0@lo:400:kworker.0 Request processed in 21us (171us total) trans 0 rc 0/0 00000100:00080000:1.0:1721880461.449276:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880431 00000100:00080000:1.0:1721880461.449278:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880431 00000100:00080000:1.0:1721880461.449280:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880431 00000100:00100000:0.0:1721880461.449282:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1721880461.449287:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101108 00000100:00100000:2.0:1721880461.449291:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800994e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3689:x1805522011868672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880461.449299:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880461.449305:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011869568:0@lo:400:kworker.0 00000100:00100000:0.0:1721880461.449315:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3687:1805522011868928:0@lo:400:kworker.0 00000100:00100000:1.0:1721880461.449315:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3688:1805522011868544:0@lo:400:kworker.0 00000100:00100000:3.0:1721880461.449322:0:15434:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011868416 00000100:00100000:1.0:1721880461.449323:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011869056:0@lo:400:kworker.0 00000100:00100000:3.0:1721880461.449324:0:15434:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011868416 00000100:00100000:2.0:1721880461.449325:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800994e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3689:x1805522011868672:12345-0@lo:400:kworker.0 Request processed in 33us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880461.449331:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101108 00000100:00100000:0.0:1721880461.449334:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880461.449341:0:15434:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011868928 00000100:00100000:3.0:1721880461.449343:0:15434:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011868928 00000100:00100000:2.0:1721880461.449374:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011869440:0@lo:400:kworker.0 00000100:00080000:1.0:1721880461.449375:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880431 00000100:00100000:2.0:1721880461.449383:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3686:1805522011869312:0@lo:400:kworker.0 00000100:00100000:1.0:1721880461.449385:0:15477:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2939 00000100:00100000:0.0:1721880461.449387:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011868672:0@lo:400:kworker.0 00000100:00100000:2.0:1721880461.449388:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0603f996-9d5e-4498-85ba-9976a06b304f:3686:1805522011868288:0@lo:400:kworker.0 00000100:00100000:1.0:1721880461.449390:0:15477:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800994e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-lwp-MDT0000_UUID+5:3687:x1805522011868416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880461.449392:0:15434:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2940 00000100:00100000:2.0:1721880461.449393:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3686:1805522011868800:0@lo:400:kworker.0 00000100:00100000:3.0:1721880461.449396:0:15434:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800994ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0001-lwp-OST0000_UUID+5:3687:x1805522011868928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880461.449397:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3689:1805522011869184:0@lo:400:kworker.0 00000100:00100000:1.0:1721880461.449419:0:15477:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800994e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-lwp-MDT0000_UUID+5:3687:x1805522011868416:12345-0@lo:400:kworker.0 Request processed in 29us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880461.449419:0:15434:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800994ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0001-lwp-OST0000_UUID+5:3687:x1805522011868928:12345-0@lo:400:kworker.0 Request processed in 22us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880461.449422:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3687:1805522011868416:0@lo:400:kworker.0 00000100:00100000:1.0:1721880461.449424:0:15477:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2939 00000100:00100000:3.0:1721880461.449426:0:15434:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2940 00000100:00100000:0.0:1721880461.449431:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3687:1805522011868928:0@lo:400:kworker.0 00000100:00100000:2.0:1721880461.496881:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1721880461.496894:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099a3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011869824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1721880461.496894:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e9c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011869696:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1721880461.496943:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880461.496975:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880461.496976:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011869824 00000100:00100000:0.0:1721880461.496982:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011869824 00000100:00100000:1.0:1721880461.497011:0:9462:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011869696 00000100:00100000:1.0:1721880461.497016:0:9462:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011869696 00000100:00100000:0.0:1721880461.497019:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 598 00000100:00100000:0.0:1721880461.497026:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011869824:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1721880461.497035:0:9462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 599 00000100:00100000:1.0:1721880461.497039:0:9462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011869696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1721880461.497052:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00002000:00000024:1.0:1721880461.497053:0:9462:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:1.0:1721880461.497104:0:9462:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011869696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880461.497109:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011869824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880461.497111:0:9462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 599 00000100:00100000:0.0:1721880461.497114:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 598 00000100:00100000:2.0:1721880461.497123:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099a3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011869824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1721880461.497127:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e9c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011869696:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1721880461.522942:0:8270:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880462.524915:0:7120:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880462.882164:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880462.882200:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880462.882222:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880462.882232:0:7124:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257796352 00000100:00100000:3.0:1721880462.882241:0:7124:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257796352 00000100:00100000:0.0:1721880462.882242:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880462.882245:0:15416:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257796480 00000100:00100000:2.0:1721880462.882249:0:15416:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257796480 00000100:00100000:0.0:1721880462.882262:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880462.882271:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880462.882281:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880462.882290:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880462.882294:0:15416:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257796608 00000100:00100000:2.0:1721880462.882295:0:15416:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257796608 00000100:00100000:3.0:1721880462.882296:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 591 00000100:00100000:2.0:1721880462.882303:0:15416:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257796992 00000100:00100000:3.0:1721880462.882303:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2007:x1805522257796352:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880462.882305:0:15416:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257796992 00000100:00100000:1.0:1721880462.882307:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257796736 00000100:00100000:1.0:1721880462.882311:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257796736 00000100:00100000:2.0:1721880462.882312:0:15416:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257797120 00000100:00100000:2.0:1721880462.882313:0:15416:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257797120 00000100:00100000:2.0:1721880462.882324:0:15416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2941 00000100:00100000:2.0:1721880462.882328:0:15416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800994eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2007:x1805522257796480:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880462.882353:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257796864 00000100:00100000:1.0:1721880462.882356:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257796864 00000100:00100000:1.0:1721880462.882371:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257797248 00000100:00100000:1.0:1721880462.882373:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257797248 00000100:00100000:3.0:1721880462.882373:0:7124:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2007:x1805522257796352:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 68us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880462.882380:0:15416:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800994eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2007:x1805522257796480:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 51us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880462.882380:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 591 00000100:00100000:2.0:1721880462.882384:0:15416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2941 00000100:00100000:1.0:1721880462.882387:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 345 00000100:00100000:1.0:1721880462.882392:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800994e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2007:x1805522257796736:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880462.882394:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880462.882395:0:15416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2942 00000100:00100000:2.0:1721880462.882398:0:15416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800994eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2007:x1805522257796608:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880462.882409:0:15416:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800994eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2007:x1805522257796608:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 11us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880462.882412:0:15416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2942 00000100:00100000:3.0:1721880462.882415:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257797376 00000100:00100000:3.0:1721880462.882417:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257797376 00000100:00100000:2.0:1721880462.882419:0:15416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2943 00000100:00100000:1.0:1721880462.882421:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800994e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2007:x1805522257796736:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 28us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880462.882422:0:15416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800994e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:30425778-2709-4512-9d75-01ec53c4cfad+4135:2007:x1805522257796992:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880462.882428:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 345 00000100:00100000:2.0:1721880462.882435:0:15416:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800994e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:30425778-2709-4512-9d75-01ec53c4cfad+4135:2007:x1805522257796992:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 12us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880462.882435:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 346 00000100:00100000:2.0:1721880462.882438:0:15416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2943 00000100:00100000:3.0:1721880462.882440:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800994e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2007:x1805522257796864:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880462.882443:0:15416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2944 00000100:00100000:2.0:1721880462.882445:0:15416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800994e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:30425778-2709-4512-9d75-01ec53c4cfad+3694:2007:x1805522257797120:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880462.882448:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 347 00000100:00100000:1.0:1721880462.882452:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800994e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:30425778-2709-4512-9d75-01ec53c4cfad+280:2007:x1805522257797248:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880462.882460:0:15416:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800994e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:30425778-2709-4512-9d75-01ec53c4cfad+3694:2007:x1805522257797120:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 15us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880462.882463:0:15416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2944 00000100:00100000:3.0:1721880462.882466:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800994e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2007:x1805522257796864:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 25us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880462.882472:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 346 00000100:00100000:1.0:1721880462.882476:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800994e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:30425778-2709-4512-9d75-01ec53c4cfad+280:2007:x1805522257797248:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 23us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880462.882482:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 347 00000100:00100000:3.0:1721880462.882486:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 348 00000100:00100000:3.0:1721880462.882490:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800994eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:30425778-2709-4512-9d75-01ec53c4cfad+665:2007:x1805522257797376:12345-192.168.201.24@tcp:400:kworker.0 00000100:00080000:1.0:1721880462.882498:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880432 00000100:00080000:1.0:1721880462.882501:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880432 00000100:00080000:1.0:1721880462.882503:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880432 00000100:00080000:1.0:1721880462.882505:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880432 00000100:00080000:1.0:1721880462.882506:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880432 00000100:00100000:3.0:1721880462.882508:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800994eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:30425778-2709-4512-9d75-01ec53c4cfad+665:2007:x1805522257797376:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 17us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880462.882514:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 348 00000100:00100000:2.0:1721880462.968956:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011869952:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1721880462.969014:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880462.969055:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011869952 00000100:00100000:0.0:1721880462.969062:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011869952 00000100:00100000:0.0:1721880462.969109:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101109 00000100:00100000:0.0:1721880462.969114:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011869952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1721880462.969141:0:15587:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1435709440 avail 1306247168 00000100:00100000:0.0:1721880462.969185:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011869952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880462.969192:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101109 00000100:00100000:2.0:1721880462.969215:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011869952:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1721880463.527005:0:15560:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880464.528923:0:11721:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880465.530949:0:7119:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1721880465.864980:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011870080:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1721880465.865036:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880465.865081:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011870080 00000100:00100000:0.0:1721880465.865087:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011870080 00000100:00080000:1.0:1721880465.865107:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880435 00000100:00100000:0.0:1721880465.865125:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 600 00000100:00100000:0.0:1721880465.865131:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011870080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1721880465.865156:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:0.0:1721880465.865199:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011870080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880465.865203:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 600 00000100:00100000:1.0:1721880465.865227:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011870080:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1721880466.264948:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011870208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1721880466.265006:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880466.265108:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011870208 00000100:00100000:0.0:1721880466.265115:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011870208 00000100:00080000:1.0:1721880466.265154:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880436 00000100:00100000:0.0:1721880466.265170:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 601 00000100:00100000:0.0:1721880466.265178:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011870208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1721880466.265200:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:0.0:1721880466.265252:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011870208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880466.265259:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 601 00000100:00100000:3.0:1721880466.265315:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011870208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1721880466.360936:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800994e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011870336:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1721880466.360991:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880466.361029:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011870336 00000100:00100000:0.0:1721880466.361036:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011870336 00000100:00100000:0.0:1721880466.361071:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101110 00000100:00100000:0.0:1721880466.361076:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+19:3686:x1805522011870336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1721880466.361104:0:15587:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1437519872 avail 1308057600 00000100:00100000:0.0:1721880466.361149:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+19:3686:x1805522011870336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880466.361153:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101110 00000100:00100000:2.0:1721880466.361172:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800994e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011870336:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1721880466.457001:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0603f996-9d5e-4498-85ba-9976a06b304f:3687:1805522011870464:0@lo:400:kworker.0 00000100:00100000:2.0:1721880466.457003:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011870848:0@lo:400:kworker.0 00000100:00100000:0.0:1721880466.457035:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3688:1805522011870592:0@lo:400:kworker.0 00000100:00100000:0.0:1721880466.457081:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880466.457081:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880466.457083:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880466.457104:0:15477:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011870592 00000100:00100000:0.0:1721880466.457112:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3688:1805522011871104:0@lo:400:kworker.0 00000100:00100000:1.0:1721880466.457112:0:15477:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011870592 00000100:00100000:2.0:1721880466.457122:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3686:1805522011871360:0@lo:400:kworker.0 00000100:00100000:3.0:1721880466.457122:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3687:1805522011870976:0@lo:400:kworker.0 00000100:00100000:0.0:1721880466.457124:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880466.457133:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011871616:0@lo:400:kworker.0 00000100:00100000:3.0:1721880466.457142:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880466.457146:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880466.457148:0:15477:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011871104 00000100:00100000:2.0:1721880466.457150:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011870464 00000100:00100000:1.0:1721880466.457151:0:15477:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011871104 00000100:00100000:2.0:1721880466.457152:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011870464 00000100:00100000:3.0:1721880466.457156:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011871488:0@lo:400:kworker.0 00000100:00100000:0.0:1721880466.457159:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1721880466.457162:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3688:1805522011870720:0@lo:400:kworker.0 00000100:00100000:1.0:1721880466.457167:0:15477:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011870976 00000100:00100000:1.0:1721880466.457168:0:15477:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011870976 00000100:00100000:3.0:1721880466.457172:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880466.457179:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 592 00000100:00100000:0.0:1721880466.457182:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011871616 00000100:00100000:1.0:1721880466.457183:0:15477:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011871488 00000100:00100000:2.0:1721880466.457184:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3687:x1805522011870464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880466.457185:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011871616 00000100:00100000:1.0:1721880466.457185:0:15477:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011871488 00000100:00100000:1.0:1721880466.457197:0:15477:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2945 00000100:00100000:1.0:1721880466.457201:0:15477:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800994eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-lwp-MDT0000_UUID+5:3688:x1805522011870592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880466.457205:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1721880466.457205:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2946 00000100:00100000:0.0:1721880466.457208:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800994e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011871616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880466.457211:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800994e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-lwp-OST0000_UUID+5:3688:x1805522011871104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880466.457225:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3687:x1805522011870464:12345-0@lo:400:kworker.0 Request processed in 40us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880466.457230:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 592 00000100:00100000:1.0:1721880466.457236:0:15477:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800994eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-lwp-MDT0000_UUID+5:3688:x1805522011870592:12345-0@lo:400:kworker.0 Request processed in 34us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880466.457240:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800994e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011871616:12345-0@lo:400:kworker.0 Request processed in 31us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880466.457241:0:15477:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2945 00000100:00100000:3.0:1721880466.457243:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800994e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-lwp-OST0000_UUID+5:3688:x1805522011871104:12345-0@lo:400:kworker.0 Request processed in 32us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880466.457244:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1721880466.457249:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2946 00000100:00100000:1.0:1721880466.457259:0:15477:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2947 00000100:00100000:1.0:1721880466.457262:0:15477:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-lwp-OST0000_UUID+5:3687:x1805522011870976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880466.457262:0:15434:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2948 00000100:00100000:2.0:1721880466.457265:0:15434:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011871488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880466.457266:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011870848 00000100:00100000:0.0:1721880466.457268:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011870848 00000100:00100000:0.0:1721880466.457301:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101111 00000100:00100000:0.0:1721880466.457303:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f820a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3686:x1805522011870848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880466.457309:0:15477:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-lwp-OST0000_UUID+5:3687:x1805522011870976:12345-0@lo:400:kworker.0 Request processed in 45us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880466.457309:0:15434:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011871488:12345-0@lo:400:kworker.0 Request processed in 43us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880466.457315:0:15477:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2947 00000100:00100000:2.0:1721880466.457317:0:15434:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2948 00000100:00100000:0.0:1721880466.457326:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f820a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3686:x1805522011870848:12345-0@lo:400:kworker.0 Request processed in 22us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880466.457330:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101111 00000100:00100000:3.0:1721880466.457333:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3687:1805522011870976:0@lo:400:kworker.0 00000100:00080000:1.0:1721880466.457338:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880436 00000100:00100000:2.0:1721880466.457338:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1721880466.457340:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880436 00000100:00080000:1.0:1721880466.457342:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880436 00000100:00100000:3.0:1721880466.457343:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011871488:0@lo:400:kworker.0 00000100:00080000:1.0:1721880466.457344:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880436 00000100:00100000:1.0:1721880466.457350:0:15416:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011871360 00000100:00100000:1.0:1721880466.457354:0:15416:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011871360 00000100:00100000:3.0:1721880466.457357:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0603f996-9d5e-4498-85ba-9976a06b304f:3687:1805522011870464:0@lo:400:kworker.0 00000100:00100000:0.0:1721880466.457364:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880466.457368:0:15416:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011870720 00000100:00100000:1.0:1721880466.457370:0:15416:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011870720 00000100:00100000:2.0:1721880466.457371:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011870848:0@lo:400:kworker.0 00000100:00100000:0.0:1721880466.457373:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011871232:0@lo:400:kworker.0 00000100:00100000:1.0:1721880466.457380:0:15416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2949 00000100:00100000:0.0:1721880466.457392:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880466.457393:0:15416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f821500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3686:x1805522011871360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880466.457398:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011871744:0@lo:400:kworker.0 00000100:00100000:2.0:1721880466.457403:0:15431:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2950 00000100:00100000:0.0:1721880466.457406:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880466.457407:0:15431:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-MDT0001_UUID+5:3688:x1805522011870720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880466.457418:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3688:1805522011870592:0@lo:400:kworker.0 00000100:00100000:1.0:1721880466.457421:0:15416:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f821500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3686:x1805522011871360:12345-0@lo:400:kworker.0 Request processed in 27us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880466.457423:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3688:1805522011871104:0@lo:400:kworker.0 00000100:00100000:1.0:1721880466.457427:0:15416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2949 00000100:00100000:0.0:1721880466.457430:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011871616:0@lo:400:kworker.0 00000100:00100000:2.0:1721880466.457430:0:15431:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-MDT0001_UUID+5:3688:x1805522011870720:12345-0@lo:400:kworker.0 Request processed in 23us (65us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880466.457432:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3686:1805522011871360:0@lo:400:kworker.0 00000100:00100000:2.0:1721880466.457435:0:15431:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2950 00000100:00080000:1.0:1721880466.457437:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880436 00000100:00100000:0.0:1721880466.457443:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3688:1805522011870720:0@lo:400:kworker.0 00000100:00100000:0.0:1721880466.457457:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011871232 00000100:00100000:0.0:1721880466.457459:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011871232 00000100:00100000:0.0:1721880466.457469:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011871744 00000100:00100000:0.0:1721880466.457471:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011871744 00000100:00100000:1.0:1721880466.457481:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00080000:2.0:1721880466.457482:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880436 00000100:00100000:0.0:1721880466.457485:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1721880466.457486:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088414e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011871232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880466.457487:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088414380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+5:3688:x1805522011871744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880466.457505:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088414380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+5:3688:x1805522011871744:12345-0@lo:400:kworker.0 Request processed in 18us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880466.457508:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1721880466.457513:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088414e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011871232:12345-0@lo:400:kworker.0 Request processed in 27us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880466.457518:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1721880466.457519:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011871232:0@lo:400:kworker.0 00000100:00100000:2.0:1721880466.457527:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011871744:0@lo:400:kworker.0 00000100:00100000:0.0:1721880466.504859:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e9c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011871872:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1721880466.504921:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880466.504959:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1721880466.504963:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88011f820e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011872000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1721880466.504975:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880466.504988:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011871872 00000100:00100000:2.0:1721880466.504996:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011871872 00000100:00100000:3.0:1721880466.505020:0:9462:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011872000 00000100:00100000:3.0:1721880466.505024:0:9462:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011872000 00000100:00100000:2.0:1721880466.505043:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 602 00000100:00100000:2.0:1721880466.505050:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088414000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3687:x1805522011871872:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1721880466.505059:0:9462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 603 00000100:00100000:3.0:1721880466.505064:0:9462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088416d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011872000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1721880466.505078:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00002000:00000024:3.0:1721880466.505078:0:9462:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:3.0:1721880466.505124:0:9462:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088416d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011872000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880466.505130:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088414000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3687:x1805522011871872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880466.505130:0:9462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 603 00000100:00100000:0.0:1721880466.505134:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88011f820e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011872000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1721880466.505137:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 602 00000100:00100000:0.0:1721880466.505145:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e9c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011871872:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1721880466.532900:0:8270:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880467.534950:0:7120:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880467.890121:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880467.890154:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880467.890175:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880467.890185:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880467.890198:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880467.890207:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880467.890212:0:7124:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257797504 00000100:00100000:0.0:1721880467.890217:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880467.890221:0:7124:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257797504 00000100:00100000:0.0:1721880467.890225:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880467.890241:0:15415:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257797760 00000100:00100000:1.0:1721880467.890242:0:15432:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257798272 00000100:00100000:1.0:1721880467.890264:0:15432:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257798272 00000100:00100000:2.0:1721880467.890264:0:15415:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257797760 00000100:00100000:3.0:1721880467.890281:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 593 00000100:00100000:3.0:1721880467.890286:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2004:x1805522257797504:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880467.890292:0:15432:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257797632 00000100:00100000:1.0:1721880467.890293:0:15432:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257797632 00000100:00100000:2.0:1721880467.890303:0:15415:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257798144 00000100:00100000:0.0:1721880467.890304:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880467.890306:0:15415:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257798144 00000100:00100000:1.0:1721880467.890312:0:15432:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2951 00000100:00100000:1.0:1721880467.890317:0:15432:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088417100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:30425778-2709-4512-9d75-01ec53c4cfad+3694:2005:x1805522257798272:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880467.890325:0:15415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2952 00000100:00100000:0.0:1721880467.890329:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257798016 00000100:00100000:2.0:1721880467.890330:0:15415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088415180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2005:x1805522257797760:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880467.890332:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257798016 00000100:00100000:3.0:1721880467.890332:0:7124:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2004:x1805522257797504:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 47us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880467.890337:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 593 00000100:00100000:1.0:1721880467.890351:0:15432:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088417100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:30425778-2709-4512-9d75-01ec53c4cfad+3694:2005:x1805522257798272:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 33us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880467.890357:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257798528 00000100:00100000:1.0:1721880467.890357:0:15432:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2951 00000100:00080000:3.0:1721880467.890359:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880437 00000100:00100000:0.0:1721880467.890360:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257798528 00000100:00100000:2.0:1721880467.890361:0:15415:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088415180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2005:x1805522257797760:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 30us (204us total) trans 0 rc 0/0 00000100:00080000:3.0:1721880467.890361:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880437 00000100:00080000:3.0:1721880467.890363:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880437 00000100:00080000:3.0:1721880467.890364:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880437 00000100:00080000:3.0:1721880467.890365:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880437 00000100:00100000:2.0:1721880467.890368:0:15415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2952 00000100:00100000:0.0:1721880467.890373:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257797888 00000100:00100000:0.0:1721880467.890375:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257797888 00000100:00100000:1.0:1721880467.890380:0:15432:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2953 00000100:00100000:3.0:1721880467.890382:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257798400 00000100:00100000:3.0:1721880467.890383:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257798400 00000100:00100000:1.0:1721880467.890384:0:15432:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088416300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2004:x1805522257797632:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880467.890387:0:15415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2954 00000100:00100000:2.0:1721880467.890391:0:15415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088415f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:30425778-2709-4512-9d75-01ec53c4cfad+4135:2004:x1805522257798144:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880467.890394:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 352 00000100:00100000:3.0:1721880467.890398:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 353 00000100:00100000:0.0:1721880467.890400:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088416a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2005:x1805522257798016:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880467.890401:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088417b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:30425778-2709-4512-9d75-01ec53c4cfad+665:2005:x1805522257798528:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880467.890407:0:15432:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088416300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2004:x1805522257797632:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 23us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880467.890412:0:15432:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2953 00000100:00100000:2.0:1721880467.890413:0:15415:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088415f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:30425778-2709-4512-9d75-01ec53c4cfad+4135:2004:x1805522257798144:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 20us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880467.890419:0:15415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2954 00000100:00100000:3.0:1721880467.890419:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088417b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:30425778-2709-4512-9d75-01ec53c4cfad+665:2005:x1805522257798528:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 17us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880467.890425:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088416a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2005:x1805522257798016:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 26us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880467.890425:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 353 00000100:00100000:0.0:1721880467.890429:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 352 00000100:00100000:1.0:1721880467.890433:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 354 00000100:00100000:1.0:1721880467.890436:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088414a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2004:x1805522257797888:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880467.890443:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 355 00000100:00100000:3.0:1721880467.890447:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088417480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:30425778-2709-4512-9d75-01ec53c4cfad+280:2004:x1805522257798400:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880467.890450:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088414a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2004:x1805522257797888:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 13us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880467.890453:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 354 00000100:00100000:3.0:1721880467.890464:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088417480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:30425778-2709-4512-9d75-01ec53c4cfad+280:2004:x1805522257798400:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 16us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880467.890473:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 355 00000100:00080000:3.0:1721880467.890486:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880437 00000100:00100000:0.0:1721880467.976932:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88011f820000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011872128:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1721880467.976982:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880467.977020:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011872128 00000100:00100000:2.0:1721880467.977027:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011872128 00000100:00100000:2.0:1721880467.977064:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101112 00000100:00100000:2.0:1721880467.977068:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088416680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011872128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1721880467.977095:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1435709440 avail 1306247168 00000100:00100000:2.0:1721880467.977142:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088416680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011872128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880467.977143:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88011f820000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011872128:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1721880467.977147:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101112 00010000:00010000:1.0:1721880468.536898:0:15560:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880469.538952:0:11721:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880470.540919:0:7119:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1721880470.872910:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011872256:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1721880470.872971:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880470.873035:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011872256 00000100:00100000:0.0:1721880470.873058:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011872256 00000100:00100000:0.0:1721880470.873105:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 604 00000100:00100000:0.0:1721880470.873110:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f821180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011872256:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1721880470.873113:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880440 00002000:00000024:0.0:1721880470.873133:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:0.0:1721880470.873169:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f821180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011872256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880470.873174:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 604 00000100:00100000:2.0:1721880470.873185:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011872256:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1721880471.273091:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1721880471.273118:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88011f821880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011872384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1721880471.273241:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880471.273301:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011872384 00000100:00100000:0.0:1721880471.273313:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011872384 00000100:00100000:0.0:1721880471.273388:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 605 00000100:00080000:3.0:1721880471.273388:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880441 00000100:00100000:0.0:1721880471.273398:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011872384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1721880471.273425:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:0.0:1721880471.273486:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011872384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880471.273495:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 605 00000100:00100000:1.0:1721880471.273525:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88011f821880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011872384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1721880471.368955:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1721880471.368976:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88011f822680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011872512:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1721880471.369038:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880471.369095:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011872512 00000100:00100000:2.0:1721880471.369103:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011872512 00000100:00100000:2.0:1721880471.369143:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101113 00000100:00100000:2.0:1721880471.369148:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3686:x1805522011872512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1721880471.369178:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1437519872 avail 1308057600 00000100:00100000:2.0:1721880471.369247:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3686:x1805522011872512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880471.369252:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101113 00000100:00100000:0.0:1721880471.369281:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88011f822680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011872512:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1721880471.465006:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011873024:0@lo:400:kworker.0 00000100:00100000:2.0:1721880471.465006:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3689:1805522011872768:0@lo:400:kworker.0 00000100:00100000:0.0:1721880471.465027:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011872640:0@lo:400:kworker.0 00000100:00100000:1.0:1721880471.465081:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880471.465081:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880471.465083:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880471.465123:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3687:1805522011873536:0@lo:400:kworker.0 00000100:00100000:2.0:1721880471.465130:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3689:1805522011873280:0@lo:400:kworker.0 00000100:00100000:0.0:1721880471.465133:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011873152:0@lo:400:kworker.0 00000100:00100000:1.0:1721880471.465139:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880471.465166:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880471.465166:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011872640 00000100:00100000:1.0:1721880471.465172:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1721880471.465173:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011872640 00000100:00100000:0.0:1721880471.465178:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3688:1805522011873664:0@lo:400:kworker.0 00000100:00100000:1.0:1721880471.465178:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3687:1805522011872896:0@lo:400:kworker.0 00000100:00100000:3.0:1721880471.465208:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011872768 00000100:00100000:0.0:1721880471.465216:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880471.465218:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011872768 00000100:00100000:1.0:1721880471.465232:0:15416:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011873536 00000100:00100000:2.0:1721880471.465235:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 594 00000100:00100000:1.0:1721880471.465236:0:15416:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011873536 00000100:00100000:2.0:1721880471.465241:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133037c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011872640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880471.465253:0:15434:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011873152 00000100:00100000:3.0:1721880471.465253:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011873664 00000100:00100000:3.0:1721880471.465255:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011873664 00000100:00100000:0.0:1721880471.465257:0:15434:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011873152 00000100:00100000:1.0:1721880471.465262:0:15416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2955 00000100:00100000:1.0:1721880471.465267:0:15416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f821f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1805522011872768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880471.465274:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2956 00000100:00100000:0.0:1721880471.465279:0:15434:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2957 00000100:00100000:3.0:1721880471.465280:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3687:x1805522011873536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880471.465283:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880133037c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011872640:12345-0@lo:400:kworker.0 Request processed in 41us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880471.465284:0:15434:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0001-lwp-OST0001_UUID+5:3688:x1805522011873664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880471.465289:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 594 00000100:00100000:1.0:1721880471.465299:0:15416:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f821f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1805522011872768:12345-0@lo:400:kworker.0 Request processed in 31us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880471.465304:0:15416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2955 00000100:00100000:0.0:1721880471.465317:0:15434:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0001-lwp-OST0001_UUID+5:3688:x1805522011873664:12345-0@lo:400:kworker.0 Request processed in 32us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880471.465321:0:15416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2958 00000100:00100000:0.0:1721880471.465324:0:15434:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2957 00000100:00100000:1.0:1721880471.465325:0:15416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011873152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880471.465327:0:7129:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3687:x1805522011873536:12345-0@lo:400:kworker.0 Request processed in 47us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880471.465332:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2956 00000100:00100000:2.0:1721880471.465337:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880471.465343:0:15416:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011873152:12345-0@lo:400:kworker.0 Request processed in 18us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880471.465348:0:15416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2958 00000100:00100000:2.0:1721880471.465353:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011873792:0@lo:400:kworker.0 00000100:00100000:3.0:1721880471.465353:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011873280 00000100:00100000:0.0:1721880471.465355:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011872640:0@lo:400:kworker.0 00000100:00100000:3.0:1721880471.465356:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011873280 00000100:00100000:1.0:1721880471.465365:0:15416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2959 00000100:00100000:0.0:1721880471.465366:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011873152:0@lo:400:kworker.0 00000100:00100000:1.0:1721880471.465369:0:15416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f822a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1805522011873280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880471.465373:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3688:1805522011873664:0@lo:400:kworker.0 00000100:00100000:2.0:1721880471.465374:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1721880471.465378:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880441 00000100:00080000:3.0:1721880471.465381:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880441 00000100:00080000:3.0:1721880471.465383:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880441 00000100:00100000:1.0:1721880471.465387:0:15416:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f822a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1805522011873280:12345-0@lo:400:kworker.0 Request processed in 18us (50us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880471.465392:0:15416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2959 00000100:00100000:3.0:1721880471.465397:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011873792 00000100:00100000:3.0:1721880471.465399:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011873792 00000100:00100000:2.0:1721880471.465400:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3689:1805522011872768:0@lo:400:kworker.0 00000100:00100000:1.0:1721880471.465408:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880471.465408:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3689:1805522011873280:0@lo:400:kworker.0 00000100:00100000:0.0:1721880471.465417:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011873024 00000100:00100000:1.0:1721880471.465418:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011873408:0@lo:400:kworker.0 00000100:00100000:0.0:1721880471.465419:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011873024 00000100:00100000:3.0:1721880471.465420:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1721880471.465423:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f821c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011873792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880471.465433:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880471.465437:0:15432:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011872896 00000100:00100000:0.0:1721880471.465439:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101114 00000100:00100000:2.0:1721880471.465439:0:15432:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011872896 00000100:00100000:0.0:1721880471.465442:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011873024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880471.465443:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011873920:0@lo:400:kworker.0 00000100:00100000:3.0:1721880471.465451:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f821c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011873792:12345-0@lo:400:kworker.0 Request processed in 26us (76us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880471.465458:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1721880471.465459:0:15432:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2960 00000100:00100000:1.0:1721880471.465460:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880471.465463:0:15432:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-MDT0001_UUID+5:3687:x1805522011872896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880471.465467:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011873024:12345-0@lo:400:kworker.0 Request processed in 24us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880471.465467:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011873408 00000100:00100000:3.0:1721880471.465469:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011873408 00000100:00100000:0.0:1721880471.465471:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101114 00000100:00100000:1.0:1721880471.465477:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011873024:0@lo:400:kworker.0 00000100:00100000:3.0:1721880471.465480:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011873920 00000100:00100000:3.0:1721880471.465482:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011873920 00000100:00100000:1.0:1721880471.465486:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3687:1805522011873536:0@lo:400:kworker.0 00000100:00100000:2.0:1721880471.465489:0:15432:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-MDT0001_UUID+5:3687:x1805522011872896:12345-0@lo:400:kworker.0 Request processed in 25us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880471.465491:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1721880471.465494:0:15432:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2960 00000100:00100000:0.0:1721880471.465496:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3687:x1805522011873408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880471.465496:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1721880471.465499:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011873920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880471.465503:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3687:1805522011872896:0@lo:400:kworker.0 00000100:00100000:2.0:1721880471.465514:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011873792:0@lo:400:kworker.0 00000100:00100000:0.0:1721880471.465518:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3687:x1805522011873408:12345-0@lo:400:kworker.0 Request processed in 22us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880471.465522:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1721880471.465522:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011873920:12345-0@lo:400:kworker.0 Request processed in 22us (64us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880471.465527:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1721880471.465531:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011873408:0@lo:400:kworker.0 00000100:00100000:1.0:1721880471.465538:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011873920:0@lo:400:kworker.0 00000100:00080000:3.0:1721880471.465538:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880441 00000100:00100000:2.0:1721880471.513034:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1721880471.513042:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1721880471.513054:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88011f823100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011874048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1721880471.513058:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e9c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011874176:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1721880471.513123:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880471.513155:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880471.513181:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011874048 00000100:00100000:0.0:1721880471.513207:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011874048 00000100:00100000:2.0:1721880471.513212:0:9462:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011874176 00000100:00100000:2.0:1721880471.513218:0:9462:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011874176 00000100:00100000:0.0:1721880471.513259:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 606 00000100:00100000:0.0:1721880471.513266:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f823480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011874048:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1721880471.513270:0:9462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 607 00000100:00100000:2.0:1721880471.513277:0:9462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011874176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1721880471.513298:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00002000:00000024:2.0:1721880471.513299:0:9462:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:2.0:1721880471.513356:0:9462:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011874176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880471.513360:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f823480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011874048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880471.513364:0:9462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 607 00000100:00100000:0.0:1721880471.513368:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 606 00000100:00100000:3.0:1721880471.513404:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e9c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011874176:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1721880471.513412:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88011f823100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011874048:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1721880471.542996:0:8270:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880472.545035:0:7120:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880472.898657:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880472.898722:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880472.898794:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880472.898805:0:15431:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257798784 00000100:00100000:1.0:1721880472.898818:0:15431:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257798784 00000100:00100000:3.0:1721880472.898824:0:7124:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257798656 00000100:00100000:0.0:1721880472.898825:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880472.898834:0:7124:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257798656 00000100:00100000:0.0:1721880472.898841:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880472.898867:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880472.898875:0:15431:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257799296 00000100:00100000:1.0:1721880472.898877:0:15431:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257799296 00000100:00100000:0.0:1721880472.898883:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880472.898886:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 595 00000100:00100000:1.0:1721880472.898892:0:15431:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257798912 00000100:00100000:1.0:1721880472.898894:0:15431:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257798912 00000100:00100000:3.0:1721880472.898897:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133037850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2004:x1805522257798656:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880472.898898:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880472.898909:0:15431:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257799424 00000100:00100000:1.0:1721880472.898911:0:15431:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257799424 00000100:00100000:1.0:1721880472.898927:0:15431:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2961 00000100:00100000:0.0:1721880472.898935:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880472.898935:0:15431:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2005:x1805522257798784:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880472.898937:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257799040 00000100:00100000:2.0:1721880472.898946:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257799040 00000100:00100000:0.0:1721880472.898972:0:15432:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2962 00000100:00100000:3.0:1721880472.898978:0:7124:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880133037850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2004:x1805522257798656:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 80us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880472.898980:0:15431:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2005:x1805522257798784:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 46us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880472.898981:0:15432:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:30425778-2709-4512-9d75-01ec53c4cfad+4135:2005:x1805522257799296:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880472.898985:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257799552 00000100:00100000:2.0:1721880472.898987:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257799552 00000100:00100000:1.0:1721880472.898988:0:15431:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2961 00000100:00100000:3.0:1721880472.898990:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 595 00000100:00100000:2.0:1721880472.899003:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257799168 00000100:00100000:2.0:1721880472.899006:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257799168 00000100:00100000:1.0:1721880472.899014:0:15431:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2963 00000100:00100000:1.0:1721880472.899018:0:15431:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2004:x1805522257798912:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880472.899020:0:15432:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:30425778-2709-4512-9d75-01ec53c4cfad+4135:2005:x1805522257799296:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 40us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880472.899027:0:15432:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2962 00000100:00100000:2.0:1721880472.899027:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257799680 00000100:00100000:2.0:1721880472.899030:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257799680 00000100:00080000:3.0:1721880472.899037:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880442 00000100:00100000:1.0:1721880472.899038:0:15431:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2004:x1805522257798912:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 19us (196us total) trans 0 rc 0/0 00000100:00080000:3.0:1721880472.899042:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880442 00000100:00100000:1.0:1721880472.899043:0:15431:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2963 00000100:00080000:3.0:1721880472.899046:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880442 00000100:00080000:3.0:1721880472.899049:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880442 00000100:00100000:0.0:1721880472.899050:0:15432:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2964 00000100:00080000:3.0:1721880472.899052:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880442 00000100:00100000:0.0:1721880472.899055:0:15432:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:30425778-2709-4512-9d75-01ec53c4cfad+3694:2004:x1805522257799424:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880472.899057:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 359 00000100:00100000:2.0:1721880472.899067:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2005:x1805522257799040:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880472.899075:0:15432:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:30425778-2709-4512-9d75-01ec53c4cfad+3694:2004:x1805522257799424:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 19us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880472.899081:0:15432:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2964 00000100:00100000:1.0:1721880472.899081:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 360 00000100:00100000:1.0:1721880472.899086:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092854850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:30425778-2709-4512-9d75-01ec53c4cfad+280:2005:x1805522257799552:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880472.899103:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 361 00000100:00100000:1.0:1721880472.899105:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880092854850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:30425778-2709-4512-9d75-01ec53c4cfad+280:2005:x1805522257799552:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 18us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880472.899111:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2004:x1805522257799168:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880472.899114:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 362 00000100:00100000:0.0:1721880472.899119:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:30425778-2709-4512-9d75-01ec53c4cfad+665:2004:x1805522257799680:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880472.899121:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2005:x1805522257799040:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 54us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880472.899125:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 360 00000100:00100000:2.0:1721880472.899133:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 359 00000100:00100000:0.0:1721880472.899141:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:30425778-2709-4512-9d75-01ec53c4cfad+665:2004:x1805522257799680:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 21us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880472.899147:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 362 00000100:00100000:3.0:1721880472.899149:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2004:x1805522257799168:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 37us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880472.899161:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 361 00000100:00100000:2.0:1721880472.985141:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800995f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011874304:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1721880472.985269:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880472.985350:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011874304 00000100:00100000:0.0:1721880472.985363:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011874304 00000100:00100000:0.0:1721880472.985428:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101115 00000100:00100000:0.0:1721880472.985436:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f821c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3689:x1805522011874304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1721880472.985479:0:15587:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1435709440 avail 1306247168 00000100:00100000:0.0:1721880472.985553:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f821c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3689:x1805522011874304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880472.985561:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101115 00000100:00100000:2.0:1721880472.985611:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800995f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011874304:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1721880473.546957:0:15560:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880474.548918:0:11721:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880475.551113:0:7119:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1721880475.880954:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88011f823100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011874432:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1721880475.881031:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880475.881109:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011874432 00000100:00100000:0.0:1721880475.881150:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011874432 00000100:00080000:3.0:1721880475.881207:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880445 00000100:00100000:0.0:1721880475.881213:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 608 00000100:00100000:0.0:1721880475.881218:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011874432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1721880475.881242:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:0.0:1721880475.881281:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011874432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880475.881288:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 608 00000100:00100000:3.0:1721880475.881302:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88011f823100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011874432:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1721880476.280992:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1721880476.281010:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011874560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1721880476.281061:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880476.281150:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011874560 00000100:00100000:0.0:1721880476.281156:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011874560 00000100:00100000:0.0:1721880476.281198:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 609 00000100:00080000:3.0:1721880476.281198:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880446 00000100:00100000:0.0:1721880476.281202:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011874560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1721880476.281220:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:0.0:1721880476.281257:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011874560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880476.281262:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 609 00000100:00100000:3.0:1721880476.281274:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011874560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1721880476.376990:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88011f822300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011874688:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1721880476.377044:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880476.377079:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011874688 00000100:00100000:0.0:1721880476.377086:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011874688 00000100:00100000:0.0:1721880476.377132:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101116 00000100:00100000:0.0:1721880476.377137:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+19:3688:x1805522011874688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1721880476.377171:0:15587:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1437519872 avail 1308057600 00000100:00100000:0.0:1721880476.377218:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+19:3688:x1805522011874688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880476.377222:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101116 00000100:00100000:1.0:1721880476.377240:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88011f822300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011874688:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1721880476.473021:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1721880476.473044:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011875200:0@lo:400:kworker.0 00000100:00100000:2.0:1721880476.473059:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3687:1805522011875072:0@lo:400:kworker.0 00000100:00100000:3.0:1721880476.473060:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3686:1805522011874944:0@lo:400:kworker.0 00000100:00100000:0.0:1721880476.473140:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880476.473143:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880476.473153:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3689:1805522011875328:0@lo:400:kworker.0 00000100:00100000:1.0:1721880476.473179:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011875200 00000100:00100000:0.0:1721880476.473182:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011874816:0@lo:400:kworker.0 00000100:00100000:1.0:1721880476.473189:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011875200 00000100:00100000:2.0:1721880476.473191:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011875584:0@lo:400:kworker.0 00000100:00100000:3.0:1721880476.473193:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880476.473218:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880476.473230:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880476.473231:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3689:1805522011875840:0@lo:400:kworker.0 00000100:00100000:0.0:1721880476.473239:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3688:1805522011875712:0@lo:400:kworker.0 00000100:00100000:1.0:1721880476.473241:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101117 00000100:00100000:2.0:1721880476.473243:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011876096:0@lo:400:kworker.0 00000100:00100000:1.0:1721880476.473250:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011875200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880476.473258:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880476.473261:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880476.473273:0:15432:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011875072 00000100:00100000:0.0:1721880476.473277:0:15432:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011875072 00000100:00100000:2.0:1721880476.473278:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1721880476.473283:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3687:1805522011875456:0@lo:400:kworker.0 00000100:00100000:2.0:1721880476.473299:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880476.473306:0:15432:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011875328 00000100:00100000:3.0:1721880476.473306:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011874816 00000100:00100000:0.0:1721880476.473308:0:15432:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011875328 00000100:00100000:3.0:1721880476.473312:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011874816 00000100:00100000:2.0:1721880476.473318:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011875968:0@lo:400:kworker.0 00000100:00100000:1.0:1721880476.473321:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011875200:12345-0@lo:400:kworker.0 Request processed in 70us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880476.473324:0:15432:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011875840 00000100:00100000:0.0:1721880476.473326:0:15432:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011875840 00000100:00100000:1.0:1721880476.473331:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101117 00000100:00100000:2.0:1721880476.473331:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880476.473336:0:15432:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011875456 00000100:00100000:0.0:1721880476.473338:0:15432:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011875456 00000100:00100000:3.0:1721880476.473348:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 596 00000100:00100000:0.0:1721880476.473350:0:15432:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2965 00000100:00100000:0.0:1721880476.473355:0:15432:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f820380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-MDT0001_UUID+5:3687:x1805522011875072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880476.473356:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133037450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011874816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880476.473359:0:15416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2966 00000100:00100000:2.0:1721880476.473365:0:15416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3689:x1805522011875328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880476.473375:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2967 00000100:00100000:1.0:1721880476.473382:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-lwp-OST0001_UUID+5:3689:x1805522011875840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880476.473394:0:15432:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f820380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-MDT0001_UUID+5:3687:x1805522011875072:12345-0@lo:400:kworker.0 Request processed in 39us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880476.473400:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880133037450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011874816:12345-0@lo:400:kworker.0 Request processed in 44us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880476.473401:0:15432:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2965 00000100:00100000:2.0:1721880476.473403:0:15416:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3689:x1805522011875328:12345-0@lo:400:kworker.0 Request processed in 38us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880476.473409:0:15416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2966 00000100:00100000:3.0:1721880476.473409:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 596 00000100:00100000:0.0:1721880476.473420:0:15432:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2968 00000100:00100000:1.0:1721880476.473421:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-lwp-OST0001_UUID+5:3689:x1805522011875840:12345-0@lo:400:kworker.0 Request processed in 37us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880476.473424:0:15432:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f820700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001-lwp-OST0000_UUID+5:3687:x1805522011875456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880476.473430:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2967 00000100:00100000:2.0:1721880476.473439:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011875584 00000100:00100000:2.0:1721880476.473443:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011875584 00000100:00100000:0.0:1721880476.473444:0:15432:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f820700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001-lwp-OST0000_UUID+5:3687:x1805522011875456:12345-0@lo:400:kworker.0 Request processed in 19us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880476.473449:0:15432:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2968 00000100:00080000:3.0:1721880476.473452:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880446 00000100:00080000:3.0:1721880476.473458:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880446 00000100:00080000:3.0:1721880476.473460:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880446 00000100:00100000:0.0:1721880476.473465:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011876096 00000100:00100000:0.0:1721880476.473468:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011876096 00000100:00100000:2.0:1721880476.473474:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011875968 00000100:00100000:2.0:1721880476.473476:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011875968 00000100:00100000:3.0:1721880476.473484:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1721880476.473489:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1721880476.473491:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f823800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0001-mdtlov_UUID+5:3687:x1805522011875584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880476.473493:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f822d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011876096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880476.473497:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1721880476.473504:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f822300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0001-mdtlov_UUID+5:3687:x1805522011875968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880476.473513:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f822d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011876096:12345-0@lo:400:kworker.0 Request processed in 19us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880476.473518:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1721880476.473533:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3689:1805522011875328:0@lo:400:kworker.0 00000100:00100000:3.0:1721880476.473533:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f823800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0001-mdtlov_UUID+5:3687:x1805522011875584:12345-0@lo:400:kworker.0 Request processed in 42us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880476.473537:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880476.473540:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1721880476.473542:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3689:1805522011875840:0@lo:400:kworker.0 00000100:00100000:1.0:1721880476.473547:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f822300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0001-mdtlov_UUID+5:3687:x1805522011875968:12345-0@lo:400:kworker.0 Request processed in 42us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880476.473555:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1721880476.473557:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011875200:0@lo:400:kworker.0 00000100:00100000:0.0:1721880476.473565:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011874816:0@lo:400:kworker.0 00000100:00080000:3.0:1721880476.473566:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880446 00000100:00100000:2.0:1721880476.473570:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3687:1805522011875456:0@lo:400:kworker.0 00000100:00100000:2.0:1721880476.473578:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011875968:0@lo:400:kworker.0 00000100:00100000:3.0:1721880476.473579:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880476.473582:0:15434:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011875712 00000100:00100000:2.0:1721880476.473585:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011875584:0@lo:400:kworker.0 00000100:00100000:1.0:1721880476.473587:0:15434:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011875712 00000100:00100000:2.0:1721880476.473592:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011876096:0@lo:400:kworker.0 00000100:00100000:2.0:1721880476.473599:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3687:1805522011875072:0@lo:400:kworker.0 00000100:00080000:3.0:1721880476.473610:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880446 00000100:00100000:1.0:1721880476.473614:0:15434:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011874944 00000100:00100000:1.0:1721880476.473617:0:15434:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011874944 00000100:00100000:0.0:1721880476.473628:0:15432:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2969 00000100:00100000:0.0:1721880476.473636:0:15432:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-OST0001_UUID+5:3688:x1805522011875712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880476.473642:0:15434:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2970 00000100:00100000:1.0:1721880476.473647:0:15434:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009713b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0000-lwp-MDT0000_UUID+5:3686:x1805522011874944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880476.473682:0:15432:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-OST0001_UUID+5:3688:x1805522011875712:12345-0@lo:400:kworker.0 Request processed in 45us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880476.473687:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3688:1805522011875712:0@lo:400:kworker.0 00000100:00100000:0.0:1721880476.473690:0:15432:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2969 00000100:00100000:1.0:1721880476.473703:0:15434:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009713b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0000-lwp-MDT0000_UUID+5:3686:x1805522011874944:12345-0@lo:400:kworker.0 Request processed in 53us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880476.473712:0:15434:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2970 00000100:00100000:3.0:1721880476.473802:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3686:1805522011874944:0@lo:400:kworker.0 00000100:00100000:0.0:1721880476.520999:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009713aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011876352:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1721880476.521061:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880476.521146:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1721880476.521155:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88011f823100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011876224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1721880476.521158:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011876352 00000100:00100000:2.0:1721880476.521170:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011876352 00000100:00100000:0.0:1721880476.521176:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880476.521234:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011876224 00000100:00100000:2.0:1721880476.521238:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011876224 00000100:00100000:2.0:1721880476.521276:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 610 00000100:00100000:2.0:1721880476.521287:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011876352:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1721880476.521290:0:9462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 611 00000100:00100000:3.0:1721880476.521300:0:9462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011876224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1721880476.521338:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00002000:00000024:3.0:1721880476.521341:0:9462:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:3.0:1721880476.521423:0:9462:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011876224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880476.521436:0:9462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 611 00000100:00100000:2.0:1721880476.521446:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011876352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 157us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880476.521457:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 610 00000100:00100000:0.0:1721880476.521466:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88011f823100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011876224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1721880476.521480:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009713aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011876352:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1721880476.552903:0:8270:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880477.555009:0:7120:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880477.906574:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880477.906637:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880477.906666:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880477.906688:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880477.906706:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880477.906771:0:15431:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257800064 00000100:00100000:3.0:1721880477.906773:0:7124:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257799808 00000100:00100000:0.0:1721880477.906781:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880477.906784:0:15431:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257800064 00000100:00100000:3.0:1721880477.906784:0:7124:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257799808 00000100:00100000:0.0:1721880477.906803:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880477.906820:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880477.906835:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257800320 00000100:00100000:3.0:1721880477.906840:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 597 00000100:00100000:1.0:1721880477.906842:0:15431:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257799936 00000100:00100000:2.0:1721880477.906844:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257800320 00000100:00100000:1.0:1721880477.906845:0:15431:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257799936 00000100:00100000:3.0:1721880477.906849:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133037050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2004:x1805522257799808:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880477.906856:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880477.906863:0:15431:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257800576 00000100:00100000:1.0:1721880477.906865:0:15431:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257800576 00000100:00100000:1.0:1721880477.906878:0:15431:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257800448 00000100:00100000:1.0:1721880477.906881:0:15431:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257800448 00000100:00100000:2.0:1721880477.906885:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257800192 00000100:00100000:2.0:1721880477.906888:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257800192 00000100:00100000:0.0:1721880477.906894:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257800832 00000100:00100000:0.0:1721880477.906899:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257800832 00000100:00100000:1.0:1721880477.906900:0:15431:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2971 00000100:00100000:2.0:1721880477.906906:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257800704 00000100:00100000:1.0:1721880477.906907:0:15431:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2005:x1805522257800064:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880477.906908:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257800704 00000100:00100000:3.0:1721880477.906920:0:7124:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880133037050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2004:x1805522257799808:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 72us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880477.906928:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 597 00000100:00100000:2.0:1721880477.906929:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 366 00000100:00100000:0.0:1721880477.906936:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 367 00000100:00100000:2.0:1721880477.906937:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2005:x1805522257800320:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880477.906943:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2004:x1805522257800192:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880477.906956:0:15431:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2005:x1805522257800064:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 48us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880477.906963:0:15431:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2971 00000100:00080000:3.0:1721880477.906965:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880447 00000100:00080000:3.0:1721880477.906969:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880447 00000100:00080000:3.0:1721880477.906972:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880447 00000100:00080000:3.0:1721880477.906975:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880447 00000100:00080000:3.0:1721880477.906977:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880447 00000100:00100000:2.0:1721880477.906983:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2005:x1805522257800320:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 46us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880477.906987:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2004:x1805522257800192:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 43us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880477.906989:0:15431:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2972 00000100:00100000:2.0:1721880477.906991:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 366 00000100:00100000:1.0:1721880477.906994:0:15431:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2004:x1805522257799936:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880477.906997:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 367 00000100:00100000:3.0:1721880477.906997:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2973 00000100:00100000:3.0:1721880477.907002:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30425778-2709-4512-9d75-01ec53c4cfad+3694:2005:x1805522257800576:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880477.907012:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 368 00000100:00100000:1.0:1721880477.907014:0:15431:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2004:x1805522257799936:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 19us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880477.907017:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 369 00000100:00100000:2.0:1721880477.907018:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087bbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:30425778-2709-4512-9d75-01ec53c4cfad+280:2004:x1805522257800704:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880477.907021:0:15431:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2972 00000100:00100000:0.0:1721880477.907022:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087bbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:30425778-2709-4512-9d75-01ec53c4cfad+665:2005:x1805522257800832:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880477.907029:0:7129:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30425778-2709-4512-9d75-01ec53c4cfad+3694:2005:x1805522257800576:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 27us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880477.907032:0:15431:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2974 00000100:00100000:1.0:1721880477.907036:0:15431:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087bbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:30425778-2709-4512-9d75-01ec53c4cfad+4135:2004:x1805522257800448:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880477.907036:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2973 00000100:00100000:2.0:1721880477.907039:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087bbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:30425778-2709-4512-9d75-01ec53c4cfad+280:2004:x1805522257800704:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 21us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880477.907043:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087bbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:30425778-2709-4512-9d75-01ec53c4cfad+665:2005:x1805522257800832:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 20us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880477.907046:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 368 00000100:00100000:0.0:1721880477.907050:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 369 00000100:00100000:1.0:1721880477.907052:0:15431:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087bbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:30425778-2709-4512-9d75-01ec53c4cfad+4135:2004:x1805522257800448:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 15us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880477.907058:0:15431:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2974 00000100:00100000:0.0:1721880477.993108:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1721880477.993135:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88011f822680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011876480:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1721880477.993209:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880477.993351:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011876480 00000100:00100000:1.0:1721880477.993363:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011876480 00000100:00100000:1.0:1721880477.993431:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101118 00000100:00100000:1.0:1721880477.993439:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087bbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011876480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1721880477.993479:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1435709440 avail 1306247168 00000100:00100000:1.0:1721880477.993552:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087bbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011876480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880477.993561:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101118 00000100:00100000:0.0:1721880477.993590:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88011f822680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011876480:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1721880478.556937:0:15560:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880479.558945:0:11721:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880480.560940:0:7119:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1721880480.888962:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1721880480.888983:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88011f821880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011876608:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1721880480.889082:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880480.889130:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011876608 00000100:00100000:2.0:1721880480.889138:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011876608 00000100:00080000:3.0:1721880480.889159:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880450 00000100:00100000:2.0:1721880480.889185:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 612 00000100:00100000:2.0:1721880480.889192:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009713a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011876608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1721880480.889222:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:2.0:1721880480.889285:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009713a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011876608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880480.889293:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 612 00000100:00100000:3.0:1721880480.889326:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88011f821880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011876608:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1721880481.288964:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880097139f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011876736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1721880481.289018:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880481.289142:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011876736 00000100:00100000:2.0:1721880481.289149:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011876736 00000100:00100000:2.0:1721880481.289201:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 613 00000100:00100000:2.0:1721880481.289213:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087bbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3688:x1805522011876736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1721880481.289234:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00080000:3.0:1721880481.289238:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880451 00000100:00100000:2.0:1721880481.289287:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087bbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3688:x1805522011876736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880481.289291:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880097139f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011876736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1721880481.289295:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 613 00000100:00100000:2.0:1721880481.385009:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011876864:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1721880481.385090:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880481.385140:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011876864 00000100:00100000:1.0:1721880481.385148:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011876864 00000100:00100000:1.0:1721880481.385190:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101119 00000100:00100000:1.0:1721880481.385195:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f820000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3689:x1805522011876864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1721880481.385226:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1437519872 avail 1308057600 00000100:00100000:1.0:1721880481.385277:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f820000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3689:x1805522011876864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880481.385285:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101119 00000100:00100000:2.0:1721880481.385291:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011876864:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1721880481.480936:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0603f996-9d5e-4498-85ba-9976a06b304f:3686:1805522011876992:0@lo:400:kworker.0 00000100:00100000:0.0:1721880481.480939:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3687:1805522011877120:0@lo:400:kworker.0 00000100:00100000:1.0:1721880481.480942:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3688:1805522011877248:0@lo:400:kworker.0 00000100:00100000:2.0:1721880481.480945:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011877376:0@lo:400:kworker.0 00000100:00100000:1.0:1721880481.481003:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880481.481003:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880481.481004:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880481.481060:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880481.481185:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011877760:0@lo:400:kworker.0 00000100:00100000:3.0:1721880481.481188:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3686:1805522011877504:0@lo:400:kworker.0 00000100:00100000:2.0:1721880481.481189:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3689:1805522011877888:0@lo:400:kworker.0 00000100:00100000:0.0:1721880481.481208:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3687:1805522011877632:0@lo:400:kworker.0 00000100:00100000:3.0:1721880481.481217:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880481.481218:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880481.481228:0:15415:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011877248 00000100:00100000:0.0:1721880481.481233:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880481.481233:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3686:1805522011878016:0@lo:400:kworker.0 00000100:00100000:1.0:1721880481.481234:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011878272:0@lo:400:kworker.0 00000100:00100000:2.0:1721880481.481235:0:15415:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011877248 00000100:00100000:0.0:1721880481.481249:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011878144:0@lo:400:kworker.0 00000100:00100000:3.0:1721880481.481250:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880481.481253:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880481.481268:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880481.481273:0:15415:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011877120 00000100:00100000:2.0:1721880481.481276:0:15415:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011877120 00000100:00100000:3.0:1721880481.481283:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011876992 00000100:00100000:1.0:1721880481.481285:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011877504 00000100:00100000:3.0:1721880481.481287:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011876992 00000100:00100000:1.0:1721880481.481289:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011877504 00000100:00100000:2.0:1721880481.481289:0:15415:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011877632 00000100:00100000:2.0:1721880481.481292:0:15415:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011877632 00000100:00100000:0.0:1721880481.481298:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011877760 00000100:00100000:0.0:1721880481.481302:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011877760 00000100:00100000:2.0:1721880481.481305:0:15415:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011878016 00000100:00100000:2.0:1721880481.481307:0:15415:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011878016 00000100:00100000:1.0:1721880481.481314:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2975 00000100:00100000:3.0:1721880481.481314:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 598 00000100:00100000:1.0:1721880481.481318:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-MDT0001_UUID+5:3688:x1805522011877248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880481.481319:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133036c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3686:x1805522011876992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880481.481324:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011878272 00000100:00100000:0.0:1721880481.481326:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011878272 00000100:00100000:2.0:1721880481.481326:0:15415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2976 00000100:00100000:2.0:1721880481.481331:0:15415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087bbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3687:x1805522011877120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880481.481339:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011878144 00000100:00100000:0.0:1721880481.481341:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011878144 00000100:00100000:3.0:1721880481.481352:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880133036c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3686:x1805522011876992:12345-0@lo:400:kworker.0 Request processed in 34us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880481.481353:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-MDT0001_UUID+5:3688:x1805522011877248:12345-0@lo:400:kworker.0 Request processed in 35us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880481.481354:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1721880481.481357:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2975 00000100:00100000:3.0:1721880481.481357:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 598 00000100:00100000:0.0:1721880481.481359:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011877760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880481.481370:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2977 00000100:00100000:1.0:1721880481.481372:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087bbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-lwp-OST0000_UUID+5:3687:x1805522011877632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880481.481373:0:15415:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087bbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3687:x1805522011877120:12345-0@lo:400:kworker.0 Request processed in 40us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880481.481379:0:15415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2976 00000100:00100000:3.0:1721880481.481382:0:15416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2978 00000100:00100000:3.0:1721880481.481384:0:15416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009713bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3686:x1805522011877504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880481.481389:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087bbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-lwp-OST0000_UUID+5:3687:x1805522011877632:12345-0@lo:400:kworker.0 Request processed in 16us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880481.481392:0:15415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2979 00000100:00100000:1.0:1721880481.481395:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2977 00000100:00100000:2.0:1721880481.481396:0:15415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097139880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3686:x1805522011878016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880481.481400:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011877760:12345-0@lo:400:kworker.0 Request processed in 41us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880481.481406:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1721880481.481408:0:15416:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009713bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3686:x1805522011877504:12345-0@lo:400:kworker.0 Request processed in 23us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880481.481411:0:15416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2978 00000100:00100000:1.0:1721880481.481412:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1721880481.481415:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3688:x1805522011878272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880481.481423:0:15415:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880097139880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3686:x1805522011878016:12345-0@lo:400:kworker.0 Request processed in 26us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880481.481425:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1721880481.481428:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3688:x1805522011878272:12345-0@lo:400:kworker.0 Request processed in 13us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880481.481430:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087bbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3687:x1805522011878144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880481.481430:0:15415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2979 00000100:00080000:3.0:1721880481.481433:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880451 00000100:00100000:1.0:1721880481.481434:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00080000:3.0:1721880481.481435:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880451 00000100:00080000:3.0:1721880481.481436:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880451 00000100:00080000:3.0:1721880481.481437:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880451 00000100:00100000:3.0:1721880481.481453:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0603f996-9d5e-4498-85ba-9976a06b304f:3686:1805522011876992:0@lo:400:kworker.0 00000100:00100000:0.0:1721880481.481462:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087bbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3687:x1805522011878144:12345-0@lo:400:kworker.0 Request processed in 32us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880481.481464:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3686:1805522011877504:0@lo:400:kworker.0 00000100:00100000:2.0:1721880481.481466:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3687:1805522011877120:0@lo:400:kworker.0 00000100:00100000:0.0:1721880481.481467:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1721880481.481469:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3686:1805522011878016:0@lo:400:kworker.0 00000100:00100000:1.0:1721880481.481470:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3688:1805522011877248:0@lo:400:kworker.0 00000100:00100000:2.0:1721880481.481476:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3687:1805522011877632:0@lo:400:kworker.0 00000100:00100000:1.0:1721880481.481479:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011877760:0@lo:400:kworker.0 00000100:00100000:2.0:1721880481.481484:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011878144:0@lo:400:kworker.0 00000100:00100000:1.0:1721880481.481486:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011878272:0@lo:400:kworker.0 00000100:00100000:0.0:1721880481.481496:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011877376 00000100:00100000:0.0:1721880481.481499:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011877376 00000100:00100000:2.0:1721880481.481505:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880481.481530:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101120 00000100:00100000:1.0:1721880481.481532:0:11334:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011877888 00000100:00100000:0.0:1721880481.481535:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f820e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3689:x1805522011877376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880481.481535:0:11334:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011877888 00000100:00080000:2.0:1721880481.481551:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880451 00000100:00100000:1.0:1721880481.481556:0:11334:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2980 00000100:00100000:1.0:1721880481.481560:0:11334:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f821880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3689:x1805522011877888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880481.481568:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f820e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3689:x1805522011877376:12345-0@lo:400:kworker.0 Request processed in 32us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880481.481574:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101120 00000100:00100000:3.0:1721880481.481581:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011877376:0@lo:400:kworker.0 00000100:00100000:1.0:1721880481.481590:0:11334:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f821880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3689:x1805522011877888:12345-0@lo:400:kworker.0 Request processed in 29us (84us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880481.481592:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3689:1805522011877888:0@lo:400:kworker.0 00000100:00100000:1.0:1721880481.481595:0:11334:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2980 00000100:00100000:2.0:1721880481.528953:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1721880481.528966:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009713ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011878400:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1721880481.528975:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88011f822680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011878528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1721880481.529040:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880481.529064:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011878528 00000100:00100000:0.0:1721880481.529070:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011878528 00000100:00100000:1.0:1721880481.529085:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880481.529101:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011878400 00000100:00100000:0.0:1721880481.529103:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011878400 00000100:00100000:2.0:1721880481.529111:0:9462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 614 00000100:00100000:2.0:1721880481.529119:0:9462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f823100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011878528:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1721880481.529127:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 615 00000100:00100000:0.0:1721880481.529131:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011878400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1721880481.529150:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00002000:00000024:2.0:1721880481.529150:0:9462:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:0.0:1721880481.529187:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011878400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880481.529193:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 615 00000100:00100000:2.0:1721880481.529199:0:9462:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f823100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011878528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880481.529206:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009713ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011878400:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1721880481.529208:0:9462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 614 00000100:00100000:3.0:1721880481.529229:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88011f822680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011878528:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1721880481.562914:0:8270:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880482.564927:0:7120:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880482.914420:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880482.914460:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880482.914480:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880482.914497:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880482.914508:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880482.914518:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880482.914523:0:7124:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257800960 00000100:00100000:3.0:1721880482.914534:0:7124:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257800960 00000100:00100000:0.0:1721880482.914537:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880482.914554:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880482.914561:0:11334:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257801088 00000100:00100000:1.0:1721880482.914568:0:11334:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257801088 00000100:00100000:0.0:1721880482.914583:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880482.914588:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 599 00000100:00100000:3.0:1721880482.914597:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133036850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2004:x1805522257800960:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880482.914607:0:11334:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257801600 00000100:00100000:2.0:1721880482.914607:0:15477:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257801216 00000100:00100000:0.0:1721880482.914609:0:15432:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257801728 00000100:00100000:1.0:1721880482.914610:0:11334:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257801600 00000100:00100000:2.0:1721880482.914611:0:15477:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257801216 00000100:00100000:0.0:1721880482.914613:0:15432:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257801728 00000100:00100000:1.0:1721880482.914630:0:11334:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2981 00000100:00100000:1.0:1721880482.914637:0:11334:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2005:x1805522257801088:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880482.914640:0:15477:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2982 00000100:00100000:2.0:1721880482.914645:0:15477:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087bbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:30425778-2709-4512-9d75-01ec53c4cfad+4135:2005:x1805522257801600:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880482.914646:0:15432:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2983 00000100:00100000:0.0:1721880482.914650:0:15432:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087bbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2004:x1805522257801216:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880482.914658:0:7124:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880133036850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2004:x1805522257800960:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 62us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880482.914670:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 599 00000100:00100000:1.0:1721880482.914677:0:11334:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2005:x1805522257801088:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 39us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880482.914679:0:15477:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087bbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:30425778-2709-4512-9d75-01ec53c4cfad+4135:2005:x1805522257801600:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 33us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880482.914681:0:15432:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087bbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2004:x1805522257801216:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 31us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880482.914684:0:11334:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2981 00000100:00100000:2.0:1721880482.914688:0:15477:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2982 00000100:00100000:0.0:1721880482.914691:0:15432:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2983 00000100:00100000:0.0:1721880482.914707:0:15432:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2984 00000100:00100000:0.0:1721880482.914710:0:15432:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087bbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:30425778-2709-4512-9d75-01ec53c4cfad+3694:2004:x1805522257801728:12345-192.168.201.24@tcp:400:kworker.0 00000100:00080000:2.0:1721880482.914718:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880452 00000100:00100000:0.0:1721880482.914722:0:15432:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087bbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:30425778-2709-4512-9d75-01ec53c4cfad+3694:2004:x1805522257801728:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 11us (185us total) trans 0 rc 0/0 00000100:00080000:2.0:1721880482.914722:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880452 00000100:00080000:2.0:1721880482.914724:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880452 00000100:00100000:0.0:1721880482.914726:0:15432:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2984 00000100:00100000:2.0:1721880482.914769:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257801344 00000100:00100000:1.0:1721880482.914772:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257801472 00000100:00100000:2.0:1721880482.914773:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257801344 00000100:00100000:1.0:1721880482.914776:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257801472 00000100:00100000:2.0:1721880482.914800:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257801856 00000100:00100000:2.0:1721880482.914803:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257801856 00000100:00100000:1.0:1721880482.914807:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257801984 00000100:00100000:1.0:1721880482.914810:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257801984 00000100:00100000:0.0:1721880482.914811:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 373 00000100:00100000:0.0:1721880482.914815:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2005:x1805522257801344:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880482.914822:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 374 00000100:00100000:1.0:1721880482.914828:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 375 00000100:00100000:2.0:1721880482.914829:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087bbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2004:x1805522257801472:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880482.914833:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2005:x1805522257801344:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 18us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880482.914834:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087bbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:30425778-2709-4512-9d75-01ec53c4cfad+280:2005:x1805522257801856:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880482.914837:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 373 00000100:00100000:0.0:1721880482.914848:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 376 00000100:00100000:0.0:1721880482.914851:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:30425778-2709-4512-9d75-01ec53c4cfad+665:2004:x1805522257801984:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880482.914867:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:30425778-2709-4512-9d75-01ec53c4cfad+665:2004:x1805522257801984:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 14us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880482.914868:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087bbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:30425778-2709-4512-9d75-01ec53c4cfad+280:2005:x1805522257801856:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 33us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880482.914870:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087bbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2004:x1805522257801472:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 41us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880482.914875:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 375 00000100:00100000:0.0:1721880482.914879:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 376 00000100:00100000:2.0:1721880482.914882:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 374 00000100:00080000:2.0:1721880482.914906:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880452 00000100:00080000:2.0:1721880482.914909:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880452 00000100:00100000:3.0:1721880483.000938:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880125986a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011878656:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1721880483.000988:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880483.001043:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011878656 00000100:00100000:0.0:1721880483.001051:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011878656 00000100:00100000:0.0:1721880483.001098:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101121 00000100:00100000:0.0:1721880483.001105:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097139c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011878656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1721880483.001133:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1435709440 avail 1306247168 00000100:00100000:0.0:1721880483.001186:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880097139c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011878656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880483.001193:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101121 00000100:00100000:3.0:1721880483.001203:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880125986a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011878656:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1721880483.566965:0:15560:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880484.568937:0:11721:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880485.570994:0:7119:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880485.897037:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1721880485.897060:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880097138380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011878784:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1721880485.897124:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880485.897186:0:9462:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011878784 00000100:00100000:2.0:1721880485.897195:0:9462:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011878784 00000100:00080000:0.0:1721880485.897240:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880455 00000100:00100000:2.0:1721880485.897257:0:9462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 616 00000100:00100000:2.0:1721880485.897264:0:9462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880125984380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011878784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1721880485.897300:0:9462:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:2.0:1721880485.897365:0:9462:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880125984380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011878784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880485.897371:0:9462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 616 00000100:00100000:0.0:1721880485.897417:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880097138380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011878784:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1721880486.297031:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880125985180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011878912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1721880486.297103:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880486.297173:0:9462:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011878912 00000100:00100000:0.0:1721880486.297183:0:9462:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011878912 00000100:00080000:2.0:1721880486.297238:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880456 00000100:00100000:0.0:1721880486.297258:0:9462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 617 00000100:00100000:0.0:1721880486.297267:0:9462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f822680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011878912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1721880486.297295:0:9462:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:0.0:1721880486.297370:0:9462:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f822680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011878912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880486.297380:0:9462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 617 00000100:00100000:2.0:1721880486.297395:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880125985180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011878912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1721880486.393025:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800959a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011879040:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1721880486.393091:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880486.393175:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011879040 00000100:00100000:0.0:1721880486.393183:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011879040 00000100:00100000:0.0:1721880486.393245:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101122 00000100:00100000:0.0:1721880486.393251:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3686:x1805522011879040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1721880486.393296:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1437519872 avail 1308057600 00000100:00100000:0.0:1721880486.393359:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3686:x1805522011879040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880486.393365:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101122 00000100:00100000:1.0:1721880486.393389:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800959a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011879040:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1721880486.489006:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3688:1805522011879296:0@lo:400:kworker.0 00000100:00100000:3.0:1721880486.489006:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0603f996-9d5e-4498-85ba-9976a06b304f:3687:1805522011879168:0@lo:400:kworker.0 00000100:00100000:2.0:1721880486.489030:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3689:1805522011879424:0@lo:400:kworker.0 00000100:00100000:0.0:1721880486.489071:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880486.489081:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880486.489094:0:15434:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011879296 00000100:00100000:2.0:1721880486.489099:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880486.489102:0:15434:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011879296 00000100:00100000:0.0:1721880486.489104:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3688:1805522011879808:0@lo:400:kworker.0 00000100:00100000:3.0:1721880486.489112:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3687:1805522011879680:0@lo:400:kworker.0 00000100:00100000:0.0:1721880486.489120:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880486.489128:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011880320:0@lo:400:kworker.0 00000100:00100000:2.0:1721880486.489130:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011879936:0@lo:400:kworker.0 00000100:00100000:1.0:1721880486.489138:0:15434:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011879424 00000100:00100000:1.0:1721880486.489140:0:15434:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011879424 00000100:00100000:3.0:1721880486.489141:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880486.489142:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880486.489154:0:15434:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011879808 00000100:00100000:1.0:1721880486.489155:0:15434:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011879808 00000100:00100000:0.0:1721880486.489157:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1721880486.489157:0:15432:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011879680 00000100:00100000:0.0:1721880486.489160:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011880448:0@lo:400:kworker.0 00000100:00100000:2.0:1721880486.489161:0:15432:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011879680 00000100:00100000:3.0:1721880486.489161:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011880192:0@lo:400:kworker.0 00000100:00100000:0.0:1721880486.489171:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880486.489173:0:15434:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2985 00000100:00100000:1.0:1721880486.489178:0:15434:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880125986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0000-lwp-MDT0000_UUID+5:3688:x1805522011879296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880486.489178:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880486.489188:0:15432:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011880192 00000100:00100000:0.0:1721880486.489190:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011880320 00000100:00100000:2.0:1721880486.489190:0:15432:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011880192 00000100:00100000:0.0:1721880486.489192:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011880320 00000100:00100000:3.0:1721880486.489200:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1721880486.489205:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011879552:0@lo:400:kworker.0 00000100:00100000:2.0:1721880486.489206:0:15432:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2986 00000100:00100000:0.0:1721880486.489210:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011880448 00000100:00100000:0.0:1721880486.489211:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011880448 00000100:00100000:2.0:1721880486.489211:0:15432:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-MDT0001_UUID+5:3689:x1805522011879424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880486.489221:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1721880486.489223:0:15434:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880125986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0000-lwp-MDT0000_UUID+5:3688:x1805522011879296:12345-0@lo:400:kworker.0 Request processed in 45us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880486.489224:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880125984a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011880320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880486.489224:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880486.489227:0:15434:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2985 00000100:00100000:3.0:1721880486.489245:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3687:1805522011880064:0@lo:400:kworker.0 00000100:00100000:1.0:1721880486.489246:0:15434:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2987 00000100:00100000:1.0:1721880486.489248:0:15434:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880125985500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0001-lwp-OST0000_UUID+5:3688:x1805522011879808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880486.489253:0:15432:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-MDT0001_UUID+5:3689:x1805522011879424:12345-0@lo:400:kworker.0 Request processed in 41us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880486.489254:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880125984a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011880320:12345-0@lo:400:kworker.0 Request processed in 30us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880486.489258:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1721880486.489259:0:15432:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2986 00000100:00100000:1.0:1721880486.489263:0:15434:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880125985500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0001-lwp-OST0000_UUID+5:3688:x1805522011879808:12345-0@lo:400:kworker.0 Request processed in 15us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880486.489265:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880486.489267:0:15434:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2987 00000100:00100000:0.0:1721880486.489271:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1721880486.489272:0:15434:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011880064 00000100:00100000:1.0:1721880486.489273:0:15434:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011880064 00000100:00100000:0.0:1721880486.489274:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880125987100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+5:3688:x1805522011880448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880486.489276:0:15432:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2988 00000100:00100000:2.0:1721880486.489280:0:15432:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009713b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-OST0000_UUID+5:3687:x1805522011879680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880486.489283:0:15434:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2989 00000100:00100000:1.0:1721880486.489286:0:15434:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097139180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011880192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880486.489287:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880125987100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+5:3688:x1805522011880448:12345-0@lo:400:kworker.0 Request processed in 11us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880486.489290:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1721880486.489296:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011879168 00000100:00100000:3.0:1721880486.489299:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011879168 00000100:00100000:0.0:1721880486.489305:0:15420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2990 00000100:00100000:1.0:1721880486.489305:0:15434:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880097139180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011880192:12345-0@lo:400:kworker.0 Request processed in 19us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880486.489308:0:15420:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097138700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-OST0001_UUID+5:3687:x1805522011880064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880486.489308:0:15434:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2989 00000100:00100000:2.0:1721880486.489308:0:15432:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009713b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-OST0000_UUID+5:3687:x1805522011879680:12345-0@lo:400:kworker.0 Request processed in 27us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880486.489313:0:15432:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2988 00000100:00100000:0.0:1721880486.489333:0:15420:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880097138700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-OST0001_UUID+5:3687:x1805522011880064:12345-0@lo:400:kworker.0 Request processed in 24us (68us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880486.489336:0:15420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2990 00000100:00100000:3.0:1721880486.489340:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 600 00000100:00080000:2.0:1721880486.489345:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880456 00000100:00100000:3.0:1721880486.489345:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133036450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3687:x1805522011879168:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1721880486.489348:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880456 00000100:00080000:2.0:1721880486.489350:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880456 00000100:00080000:2.0:1721880486.489351:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880456 00000100:00100000:2.0:1721880486.489357:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880486.489361:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011880448:0@lo:400:kworker.0 00000100:00100000:0.0:1721880486.489366:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3688:1805522011879808:0@lo:400:kworker.0 00000100:00100000:3.0:1721880486.489368:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880133036450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3687:x1805522011879168:12345-0@lo:400:kworker.0 Request processed in 23us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880486.489371:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011880320:0@lo:400:kworker.0 00000100:00100000:3.0:1721880486.489372:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 600 00000100:00100000:1.0:1721880486.489374:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011879552 00000100:00100000:0.0:1721880486.489376:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3688:1805522011879296:0@lo:400:kworker.0 00000100:00100000:1.0:1721880486.489376:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011879552 00000100:00100000:2.0:1721880486.489378:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3689:1805522011879424:0@lo:400:kworker.0 00000100:00100000:1.0:1721880486.489391:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101123 00000100:00100000:1.0:1721880486.489393:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009713b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011879552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880486.489400:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011879936 00000100:00100000:2.0:1721880486.489401:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011879936 00000100:00100000:1.0:1721880486.489413:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009713b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011879552:12345-0@lo:400:kworker.0 Request processed in 19us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880486.489413:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1721880486.489413:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3687:1805522011880064:0@lo:400:kworker.0 00000100:00100000:1.0:1721880486.489416:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101123 00000100:00100000:2.0:1721880486.489416:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011879936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880486.489421:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3687:1805522011879680:0@lo:400:kworker.0 00000100:00100000:3.0:1721880486.489426:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011880192:0@lo:400:kworker.0 00000100:00100000:3.0:1721880486.489430:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0603f996-9d5e-4498-85ba-9976a06b304f:3687:1805522011879168:0@lo:400:kworker.0 00000100:00100000:2.0:1721880486.489445:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011879936:12345-0@lo:400:kworker.0 Request processed in 28us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880486.489449:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1721880486.489453:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011879552:0@lo:400:kworker.0 00000100:00100000:0.0:1721880486.489462:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011879936:0@lo:400:kworker.0 00000100:00100000:0.0:1721880486.537004:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011880576:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1721880486.537004:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880097138e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011880704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1721880486.537075:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880486.537112:0:9462:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011880704 00000100:00100000:0.0:1721880486.537119:0:9462:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011880704 00000100:00100000:1.0:1721880486.537147:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880486.537157:0:9462:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011880576 00000100:00100000:0.0:1721880486.537159:0:9462:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011880576 00000100:00100000:0.0:1721880486.537173:0:9462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 618 00000100:00100000:0.0:1721880486.537179:0:9462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011880704:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1721880486.537180:0:10429:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 619 00000100:00100000:2.0:1721880486.537187:0:10429:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011880576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1721880486.537210:0:9462:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00002000:00000024:2.0:1721880486.537210:0:10429:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:0.0:1721880486.537277:0:9462:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011880704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880486.537281:0:10429:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880085a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011880576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880486.537283:0:9462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 618 00000100:00100000:2.0:1721880486.537287:0:10429:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 619 00000100:00100000:1.0:1721880486.537298:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011880576:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1721880486.537336:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880097138e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011880704:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1721880486.572956:0:8270:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880487.574959:0:7120:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880487.922079:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880487.922109:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880487.922124:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880487.922130:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257802112 00000100:00100000:0.0:1721880487.922136:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880487.922139:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257802112 00000100:00100000:0.0:1721880487.922145:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880487.922153:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880487.922164:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880487.922173:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880487.922178:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 601 00000100:00100000:2.0:1721880487.922179:0:15416:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257802368 00000100:00100000:3.0:1721880487.922182:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133036050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4976b229-99ef-4953-87e9-78e1b901883f+12:2004:x1805522257802112:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880487.922184:0:15416:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257802368 00000100:00100000:1.0:1721880487.922193:0:7130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257802240 00000100:00100000:1.0:1721880487.922198:0:7130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257802240 00000100:00100000:2.0:1721880487.922211:0:15416:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257802752 00000100:00100000:2.0:1721880487.922212:0:15416:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257802752 00000100:00100000:2.0:1721880487.922223:0:15416:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257802880 00000100:00100000:2.0:1721880487.922224:0:15416:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257802880 00000100:00100000:1.0:1721880487.922225:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2991 00000100:00100000:3.0:1721880487.922226:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880133036050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4976b229-99ef-4953-87e9-78e1b901883f+12:2004:x1805522257802112:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 44us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880487.922229:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880487.922230:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 601 00000100:00100000:1.0:1721880487.922231:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880125987800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2005:x1805522257802368:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880487.922235:0:15416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2992 00000100:00100000:2.0:1721880487.922239:0:15416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880125986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2004:x1805522257802240:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880487.922255:0:15415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2993 00000100:00100000:3.0:1721880487.922258:0:15415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880125985c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:30425778-2709-4512-9d75-01ec53c4cfad+4135:2004:x1805522257802752:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880487.922264:0:7130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880125987800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2005:x1805522257802368:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 33us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880487.922267:0:15416:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880125986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2004:x1805522257802240:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 28us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880487.922270:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2991 00000100:00100000:3.0:1721880487.922271:0:15415:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880125985c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:30425778-2709-4512-9d75-01ec53c4cfad+4135:2004:x1805522257802752:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 13us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880487.922273:0:15416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2992 00000100:00100000:3.0:1721880487.922275:0:15415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2993 00000100:00100000:3.0:1721880487.922286:0:15415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 2994 00000100:00100000:3.0:1721880487.922289:0:15415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880125985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:30425778-2709-4512-9d75-01ec53c4cfad+3694:2005:x1805522257802880:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880487.922298:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257802496 00000100:00100000:2.0:1721880487.922299:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257802496 00000100:00100000:3.0:1721880487.922299:0:15415:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880125985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:30425778-2709-4512-9d75-01ec53c4cfad+3694:2005:x1805522257802880:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 9us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880487.922302:0:15415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 2994 00000100:00080000:3.0:1721880487.922310:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880457 00000100:00080000:3.0:1721880487.922313:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880457 00000100:00100000:2.0:1721880487.922314:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257802624 00000100:00080000:3.0:1721880487.922314:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880457 00000100:00080000:3.0:1721880487.922315:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880457 00000100:00100000:2.0:1721880487.922316:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257802624 00000100:00100000:0.0:1721880487.922318:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257803008 00000100:00100000:1.0:1721880487.922321:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257803136 00000100:00100000:0.0:1721880487.922322:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257803008 00000100:00100000:1.0:1721880487.922323:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257803136 00000100:00100000:2.0:1721880487.922335:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 380 00000100:00100000:2.0:1721880487.922337:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880125986680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2004:x1805522257802496:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880487.922338:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 381 00000100:00100000:3.0:1721880487.922341:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880125984700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2005:x1805522257802624:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880487.922352:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 382 00000100:00100000:2.0:1721880487.922355:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880125986680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2004:x1805522257802496:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 16us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880487.922357:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 383 00000100:00100000:0.0:1721880487.922358:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880125985f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:30425778-2709-4512-9d75-01ec53c4cfad+280:2004:x1805522257803008:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880487.922360:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 380 00000100:00100000:3.0:1721880487.922360:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880125984700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2005:x1805522257802624:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 12us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880487.922361:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880125987b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:30425778-2709-4512-9d75-01ec53c4cfad+665:2004:x1805522257803136:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880487.922364:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 381 00000100:00100000:0.0:1721880487.922384:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880125985f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:30425778-2709-4512-9d75-01ec53c4cfad+280:2004:x1805522257803008:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 26us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880487.922386:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880125987b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:30425778-2709-4512-9d75-01ec53c4cfad+665:2004:x1805522257803136:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 24us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880487.922390:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 383 00000100:00100000:0.0:1721880487.922393:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 382 00000100:00080000:3.0:1721880487.922421:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880457 00000100:00080000:3.0:1721880487.922423:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880457 00000100:00100000:0.0:1721880488.008982:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880097139500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011880832:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1721880488.009046:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880488.009096:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011880832 00000100:00100000:1.0:1721880488.009104:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011880832 00000100:00100000:1.0:1721880488.009150:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101124 00000100:00100000:1.0:1721880488.009156:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880125984e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011880832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1721880488.009188:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1435709440 avail 1306247168 00000100:00100000:1.0:1721880488.009235:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880125984e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011880832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880488.009241:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101124 00000100:00100000:0.0:1721880488.009255:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880097139500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011880832:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1721880488.576957:0:15560:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880489.579024:0:11721:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880490.581032:0:7119:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1721880490.905082:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880125985180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011880960:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1721880490.905150:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880490.905200:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011880960 00000100:00100000:2.0:1721880490.905208:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011880960 00000100:00100000:2.0:1721880490.905264:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 620 00000100:00100000:2.0:1721880490.905269:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800830a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011880960:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1721880490.905282:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880460 00002000:00000024:2.0:1721880490.905297:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:2.0:1721880490.905362:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800830a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011880960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880490.905368:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 620 00000100:00100000:1.0:1721880490.905393:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880125985180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011880960:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1721880491.305056:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1721880491.305082:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800959a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011881088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1721880491.305172:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880491.305242:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011881088 00000100:00100000:2.0:1721880491.305252:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011881088 00000100:00100000:2.0:1721880491.305318:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 621 00000100:00100000:2.0:1721880491.305326:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880125986a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011881088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1721880491.305352:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00080000:3.0:1721880491.305417:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880461 00000100:00100000:2.0:1721880491.305430:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880125986a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011881088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880491.305440:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 621 00000100:00100000:0.0:1721880491.305449:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800959a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011881088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1721880491.401095:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011881216:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1721880491.401155:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880491.401202:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011881216 00000100:00100000:1.0:1721880491.401210:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011881216 00000100:00100000:1.0:1721880491.401246:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101125 00000100:00100000:1.0:1721880491.401253:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880125984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3687:x1805522011881216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1721880491.401282:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1437519872 avail 1308057600 00000100:00100000:1.0:1721880491.401334:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880125984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3687:x1805522011881216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880491.401340:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101125 00000100:00100000:0.0:1721880491.401366:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011881216:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1721880491.496965:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3689:1805522011881472:0@lo:400:kworker.0 00000100:00100000:2.0:1721880491.496967:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011881344:0@lo:400:kworker.0 00000100:00100000:3.0:1721880491.496975:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3686:1805522011881600:0@lo:400:kworker.0 00000100:00100000:1.0:1721880491.496981:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011881728:0@lo:400:kworker.0 00000100:00100000:0.0:1721880491.497035:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880491.497035:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880491.497035:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880491.497053:0:15431:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011881472 00000100:00100000:3.0:1721880491.497059:0:15431:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011881472 00000100:00100000:1.0:1721880491.497060:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3687:1805522011882240:0@lo:400:kworker.0 00000100:00100000:2.0:1721880491.497068:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011881856:0@lo:400:kworker.0 00000100:00100000:0.0:1721880491.497073:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3689:1805522011881984:0@lo:400:kworker.0 00000100:00100000:1.0:1721880491.497074:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880491.497090:0:15431:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011882240 00000100:00100000:3.0:1721880491.497092:0:15431:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011882240 00000100:00100000:2.0:1721880491.497098:0:15415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2995 00000100:00100000:2.0:1721880491.497103:0:15415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880125985180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1805522011881472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880491.497107:0:15431:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2996 00000100:00100000:0.0:1721880491.497110:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880491.497111:0:15431:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-OST0001_UUID+5:3687:x1805522011882240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880491.497118:0:7124:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011881344 00000100:00100000:1.0:1721880491.497121:0:7124:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011881344 00000100:00100000:0.0:1721880491.497130:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011882496:0@lo:400:kworker.0 00000100:00100000:1.0:1721880491.497140:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 602 00000100:00100000:2.0:1721880491.497140:0:15415:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880125985180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1805522011881472:12345-0@lo:400:kworker.0 Request processed in 37us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880491.497144:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133035c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011881344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880491.497144:0:15415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2995 00000100:00100000:3.0:1721880491.497146:0:15431:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880085a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-OST0001_UUID+5:3687:x1805522011882240:12345-0@lo:400:kworker.0 Request processed in 35us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880491.497150:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880491.497150:0:15431:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2996 00000100:00100000:3.0:1721880491.497158:0:15431:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011881984 00000100:00100000:3.0:1721880491.497160:0:15431:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011881984 00000100:00100000:1.0:1721880491.497167:0:7124:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880133035c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011881344:12345-0@lo:400:kworker.0 Request processed in 22us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880491.497168:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880491.497169:0:15431:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2997 00000100:00100000:1.0:1721880491.497171:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 602 00000100:00100000:3.0:1721880491.497172:0:15431:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1805522011881984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880491.497177:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3689:1805522011881472:0@lo:400:kworker.0 00000100:00100000:2.0:1721880491.497178:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3688:1805522011882368:0@lo:400:kworker.0 00000100:00100000:3.0:1721880491.497188:0:15431:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1805522011881984:12345-0@lo:400:kworker.0 Request processed in 16us (78us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880491.497191:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880491.497192:0:15431:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2997 00000100:00100000:3.0:1721880491.497197:0:15431:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011881856 00000100:00100000:3.0:1721880491.497198:0:15431:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011881856 00000100:00100000:1.0:1721880491.497199:0:11334:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011882368 00000100:00100000:1.0:1721880491.497200:0:11334:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011882368 00000100:00100000:0.0:1721880491.497203:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3689:1805522011881984:0@lo:400:kworker.0 00000100:00100000:2.0:1721880491.497207:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011881344:0@lo:400:kworker.0 00000100:00100000:3.0:1721880491.497208:0:15431:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2998 00000100:00100000:3.0:1721880491.497210:0:15431:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011881856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880491.497216:0:11334:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2999 00000100:00100000:1.0:1721880491.497219:0:11334:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3688:x1805522011882368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880491.497224:0:15431:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011881856:12345-0@lo:400:kworker.0 Request processed in 13us (56us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880491.497227:0:15431:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2998 00000100:00100000:0.0:1721880491.497234:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011882496 00000100:00100000:2.0:1721880491.497234:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011881856:0@lo:400:kworker.0 00000100:00100000:1.0:1721880491.497235:0:11334:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3688:x1805522011882368:12345-0@lo:400:kworker.0 Request processed in 15us (44us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880491.497237:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011882496 00000100:00100000:1.0:1721880491.497239:0:11334:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2999 00000100:00100000:2.0:1721880491.497240:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3688:1805522011882368:0@lo:400:kworker.0 00000100:00080000:3.0:1721880491.497241:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880461 00000100:00080000:3.0:1721880491.497243:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880461 00000100:00080000:3.0:1721880491.497245:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880461 00000100:00080000:3.0:1721880491.497246:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880461 00000100:00100000:3.0:1721880491.497252:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880491.497254:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011881728 00000100:00100000:1.0:1721880491.497256:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011881728 00000100:00100000:3.0:1721880491.497261:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011882112:0@lo:400:kworker.0 00000100:00100000:0.0:1721880491.497264:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1721880491.497268:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011882496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880491.497271:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101126 00000100:00100000:3.0:1721880491.497273:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880491.497274:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011881728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880491.497280:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011882624:0@lo:400:kworker.0 00000100:00100000:2.0:1721880491.497286:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011882112 00000100:00100000:2.0:1721880491.497289:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011882112 00000100:00100000:3.0:1721880491.497291:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880491.497293:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880085a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011881728:12345-0@lo:400:kworker.0 Request processed in 19us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880491.497296:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011882496:12345-0@lo:400:kworker.0 Request processed in 27us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880491.497297:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101126 00000100:00100000:0.0:1721880491.497300:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1721880491.497303:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011882624 00000100:00100000:2.0:1721880491.497304:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011882624 00000100:00100000:3.0:1721880491.497309:0:7130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011881600 00000100:00100000:1.0:1721880491.497310:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1721880491.497311:0:7130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011881600 00000100:00100000:1.0:1721880491.497313:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097138000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011882112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880491.497314:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1721880491.497317:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009713a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011882624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880491.497322:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3000 00000100:00100000:3.0:1721880491.497325:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097138a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3686:x1805522011881600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880491.497329:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880097138000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011882112:12345-0@lo:400:kworker.0 Request processed in 15us (55us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880491.497332:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009713a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011882624:12345-0@lo:400:kworker.0 Request processed in 15us (41us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880491.497332:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1721880491.497336:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1721880491.497340:0:7130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880097138a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3686:x1805522011881600:12345-0@lo:400:kworker.0 Request processed in 15us (88us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880491.497344:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3000 00000100:00100000:0.0:1721880491.497353:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011882496:0@lo:400:kworker.0 00000100:00080000:3.0:1721880491.497353:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880461 00000100:00100000:1.0:1721880491.497355:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011881728:0@lo:400:kworker.0 00000100:00100000:1.0:1721880491.497365:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3687:1805522011882240:0@lo:400:kworker.0 00000100:00100000:3.0:1721880491.497367:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3686:1805522011881600:0@lo:400:kworker.0 00000100:00100000:3.0:1721880491.497374:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011882112:0@lo:400:kworker.0 00000100:00100000:3.0:1721880491.497379:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011882624:0@lo:400:kworker.0 00000100:00100000:0.0:1721880491.544947:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1721880491.544954:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1721880491.544965:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880091bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011882880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1721880491.544965:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011882752:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1721880491.545020:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880491.545045:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880491.545071:0:10429:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011882880 00000100:00100000:2.0:1721880491.545072:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011882752 00000100:00100000:1.0:1721880491.545077:0:10429:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011882880 00000100:00100000:2.0:1721880491.545078:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011882752 00000100:00100000:2.0:1721880491.545127:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 622 00000100:00100000:1.0:1721880491.545132:0:10429:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 623 00000100:00100000:2.0:1721880491.545134:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011882752:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1721880491.545136:0:10429:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011882880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1721880491.545161:0:10429:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00002000:00000024:2.0:1721880491.545161:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:1.0:1721880491.545192:0:10429:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011882880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880491.545196:0:10429:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 623 00000100:00100000:0.0:1721880491.545214:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880091bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011882880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1721880491.545218:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880085a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011882752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880491.545226:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 622 00000100:00100000:1.0:1721880491.545233:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011882752:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1721880491.583105:0:8270:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880492.584971:0:7120:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880492.930269:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880492.930305:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880492.930328:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257803264 00000100:00100000:0.0:1721880492.930330:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880492.930367:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257803264 00000100:00100000:0.0:1721880492.930376:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880492.930389:0:7130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257803392 00000100:00100000:0.0:1721880492.930392:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880492.930398:0:7130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257803392 00000100:00100000:0.0:1721880492.930406:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880492.930409:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 603 00000100:00100000:3.0:1721880492.930413:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133035850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4976b229-99ef-4953-87e9-78e1b901883f+12:2004:x1805522257803264:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880492.930419:0:11334:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257803520 00000100:00100000:0.0:1721880492.930421:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880492.930425:0:11334:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257803520 00000100:00100000:2.0:1721880492.930428:0:7130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257804032 00000100:00100000:2.0:1721880492.930430:0:7130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257804032 00000100:00100000:0.0:1721880492.930438:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880492.930440:0:7130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257803904 00000100:00100000:2.0:1721880492.930442:0:7130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257803904 00000100:00100000:1.0:1721880492.930455:0:11334:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3001 00000100:00100000:1.0:1721880492.930461:0:11334:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2005:x1805522257803392:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880492.930461:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3002 00000100:00100000:3.0:1721880492.930462:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880133035850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4976b229-99ef-4953-87e9-78e1b901883f+12:2004:x1805522257803264:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 48us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880492.930466:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 603 00000100:00100000:2.0:1721880492.930467:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091baf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30425778-2709-4512-9d75-01ec53c4cfad+3694:2004:x1805522257804032:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880492.930483:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00080000:3.0:1721880492.930485:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880462 00000100:00080000:3.0:1721880492.930488:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880462 00000100:00080000:3.0:1721880492.930489:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880462 00000100:00100000:1.0:1721880492.930496:0:11334:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2005:x1805522257803392:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 35us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880492.930498:0:7130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880091baf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30425778-2709-4512-9d75-01ec53c4cfad+3694:2004:x1805522257804032:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 32us (91us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880492.930498:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3003 00000100:00100000:3.0:1721880492.930501:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091baf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2004:x1805522257803520:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880492.930502:0:11334:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3001 00000100:00100000:2.0:1721880492.930512:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3002 00000100:00100000:3.0:1721880492.930515:0:7129:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880091baf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2004:x1805522257803520:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 13us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880492.930518:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3003 00000100:00100000:2.0:1721880492.930525:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3004 00000100:00100000:2.0:1721880492.930528:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091baf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30425778-2709-4512-9d75-01ec53c4cfad+4135:2005:x1805522257803904:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880492.930540:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257803648 00000100:00100000:2.0:1721880492.930542:0:7130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880091baf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30425778-2709-4512-9d75-01ec53c4cfad+4135:2005:x1805522257803904:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 13us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880492.930543:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257803648 00000100:00100000:2.0:1721880492.930546:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3004 00000100:00100000:3.0:1721880492.930554:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257803776 00000100:00100000:3.0:1721880492.930556:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257803776 00000100:00100000:1.0:1721880492.930569:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257804288 00000100:00100000:1.0:1721880492.930571:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257804288 00000100:00100000:3.0:1721880492.930571:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257804160 00000100:00100000:3.0:1721880492.930572:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257804160 00000100:00100000:2.0:1721880492.930579:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 387 00000100:00100000:2.0:1721880492.930584:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2005:x1805522257803648:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880492.930584:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 388 00000100:00100000:3.0:1721880492.930587:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091badc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2004:x1805522257803776:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880492.930592:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 389 00000100:00100000:1.0:1721880492.930596:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:30425778-2709-4512-9d75-01ec53c4cfad+280:2005:x1805522257804160:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880492.930599:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880091badc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2004:x1805522257803776:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 12us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880492.930603:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 388 00000100:00100000:2.0:1721880492.930607:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2005:x1805522257803648:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 22us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880492.930609:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 390 00000100:00100000:3.0:1721880492.930612:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:30425778-2709-4512-9d75-01ec53c4cfad+665:2004:x1805522257804288:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880492.930613:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 387 00000100:00100000:1.0:1721880492.930625:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:30425778-2709-4512-9d75-01ec53c4cfad+280:2005:x1805522257804160:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 27us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880492.930630:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:30425778-2709-4512-9d75-01ec53c4cfad+665:2004:x1805522257804288:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 18us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880492.930631:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 389 00000100:00100000:3.0:1721880492.930634:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 390 00000100:00080000:3.0:1721880492.930642:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880462 00000100:00080000:3.0:1721880492.930643:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880462 00000100:00100000:2.0:1721880493.016967:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880091bafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011883008:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1721880493.017020:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880493.017079:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011883008 00000100:00100000:0.0:1721880493.017085:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011883008 00000100:00100000:0.0:1721880493.017129:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101127 00000100:00100000:0.0:1721880493.017136:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3689:x1805522011883008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1721880493.017172:0:15587:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1435709440 avail 1306247168 00000100:00100000:0.0:1721880493.017232:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3689:x1805522011883008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880493.017237:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101127 00000100:00100000:2.0:1721880493.017276:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880091bafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011883008:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1721880493.587038:0:15560:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880494.589033:0:11721:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880495.591002:0:7119:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1721880495.912891:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011883136:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1721880495.912939:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880495.912996:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011883136 00000100:00100000:0.0:1721880495.913003:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011883136 00000100:00080000:3.0:1721880495.913034:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880465 00000100:00100000:0.0:1721880495.913049:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 624 00000100:00100000:0.0:1721880495.913054:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011883136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1721880495.913078:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:0.0:1721880495.913123:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011883136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880495.913132:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 624 00000100:00100000:2.0:1721880495.913145:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011883136:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1721880496.312969:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880091badf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011883264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1721880496.313022:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880496.313071:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011883264 00000100:00100000:0.0:1721880496.313078:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011883264 00000100:00080000:3.0:1721880496.313096:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880466 00000100:00100000:0.0:1721880496.313125:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 625 00000100:00100000:0.0:1721880496.313130:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009713a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011883264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1721880496.313153:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:0.0:1721880496.313199:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009713a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011883264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880496.313207:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 625 00000100:00100000:3.0:1721880496.313228:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880091badf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011883264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1721880496.408967:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1721880496.408986:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880091bace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011883392:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1721880496.409035:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880496.409072:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011883392 00000100:00100000:0.0:1721880496.409079:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011883392 00000100:00100000:0.0:1721880496.409115:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101128 00000100:00100000:0.0:1721880496.409120:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+19:3689:x1805522011883392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1721880496.409147:0:15587:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1437519872 avail 1308057600 00000100:00100000:0.0:1721880496.409194:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+19:3689:x1805522011883392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880496.409198:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101128 00000100:00100000:2.0:1721880496.409211:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880091bace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011883392:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1721880496.505071:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3686:1805522011883648:0@lo:400:kworker.0 00000100:00100000:3.0:1721880496.505071:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011883904:0@lo:400:kworker.0 00000100:00100000:1.0:1721880496.505100:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0603f996-9d5e-4498-85ba-9976a06b304f:3689:1805522011883520:0@lo:400:kworker.0 00000100:00100000:2.0:1721880496.505140:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880496.505141:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880496.505156:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880496.505178:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3686:1805522011884160:0@lo:400:kworker.0 00000100:00100000:3.0:1721880496.505182:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3688:1805522011884416:0@lo:400:kworker.0 00000100:00100000:1.0:1721880496.505196:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3689:1805522011884032:0@lo:400:kworker.0 00000100:00100000:2.0:1721880496.505201:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880496.505215:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3687:1805522011883776:0@lo:400:kworker.0 00000100:00100000:1.0:1721880496.505225:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880496.505226:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011884672:0@lo:400:kworker.0 00000100:00100000:0.0:1721880496.505230:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011883904 00000100:00100000:0.0:1721880496.505240:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011883904 00000100:00100000:1.0:1721880496.505240:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011884544:0@lo:400:kworker.0 00000100:00100000:3.0:1721880496.505241:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880496.505247:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880496.505258:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880496.505263:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3687:1805522011884288:0@lo:400:kworker.0 00000100:00100000:2.0:1721880496.505281:0:15423:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011883648 00000100:00100000:3.0:1721880496.505282:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880496.505284:0:15423:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011883648 00000100:00100000:0.0:1721880496.505288:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101129 00000100:00100000:1.0:1721880496.505291:0:7124:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011883520 00000100:00100000:1.0:1721880496.505294:0:7124:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011883520 00000100:00100000:0.0:1721880496.505296:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097139500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011883904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880496.505326:0:15423:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011884160 00000100:00100000:2.0:1721880496.505328:0:15423:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011884160 00000100:00100000:1.0:1721880496.505339:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 604 00000100:00100000:2.0:1721880496.505340:0:15423:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011883776 00000100:00100000:3.0:1721880496.505340:0:15420:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011884032 00000100:00100000:2.0:1721880496.505342:0:15423:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011883776 00000100:00100000:1.0:1721880496.505343:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133035450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0603f996-9d5e-4498-85ba-9976a06b304f+23:3689:x1805522011883520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880496.505344:0:15420:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011884032 00000100:00100000:2.0:1721880496.505350:0:15423:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011884288 00000100:00100000:2.0:1721880496.505352:0:15423:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011884288 00000100:00100000:2.0:1721880496.505364:0:15423:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3005 00000100:00100000:2.0:1721880496.505368:0:15423:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:lustre-MDT0000-lwp-MDT0000_UUID+5:3686:x1805522011883648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880496.505372:0:15420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3006 00000100:00100000:3.0:1721880496.505379:0:15420:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-lwp-OST0000_UUID+5:3686:x1805522011884160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880496.505394:0:7124:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880133035450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0603f996-9d5e-4498-85ba-9976a06b304f+23:3689:x1805522011883520:12345-0@lo:400:kworker.0 Request processed in 48us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880496.505395:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880097139500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011883904:12345-0@lo:400:kworker.0 Request processed in 97us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880496.505400:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 604 00000100:00100000:0.0:1721880496.505403:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101129 00000100:00100000:2.0:1721880496.505406:0:15423:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:lustre-MDT0000-lwp-MDT0000_UUID+5:3686:x1805522011883648:12345-0@lo:400:kworker.0 Request processed in 37us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880496.505411:0:15423:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3005 00000100:00100000:3.0:1721880496.505419:0:15420:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-lwp-OST0000_UUID+5:3686:x1805522011884160:12345-0@lo:400:kworker.0 Request processed in 38us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880496.505427:0:15420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3006 00000100:00100000:2.0:1721880496.505437:0:15423:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3007 00000100:00100000:2.0:1721880496.505440:0:15423:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097138e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:lustre-MDT0000-lwp-MDT0001_UUID+5:3687:x1805522011883776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880496.505441:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011884672 00000100:00100000:1.0:1721880496.505442:0:15415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3008 00000100:00100000:0.0:1721880496.505445:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011884672 00000100:00100000:1.0:1721880496.505448:0:15415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097138380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3687:x1805522011884288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880496.505448:0:15420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3009 00000100:00100000:3.0:1721880496.505453:0:15420:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085a4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-OST0000_UUID+5:3689:x1805522011884032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880496.505461:0:15423:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880097138e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:lustre-MDT0000-lwp-MDT0001_UUID+5:3687:x1805522011883776:12345-0@lo:400:kworker.0 Request processed in 20us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880496.505466:0:15423:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3007 00000100:00100000:0.0:1721880496.505472:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011884544 00000100:00100000:0.0:1721880496.505474:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011884544 00000100:00100000:1.0:1721880496.505482:0:15415:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880097138380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3687:x1805522011884288:12345-0@lo:400:kworker.0 Request processed in 34us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880496.505486:0:15420:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880085a4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-OST0000_UUID+5:3689:x1805522011884032:12345-0@lo:400:kworker.0 Request processed in 32us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880496.505487:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1721880496.505489:0:15415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3008 00000100:00100000:2.0:1721880496.505490:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011884672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880496.505492:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1721880496.505493:0:15420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3009 00000100:00100000:0.0:1721880496.505497:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011884544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880496.505508:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011884672:12345-0@lo:400:kworker.0 Request processed in 17us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880496.505512:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00080000:1.0:1721880496.505516:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880466 00000100:00080000:1.0:1721880496.505519:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880466 00000100:00080000:1.0:1721880496.505521:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880466 00000100:00080000:1.0:1721880496.505524:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880466 00000100:00100000:3.0:1721880496.505527:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880496.505533:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880085a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011884544:12345-0@lo:400:kworker.0 Request processed in 35us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880496.505540:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1721880496.505543:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011884672:0@lo:400:kworker.0 00000100:00100000:1.0:1721880496.505544:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0603f996-9d5e-4498-85ba-9976a06b304f:3689:1805522011883520:0@lo:400:kworker.0 00000100:00100000:2.0:1721880496.505555:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3686:1805522011883648:0@lo:400:kworker.0 00000100:00100000:1.0:1721880496.505560:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3689:1805522011884032:0@lo:400:kworker.0 00000100:00100000:3.0:1721880496.505560:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011883904:0@lo:400:kworker.0 00000100:00100000:2.0:1721880496.505563:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3686:1805522011884160:0@lo:400:kworker.0 00000100:00100000:0.0:1721880496.505564:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011884416 00000100:00100000:0.0:1721880496.505568:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011884416 00000100:00100000:1.0:1721880496.505570:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011884544:0@lo:400:kworker.0 00000100:00080000:1.0:1721880496.505592:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880466 00000100:00100000:0.0:1721880496.505595:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3010 00000100:00100000:3.0:1721880496.505597:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3687:1805522011883776:0@lo:400:kworker.0 00000100:00100000:0.0:1721880496.505601:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009713ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-lwp-OST0001_UUID+5:3688:x1805522011884416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880496.505608:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3687:1805522011884288:0@lo:400:kworker.0 00000100:00100000:0.0:1721880496.505637:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009713ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-lwp-OST0001_UUID+5:3688:x1805522011884416:12345-0@lo:400:kworker.0 Request processed in 35us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880496.505643:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3010 00000100:00100000:2.0:1721880496.505645:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3688:1805522011884416:0@lo:400:kworker.0 00000100:00100000:1.0:1721880496.552937:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1721880496.552946:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1721880496.552958:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880091bad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011884928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1721880496.552962:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011884800:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1721880496.553021:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880496.553073:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011884928 00000100:00100000:2.0:1721880496.553073:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880496.553079:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011884928 00000100:00100000:1.0:1721880496.553096:0:10429:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011884800 00000100:00100000:1.0:1721880496.553099:0:10429:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011884800 00000100:00100000:0.0:1721880496.553127:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 626 00000100:00100000:1.0:1721880496.553132:0:10429:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 627 00000100:00100000:0.0:1721880496.553133:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011884928:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1721880496.553135:0:10429:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011884800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1721880496.553156:0:10429:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00002000:00000024:0.0:1721880496.553157:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:1.0:1721880496.553183:0:10429:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011884800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880496.553189:0:10429:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 627 00000100:00100000:0.0:1721880496.553198:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880085a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011884928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880496.553204:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 626 00000100:00100000:2.0:1721880496.553213:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011884800:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1721880496.553220:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880091bad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011884928:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1721880496.592973:0:8270:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880497.595046:0:7120:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880497.938243:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880497.938280:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880497.938297:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880497.938299:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257804416 00000100:00100000:3.0:1721880497.938308:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257804416 00000100:00100000:0.0:1721880497.938315:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880497.938326:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880497.938347:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880497.938354:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257804672 00000100:00100000:0.0:1721880497.938358:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880497.938359:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257804672 00000100:00100000:3.0:1721880497.938361:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 605 00000100:00100000:2.0:1721880497.938364:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257804544 00000100:00100000:3.0:1721880497.938365:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133035050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4976b229-99ef-4953-87e9-78e1b901883f+12:2004:x1805522257804416:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880497.938367:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880497.938370:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257804544 00000100:00100000:1.0:1721880497.938383:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257805184 00000100:00100000:1.0:1721880497.938384:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257805184 00000100:00100000:1.0:1721880497.938399:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257805056 00000100:00100000:1.0:1721880497.938401:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257805056 00000100:00100000:2.0:1721880497.938404:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3011 00000100:00100000:3.0:1721880497.938410:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880133035050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4976b229-99ef-4953-87e9-78e1b901883f+12:2004:x1805522257804416:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 44us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880497.938411:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2005:x1805522257804672:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880497.938414:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3012 00000100:00100000:3.0:1721880497.938415:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 605 00000100:00100000:1.0:1721880497.938418:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2004:x1805522257804544:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880497.938428:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880497.938454:0:15431:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3013 00000100:00100000:2.0:1721880497.938457:0:7129:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2005:x1805522257804672:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 46us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880497.938458:0:15431:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f12e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:30425778-2709-4512-9d75-01ec53c4cfad+3694:2005:x1805522257805184:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880497.938459:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2004:x1805522257804544:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 41us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880497.938462:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3011 00000100:00100000:1.0:1721880497.938465:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3012 00000100:00100000:3.0:1721880497.938472:0:15431:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f12e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:30425778-2709-4512-9d75-01ec53c4cfad+3694:2005:x1805522257805184:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 14us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880497.938476:0:15431:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3013 00000100:00100000:1.0:1721880497.938480:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3014 00000100:00100000:1.0:1721880497.938482:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f12fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:30425778-2709-4512-9d75-01ec53c4cfad+4135:2004:x1805522257805056:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880497.938493:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f12fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:30425778-2709-4512-9d75-01ec53c4cfad+4135:2004:x1805522257805056:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 11us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880497.938496:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257804928 00000100:00100000:1.0:1721880497.938497:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3014 00000100:00100000:2.0:1721880497.938499:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257804928 00000100:00100000:3.0:1721880497.938506:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257804800 00000100:00100000:3.0:1721880497.938508:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257804800 00000100:00100000:1.0:1721880497.938512:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257805440 00000100:00100000:1.0:1721880497.938513:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257805440 00000100:00100000:2.0:1721880497.938515:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257805312 00000100:00100000:2.0:1721880497.938516:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257805312 00000100:00100000:3.0:1721880497.938522:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 393 00000100:00100000:3.0:1721880497.938524:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091badf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2005:x1805522257804928:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880497.938526:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 394 00000100:00100000:1.0:1721880497.938529:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2004:x1805522257804800:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880497.938529:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 395 00000100:00100000:2.0:1721880497.938532:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f12f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:30425778-2709-4512-9d75-01ec53c4cfad+665:2005:x1805522257805440:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880497.938549:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2004:x1805522257804800:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 19us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880497.938550:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f12f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:30425778-2709-4512-9d75-01ec53c4cfad+665:2005:x1805522257805440:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 17us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880497.938550:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880091badf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2005:x1805522257804928:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 24us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880497.938553:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 396 00000100:00100000:1.0:1721880497.938557:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 394 00000100:00100000:0.0:1721880497.938560:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f12d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:30425778-2709-4512-9d75-01ec53c4cfad+280:2004:x1805522257805312:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880497.938560:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 393 00000100:00100000:2.0:1721880497.938564:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 395 00000100:00080000:1.0:1721880497.938566:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880467 00000100:00080000:1.0:1721880497.938568:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880467 00000100:00080000:1.0:1721880497.938569:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880467 00000100:00080000:1.0:1721880497.938570:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880467 00000100:00080000:1.0:1721880497.938572:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880467 00000100:00100000:0.0:1721880497.938588:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f12d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:30425778-2709-4512-9d75-01ec53c4cfad+280:2004:x1805522257805312:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 28us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880497.938595:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 396 00000100:00100000:3.0:1721880498.024994:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1721880498.025015:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e9c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011885056:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1721880498.025071:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880498.025141:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011885056 00000100:00100000:0.0:1721880498.025149:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011885056 00000100:00100000:0.0:1721880498.025192:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101130 00000100:00100000:0.0:1721880498.025198:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097139f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011885056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1721880498.025233:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1435709440 avail 1306247168 00000100:00100000:0.0:1721880498.025292:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880097139f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011885056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880498.025300:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101130 00000100:00100000:3.0:1721880498.025326:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e9c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011885056:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1721880498.596915:0:15560:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880499.599004:0:11721:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880500.601084:0:7119:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880500.921022:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e9c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011885184:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1721880500.921103:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880500.921195:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011885184 00000100:00100000:2.0:1721880500.921210:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011885184 00000100:00080000:1.0:1721880500.921283:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880470 00000100:00100000:2.0:1721880500.921293:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 628 00000100:00100000:2.0:1721880500.921303:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f12c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011885184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1721880500.921347:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:2.0:1721880500.921458:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f12c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011885184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 155us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880500.921467:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 628 00000100:00100000:0.0:1721880500.921482:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e9c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011885184:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1721880501.321180:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009f12e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011885312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1721880501.321290:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880501.321443:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011885312 00000100:00100000:2.0:1721880501.321455:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011885312 00000100:00100000:2.0:1721880501.321529:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 629 00000100:00100000:2.0:1721880501.321537:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009713aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011885312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1721880501.321570:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00080000:1.0:1721880501.321573:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880471 00000100:00100000:2.0:1721880501.321639:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009713aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011885312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880501.321646:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 629 00000100:00100000:3.0:1721880501.321682:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009f12e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011885312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1721880501.417112:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1721880501.417147:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e9c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011885440:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1721880501.417233:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880501.417407:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011885440 00000100:00100000:0.0:1721880501.417418:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011885440 00000100:00100000:0.0:1721880501.417487:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101131 00000100:00100000:0.0:1721880501.417495:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085a4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3689:x1805522011885440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1721880501.417543:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1437519872 avail 1308057600 00000100:00100000:0.0:1721880501.417614:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880085a4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3689:x1805522011885440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880501.417622:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101131 00000100:00100000:1.0:1721880501.417672:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e9c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011885440:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1721880501.513054:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3687:1805522011885824:0@lo:400:kworker.0 00000100:00100000:3.0:1721880501.513058:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011885952:0@lo:400:kworker.0 00000100:00100000:2.0:1721880501.513062:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0603f996-9d5e-4498-85ba-9976a06b304f:3689:1805522011885568:0@lo:400:kworker.0 00000100:00100000:0.0:1721880501.513079:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3686:1805522011885696:0@lo:400:kworker.0 00000100:00100000:1.0:1721880501.513136:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880501.513173:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880501.513176:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3687:1805522011886336:0@lo:400:kworker.0 00000100:00100000:3.0:1721880501.513181:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880501.513204:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880501.513221:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3686:1805522011886208:0@lo:400:kworker.0 00000100:00100000:1.0:1721880501.513224:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880501.513229:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3688:1805522011886464:0@lo:400:kworker.0 00000100:00100000:2.0:1721880501.513266:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3689:1805522011886080:0@lo:400:kworker.0 00000100:00100000:0.0:1721880501.513271:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880501.513293:0:15434:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011885824 00000100:00100000:0.0:1721880501.513296:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011886720:0@lo:400:kworker.0 00000100:00100000:1.0:1721880501.513301:0:15434:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011885824 00000100:00100000:3.0:1721880501.513302:0:15415:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011885696 00000100:00100000:2.0:1721880501.513309:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880501.513310:0:15415:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011885696 00000100:00100000:0.0:1721880501.513318:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880501.513338:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011886592:0@lo:400:kworker.0 00000100:00100000:1.0:1721880501.513340:0:15434:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011886336 00000100:00100000:1.0:1721880501.513342:0:15434:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011886336 00000100:00100000:3.0:1721880501.513355:0:15415:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011886208 00000100:00100000:3.0:1721880501.513358:0:15415:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011886208 00000100:00100000:0.0:1721880501.513360:0:11334:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011886080 00000100:00100000:0.0:1721880501.513366:0:11334:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011886080 00000100:00100000:1.0:1721880501.513369:0:15434:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3015 00000100:00100000:2.0:1721880501.513372:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880501.513377:0:15434:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094663b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0000-lwp-MDT0001_UUID+5:3687:x1805522011885824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880501.513390:0:15415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3016 00000100:00100000:3.0:1721880501.513398:0:15415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f12ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3686:x1805522011885696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880501.513399:0:11334:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3017 00000100:00100000:0.0:1721880501.513405:0:11334:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094661880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3687:x1805522011886336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880501.513425:0:15434:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094663b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0000-lwp-MDT0001_UUID+5:3687:x1805522011885824:12345-0@lo:400:kworker.0 Request processed in 48us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880501.513432:0:15434:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3015 00000100:00100000:2.0:1721880501.513439:0:7124:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011885568 00000100:00100000:0.0:1721880501.513445:0:11334:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094661880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3687:x1805522011886336:12345-0@lo:400:kworker.0 Request processed in 40us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880501.513447:0:7124:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011885568 00000100:00100000:0.0:1721880501.513453:0:11334:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3017 00000100:00100000:1.0:1721880501.513461:0:15434:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3018 00000100:00100000:3.0:1721880501.513462:0:15415:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f12ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3686:x1805522011885696:12345-0@lo:400:kworker.0 Request processed in 64us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880501.513466:0:15434:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f12c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0001-lwp-OST0000_UUID+5:3686:x1805522011886208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880501.513470:0:15415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3016 00000100:00100000:0.0:1721880501.513476:0:11334:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3019 00000100:00100000:0.0:1721880501.513480:0:11334:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3689:x1805522011886080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880501.513492:0:15434:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f12c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0001-lwp-OST0000_UUID+5:3686:x1805522011886208:12345-0@lo:400:kworker.0 Request processed in 26us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880501.513497:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 606 00000100:00100000:1.0:1721880501.513499:0:15434:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3018 00000100:00100000:0.0:1721880501.513508:0:11334:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3689:x1805522011886080:12345-0@lo:400:kworker.0 Request processed in 27us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880501.513508:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133034c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0603f996-9d5e-4498-85ba-9976a06b304f+23:3689:x1805522011885568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880501.513512:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880501.513514:0:11334:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3019 00000100:00100000:1.0:1721880501.513528:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011886464 00000100:00100000:1.0:1721880501.513531:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011886464 00000100:00100000:0.0:1721880501.513549:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011886720 00000100:00100000:0.0:1721880501.513552:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011886720 00000100:00100000:1.0:1721880501.513552:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3020 00000100:00100000:1.0:1721880501.513557:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-lwp-OST0001_UUID+5:3688:x1805522011886464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880501.513562:0:7124:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880133034c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0603f996-9d5e-4498-85ba-9976a06b304f+23:3689:x1805522011885568:12345-0@lo:400:kworker.0 Request processed in 54us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880501.513573:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 606 00000100:00100000:0.0:1721880501.513586:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011886592 00000100:00100000:1.0:1721880501.513588:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-lwp-OST0001_UUID+5:3688:x1805522011886464:12345-0@lo:400:kworker.0 Request processed in 30us (76us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880501.513590:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011886592 00000100:00100000:1.0:1721880501.513594:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3020 00000100:00100000:0.0:1721880501.513608:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:0.0:1721880501.513614:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f12dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011886720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880501.513616:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1721880501.513623:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011886592:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1721880501.513626:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880471 00000100:00080000:1.0:1721880501.513630:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880471 00000100:00080000:1.0:1721880501.513632:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880471 00000100:00080000:1.0:1721880501.513635:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880471 00000100:00100000:0.0:1721880501.513639:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f12dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011886720:12345-0@lo:400:kworker.0 Request processed in 24us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880501.513645:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1721880501.513659:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011886592:12345-0@lo:400:kworker.0 Request processed in 36us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880501.513660:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0603f996-9d5e-4498-85ba-9976a06b304f:3689:1805522011885568:0@lo:400:kworker.0 00000100:00100000:3.0:1721880501.513666:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:0.0:1721880501.513672:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011885952 00000100:00100000:0.0:1721880501.513675:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011885952 00000100:00100000:1.0:1721880501.513717:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3687:1805522011885824:0@lo:400:kworker.0 00000100:00100000:2.0:1721880501.513718:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3689:1805522011886080:0@lo:400:kworker.0 00000100:00100000:1.0:1721880501.513759:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3687:1805522011886336:0@lo:400:kworker.0 00000100:00100000:0.0:1721880501.513773:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101132 00000100:00100000:0.0:1721880501.513779:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011885952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880501.513791:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011886592:0@lo:400:kworker.0 00000100:00100000:3.0:1721880501.513799:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3688:1805522011886464:0@lo:400:kworker.0 00000100:00100000:0.0:1721880501.513814:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011885952:12345-0@lo:400:kworker.0 Request processed in 35us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880501.513820:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101132 00000100:00100000:3.0:1721880501.513824:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011885952:0@lo:400:kworker.0 00000100:00100000:0.0:1721880501.513853:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3686:1805522011885696:0@lo:400:kworker.0 00000100:00100000:0.0:1721880501.513863:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3686:1805522011886208:0@lo:400:kworker.0 00000100:00100000:0.0:1721880501.513872:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011886720:0@lo:400:kworker.0 00000100:00100000:1.0:1721880501.560967:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1721880501.560991:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094660e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011886848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1721880501.561046:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1721880501.561062:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880501.561074:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e9ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011886976:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1721880501.561144:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011886848 00000100:00100000:2.0:1721880501.561147:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880501.561154:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011886848 00000100:00100000:1.0:1721880501.561237:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 630 00000100:00100000:0.0:1721880501.561240:0:10429:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011886976 00000100:00100000:1.0:1721880501.561248:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094661f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011886848:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1721880501.561249:0:10429:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011886976 00002000:00000024:1.0:1721880501.561289:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:0.0:1721880501.561298:0:10429:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 631 00000100:00100000:0.0:1721880501.561309:0:10429:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011886976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1721880501.561333:0:10429:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:1.0:1721880501.561372:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094661f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011886848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880501.561387:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 630 00000100:00100000:0.0:1721880501.561427:0:10429:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011886976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 117us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880501.561441:0:10429:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 631 00000100:00100000:2.0:1721880501.561443:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094660e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011886848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1721880501.561468:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e9ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011886976:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1721880501.602973:0:8270:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880502.605017:0:7120:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880502.946302:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880502.946366:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880502.946398:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880502.946415:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880502.946433:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880502.946441:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880502.946452:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880502.946465:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880502.946480:0:11334:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257805696 00000100:00100000:3.0:1721880502.946480:0:7124:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257805568 00000100:00100000:2.0:1721880502.946499:0:11334:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257805696 00000100:00100000:3.0:1721880502.946499:0:7124:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257805568 00000100:00100000:0.0:1721880502.946501:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880502.946508:0:15423:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257805824 00000100:00100000:1.0:1721880502.946517:0:15423:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257805824 00000100:00100000:0.0:1721880502.946527:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257805952 00000100:00100000:0.0:1721880502.946531:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257805952 00000100:00100000:0.0:1721880502.946567:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257806080 00000100:00100000:0.0:1721880502.946569:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257806080 00000100:00100000:1.0:1721880502.946569:0:15423:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257806208 00000100:00100000:1.0:1721880502.946570:0:15423:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257806208 00000100:00100000:1.0:1721880502.946583:0:15423:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257806336 00000100:00100000:0.0:1721880502.946584:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257806464 00000100:00100000:1.0:1721880502.946584:0:15423:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257806336 00000100:00100000:0.0:1721880502.946586:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257806464 00000100:00100000:3.0:1721880502.946594:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 607 00000100:00100000:0.0:1721880502.946597:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257806592 00000100:00100000:0.0:1721880502.946599:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257806592 00000100:00100000:2.0:1721880502.946601:0:11334:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3021 00000100:00100000:3.0:1721880502.946608:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133034850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2004:x1805522257805568:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880502.946612:0:15423:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3022 00000100:00100000:0.0:1721880502.946615:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 399 00000100:00100000:2.0:1721880502.946618:0:11334:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f12ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2004:x1805522257805824:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880502.946620:0:15423:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f12ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2005:x1805522257805696:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880502.946621:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f12c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2005:x1805522257805952:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880502.946696:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f12c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2005:x1805522257805952:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 74us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880502.946702:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 399 00000100:00100000:1.0:1721880502.946707:0:15423:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f12ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2005:x1805522257805696:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 87us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880502.946720:0:15423:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3022 00000100:00100000:0.0:1721880502.946723:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 400 00000100:00100000:0.0:1721880502.946779:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f12f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2004:x1805522257806080:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880502.946780:0:7124:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880133034850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2004:x1805522257805568:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 123us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880502.946782:0:15423:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3023 00000100:00100000:2.0:1721880502.946782:0:11334:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f12ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2004:x1805522257805824:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 165us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880502.946786:0:15423:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f12d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:30425778-2709-4512-9d75-01ec53c4cfad+4135:2005:x1805522257806208:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880502.946790:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 607 00000100:00100000:2.0:1721880502.946796:0:11334:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3021 00000100:00100000:0.0:1721880502.946806:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f12f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2004:x1805522257806080:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 78us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880502.946806:0:15423:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f12d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:30425778-2709-4512-9d75-01ec53c4cfad+4135:2005:x1805522257806208:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 20us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880502.946810:0:15423:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3023 00000100:00100000:0.0:1721880502.946813:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 400 00000100:00100000:0.0:1721880502.946825:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 401 00000100:00100000:0.0:1721880502.946829:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f12f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:30425778-2709-4512-9d75-01ec53c4cfad+280:2005:x1805522257806464:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880502.946829:0:15423:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3024 00000100:00100000:1.0:1721880502.946831:0:15423:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f12e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:30425778-2709-4512-9d75-01ec53c4cfad+3694:2004:x1805522257806336:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880502.946842:0:15423:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f12e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:30425778-2709-4512-9d75-01ec53c4cfad+3694:2004:x1805522257806336:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 10us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880502.946846:0:15423:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3024 00000100:00100000:3.0:1721880502.946847:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 402 00000100:00100000:0.0:1721880502.946851:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f12f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:30425778-2709-4512-9d75-01ec53c4cfad+280:2005:x1805522257806464:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 21us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880502.946854:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:30425778-2709-4512-9d75-01ec53c4cfad+665:2004:x1805522257806592:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880502.946857:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 401 00000100:00100000:3.0:1721880502.946882:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:30425778-2709-4512-9d75-01ec53c4cfad+665:2004:x1805522257806592:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 28us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880502.946893:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 402 00000100:00080000:2.0:1721880502.946894:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880472 00000100:00080000:2.0:1721880502.946899:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880472 00000100:00080000:2.0:1721880502.946902:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880472 00000100:00080000:2.0:1721880502.946904:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880472 00000100:00080000:2.0:1721880502.946907:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880472 00000100:00100000:0.0:1721880503.032995:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011887104:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1721880503.033070:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880503.033141:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011887104 00000100:00100000:2.0:1721880503.033154:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011887104 00000100:00100000:2.0:1721880503.033230:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101133 00000100:00100000:2.0:1721880503.033239:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3689:x1805522011887104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1721880503.033284:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1435709440 avail 1306247168 00000100:00100000:2.0:1721880503.033392:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3689:x1805522011887104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 151us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880503.033405:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101133 00000100:00100000:0.0:1721880503.033429:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011887104:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1721880503.607019:0:15560:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880504.609043:0:11721:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880505.611009:0:7119:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1721880505.928974:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011887232:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1721880505.929057:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880505.929112:0:10429:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011887232 00000100:00100000:0.0:1721880505.929124:0:10429:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011887232 00000100:00080000:2.0:1721880505.929150:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880475 00000100:00100000:0.0:1721880505.929193:0:10429:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 632 00000100:00100000:0.0:1721880505.929203:0:10429:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011887232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1721880505.929239:0:10429:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:0.0:1721880505.929297:0:10429:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011887232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880505.929303:0:10429:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 632 00000100:00100000:2.0:1721880505.929329:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012fc36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011887232:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1721880506.329023:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1721880506.329049:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011887360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1721880506.329125:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880506.329222:0:10429:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011887360 00000100:00100000:0.0:1721880506.329231:0:10429:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011887360 00000100:00080000:2.0:1721880506.329289:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880476 00000100:00100000:0.0:1721880506.329302:0:10429:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 633 00000100:00100000:0.0:1721880506.329310:0:10429:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011887360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1721880506.329341:0:10429:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:0.0:1721880506.329397:0:10429:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011887360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880506.329404:0:10429:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 633 00000100:00100000:2.0:1721880506.329439:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012fc34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011887360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1721880506.425101:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094662d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011887488:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1721880506.425184:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880506.425253:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011887488 00000100:00100000:0.0:1721880506.425267:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011887488 00000100:00100000:0.0:1721880506.425335:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101134 00000100:00100000:0.0:1721880506.425345:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3688:x1805522011887488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1721880506.425394:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1437519872 avail 1308057600 00000100:00100000:0.0:1721880506.425470:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3688:x1805522011887488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 125us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880506.425480:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101134 00000100:00100000:2.0:1721880506.425503:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094662d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011887488:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1721880506.521162:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094663100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0603f996-9d5e-4498-85ba-9976a06b304f:3689:1805522011887616:0@lo:400:kworker.0 00000100:00100000:2.0:1721880506.521171:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011888000:0@lo:400:kworker.0 00000100:00100000:1.0:1721880506.521184:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094660700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3687:1805522011887872:0@lo:400:kworker.0 00000100:00100000:3.0:1721880506.521189:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094661500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3686:1805522011887744:0@lo:400:kworker.0 00000100:00100000:1.0:1721880506.521300:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880506.521301:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880506.521302:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880506.521342:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880506.521352:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094662300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3687:1805522011888384:0@lo:400:kworker.0 00000100:00100000:0.0:1721880506.521356:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3689:1805522011888128:0@lo:400:kworker.0 00000100:00100000:2.0:1721880506.521359:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094663800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3688:1805522011888512:0@lo:400:kworker.0 00000100:00100000:1.0:1721880506.521372:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880506.521373:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3686:1805522011888256:0@lo:400:kworker.0 00000100:00100000:0.0:1721880506.521389:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880506.521398:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011887872 00000100:00100000:3.0:1721880506.521403:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880506.521408:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011887872 00000100:00100000:0.0:1721880506.521414:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011888640:0@lo:400:kworker.0 00000100:00100000:1.0:1721880506.521420:0:15416:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011887744 00000100:00100000:3.0:1721880506.521423:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011888768:0@lo:400:kworker.0 00000100:00100000:1.0:1721880506.521425:0:15416:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011887744 00000100:00100000:0.0:1721880506.521445:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880506.521449:0:15416:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011888384 00000100:00100000:1.0:1721880506.521451:0:15416:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011888384 00000100:00100000:2.0:1721880506.521454:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011888128 00000100:00100000:2.0:1721880506.521456:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011888128 00000100:00100000:3.0:1721880506.521461:0:15420:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011888256 00000100:00100000:3.0:1721880506.521466:0:15420:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011888256 00000100:00100000:1.0:1721880506.521474:0:15416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3025 00000100:00100000:2.0:1721880506.521479:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3026 00000100:00100000:1.0:1721880506.521481:0:15416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3686:x1805522011887744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880506.521484:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094662d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3687:x1805522011887872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880506.521499:0:15434:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3027 00000100:00100000:3.0:1721880506.521506:0:15420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3028 00000100:00100000:0.0:1721880506.521508:0:15434:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0000-lwp-OST0001_UUID+5:3687:x1805522011888384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880506.521514:0:15420:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-OST0000_UUID+5:3689:x1805522011888128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880506.521546:0:7129:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094662d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3687:x1805522011887872:12345-0@lo:400:kworker.0 Request processed in 60us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880506.521552:0:15416:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3686:x1805522011887744:12345-0@lo:400:kworker.0 Request processed in 71us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880506.521555:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3026 00000100:00100000:1.0:1721880506.521559:0:15416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3025 00000100:00100000:0.0:1721880506.521563:0:15434:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0000-lwp-OST0001_UUID+5:3687:x1805522011888384:12345-0@lo:400:kworker.0 Request processed in 56us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880506.521569:0:15434:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3027 00000100:00100000:3.0:1721880506.521570:0:15420:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-OST0000_UUID+5:3689:x1805522011888128:12345-0@lo:400:kworker.0 Request processed in 56us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880506.521579:0:15420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3028 00000100:00100000:1.0:1721880506.521583:0:15416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3029 00000100:00100000:1.0:1721880506.521587:0:15416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3686:x1805522011888256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880506.521637:0:15416:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3686:x1805522011888256:12345-0@lo:400:kworker.0 Request processed in 49us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880506.521640:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011888640 00000100:00100000:0.0:1721880506.521643:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3689:1805522011888128:0@lo:400:kworker.0 00000100:00100000:1.0:1721880506.521643:0:15416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3029 00000100:00100000:3.0:1721880506.521645:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011888640 00000100:00100000:2.0:1721880506.521649:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011887616 00000100:00100000:2.0:1721880506.521653:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011887616 00000100:00100000:3.0:1721880506.521681:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:3.0:1721880506.521687:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011888640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880506.521689:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 608 00000100:00100000:0.0:1721880506.521693:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880506.521695:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094660700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3687:1805522011887872:0@lo:400:kworker.0 00000100:00100000:2.0:1721880506.521696:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133034450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3689:x1805522011887616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880506.521708:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094662300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3687:1805522011888384:0@lo:400:kworker.0 00000100:00100000:1.0:1721880506.521762:0:11334:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011888512 00000100:00100000:1.0:1721880506.521767:0:11334:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011888512 00000100:00080000:0.0:1721880506.521768:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880476 00000100:00080000:0.0:1721880506.521772:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880476 00000100:00080000:0.0:1721880506.521775:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880476 00000100:00080000:0.0:1721880506.521776:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880476 00000100:00100000:3.0:1721880506.521784:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011888640:12345-0@lo:400:kworker.0 Request processed in 94us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880506.521788:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011888000 00000100:00100000:0.0:1721880506.521791:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011888000 00000100:00100000:2.0:1721880506.521792:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880133034450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3689:x1805522011887616:12345-0@lo:400:kworker.0 Request processed in 94us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880506.521794:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:1.0:1721880506.521795:0:11334:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3030 00000100:00100000:1.0:1721880506.521800:0:11334:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3688:x1805522011888512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880506.521801:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 608 00000100:00100000:0.0:1721880506.521818:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101135 00000100:00100000:0.0:1721880506.521822:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011888000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880506.521827:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880506.521847:0:11334:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3688:x1805522011888512:12345-0@lo:400:kworker.0 Request processed in 45us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880506.521860:0:11334:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3030 00000100:00100000:0.0:1721880506.521862:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011888000:12345-0@lo:400:kworker.0 Request processed in 39us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880506.521865:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094661500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3686:1805522011887744:0@lo:400:kworker.0 00000100:00100000:0.0:1721880506.521867:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101135 00000100:00100000:3.0:1721880506.521879:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3686:1805522011888256:0@lo:400:kworker.0 00000100:00100000:0.0:1721880506.521896:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011888640:0@lo:400:kworker.0 00000100:00100000:0.0:1721880506.521903:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094663100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0603f996-9d5e-4498-85ba-9976a06b304f:3689:1805522011887616:0@lo:400:kworker.0 00000100:00100000:3.0:1721880506.521910:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011888768 00000100:00100000:3.0:1721880506.521914:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011888768 00000100:00100000:0.0:1721880506.521923:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011888000:0@lo:400:kworker.0 00000100:00100000:0.0:1721880506.521931:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094663800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3688:1805522011888512:0@lo:400:kworker.0 00000100:00100000:3.0:1721880506.521961:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00080000:1.0:1721880506.521966:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880476 00000100:00100000:3.0:1721880506.521967:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011888768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880506.522010:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011888768:12345-0@lo:400:kworker.0 Request processed in 41us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880506.522017:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011888768:0@lo:400:kworker.0 00000100:00100000:3.0:1721880506.522018:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:3.0:1721880506.569025:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1721880506.569060:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1721880506.569060:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011888896:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1721880506.569078:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800995f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011889024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1721880506.569159:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880506.569195:0:10429:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011888896 00000100:00100000:0.0:1721880506.569204:0:10429:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011888896 00000100:00100000:1.0:1721880506.569235:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880506.569271:0:10429:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011889024 00000100:00100000:0.0:1721880506.569274:0:10429:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011889024 00000100:00100000:0.0:1721880506.569298:0:10429:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 634 00000100:00100000:0.0:1721880506.569306:0:10429:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011888896:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1721880506.569320:0:9461:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 635 00000100:00100000:3.0:1721880506.569331:0:9461:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094662300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011889024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1721880506.569347:0:10429:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00002000:00000024:3.0:1721880506.569360:0:9461:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:0.0:1721880506.569409:0:10429:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011888896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880506.569417:0:10429:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 634 00000100:00100000:2.0:1721880506.569443:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011888896:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1721880506.569444:0:9461:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094662300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011889024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880506.569456:0:9461:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 635 00000100:00100000:1.0:1721880506.569494:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800995f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011889024:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1721880506.612976:0:8270:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880507.615041:0:7120:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880507.954210:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880507.954246:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880507.954263:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880507.954276:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880507.954293:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880507.954302:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880507.954303:0:15423:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257806848 00000100:00100000:2.0:1721880507.954306:0:7124:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257806720 00000100:00100000:0.0:1721880507.954312:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880507.954313:0:15423:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257806848 00000100:00100000:2.0:1721880507.954313:0:7124:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257806720 00000100:00100000:0.0:1721880507.954322:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880507.954324:0:15431:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257806976 00000100:00100000:3.0:1721880507.954329:0:15431:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257806976 00000100:00100000:0.0:1721880507.954347:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880507.954359:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 609 00000100:00100000:1.0:1721880507.954360:0:15423:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257807360 00000100:00100000:1.0:1721880507.954361:0:15423:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257807360 00000100:00100000:0.0:1721880507.954363:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257807104 00000100:00100000:3.0:1721880507.954363:0:15431:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257807488 00000100:00100000:2.0:1721880507.954364:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133034050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2005:x1805522257806720:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880507.954365:0:15431:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257807488 00000100:00100000:0.0:1721880507.954366:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257807104 00000100:00100000:1.0:1721880507.954375:0:15423:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3031 00000100:00100000:1.0:1721880507.954379:0:15423:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2004:x1805522257806848:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880507.954380:0:15431:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3032 00000100:00100000:3.0:1721880507.954384:0:15431:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2005:x1805522257806976:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880507.954388:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257807232 00000100:00100000:0.0:1721880507.954389:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257807232 00000100:00100000:0.0:1721880507.954399:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257807616 00000100:00100000:0.0:1721880507.954400:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257807616 00000100:00100000:0.0:1721880507.954407:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257807744 00000100:00100000:0.0:1721880507.954408:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257807744 00000100:00100000:0.0:1721880507.954419:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 405 00000100:00100000:1.0:1721880507.954422:0:15423:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2004:x1805522257806848:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 41us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880507.954422:0:7124:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880133034050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2005:x1805522257806720:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 57us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880507.954423:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2004:x1805522257807104:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880507.954423:0:15431:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2005:x1805522257806976:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 37us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880507.954427:0:15423:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3031 00000100:00100000:2.0:1721880507.954427:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 609 00000100:00100000:3.0:1721880507.954430:0:15431:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3032 00000100:00100000:3.0:1721880507.954443:0:15431:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3033 00000100:00100000:0.0:1721880507.954445:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2004:x1805522257807104:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 21us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880507.954446:0:15423:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3034 00000100:00100000:3.0:1721880507.954446:0:15431:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:30425778-2709-4512-9d75-01ec53c4cfad+4135:2004:x1805522257807360:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880507.954449:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 405 00000100:00100000:1.0:1721880507.954449:0:15423:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:30425778-2709-4512-9d75-01ec53c4cfad+3694:2005:x1805522257807488:12345-192.168.201.24@tcp:400:kworker.0 00000100:00080000:2.0:1721880507.954454:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880477 00000100:00080000:2.0:1721880507.954456:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880477 00000100:00080000:2.0:1721880507.954458:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880477 00000100:00080000:2.0:1721880507.954459:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880477 00000100:00080000:2.0:1721880507.954461:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880477 00000100:00100000:3.0:1721880507.954461:0:15431:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:30425778-2709-4512-9d75-01ec53c4cfad+4135:2004:x1805522257807360:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 16us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880507.954463:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 406 00000100:00100000:1.0:1721880507.954463:0:15423:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:30425778-2709-4512-9d75-01ec53c4cfad+3694:2005:x1805522257807488:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 13us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880507.954465:0:15431:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3033 00000100:00100000:0.0:1721880507.954466:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2005:x1805522257807232:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880507.954467:0:15423:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3034 00000100:00100000:2.0:1721880507.954472:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 407 00000100:00100000:2.0:1721880507.954474:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:30425778-2709-4512-9d75-01ec53c4cfad+280:2004:x1805522257807616:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880507.954478:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2005:x1805522257807232:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 11us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880507.954481:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 406 00000100:00100000:3.0:1721880507.954487:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 408 00000100:00100000:2.0:1721880507.954490:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:30425778-2709-4512-9d75-01ec53c4cfad+280:2004:x1805522257807616:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 14us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880507.954490:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:30425778-2709-4512-9d75-01ec53c4cfad+665:2005:x1805522257807744:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880507.954494:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 407 00000100:00100000:3.0:1721880507.954502:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:30425778-2709-4512-9d75-01ec53c4cfad+665:2005:x1805522257807744:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 11us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880507.954505:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 408 00000100:00100000:0.0:1721880508.040971:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1721880508.040993:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011889152:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1721880508.041058:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880508.041094:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011889152 00000100:00100000:2.0:1721880508.041104:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011889152 00000100:00100000:2.0:1721880508.041152:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101136 00000100:00100000:2.0:1721880508.041157:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011889152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1721880508.041190:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1435709440 avail 1306247168 00000100:00100000:2.0:1721880508.041241:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011889152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880508.041245:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101136 00000100:00100000:0.0:1721880508.041273:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011889152:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1721880508.617044:0:15560:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880509.619050:0:11721:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880510.621040:0:7119:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1721880510.936983:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800995f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011889280:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1721880510.937060:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880510.937168:0:9461:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011889280 00000100:00100000:3.0:1721880510.937180:0:9461:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011889280 00000100:00080000:2.0:1721880510.937236:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880480 00000100:00100000:3.0:1721880510.937257:0:9461:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 636 00000100:00100000:3.0:1721880510.937267:0:9461:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094660700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011889280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1721880510.937307:0:9461:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:3.0:1721880510.937379:0:9461:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094660700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011889280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880510.937387:0:9461:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 636 00000100:00100000:1.0:1721880510.937480:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800995f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011889280:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1721880511.337002:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800995f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011889408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1721880511.337075:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880511.337162:0:9461:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011889408 00000100:00100000:3.0:1721880511.337172:0:9461:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011889408 00000100:00080000:2.0:1721880511.337213:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880481 00000100:00100000:3.0:1721880511.337228:0:9461:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 637 00000100:00100000:3.0:1721880511.337234:0:9461:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011889408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1721880511.337261:0:9461:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:3.0:1721880511.337301:0:9461:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011889408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880511.337306:0:9461:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 637 00000100:00100000:0.0:1721880511.337323:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800995f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011889408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1721880511.433019:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800995f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011889536:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1721880511.433097:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880511.433142:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011889536 00000100:00100000:2.0:1721880511.433150:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011889536 00000100:00100000:2.0:1721880511.433194:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101137 00000100:00100000:2.0:1721880511.433199:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3688:x1805522011889536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1721880511.433233:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1437519872 avail 1308057600 00000100:00100000:2.0:1721880511.433304:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3688:x1805522011889536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880511.433312:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101137 00000100:00100000:0.0:1721880511.433338:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800995f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011889536:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1721880511.529176:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3687:1805522011889920:0@lo:400:kworker.0 00000100:00100000:1.0:1721880511.529178:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094663800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3686:1805522011889792:0@lo:400:kworker.0 00000100:00100000:3.0:1721880511.529213:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0603f996-9d5e-4498-85ba-9976a06b304f:3689:1805522011889664:0@lo:400:kworker.0 00000100:00100000:0.0:1721880511.529333:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880511.529335:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880511.529350:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094663100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011890048:0@lo:400:kworker.0 00000100:00100000:0.0:1721880511.529385:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094661500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3687:1805522011890432:0@lo:400:kworker.0 00000100:00100000:3.0:1721880511.529391:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3689:1805522011890176:0@lo:400:kworker.0 00000100:00100000:1.0:1721880511.529393:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880511.529419:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880511.529431:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3688:1805522011890560:0@lo:400:kworker.0 00000100:00100000:3.0:1721880511.529436:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880511.529458:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011890688:0@lo:400:kworker.0 00000100:00100000:1.0:1721880511.529462:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011889920 00000100:00100000:0.0:1721880511.529464:0:15434:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011890432 00000100:00100000:0.0:1721880511.529471:0:15434:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011890432 00000100:00100000:1.0:1721880511.529471:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011889920 00000100:00100000:3.0:1721880511.529480:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880511.529487:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011889664 00000100:00100000:2.0:1721880511.529496:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011889664 00000100:00100000:0.0:1721880511.529541:0:15434:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011890176 00000100:00100000:0.0:1721880511.529544:0:15434:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011890176 00000100:00100000:1.0:1721880511.529561:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3035 00000100:00100000:1.0:1721880511.529569:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-OST0001_UUID+5:3687:x1805522011890432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880511.529575:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3036 00000100:00100000:2.0:1721880511.529576:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 610 00000100:00100000:0.0:1721880511.529582:0:15434:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3037 00000100:00100000:3.0:1721880511.529584:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3687:x1805522011889920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880511.529585:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c053c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3689:x1805522011889664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880511.529588:0:15434:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0000-lwp-OST0000_UUID+5:3689:x1805522011890176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880511.529642:0:7130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3687:x1805522011889920:12345-0@lo:400:kworker.0 Request processed in 59us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880511.529644:0:15434:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0000-lwp-OST0000_UUID+5:3689:x1805522011890176:12345-0@lo:400:kworker.0 Request processed in 56us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880511.529650:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-OST0001_UUID+5:3687:x1805522011890432:12345-0@lo:400:kworker.0 Request processed in 81us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880511.529650:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3036 00000100:00100000:0.0:1721880511.529654:0:15434:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3037 00000100:00100000:1.0:1721880511.529657:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3035 00000100:00100000:2.0:1721880511.529671:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c053c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3689:x1805522011889664:12345-0@lo:400:kworker.0 Request processed in 88us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880511.529678:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 610 00000100:00080000:0.0:1721880511.529687:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880481 00000100:00100000:1.0:1721880511.529688:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1721880511.529691:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880481 00000100:00100000:3.0:1721880511.529693:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011890688 00000100:00100000:3.0:1721880511.529715:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011890688 00000100:00100000:0.0:1721880511.529721:0:11334:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011890560 00000100:00100000:0.0:1721880511.529724:0:11334:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011890560 00000100:00100000:1.0:1721880511.529734:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880511.529771:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3686:1805522011890304:0@lo:400:kworker.0 00000100:00100000:2.0:1721880511.529790:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011890048 00000100:00100000:2.0:1721880511.529795:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011890048 00000100:00100000:3.0:1721880511.529796:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:3.0:1721880511.529801:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011890688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880511.529803:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880511.529814:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011890816:0@lo:400:kworker.0 00000100:00100000:0.0:1721880511.529818:0:11334:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011889792 00000100:00100000:0.0:1721880511.529823:0:11334:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011889792 00000100:00100000:1.0:1721880511.529830:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880511.529835:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101138 00000100:00100000:3.0:1721880511.529835:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011890688:12345-0@lo:400:kworker.0 Request processed in 33us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880511.529841:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:2.0:1721880511.529843:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085a4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011890048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880511.529863:0:11334:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011890304 00000100:00100000:0.0:1721880511.529866:0:11334:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011890304 00000100:00100000:3.0:1721880511.529873:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011890816 00000100:00100000:3.0:1721880511.529876:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011890816 00000100:00100000:0.0:1721880511.529887:0:11334:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3038 00000100:00100000:1.0:1721880511.529893:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3039 00000100:00100000:0.0:1721880511.529894:0:11334:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3688:x1805522011890560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880511.529894:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:1.0:1721880511.529898:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085a4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3686:x1805522011889792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880511.529898:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085a4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011890816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880511.529926:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880085a4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011890048:12345-0@lo:400:kworker.0 Request processed in 82us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880511.529936:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101138 00000100:00100000:3.0:1721880511.529936:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880085a4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011890816:12345-0@lo:400:kworker.0 Request processed in 37us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880511.529937:0:7130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880085a4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3686:x1805522011889792:12345-0@lo:400:kworker.0 Request processed in 39us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880511.529941:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00100000:1.0:1721880511.529942:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3039 00000100:00100000:0.0:1721880511.529948:0:11334:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880085a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3688:x1805522011890560:12345-0@lo:400:kworker.0 Request processed in 53us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880511.529954:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3040 00000100:00100000:1.0:1721880511.529958:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085a4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3686:x1805522011890304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880511.529959:0:11334:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3038 00000100:00100000:1.0:1721880511.529983:0:7130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880085a4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3686:x1805522011890304:12345-0@lo:400:kworker.0 Request processed in 23us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880511.529985:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0603f996-9d5e-4498-85ba-9976a06b304f:3689:1805522011889664:0@lo:400:kworker.0 00000100:00100000:2.0:1721880511.529986:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094663100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011890048:0@lo:400:kworker.0 00000100:00100000:1.0:1721880511.529988:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3040 00000100:00080000:0.0:1721880511.529992:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880481 00000100:00080000:0.0:1721880511.529996:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880481 00000100:00100000:2.0:1721880511.529997:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3688:1805522011890560:0@lo:400:kworker.0 00000100:00100000:3.0:1721880511.529998:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3689:1805522011890176:0@lo:400:kworker.0 00000100:00100000:3.0:1721880511.530006:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011890688:0@lo:400:kworker.0 00000100:00100000:1.0:1721880511.530021:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094663800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3686:1805522011889792:0@lo:400:kworker.0 00000100:00100000:0.0:1721880511.530022:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3687:1805522011889920:0@lo:400:kworker.0 00000100:00100000:1.0:1721880511.530029:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3686:1805522011890304:0@lo:400:kworker.0 00000100:00100000:1.0:1721880511.530037:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011890816:0@lo:400:kworker.0 00000100:00100000:0.0:1721880511.530038:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094661500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3687:1805522011890432:0@lo:400:kworker.0 00000100:00100000:2.0:1721880511.576945:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1721880511.576952:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1721880511.576967:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800995f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011890944:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1721880511.576968:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011891072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1721880511.577046:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880511.577098:0:9461:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011891072 00000100:00100000:2.0:1721880511.577107:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880511.577109:0:9461:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011891072 00000100:00100000:3.0:1721880511.577144:0:9461:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011890944 00000100:00100000:3.0:1721880511.577146:0:9461:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011890944 00000100:00100000:0.0:1721880511.577153:0:10429:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 638 00000100:00100000:0.0:1721880511.577163:0:10429:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011891072:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1721880511.577169:0:9461:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 639 00000100:00100000:3.0:1721880511.577175:0:9461:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094661500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011890944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1721880511.577199:0:10429:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00002000:00000024:3.0:1721880511.577199:0:9461:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:3.0:1721880511.577259:0:9461:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094661500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011890944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880511.577266:0:9461:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 639 00000100:00100000:0.0:1721880511.577267:0:10429:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880085a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011891072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880511.577274:0:10429:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 638 00000100:00100000:2.0:1721880511.577286:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800995f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011890944:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1721880511.577304:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011891072:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1721880511.623071:0:8270:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880512.625194:0:7120:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880512.962832:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880512.962904:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880512.962945:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880512.962970:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880512.962990:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880512.963007:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880512.963020:0:7124:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257807872 00000100:00100000:0.0:1721880512.963024:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880512.963038:0:7124:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257807872 00000100:00100000:0.0:1721880512.963040:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880512.963050:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257808000 00000100:00100000:1.0:1721880512.963062:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257808000 00000100:00100000:0.0:1721880512.963086:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880512.963120:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257808256 00000100:00100000:1.0:1721880512.963124:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257808128 00000100:00100000:0.0:1721880512.963126:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257808256 00000100:00100000:1.0:1721880512.963129:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257808128 00000100:00100000:2.0:1721880512.963129:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 611 00000100:00100000:2.0:1721880512.963142:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c053850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2004:x1805522257807872:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880512.963155:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257808512 00000100:00100000:1.0:1721880512.963159:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257808512 00000100:00100000:0.0:1721880512.963162:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257808384 00000100:00100000:0.0:1721880512.963164:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257808384 00000100:00100000:3.0:1721880512.963178:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257808896 00000100:00100000:1.0:1721880512.963179:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257808640 00000100:00100000:0.0:1721880512.963180:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257808768 00000100:00100000:0.0:1721880512.963182:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257808768 00000100:00100000:1.0:1721880512.963183:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257808640 00000100:00100000:3.0:1721880512.963188:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257808896 00000100:00100000:0.0:1721880512.963197:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 411 00000100:00100000:0.0:1721880512.963204:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2005:x1805522257808256:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880512.963214:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3041 00000100:00100000:1.0:1721880512.963225:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2005:x1805522257808000:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880512.963231:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 412 00000100:00100000:3.0:1721880512.963239:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2004:x1805522257808384:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880512.963248:0:7124:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c053850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2004:x1805522257807872:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 105us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880512.963249:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2005:x1805522257808256:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 45us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880512.963258:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 411 00000100:00100000:2.0:1721880512.963261:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 611 00000100:00100000:0.0:1721880512.963287:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 413 00000100:00100000:1.0:1721880512.963287:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2005:x1805522257808000:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 62us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880512.963292:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:30425778-2709-4512-9d75-01ec53c4cfad+280:2005:x1805522257808768:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880512.963300:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3041 00000100:00100000:3.0:1721880512.963300:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2004:x1805522257808384:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 61us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880512.963308:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 412 00000100:00100000:0.0:1721880512.963315:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:30425778-2709-4512-9d75-01ec53c4cfad+280:2005:x1805522257808768:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 23us (230us total) trans 0 rc 0/0 00000100:00080000:2.0:1721880512.963315:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880482 00000100:00080000:2.0:1721880512.963321:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880482 00000100:00100000:0.0:1721880512.963322:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 413 00000100:00080000:2.0:1721880512.963325:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880482 00000100:00080000:2.0:1721880512.963329:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880482 00000100:00100000:3.0:1721880512.963330:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 414 00000100:00080000:2.0:1721880512.963332:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880482 00000100:00100000:3.0:1721880512.963335:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:30425778-2709-4512-9d75-01ec53c4cfad+665:2004:x1805522257808896:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880512.963338:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3042 00000100:00100000:1.0:1721880512.963347:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2004:x1805522257808128:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880512.963355:0:15423:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3043 00000100:00100000:3.0:1721880512.963356:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:30425778-2709-4512-9d75-01ec53c4cfad+665:2004:x1805522257808896:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 21us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880512.963360:0:15423:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:30425778-2709-4512-9d75-01ec53c4cfad+4135:2005:x1805522257808512:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880512.963363:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 414 00000100:00100000:1.0:1721880512.963384:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2004:x1805522257808128:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 38us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880512.963385:0:15423:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:30425778-2709-4512-9d75-01ec53c4cfad+4135:2005:x1805522257808512:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 24us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880512.963391:0:15423:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3043 00000100:00100000:1.0:1721880512.963406:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3042 00000100:00100000:3.0:1721880512.963412:0:15431:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3044 00000100:00100000:3.0:1721880512.963418:0:15431:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:30425778-2709-4512-9d75-01ec53c4cfad+3694:2004:x1805522257808640:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880512.963438:0:15431:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:30425778-2709-4512-9d75-01ec53c4cfad+3694:2004:x1805522257808640:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 20us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880512.963445:0:15431:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3044 00000100:00100000:1.0:1721880513.049093:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011891200:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1721880513.049188:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880513.049345:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011891200 00000100:00100000:2.0:1721880513.049359:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011891200 00000100:00100000:2.0:1721880513.049447:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101139 00000100:00100000:2.0:1721880513.049460:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085a4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3689:x1805522011891200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1721880513.049546:0:15587:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1435709440 avail 1306247168 00000100:00100000:2.0:1721880513.049655:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880085a4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3689:x1805522011891200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 195us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880513.049668:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101139 00000100:00100000:1.0:1721880513.049694:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007ca5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011891200:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1721880513.626985:0:15560:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880514.629168:0:11721:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880515.631099:0:7119:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1721880515.945110:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011891328:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1721880515.945203:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880515.945286:0:10429:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011891328 00000100:00100000:0.0:1721880515.945302:0:10429:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011891328 00000100:00080000:2.0:1721880515.945368:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880485 00000100:00100000:0.0:1721880515.945407:0:10429:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 640 00000100:00100000:0.0:1721880515.945421:0:10429:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094660380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011891328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1721880515.945505:0:10429:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:0.0:1721880515.945603:0:10429:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094660380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011891328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 182us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880515.945616:0:10429:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 640 00000100:00100000:2.0:1721880515.945642:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011891328:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1721880516.345049:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011891456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1721880516.345128:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880516.345176:0:10429:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011891456 00000100:00100000:0.0:1721880516.345185:0:10429:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011891456 00000100:00080000:2.0:1721880516.345210:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880486 00000100:00100000:0.0:1721880516.345236:0:10429:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 641 00000100:00100000:0.0:1721880516.345242:0:10429:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094663480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011891456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1721880516.345266:0:10429:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:0.0:1721880516.345319:0:10429:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094663480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011891456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880516.345324:0:10429:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 641 00000100:00100000:2.0:1721880516.345391:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007ca5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011891456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1721880516.441000:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1721880516.441023:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011891584:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1721880516.441096:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880516.441199:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011891584 00000100:00100000:2.0:1721880516.441209:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011891584 00000100:00100000:2.0:1721880516.441263:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101140 00000100:00100000:2.0:1721880516.441269:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085a4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+19:3689:x1805522011891584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1721880516.441304:0:15587:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1437519872 avail 1308057600 00000100:00100000:2.0:1721880516.441363:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880085a4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+19:3689:x1805522011891584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880516.441368:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101140 00000100:00100000:1.0:1721880516.441390:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007ca5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011891584:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1721880516.537020:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0603f996-9d5e-4498-85ba-9976a06b304f:3689:1805522011891712:0@lo:400:kworker.0 00000100:00100000:3.0:1721880516.537020:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011892096:0@lo:400:kworker.0 00000100:00100000:1.0:1721880516.537056:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3687:1805522011891968:0@lo:400:kworker.0 00000100:00100000:1.0:1721880516.537109:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880516.537109:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880516.537109:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880516.537156:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3687:1805522011892480:0@lo:400:kworker.0 00000100:00100000:2.0:1721880516.537156:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3689:1805522011892224:0@lo:400:kworker.0 00000100:00100000:3.0:1721880516.537164:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3688:1805522011892608:0@lo:400:kworker.0 00000100:00100000:1.0:1721880516.537175:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880516.537186:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880085a4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3686:1805522011891840:0@lo:400:kworker.0 00000100:00100000:0.0:1721880516.537193:0:15431:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011891968 00000100:00100000:2.0:1721880516.537193:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011891712 00000100:00100000:0.0:1721880516.537202:0:15431:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011891968 00000100:00100000:2.0:1721880516.537202:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011891712 00000100:00100000:3.0:1721880516.537210:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880516.537218:0:7130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011892480 00000100:00100000:1.0:1721880516.537221:0:7130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011892480 00000100:00100000:3.0:1721880516.537227:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3686:1805522011892352:0@lo:400:kworker.0 00000100:00100000:2.0:1721880516.537246:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 612 00000100:00100000:3.0:1721880516.537247:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880516.537249:0:15431:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011891840 00000100:00100000:0.0:1721880516.537252:0:15431:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011891840 00000100:00100000:2.0:1721880516.537253:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c053450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3689:x1805522011891712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880516.537254:0:7130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011892352 00000100:00100000:1.0:1721880516.537257:0:7130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011892352 00000100:00100000:3.0:1721880516.537260:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011892864:0@lo:400:kworker.0 00000100:00100000:0.0:1721880516.537272:0:15431:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3045 00000100:00100000:1.0:1721880516.537277:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3046 00000100:00100000:0.0:1721880516.537279:0:15431:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-MDT0001_UUID+5:3687:x1805522011891968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880516.537279:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880516.537282:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3687:x1805522011892480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880516.537309:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c053450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3689:x1805522011891712:12345-0@lo:400:kworker.0 Request processed in 56us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880516.537313:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011892864 00000100:00100000:2.0:1721880516.537317:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 612 00000100:00100000:3.0:1721880516.537317:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011892864 00000100:00100000:1.0:1721880516.537318:0:7130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3687:x1805522011892480:12345-0@lo:400:kworker.0 Request processed in 35us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880516.537324:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3046 00000100:00100000:0.0:1721880516.537336:0:15431:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-MDT0001_UUID+5:3687:x1805522011891968:12345-0@lo:400:kworker.0 Request processed in 57us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880516.537344:0:15431:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3045 00000100:00100000:3.0:1721880516.537346:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:1.0:1721880516.537348:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3047 00000100:00100000:1.0:1721880516.537353:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3686:x1805522011891840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880516.537353:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011892864:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1721880516.537359:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880486 00000100:00080000:2.0:1721880516.537363:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880486 00000100:00080000:2.0:1721880516.537365:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880486 00000100:00080000:2.0:1721880516.537368:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880486 00000100:00100000:0.0:1721880516.537369:0:15431:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3048 00000100:00100000:0.0:1721880516.537374:0:15431:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001-lwp-OST0000_UUID+5:3686:x1805522011892352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880516.537381:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011892096 00000100:00100000:1.0:1721880516.537383:0:7130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3686:x1805522011891840:12345-0@lo:400:kworker.0 Request processed in 29us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880516.537384:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011892096 00000100:00100000:3.0:1721880516.537392:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011892864:12345-0@lo:400:kworker.0 Request processed in 38us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880516.537393:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3047 00000100:00100000:3.0:1721880516.537399:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000100:00100000:0.0:1721880516.537403:0:15431:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001-lwp-OST0000_UUID+5:3686:x1805522011892352:12345-0@lo:400:kworker.0 Request processed in 29us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880516.537410:0:15431:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3048 00000100:00100000:2.0:1721880516.537410:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101141 00000100:00100000:2.0:1721880516.537415:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011892096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880516.537464:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3687:1805522011891968:0@lo:400:kworker.0 00000100:00100000:3.0:1721880516.537464:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3686:1805522011891840:0@lo:400:kworker.0 00000100:00100000:1.0:1721880516.537476:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3687:1805522011892480:0@lo:400:kworker.0 00000100:00100000:3.0:1721880516.537478:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3686:1805522011892352:0@lo:400:kworker.0 00000100:00100000:3.0:1721880516.537491:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011892864:0@lo:400:kworker.0 00000100:00100000:2.0:1721880516.537503:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011892096:12345-0@lo:400:kworker.0 Request processed in 87us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880516.537510:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101141 00000100:00100000:3.0:1721880516.537523:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880516.537552:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011892096:0@lo:400:kworker.0 00000100:00100000:2.0:1721880516.537555:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880516.537561:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1721880516.537567:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011892736:0@lo:400:kworker.0 00000100:00100000:0.0:1721880516.537581:0:15416:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011892608 00000100:00100000:0.0:1721880516.537586:0:15416:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011892608 00000100:00100000:3.0:1721880516.537589:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880516.537591:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880085a4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0603f996-9d5e-4498-85ba-9976a06b304f:3689:1805522011891712:0@lo:400:kworker.0 00000100:00100000:1.0:1721880516.537601:0:11334:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011892224 00000100:00100000:1.0:1721880516.537605:0:11334:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011892224 00000100:00100000:3.0:1721880516.537611:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011892736 00000100:00100000:0.0:1721880516.537615:0:15416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3049 00000100:00100000:3.0:1721880516.537615:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011892736 00000100:00080000:2.0:1721880516.537616:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880486 00000100:00080000:2.0:1721880516.537618:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880486 00000100:00100000:0.0:1721880516.537620:0:15416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3688:x1805522011892608:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1721880516.537621:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880486 00000100:00100000:1.0:1721880516.537630:0:11334:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3050 00000100:00100000:3.0:1721880516.537635:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:1.0:1721880516.537636:0:11334:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094663800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3689:x1805522011892224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880516.537639:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085a4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011892736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880516.537664:0:15416:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3688:x1805522011892608:12345-0@lo:400:kworker.0 Request processed in 42us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880516.537670:0:15416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3049 00000100:00100000:3.0:1721880516.537674:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880085a4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011892736:12345-0@lo:400:kworker.0 Request processed in 34us (84us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880516.537675:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3688:1805522011892608:0@lo:400:kworker.0 00000100:00100000:3.0:1721880516.537679:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00100000:1.0:1721880516.537680:0:11334:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094663800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3689:x1805522011892224:12345-0@lo:400:kworker.0 Request processed in 43us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880516.537686:0:11334:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3050 00000100:00100000:2.0:1721880516.537690:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011892736:0@lo:400:kworker.0 00000100:00100000:2.0:1721880516.537709:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3689:1805522011892224:0@lo:400:kworker.0 00000100:00100000:2.0:1721880516.584924:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1721880516.584928:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1721880516.584943:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011893120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1721880516.584943:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011892992:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1721880516.585005:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880516.585025:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880516.585035:0:10429:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011893120 00000100:00100000:0.0:1721880516.585043:0:10429:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011893120 00000100:00100000:3.0:1721880516.585053:0:9461:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011892992 00000100:00100000:3.0:1721880516.585059:0:9461:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011892992 00000100:00100000:0.0:1721880516.585083:0:10429:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 642 00000100:00100000:0.0:1721880516.585089:0:10429:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011893120:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1721880516.585090:0:9461:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 643 00000100:00100000:3.0:1721880516.585095:0:9461:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094660000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011892992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1721880516.585118:0:10429:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00002000:00000024:3.0:1721880516.585118:0:9461:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:3.0:1721880516.585161:0:9461:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094660000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011892992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880516.585165:0:10429:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011893120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880516.585166:0:9461:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 643 00000100:00100000:0.0:1721880516.585170:0:10429:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 642 00000100:00100000:1.0:1721880516.585185:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011893120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1721880516.585190:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011892992:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1721880516.633006:0:8270:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880517.634987:0:7120:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880517.970248:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880517.970289:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880517.970312:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880517.970328:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880517.970340:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880517.970349:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880517.970356:0:7124:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257809024 00000100:00100000:0.0:1721880517.970361:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880517.970366:0:7124:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257809024 00000100:00100000:3.0:1721880517.970370:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257809536 00000100:00100000:0.0:1721880517.970371:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880517.970373:0:11334:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257809280 00000100:00100000:3.0:1721880517.970375:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257809536 00000100:00100000:1.0:1721880517.970378:0:11334:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257809280 00000100:00100000:1.0:1721880517.970421:0:11334:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257809152 00000100:00100000:1.0:1721880517.970422:0:11334:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257809152 00000100:00100000:2.0:1721880517.970423:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 613 00000100:00100000:2.0:1721880517.970430:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c053050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2004:x1805522257809024:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880517.970432:0:11334:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257809792 00000100:00100000:1.0:1721880517.970433:0:11334:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257809792 00000100:00100000:3.0:1721880517.970437:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257810048 00000100:00100000:1.0:1721880517.970440:0:11334:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257809664 00000100:00100000:3.0:1721880517.970440:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257810048 00000100:00100000:1.0:1721880517.970442:0:11334:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257809664 00000100:00100000:0.0:1721880517.970451:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880517.970453:0:11334:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3051 00000100:00100000:1.0:1721880517.970457:0:11334:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2005:x1805522257809280:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880517.970457:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257809408 00000100:00100000:3.0:1721880517.970459:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257809408 00000100:00100000:0.0:1721880517.970473:0:15431:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3052 00000100:00100000:3.0:1721880517.970474:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257809920 00000100:00100000:3.0:1721880517.970476:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257809920 00000100:00100000:0.0:1721880517.970478:0:15431:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2004:x1805522257809152:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880517.970491:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 417 00000100:00100000:1.0:1721880517.970492:0:11334:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2005:x1805522257809280:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 34us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880517.970496:0:7124:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c053050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2004:x1805522257809024:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 65us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880517.970496:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2005:x1805522257809536:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880517.970500:0:11334:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3051 00000100:00100000:0.0:1721880517.970501:0:15431:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2004:x1805522257809152:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 23us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880517.970501:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 613 00000100:00100000:0.0:1721880517.970509:0:15431:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3052 00000100:00100000:1.0:1721880517.970519:0:11334:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3053 00000100:00100000:0.0:1721880517.970522:0:15431:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3054 00000100:00100000:1.0:1721880517.970522:0:11334:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30425778-2709-4512-9d75-01ec53c4cfad+3694:2005:x1805522257809792:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880517.970525:0:15431:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:30425778-2709-4512-9d75-01ec53c4cfad+4135:2004:x1805522257809664:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880517.970526:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2005:x1805522257809536:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 29us (213us total) trans 0 rc 0/0 00000100:00080000:2.0:1721880517.970527:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880487 00000100:00080000:2.0:1721880517.970530:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880487 00000100:00080000:2.0:1721880517.970531:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880487 00000100:00080000:2.0:1721880517.970532:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880487 00000100:00080000:2.0:1721880517.970533:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880487 00000100:00100000:3.0:1721880517.970533:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 417 00000100:00100000:1.0:1721880517.970534:0:11334:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30425778-2709-4512-9d75-01ec53c4cfad+3694:2005:x1805522257809792:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 12us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880517.970536:0:15431:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:30425778-2709-4512-9d75-01ec53c4cfad+4135:2004:x1805522257809664:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 10us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880517.970538:0:11334:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3053 00000100:00100000:0.0:1721880517.970541:0:15431:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3054 00000100:00100000:2.0:1721880517.970548:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 418 00000100:00100000:2.0:1721880517.970552:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:30425778-2709-4512-9d75-01ec53c4cfad+665:2005:x1805522257810048:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880517.970557:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 419 00000100:00100000:3.0:1721880517.970561:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2004:x1805522257809408:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880517.970564:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 420 00000100:00100000:0.0:1721880517.970567:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:30425778-2709-4512-9d75-01ec53c4cfad+280:2004:x1805522257809920:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880517.970576:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:30425778-2709-4512-9d75-01ec53c4cfad+665:2005:x1805522257810048:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 23us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880517.970579:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:30425778-2709-4512-9d75-01ec53c4cfad+280:2004:x1805522257809920:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 12us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880517.970581:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2004:x1805522257809408:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 20us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880517.970582:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 418 00000100:00100000:0.0:1721880517.970584:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 420 00000100:00100000:3.0:1721880517.970587:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 419 00000100:00100000:3.0:1721880518.057022:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1721880518.057042:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011893248:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1721880518.057110:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880518.057148:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011893248 00000100:00100000:2.0:1721880518.057156:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011893248 00000100:00100000:2.0:1721880518.057208:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101142 00000100:00100000:2.0:1721880518.057214:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011893248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1721880518.057247:0:15587:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1435709440 avail 1306247168 00000100:00100000:2.0:1721880518.057303:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880085a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011893248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880518.057308:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101142 00000100:00100000:3.0:1721880518.057380:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011893248:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1721880518.637056:0:15560:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880519.638957:0:11721:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880520.641002:0:7119:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1721880520.952981:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011893376:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1721880520.953047:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880520.953090:0:10429:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011893376 00000100:00100000:0.0:1721880520.953099:0:10429:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011893376 00000100:00100000:0.0:1721880520.953161:0:10429:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 644 00000100:00100000:0.0:1721880520.953167:0:10429:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011893376:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1721880520.953203:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880490 00002000:00000024:0.0:1721880520.953211:0:10429:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:0.0:1721880520.953259:0:10429:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011893376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880520.953264:0:10429:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 644 00000100:00100000:1.0:1721880520.953296:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011893376:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1721880521.353042:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011893504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1721880521.353128:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880521.353177:0:10429:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011893504 00000100:00100000:2.0:1721880521.353186:0:10429:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011893504 00000100:00080000:0.0:1721880521.353212:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880491 00000100:00100000:2.0:1721880521.353237:0:10429:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 645 00000100:00100000:2.0:1721880521.353243:0:10429:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087798a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011893504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1721880521.353270:0:10429:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:2.0:1721880521.353325:0:10429:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087798a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011893504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880521.353330:0:10429:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 645 00000100:00100000:0.0:1721880521.353384:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011893504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1721880521.449036:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011893632:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1721880521.449109:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880521.449153:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011893632 00000100:00100000:2.0:1721880521.449163:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011893632 00000100:00100000:2.0:1721880521.449223:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101143 00000100:00100000:2.0:1721880521.449230:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076fe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+19:3688:x1805522011893632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1721880521.449269:0:15587:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1437519872 avail 1308057600 00000100:00100000:2.0:1721880521.449333:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880076fe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+19:3688:x1805522011893632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880521.449339:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101143 00000100:00100000:3.0:1721880521.449389:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011893632:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1721880521.544991:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3687:1805522011894016:0@lo:400:kworker.0 00000100:00100000:2.0:1721880521.544991:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0603f996-9d5e-4498-85ba-9976a06b304f:3689:1805522011893760:0@lo:400:kworker.0 00000100:00100000:3.0:1721880521.544998:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011894144:0@lo:400:kworker.0 00000100:00100000:0.0:1721880521.545003:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3686:1805522011893888:0@lo:400:kworker.0 00000100:00100000:1.0:1721880521.545069:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880521.545071:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880521.545073:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880521.545089:0:15416:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011894016 00000100:00100000:0.0:1721880521.545095:0:15416:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011894016 00000100:00100000:1.0:1721880521.545102:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3687:1805522011894528:0@lo:400:kworker.0 00000100:00100000:3.0:1721880521.545104:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3688:1805522011894656:0@lo:400:kworker.0 00000100:00100000:2.0:1721880521.545113:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3689:1805522011894272:0@lo:400:kworker.0 00000100:00100000:1.0:1721880521.545115:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880521.545135:0:15416:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011894528 00000100:00100000:0.0:1721880521.545137:0:15416:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011894528 00000100:00100000:3.0:1721880521.545139:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011893760 00000100:00100000:3.0:1721880521.545143:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011893760 00000100:00100000:2.0:1721880521.545149:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880521.545155:0:15416:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011894272 00000100:00100000:0.0:1721880521.545157:0:15416:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011894272 00000100:00100000:2.0:1721880521.545161:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011894784:0@lo:400:kworker.0 00000100:00100000:1.0:1721880521.545165:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3055 00000100:00100000:0.0:1721880521.545170:0:15416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3056 00000100:00100000:1.0:1721880521.545171:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3687:x1805522011894016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880521.545174:0:15416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3687:x1805522011894528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880521.545178:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880521.545179:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 614 00000100:00100000:3.0:1721880521.545184:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c052c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3689:x1805522011893760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880521.545208:0:15423:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3057 00000100:00100000:2.0:1721880521.545212:0:15423:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094663100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:lustre-MDT0000-lwp-OST0000_UUID+5:3689:x1805522011894272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880521.545216:0:7130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3687:x1805522011894016:12345-0@lo:400:kworker.0 Request processed in 45us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880521.545220:0:15416:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3687:x1805522011894528:12345-0@lo:400:kworker.0 Request processed in 46us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880521.545221:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3055 00000100:00100000:0.0:1721880521.545225:0:15416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3056 00000100:00100000:3.0:1721880521.545235:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c052c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3689:x1805522011893760:12345-0@lo:400:kworker.0 Request processed in 49us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880521.545236:0:15423:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094663100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:lustre-MDT0000-lwp-OST0000_UUID+5:3689:x1805522011894272:12345-0@lo:400:kworker.0 Request processed in 23us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880521.545240:0:15423:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3057 00000100:00100000:3.0:1721880521.545242:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 614 00000100:00080000:0.0:1721880521.545248:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880491 00000100:00080000:0.0:1721880521.545250:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880491 00000100:00100000:0.0:1721880521.545258:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880521.545265:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011894784 00000100:00100000:1.0:1721880521.545267:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3687:1805522011894016:0@lo:400:kworker.0 00000100:00100000:2.0:1721880521.545267:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011894784 00000100:00100000:0.0:1721880521.545272:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3686:1805522011894400:0@lo:400:kworker.0 00000100:00100000:1.0:1721880521.545273:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3687:1805522011894528:0@lo:400:kworker.0 00000100:00100000:3.0:1721880521.545278:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011894144 00000100:00100000:3.0:1721880521.545282:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011894144 00000100:00100000:0.0:1721880521.545284:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880521.545291:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011894912:0@lo:400:kworker.0 00000100:00100000:2.0:1721880521.545291:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:2.0:1721880521.545294:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094661180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011894784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880521.545302:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880521.545309:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011893888 00000100:00100000:3.0:1721880521.545311:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101144 00000100:00100000:1.0:1721880521.545312:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011893888 00000100:00100000:2.0:1721880521.545312:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094661180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011894784:12345-0@lo:400:kworker.0 Request processed in 18us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880521.545316:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:3.0:1721880521.545316:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011894144:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1721880521.545321:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880491 00000100:00100000:1.0:1721880521.545326:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011894400 00000100:00100000:2.0:1721880521.545326:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011894912 00000100:00100000:1.0:1721880521.545328:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011894400 00000100:00100000:2.0:1721880521.545328:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011894912 00000100:00100000:0.0:1721880521.545329:0:15423:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3058 00000100:00100000:0.0:1721880521.545332:0:15423:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:lustre-MDT0000-lwp-MDT0000_UUID+5:3686:x1805522011893888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880521.545340:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3059 00000100:00100000:2.0:1721880521.545341:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:2.0:1721880521.545343:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008779b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011894912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880521.545369:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-lwp-OST0000_UUID+5:3686:x1805522011894400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880521.545375:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011894144:12345-0@lo:400:kworker.0 Request processed in 57us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880521.545378:0:15423:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:lustre-MDT0000-lwp-MDT0000_UUID+5:3686:x1805522011893888:12345-0@lo:400:kworker.0 Request processed in 45us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880521.545380:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101144 00000100:00100000:0.0:1721880521.545382:0:15423:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3058 00000100:00100000:2.0:1721880521.545388:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008779b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011894912:12345-0@lo:400:kworker.0 Request processed in 44us (85us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880521.545392:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00100000:1.0:1721880521.545395:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-lwp-OST0000_UUID+5:3686:x1805522011894400:12345-0@lo:400:kworker.0 Request processed in 50us (109us total) trans 0 rc 0/0 00000100:00080000:0.0:1721880521.545399:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880491 00000100:00100000:1.0:1721880521.545399:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3059 00000100:00080000:0.0:1721880521.545402:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880491 00000100:00100000:3.0:1721880521.545402:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880521.545410:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011894656 00000100:00100000:1.0:1721880521.545429:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011894656 00000100:00100000:2.0:1721880521.545429:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0603f996-9d5e-4498-85ba-9976a06b304f:3689:1805522011893760:0@lo:400:kworker.0 00000100:00100000:0.0:1721880521.545435:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3686:1805522011893888:0@lo:400:kworker.0 00000100:00100000:2.0:1721880521.545436:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3689:1805522011894272:0@lo:400:kworker.0 00000100:00100000:1.0:1721880521.545440:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3060 00000100:00100000:0.0:1721880521.545442:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3686:1805522011894400:0@lo:400:kworker.0 00000100:00100000:1.0:1721880521.545443:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-lwp-OST0001_UUID+5:3688:x1805522011894656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880521.545443:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011894784:0@lo:400:kworker.0 00000100:00100000:3.0:1721880521.545444:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011894144:0@lo:400:kworker.0 00000100:00100000:0.0:1721880521.545448:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011894912:0@lo:400:kworker.0 00000100:00100000:1.0:1721880521.545458:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-lwp-OST0001_UUID+5:3688:x1805522011894656:12345-0@lo:400:kworker.0 Request processed in 14us (55us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880521.545461:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3060 00000100:00080000:0.0:1721880521.545463:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880491 00000100:00100000:3.0:1721880521.545464:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3688:1805522011894656:0@lo:400:kworker.0 00000100:00100000:2.0:1721880521.592916:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1721880521.592919:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1721880521.592936:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011895040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1721880521.592936:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880094661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011895168:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1721880521.592999:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880521.593020:0:10429:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011895040 00000100:00100000:2.0:1721880521.593027:0:10429:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011895040 00000100:00100000:3.0:1721880521.593035:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880521.593057:0:10429:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011895168 00000100:00100000:2.0:1721880521.593058:0:10429:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011895168 00000100:00100000:2.0:1721880521.593069:0:10429:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 646 00000100:00100000:2.0:1721880521.593074:0:10429:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011895040:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1721880521.593078:0:9461:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 647 00000100:00100000:0.0:1721880521.593086:0:9461:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011895168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1721880521.593103:0:9461:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00002000:00000024:2.0:1721880521.593103:0:10429:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:2.0:1721880521.593149:0:10429:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011895040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880521.593154:0:9461:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011895168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880521.593154:0:10429:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 646 00000100:00100000:0.0:1721880521.593160:0:9461:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 647 00000100:00100000:1.0:1721880521.593173:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011895040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1721880521.593173:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880094661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011895168:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1721880521.642998:0:8270:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880522.645062:0:7120:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880522.978369:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880522.978418:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880522.978447:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880522.978449:0:7130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257810304 00000100:00100000:1.0:1721880522.978461:0:7130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257810304 00000100:00100000:0.0:1721880522.978466:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880522.978498:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257810560 00000100:00100000:2.0:1721880522.978503:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257810560 00000100:00100000:1.0:1721880522.978511:0:7130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257810816 00000100:00100000:0.0:1721880522.978514:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880522.978514:0:7130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257810816 00000100:00100000:1.0:1721880522.978528:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3061 00000100:00100000:3.0:1721880522.978530:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257811072 00000100:00100000:0.0:1721880522.978532:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880522.978534:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008779bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2005:x1805522257810304:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880522.978535:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257811072 00000100:00100000:2.0:1721880522.978544:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 423 00000100:00100000:0.0:1721880522.978550:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880522.978550:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2005:x1805522257810560:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880522.978558:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257810688 00000100:00100000:3.0:1721880522.978559:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257810688 00000100:00100000:0.0:1721880522.978569:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880522.978571:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 424 00000100:00100000:3.0:1721880522.978575:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008779b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:30425778-2709-4512-9d75-01ec53c4cfad+280:2005:x1805522257811072:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880522.978598:0:7130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008779bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2005:x1805522257810304:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 64us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880522.978600:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2005:x1805522257810560:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 49us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880522.978600:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008779b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:30425778-2709-4512-9d75-01ec53c4cfad+280:2005:x1805522257811072:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 25us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880522.978604:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 424 00000100:00100000:1.0:1721880522.978605:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3061 00000100:00100000:2.0:1721880522.978608:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 423 00000100:00100000:3.0:1721880522.978620:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 425 00000100:00100000:1.0:1721880522.978623:0:7130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257810432 00000100:00100000:3.0:1721880522.978623:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2004:x1805522257810688:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880522.978625:0:7130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257810432 00000100:00100000:1.0:1721880522.978634:0:7130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257810944 00000100:00100000:3.0:1721880522.978634:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2004:x1805522257810688:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 11us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880522.978635:0:7130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257810944 00000100:00100000:2.0:1721880522.978638:0:15420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3062 00000100:00100000:3.0:1721880522.978638:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 425 00000100:00100000:2.0:1721880522.978643:0:15420:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:30425778-2709-4512-9d75-01ec53c4cfad+4135:2005:x1805522257810816:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880522.978645:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3063 00000100:00100000:1.0:1721880522.978648:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008779a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2004:x1805522257810432:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880522.978651:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257810176 00000100:00100000:3.0:1721880522.978654:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257810176 00000100:00100000:1.0:1721880522.978663:0:7130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008779a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2004:x1805522257810432:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 15us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880522.978667:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3063 00000100:00100000:2.0:1721880522.978669:0:15420:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:30425778-2709-4512-9d75-01ec53c4cfad+4135:2005:x1805522257810816:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 25us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880522.978671:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 615 00000100:00100000:1.0:1721880522.978673:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3064 00000100:00100000:3.0:1721880522.978674:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c052850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4976b229-99ef-4953-87e9-78e1b901883f+12:2004:x1805522257810176:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880522.978675:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30425778-2709-4512-9d75-01ec53c4cfad+3694:2004:x1805522257810944:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880522.978676:0:15420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3062 00000100:00100000:0.0:1721880522.978680:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880522.978687:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c052850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4976b229-99ef-4953-87e9-78e1b901883f+12:2004:x1805522257810176:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 12us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880522.978691:0:7130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30425778-2709-4512-9d75-01ec53c4cfad+3694:2004:x1805522257810944:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 14us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880522.978691:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 615 00000100:00100000:1.0:1721880522.978697:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3064 00000100:00100000:2.0:1721880522.978698:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257811200 00000100:00100000:2.0:1721880522.978701:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257811200 00000100:00100000:2.0:1721880522.978719:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 426 00000100:00100000:2.0:1721880522.978723:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008779aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:30425778-2709-4512-9d75-01ec53c4cfad+665:2004:x1805522257811200:12345-192.168.201.24@tcp:400:kworker.0 00000100:00080000:1.0:1721880522.978770:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880492 00000100:00080000:1.0:1721880522.978773:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880492 00000100:00080000:1.0:1721880522.978775:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880492 00000100:00080000:1.0:1721880522.978776:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880492 00000100:00080000:1.0:1721880522.978778:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880492 00000100:00100000:2.0:1721880522.978781:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008779aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:30425778-2709-4512-9d75-01ec53c4cfad+665:2004:x1805522257811200:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 57us (101us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880522.978788:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 426 00000100:00100000:0.0:1721880523.064970:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011895296:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1721880523.065042:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880523.065092:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011895296 00000100:00100000:2.0:1721880523.065100:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011895296 00000100:00100000:2.0:1721880523.065152:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101145 00000100:00100000:2.0:1721880523.065159:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008779a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3689:x1805522011895296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1721880523.065196:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1435709440 avail 1306247168 00000100:00100000:2.0:1721880523.065265:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008779a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3689:x1805522011895296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880523.065272:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101145 00000100:00100000:0.0:1721880523.065281:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009e86ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011895296:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1721880523.647018:0:15560:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880524.648959:0:11721:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880525.650974:0:7119:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1721880525.961008:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011895424:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1721880525.961076:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880525.961131:0:9461:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011895424 00000100:00100000:0.0:1721880525.961156:0:9461:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011895424 00000100:00080000:1.0:1721880525.961202:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880495 00000100:00100000:0.0:1721880525.961207:0:9461:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 648 00000100:00100000:0.0:1721880525.961212:0:9461:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094661c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011895424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1721880525.961244:0:9461:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:0.0:1721880525.961314:0:9461:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094661c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011895424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880525.961322:0:9461:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 648 00000100:00100000:2.0:1721880525.961337:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011895424:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1721880526.360987:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880087799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011895552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1721880526.361059:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880526.361116:0:9461:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011895552 00000100:00100000:0.0:1721880526.361124:0:9461:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011895552 00000100:00100000:0.0:1721880526.361183:0:9461:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 649 00000100:00100000:0.0:1721880526.361190:0:9461:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011895552:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1721880526.361191:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880496 00002000:00000024:0.0:1721880526.361221:0:9461:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:0.0:1721880526.361293:0:9461:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011895552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880526.361301:0:9461:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 649 00000100:00100000:2.0:1721880526.361317:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880087799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011895552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1721880526.457125:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011895680:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1721880526.457200:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880526.457250:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011895680 00000100:00100000:0.0:1721880526.457259:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011895680 00000100:00100000:0.0:1721880526.457323:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101146 00000100:00100000:0.0:1721880526.457330:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087bbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3688:x1805522011895680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1721880526.457366:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1437519872 avail 1308057600 00000100:00100000:0.0:1721880526.457420:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087bbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3688:x1805522011895680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880526.457427:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101146 00000100:00100000:2.0:1721880526.457451:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009e86ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011895680:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1721880526.553069:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3687:1805522011896064:0@lo:400:kworker.0 00000100:00100000:3.0:1721880526.553069:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3686:1805522011895936:0@lo:400:kworker.0 00000100:00100000:0.0:1721880526.553078:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0603f996-9d5e-4498-85ba-9976a06b304f:3689:1805522011895808:0@lo:400:kworker.0 00000100:00100000:1.0:1721880526.553086:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011896192:0@lo:400:kworker.0 00000100:00100000:0.0:1721880526.553166:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880526.553167:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880526.553169:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880526.553200:0:7124:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011895808 00000100:00100000:3.0:1721880526.553209:0:7124:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011895808 00000100:00100000:0.0:1721880526.553213:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3689:1805522011896320:0@lo:400:kworker.0 00000100:00100000:1.0:1721880526.553213:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3688:1805522011896704:0@lo:400:kworker.0 00000100:00100000:2.0:1721880526.553221:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3687:1805522011896576:0@lo:400:kworker.0 00000100:00100000:1.0:1721880526.553232:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880526.553248:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880526.553256:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011896192 00000100:00100000:3.0:1721880526.553257:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 616 00000100:00100000:0.0:1721880526.553285:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011896192 00000100:00100000:3.0:1721880526.553289:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c052450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0603f996-9d5e-4498-85ba-9976a06b304f+23:3689:x1805522011895808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880526.553298:0:15416:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011896064 00000100:00100000:1.0:1721880526.553302:0:15416:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011896064 00000100:00100000:2.0:1721880526.553311:0:15423:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011896704 00000100:00100000:2.0:1721880526.553315:0:15423:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011896704 00000100:00100000:0.0:1721880526.553328:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101147 00000100:00100000:1.0:1721880526.553329:0:15416:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011896576 00000100:00100000:1.0:1721880526.553331:0:15416:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011896576 00000100:00100000:0.0:1721880526.553334:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f419180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011896192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880526.553342:0:15423:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3065 00000100:00100000:1.0:1721880526.553348:0:15416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3066 00000100:00100000:2.0:1721880526.553348:0:15423:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f821180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:lustre-MDT0000-lwp-MDT0001_UUID+5:3687:x1805522011896064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880526.553348:0:7124:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c052450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0603f996-9d5e-4498-85ba-9976a06b304f+23:3689:x1805522011895808:12345-0@lo:400:kworker.0 Request processed in 58us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880526.553353:0:15416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3688:x1805522011896704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880526.553357:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 616 00000100:00100000:0.0:1721880526.553390:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f419180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011896192:12345-0@lo:400:kworker.0 Request processed in 55us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880526.553393:0:15416:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3688:x1805522011896704:12345-0@lo:400:kworker.0 Request processed in 40us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880526.553398:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101147 00000100:00100000:1.0:1721880526.553399:0:15416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3066 00000100:00100000:2.0:1721880526.553404:0:15423:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f821180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:lustre-MDT0000-lwp-MDT0001_UUID+5:3687:x1805522011896064:12345-0@lo:400:kworker.0 Request processed in 54us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880526.553410:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880526.553413:0:15423:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3065 00000100:00100000:1.0:1721880526.553418:0:15416:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011895936 00000100:00100000:1.0:1721880526.553420:0:15416:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011895936 00000100:00100000:3.0:1721880526.553431:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3686:1805522011896448:0@lo:400:kworker.0 00000100:00100000:0.0:1721880526.553434:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880526.553435:0:15416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3067 00000100:00100000:1.0:1721880526.553438:0:15416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f823480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3687:x1805522011896576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880526.553443:0:15423:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011896320 00000100:00100000:2.0:1721880526.553447:0:15423:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011896320 00000100:00100000:0.0:1721880526.553457:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011896832:0@lo:400:kworker.0 00000100:00100000:3.0:1721880526.553458:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880526.553459:0:15416:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f823480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3687:x1805522011896576:12345-0@lo:400:kworker.0 Request processed in 20us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880526.553464:0:15416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3067 00000100:00100000:2.0:1721880526.553472:0:15423:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011896448 00000100:00100000:2.0:1721880526.553475:0:15423:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011896448 00000100:00100000:1.0:1721880526.553476:0:15416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3068 00000100:00100000:1.0:1721880526.553479:0:15416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3686:x1805522011895936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880526.553482:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011896960:0@lo:400:kworker.0 00000100:00100000:0.0:1721880526.553486:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880526.553495:0:15423:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3069 00000100:00100000:1.0:1721880526.553499:0:15416:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3686:x1805522011895936:12345-0@lo:400:kworker.0 Request processed in 19us (90us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880526.553501:0:15423:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:lustre-MDT0000-lwp-OST0000_UUID+5:3689:x1805522011896320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880526.553503:0:15416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3068 00000100:00100000:3.0:1721880526.553509:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880526.553511:0:15416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3070 00000100:00100000:1.0:1721880526.553514:0:15416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3686:x1805522011896448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880526.553524:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0603f996-9d5e-4498-85ba-9976a06b304f:3689:1805522011895808:0@lo:400:kworker.0 00000100:00100000:2.0:1721880526.553542:0:15423:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:lustre-MDT0000-lwp-OST0000_UUID+5:3689:x1805522011896320:12345-0@lo:400:kworker.0 Request processed in 42us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880526.553544:0:15416:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3686:x1805522011896448:12345-0@lo:400:kworker.0 Request processed in 29us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880526.553545:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3689:1805522011896320:0@lo:400:kworker.0 00000100:00100000:3.0:1721880526.553546:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3686:1805522011895936:0@lo:400:kworker.0 00000100:00100000:2.0:1721880526.553548:0:15423:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3069 00000100:00100000:1.0:1721880526.553550:0:15416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3070 00000100:00100000:3.0:1721880526.553559:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3686:1805522011896448:0@lo:400:kworker.0 00000100:00080000:1.0:1721880526.553573:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880496 00000100:00080000:1.0:1721880526.553576:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880496 00000100:00080000:1.0:1721880526.553578:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880496 00000100:00100000:2.0:1721880526.553589:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3687:1805522011896064:0@lo:400:kworker.0 00000100:00100000:2.0:1721880526.553596:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3687:1805522011896576:0@lo:400:kworker.0 00000100:00100000:1.0:1721880526.553597:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011896832 00000100:00100000:1.0:1721880526.553600:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011896832 00000100:00100000:0.0:1721880526.553604:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011896192:0@lo:400:kworker.0 00000100:00100000:0.0:1721880526.553615:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3688:1805522011896704:0@lo:400:kworker.0 00000100:00100000:3.0:1721880526.553615:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011896960 00000100:00100000:1.0:1721880526.553620:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:3.0:1721880526.553620:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011896960 00000100:00100000:1.0:1721880526.553624:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008779b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011896832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880526.553647:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008779b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011896832:12345-0@lo:400:kworker.0 Request processed in 22us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880526.553651:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:1.0:1721880526.553655:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00100000:3.0:1721880526.553658:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011896960:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1721880526.553666:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880496 00000100:00100000:0.0:1721880526.553673:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011896832:0@lo:400:kworker.0 00000100:00100000:3.0:1721880526.553717:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011896960:12345-0@lo:400:kworker.0 Request processed in 58us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880526.553724:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00100000:0.0:1721880526.553769:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011896960:0@lo:400:kworker.0 00000100:00100000:1.0:1721880526.600919:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1721880526.600927:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1721880526.600940:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011897216:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1721880526.600940:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f419500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011897088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1721880526.601004:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880526.601031:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880526.601046:0:9461:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011897088 00000100:00100000:0.0:1721880526.601058:0:9461:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011897088 00000100:00100000:2.0:1721880526.601065:0:10429:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011897216 00000100:00100000:2.0:1721880526.601069:0:10429:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011897216 00000100:00100000:2.0:1721880526.601100:0:10429:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 650 00000100:00100000:2.0:1721880526.601105:0:10429:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f418380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011897216:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1721880526.601115:0:9461:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 651 00000100:00100000:0.0:1721880526.601121:0:9461:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011897088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1721880526.601132:0:10429:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00002000:00000024:0.0:1721880526.601136:0:9461:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:2.0:1721880526.601190:0:10429:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f418380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011897216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880526.601194:0:9461:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011897088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880526.601198:0:10429:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 650 00000100:00100000:0.0:1721880526.601202:0:9461:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 651 00000100:00100000:1.0:1721880526.601202:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009e86e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011897216:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1721880526.601203:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f419500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011897088:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1721880526.652985:0:8270:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880527.655047:0:7120:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880527.986512:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880527.986560:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880527.986603:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880527.986615:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257811328 00000100:00100000:0.0:1721880527.986622:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880527.986628:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257811328 00000100:00100000:0.0:1721880527.986644:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880527.986652:0:15477:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257811456 00000100:00100000:0.0:1721880527.986659:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880527.986659:0:15477:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257811456 00000100:00100000:0.0:1721880527.986672:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880527.986689:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880527.986695:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 617 00000100:00100000:2.0:1721880527.986696:0:15477:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257811584 00000100:00100000:2.0:1721880527.986697:0:15477:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257811584 00000100:00100000:3.0:1721880527.986706:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c052050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4976b229-99ef-4953-87e9-78e1b901883f+12:2005:x1805522257811328:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880527.986709:0:15477:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257811968 00000100:00100000:2.0:1721880527.986711:0:15477:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257811968 00000100:00100000:2.0:1721880527.986720:0:15477:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257812096 00000100:00100000:2.0:1721880527.986722:0:15477:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257812096 00000100:00100000:0.0:1721880527.986723:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880527.986785:0:15477:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3071 00000100:00100000:2.0:1721880527.986792:0:15477:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2004:x1805522257811456:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880527.986797:0:15415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3072 00000100:00100000:0.0:1721880527.986807:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3073 00000100:00100000:1.0:1721880527.986808:0:15415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2005:x1805522257811584:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880527.986815:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30425778-2709-4512-9d75-01ec53c4cfad+4135:2004:x1805522257811968:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880527.986852:0:15477:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2004:x1805522257811456:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 58us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880527.986853:0:15415:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2005:x1805522257811584:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 47us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880527.986855:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c052050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4976b229-99ef-4953-87e9-78e1b901883f+12:2005:x1805522257811328:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 147us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880527.986860:0:15477:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3071 00000100:00100000:0.0:1721880527.986862:0:7130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30425778-2709-4512-9d75-01ec53c4cfad+4135:2004:x1805522257811968:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 49us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880527.986866:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 617 00000100:00100000:1.0:1721880527.986871:0:15415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3072 00000100:00100000:0.0:1721880527.986878:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3073 00000100:00100000:2.0:1721880527.986884:0:15477:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3074 00000100:00100000:2.0:1721880527.986888:0:15477:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:30425778-2709-4512-9d75-01ec53c4cfad+3694:2005:x1805522257812096:12345-192.168.201.24@tcp:400:kworker.0 00000100:00080000:1.0:1721880527.986898:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880497 00000100:00080000:1.0:1721880527.986901:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880497 00000100:00080000:1.0:1721880527.986903:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880497 00000100:00100000:2.0:1721880527.986908:0:15477:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:30425778-2709-4512-9d75-01ec53c4cfad+3694:2005:x1805522257812096:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 19us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880527.986911:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257811712 00000100:00100000:2.0:1721880527.986914:0:15477:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3074 00000100:00100000:1.0:1721880527.986915:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257811840 00000100:00100000:0.0:1721880527.986916:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257811712 00000100:00100000:3.0:1721880527.986918:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257812224 00000100:00100000:1.0:1721880527.986919:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257811840 00000100:00100000:3.0:1721880527.986923:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257812224 00000100:00100000:2.0:1721880527.986939:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257812352 00000100:00100000:2.0:1721880527.986942:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257812352 00000100:00100000:0.0:1721880527.986950:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 429 00000100:00100000:0.0:1721880527.986955:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092857850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2004:x1805522257811712:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880527.986957:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 430 00000100:00100000:1.0:1721880527.986962:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2005:x1805522257811840:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880527.986980:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880092857850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2004:x1805522257811712:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 25us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880527.986980:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 431 00000100:00100000:1.0:1721880527.986986:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2005:x1805522257811840:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 24us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880527.986988:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 432 00000100:00100000:3.0:1721880527.986988:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:30425778-2709-4512-9d75-01ec53c4cfad+280:2004:x1805522257812224:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880527.986992:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 429 00000100:00100000:2.0:1721880527.986995:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:30425778-2709-4512-9d75-01ec53c4cfad+665:2005:x1805522257812352:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880527.986996:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 430 00000100:00100000:2.0:1721880527.987029:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:30425778-2709-4512-9d75-01ec53c4cfad+665:2005:x1805522257812352:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 34us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880527.987032:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:30425778-2709-4512-9d75-01ec53c4cfad+280:2004:x1805522257812224:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 42us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880527.987039:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 432 00000100:00100000:3.0:1721880527.987046:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 431 00000100:00080000:0.0:1721880527.987494:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880497 00000100:00080000:0.0:1721880527.987500:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880497 00000100:00100000:3.0:1721880528.073087:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011897344:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1721880528.073191:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880528.073303:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011897344 00000100:00100000:0.0:1721880528.073316:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011897344 00000100:00100000:0.0:1721880528.073387:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101148 00000100:00100000:0.0:1721880528.073395:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3689:x1805522011897344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1721880528.073443:0:15587:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1435709440 avail 1306247168 00000100:00100000:0.0:1721880528.073538:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3689:x1805522011897344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 142us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880528.073547:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101148 00000100:00100000:3.0:1721880528.073605:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011897344:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1721880528.657010:0:15560:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721880529.658904:0:11721:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880530.661156:0:7119:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1721880530.968975:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88011f823100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011897472:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1721880530.969050:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880530.969126:0:9461:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011897472 00000100:00100000:0.0:1721880530.969136:0:9461:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011897472 00000100:00080000:2.0:1721880530.969174:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880500 00000100:00100000:0.0:1721880530.969215:0:9461:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 652 00000100:00100000:0.0:1721880530.969223:0:9461:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011897472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1721880530.969257:0:9461:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:0.0:1721880530.969305:0:9461:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011897472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880530.969310:0:9461:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 652 00000100:00100000:1.0:1721880530.969334:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88011f823100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011897472:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1721880531.369144:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88011f822680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011897600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1721880531.369335:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880531.369427:0:9461:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011897600 00000100:00100000:0.0:1721880531.369439:0:9461:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011897600 00000100:00100000:0.0:1721880531.369513:0:9461:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 653 00000100:00100000:0.0:1721880531.369522:0:9461:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011897600:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1721880531.369529:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880501 00002000:00000024:0.0:1721880531.369558:0:9461:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:0.0:1721880531.369628:0:9461:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011897600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880531.369635:0:9461:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 653 00000100:00100000:3.0:1721880531.369667:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88011f822680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011897600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1721880531.465102:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88011f822680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011897728:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1721880531.465243:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880531.465348:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011897728 00000100:00100000:0.0:1721880531.465361:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011897728 00000100:00100000:0.0:1721880531.465443:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101149 00000100:00100000:0.0:1721880531.465456:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f418a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+19:3688:x1805522011897728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1721880531.465513:0:15587:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1437519872 avail 1308057600 00000100:00100000:0.0:1721880531.465619:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f418a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+19:3688:x1805522011897728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 162us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880531.465634:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101149 00000100:00100000:1.0:1721880531.465684:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88011f822680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011897728:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1721880531.561085:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f419880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3686:1805522011897984:0@lo:400:kworker.0 00000100:00100000:2.0:1721880531.561085:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f41b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3687:1805522011898112:0@lo:400:kworker.0 00000100:00100000:0.0:1721880531.561086:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f41a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011898240:0@lo:400:kworker.0 00000100:00100000:3.0:1721880531.561087:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f418000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0603f996-9d5e-4498-85ba-9976a06b304f:3689:1805522011897856:0@lo:400:kworker.0 00000100:00100000:3.0:1721880531.561198:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880531.561208:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880531.561208:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880531.561229:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f41b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3689:1805522011898368:0@lo:400:kworker.0 00000100:00100000:1.0:1721880531.561240:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011898240 00000100:00100000:2.0:1721880531.561244:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f41bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3687:1805522011898624:0@lo:400:kworker.0 00000100:00100000:1.0:1721880531.561249:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011898240 00000100:00100000:0.0:1721880531.561258:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f418700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3688:1805522011898752:0@lo:400:kworker.0 00000100:00100000:3.0:1721880531.561262:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880531.561273:0:15420:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011898112 00000100:00100000:3.0:1721880531.561275:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f41aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011898880:0@lo:400:kworker.0 00000100:00100000:2.0:1721880531.561276:0:15420:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011898112 00000100:00100000:0.0:1721880531.561289:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880531.561295:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101150 00000100:00100000:3.0:1721880531.561295:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880531.561302:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011898240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880531.561308:0:15420:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011898368 00000100:00100000:2.0:1721880531.561309:0:15420:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011898368 00000100:00100000:2.0:1721880531.561325:0:15420:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011898752 00000100:00100000:2.0:1721880531.561327:0:15420:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011898752 00000100:00100000:3.0:1721880531.561337:0:7124:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011897856 00000100:00100000:2.0:1721880531.561341:0:15420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3075 00000100:00100000:3.0:1721880531.561341:0:7124:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011897856 00000100:00100000:2.0:1721880531.561345:0:15420:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f823100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-MDT0001_UUID+5:3687:x1805522011898112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880531.561347:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3076 00000100:00100000:0.0:1721880531.561355:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3689:x1805522011898368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880531.561359:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011898240:12345-0@lo:400:kworker.0 Request processed in 57us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880531.561365:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101150 00000100:00100000:3.0:1721880531.561367:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 618 00000100:00100000:3.0:1721880531.561372:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c051c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0603f996-9d5e-4498-85ba-9976a06b304f+23:3689:x1805522011897856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880531.561385:0:15420:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f823100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-MDT0001_UUID+5:3687:x1805522011898112:12345-0@lo:400:kworker.0 Request processed in 39us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880531.561390:0:15420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3075 00000100:00100000:1.0:1721880531.561405:0:15434:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3077 00000100:00100000:3.0:1721880531.561405:0:7124:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c051c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0603f996-9d5e-4498-85ba-9976a06b304f+23:3689:x1805522011897856:12345-0@lo:400:kworker.0 Request processed in 32us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880531.561407:0:7129:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3689:x1805522011898368:12345-0@lo:400:kworker.0 Request processed in 50us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880531.561409:0:15434:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0001-lwp-OST0001_UUID+5:3688:x1805522011898752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880531.561411:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 618 00000100:00100000:0.0:1721880531.561416:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3076 00000100:00080000:2.0:1721880531.561421:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880501 00000100:00080000:2.0:1721880531.561424:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880501 00000100:00080000:2.0:1721880531.561426:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880501 00000100:00100000:1.0:1721880531.561431:0:15434:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0001-lwp-OST0001_UUID+5:3688:x1805522011898752:12345-0@lo:400:kworker.0 Request processed in 21us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880531.561433:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880531.561436:0:15434:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3077 00000100:00100000:0.0:1721880531.561438:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011898624 00000100:00100000:0.0:1721880531.561443:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011898624 00000100:00100000:1.0:1721880531.561453:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880531.561456:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f418000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0603f996-9d5e-4498-85ba-9976a06b304f:3689:1805522011897856:0@lo:400:kworker.0 00000100:00100000:2.0:1721880531.561457:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f41b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3687:1805522011898112:0@lo:400:kworker.0 00000100:00100000:3.0:1721880531.561465:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f41b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3689:1805522011898368:0@lo:400:kworker.0 00000100:00100000:0.0:1721880531.561469:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011897984 00000100:00100000:1.0:1721880531.561469:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f41a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3686:1805522011898496:0@lo:400:kworker.0 00000100:00100000:0.0:1721880531.561473:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011897984 00000100:00100000:1.0:1721880531.561484:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880531.561487:0:15477:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3078 00000100:00100000:0.0:1721880531.561491:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011898496 00000100:00100000:2.0:1721880531.561491:0:15477:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f822d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-lwp-OST0001_UUID+5:3687:x1805522011898624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880531.561494:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011898496 00000100:00100000:1.0:1721880531.561494:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f419c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011899008:0@lo:400:kworker.0 00000100:00100000:3.0:1721880531.561506:0:15432:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3079 00000100:00100000:3.0:1721880531.561510:0:15432:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f41ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-MDT0000_UUID+5:3686:x1805522011897984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880531.561512:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880531.561517:0:15477:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f822d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-lwp-OST0001_UUID+5:3687:x1805522011898624:12345-0@lo:400:kworker.0 Request processed in 25us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880531.561521:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3080 00000100:00100000:2.0:1721880531.561524:0:15477:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3078 00000100:00100000:0.0:1721880531.561527:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f41b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3686:x1805522011898496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880531.561542:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011898880 00000100:00100000:1.0:1721880531.561545:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011898880 00000100:00100000:3.0:1721880531.561545:0:15432:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f41ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-MDT0000_UUID+5:3686:x1805522011897984:12345-0@lo:400:kworker.0 Request processed in 34us (91us total) trans 0 rc 0/0 00000100:00080000:2.0:1721880531.561547:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880501 00000100:00080000:2.0:1721880531.561550:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880501 00000100:00100000:3.0:1721880531.561550:0:15432:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3079 00000100:00080000:2.0:1721880531.561553:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880501 00000100:00100000:1.0:1721880531.561566:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011899008 00000100:00100000:2.0:1721880531.561566:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f41bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3687:1805522011898624:0@lo:400:kworker.0 00000100:00100000:1.0:1721880531.561567:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011899008 00000100:00100000:0.0:1721880531.561570:0:7129:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f41b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3686:x1805522011898496:12345-0@lo:400:kworker.0 Request processed in 41us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880531.561577:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3080 00000100:00080000:2.0:1721880531.561577:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880501 00000100:00100000:3.0:1721880531.561579:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:1.0:1721880531.561583:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00000100:00100000:3.0:1721880531.561583:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011898880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880531.561587:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f418000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011899008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880531.561605:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011898880:12345-0@lo:400:kworker.0 Request processed in 22us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880531.561611:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f418000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011899008:12345-0@lo:400:kworker.0 Request processed in 24us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880531.561611:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00100000:1.0:1721880531.561616:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00000100:00100000:0.0:1721880531.561624:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f41a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011898240:0@lo:400:kworker.0 00000100:00100000:3.0:1721880531.561632:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f41aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011898880:0@lo:400:kworker.0 00000100:00100000:0.0:1721880531.561637:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f418700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3688:1805522011898752:0@lo:400:kworker.0 00000100:00100000:1.0:1721880531.561642:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f419880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3686:1805522011897984:0@lo:400:kworker.0 00000100:00100000:1.0:1721880531.561649:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f41a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3686:1805522011898496:0@lo:400:kworker.0 00000100:00100000:1.0:1721880531.561655:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f419c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011899008:0@lo:400:kworker.0 00000100:00100000:1.0:1721880531.608896:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1721880531.608917:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011899136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1721880531.608982:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880531.609023:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f419c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011899264:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1721880531.609040:0:9461:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011899136 00000100:00100000:1.0:1721880531.609043:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880531.609048:0:9461:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011899136 00000100:00100000:0.0:1721880531.609093:0:9461:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011899264 00000100:00100000:0.0:1721880531.609096:0:9461:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011899264 00000100:00100000:3.0:1721880531.609100:0:10429:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 654 00000100:00100000:3.0:1721880531.609107:0:10429:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f41a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011899136:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1721880531.609113:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 655 00000100:00100000:2.0:1721880531.609119:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f419880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011899264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1721880531.609137:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00002000:00000024:3.0:1721880531.609137:0:10429:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:3.0:1721880531.609190:0:10429:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f41a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011899136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880531.609191:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f419880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011899264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880531.609197:0:10429:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 654 00000100:00100000:2.0:1721880531.609201:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 655 00000100:00100000:1.0:1721880531.609212:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009e86fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011899136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1721880531.609223:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f419c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011899264:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1721880531.663007:0:8270:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880532.665116:0:7120:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880532.994513:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880532.994555:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880532.994575:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880532.994588:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880532.994599:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880532.994614:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880532.994624:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880532.994633:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880532.994662:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880532.994663:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257812480 00000100:00100000:1.0:1721880532.994664:0:15434:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257812608 00000100:00100000:1.0:1721880532.994681:0:15434:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257812608 00000100:00100000:3.0:1721880532.994681:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257812480 00000100:00100000:0.0:1721880532.994684:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257812736 00000100:00100000:0.0:1721880532.994690:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257812736 00000100:00100000:2.0:1721880532.994707:0:7130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257813120 00000100:00100000:2.0:1721880532.994716:0:7130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257813120 00000100:00100000:0.0:1721880532.994775:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257813248 00000100:00100000:0.0:1721880532.994777:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257813248 00000100:00100000:0.0:1721880532.994792:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3081 00000100:00100000:0.0:1721880532.994797:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2004:x1805522257812736:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880532.994804:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3082 00000100:00100000:2.0:1721880532.994812:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30425778-2709-4512-9d75-01ec53c4cfad+4135:2005:x1805522257813120:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880532.994812:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 619 00000100:00100000:3.0:1721880532.994820:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c051850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4976b229-99ef-4953-87e9-78e1b901883f+12:2004:x1805522257812480:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880532.994836:0:15434:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3083 00000100:00100000:1.0:1721880532.994845:0:15434:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:30425778-2709-4512-9d75-01ec53c4cfad+3694:2004:x1805522257813248:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880532.994848:0:7129:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2004:x1805522257812736:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 50us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880532.994853:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3081 00000100:00100000:0.0:1721880532.994874:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3084 00000100:00100000:0.0:1721880532.994878:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2005:x1805522257812608:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880532.994894:0:7130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30425778-2709-4512-9d75-01ec53c4cfad+4135:2005:x1805522257813120:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 82us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880532.994894:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c051850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4976b229-99ef-4953-87e9-78e1b901883f+12:2004:x1805522257812480:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 74us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880532.994897:0:7129:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2005:x1805522257812608:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 19us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880532.994903:0:15434:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:30425778-2709-4512-9d75-01ec53c4cfad+3694:2004:x1805522257813248:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 57us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880532.994903:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3082 00000100:00100000:3.0:1721880532.994903:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 619 00000100:00100000:0.0:1721880532.994907:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3084 00000100:00100000:1.0:1721880532.994914:0:15434:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3083 00000100:00100000:2.0:1721880532.994945:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257812864 00000100:00100000:2.0:1721880532.994948:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257812864 00000100:00100000:3.0:1721880532.994953:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257812992 00000100:00100000:3.0:1721880532.994957:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257812992 00000100:00100000:1.0:1721880532.994962:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257813376 00000100:00100000:1.0:1721880532.994968:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257813376 00000100:00100000:2.0:1721880532.994974:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257813504 00000100:00100000:2.0:1721880532.994976:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257813504 00000100:00100000:3.0:1721880532.994981:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 435 00000100:00100000:3.0:1721880532.994986:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2005:x1805522257812864:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880532.995005:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 436 00000100:00100000:2.0:1721880532.995012:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 437 00000100:00100000:1.0:1721880532.995013:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2004:x1805522257812992:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880532.995016:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2005:x1805522257812864:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 29us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880532.995017:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:30425778-2709-4512-9d75-01ec53c4cfad+280:2005:x1805522257813376:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880532.995025:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 435 00000100:00100000:2.0:1721880532.995044:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:30425778-2709-4512-9d75-01ec53c4cfad+280:2005:x1805522257813376:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 26us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880532.995045:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 438 00000100:00100000:2.0:1721880532.995050:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 437 00000100:00100000:3.0:1721880532.995052:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087bbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:30425778-2709-4512-9d75-01ec53c4cfad+665:2004:x1805522257813504:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880532.995054:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2004:x1805522257812992:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 41us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880532.995061:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 436 00000100:00080000:2.0:1721880532.995082:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880502 00000100:00080000:2.0:1721880532.995086:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880502 00000100:00080000:2.0:1721880532.995088:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880502 00000100:00080000:2.0:1721880532.995091:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880502 00000100:00080000:2.0:1721880532.995092:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880502 00000100:00100000:3.0:1721880532.995118:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087bbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:30425778-2709-4512-9d75-01ec53c4cfad+665:2004:x1805522257813504:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 47us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880532.995130:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 438 00000100:00100000:0.0:1721880533.081062:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011899392:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1721880533.081119:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880533.081232:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011899392 00000100:00100000:3.0:1721880533.081248:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011899392 00000100:00100000:3.0:1721880533.081335:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101151 00000100:00100000:3.0:1721880533.081345:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087bbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011899392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1721880533.081394:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1435709440 avail 1306247168 00000100:00100000:3.0:1721880533.081489:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087bbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011899392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 144us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880533.081498:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101151 00000100:00100000:0.0:1721880533.081519:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009e86ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011899392:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1721880533.667095:0:15560:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721880534.668891:0:11721:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721880535.670818:0:7119:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1721880535.976940:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f419c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011899520:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1721880535.976990:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880535.977034:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011899520 00000100:00100000:0.0:1721880535.977043:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011899520 00000100:00080000:2.0:1721880535.977077:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880505 00000100:00100000:0.0:1721880535.977121:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 656 00000100:00100000:0.0:1721880535.977129:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f823800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011899520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1721880535.977157:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:0.0:1721880535.977212:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f823800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011899520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880535.977220:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 656 00000100:00100000:2.0:1721880535.977228:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f419c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011899520:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1721880536.376972:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011899648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1721880536.377029:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880536.377152:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011899648 00000100:00100000:0.0:1721880536.377160:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011899648 00000100:00080000:2.0:1721880536.377216:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880506 00000100:00100000:0.0:1721880536.377226:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 657 00000100:00100000:0.0:1721880536.377234:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f41b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011899648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1721880536.377259:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:0.0:1721880536.377317:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f41b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011899648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880536.377325:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 657 00000100:00100000:1.0:1721880536.377340:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009e86f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011899648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1721880536.472956:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f419500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011899776:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1721880536.473014:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880536.473072:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011899776 00000100:00100000:3.0:1721880536.473080:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011899776 00000100:00100000:3.0:1721880536.473135:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101152 00000100:00100000:3.0:1721880536.473140:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f822300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3687:x1805522011899776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1721880536.473169:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1437519872 avail 1308057600 00000100:00100000:3.0:1721880536.473212:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f822300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3687:x1805522011899776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880536.473216:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101152 00000100:00100000:2.0:1721880536.473249:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f419500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011899776:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1721880536.568967:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f418700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3686:1805522011900160:0@lo:400:kworker.0 00000100:00100000:0.0:1721880536.568975:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f419500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011899904:0@lo:400:kworker.0 00000100:00100000:2.0:1721880536.568982:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f419c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3689:1805522011900032:0@lo:400:kworker.0 00000100:00100000:3.0:1721880536.568982:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f41a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011900288:0@lo:400:kworker.0 00000100:00100000:0.0:1721880536.569031:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880536.569031:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880536.569034:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880536.569049:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011900160 00000100:00100000:2.0:1721880536.569055:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011900160 00000100:00100000:0.0:1721880536.569056:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f41aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011900416:0@lo:400:kworker.0 00000100:00100000:1.0:1721880536.569056:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3686:1805522011900672:0@lo:400:kworker.0 00000100:00100000:3.0:1721880536.569058:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011900800:0@lo:400:kworker.0 00000100:00100000:1.0:1721880536.569068:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880536.569078:0:7124:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011899904 00000100:00100000:0.0:1721880536.569081:0:7124:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011899904 00000100:00100000:3.0:1721880536.569083:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011900288 00000100:00100000:3.0:1721880536.569086:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011900288 00000100:00100000:2.0:1721880536.569091:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011900672 00000100:00100000:2.0:1721880536.569114:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011900672 00000100:00100000:0.0:1721880536.569124:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 620 00000100:00100000:0.0:1721880536.569129:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c051450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011899904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880536.569130:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3085 00000100:00100000:3.0:1721880536.569132:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101153 00000100:00100000:2.0:1721880536.569135:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800878d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-MDT0001_UUID+5:3686:x1805522011900160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880536.569136:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011900288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880536.569137:0:15415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3086 00000100:00100000:1.0:1721880536.569141:0:15415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800878d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3686:x1805522011900672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880536.569165:0:7124:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c051450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011899904:12345-0@lo:400:kworker.0 Request processed in 36us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880536.569170:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 620 00000100:00100000:3.0:1721880536.569176:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011900288:12345-0@lo:400:kworker.0 Request processed in 39us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880536.569180:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800878d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-MDT0001_UUID+5:3686:x1805522011900160:12345-0@lo:400:kworker.0 Request processed in 45us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880536.569181:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101153 00000100:00100000:1.0:1721880536.569182:0:15415:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800878d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3686:x1805522011900672:12345-0@lo:400:kworker.0 Request processed in 41us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880536.569186:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3085 00000100:00100000:1.0:1721880536.569188:0:15415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3086 00000100:00080000:2.0:1721880536.569204:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880506 00000100:00100000:3.0:1721880536.569204:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1721880536.569206:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880506 00000100:00100000:0.0:1721880536.569212:0:15434:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011900800 00000100:00100000:0.0:1721880536.569214:0:15434:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011900800 00000100:00100000:2.0:1721880536.569215:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880536.569223:0:15415:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011900032 00000100:00100000:1.0:1721880536.569226:0:15415:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011900032 00000100:00100000:0.0:1721880536.569229:0:15434:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3087 00000100:00100000:2.0:1721880536.569229:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f41bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3689:1805522011900544:0@lo:400:kworker.0 00000100:00100000:0.0:1721880536.569232:0:15434:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011900800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880536.569234:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f41a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011900288:0@lo:400:kworker.0 00000100:00100000:1.0:1721880536.569238:0:15415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3088 00000100:00100000:1.0:1721880536.569240:0:15415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f822680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1805522011900032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880536.569247:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880536.569249:0:15434:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011900800:12345-0@lo:400:kworker.0 Request processed in 18us (46us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880536.569253:0:15434:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3087 00000100:00100000:3.0:1721880536.569254:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011900800:0@lo:400:kworker.0 00000100:00100000:0.0:1721880536.569258:0:15434:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011900544 00000100:00100000:2.0:1721880536.569259:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011901056:0@lo:400:kworker.0 00000100:00100000:0.0:1721880536.569260:0:15434:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011900544 00000100:00100000:1.0:1721880536.569260:0:15415:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f822680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1805522011900032:12345-0@lo:400:kworker.0 Request processed in 19us (45us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880536.569263:0:15415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3088 00000100:00100000:0.0:1721880536.569269:0:15434:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3089 00000100:00100000:0.0:1721880536.569272:0:15434:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1805522011900544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880536.569276:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880536.569281:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880536.569286:0:15434:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1805522011900544:12345-0@lo:400:kworker.0 Request processed in 14us (40us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880536.569287:0:15477:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011900416 00000100:00100000:0.0:1721880536.569289:0:15434:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3089 00000100:00100000:3.0:1721880536.569290:0:15477:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011900416 00000100:00100000:1.0:1721880536.569291:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011900928:0@lo:400:kworker.0 00000100:00080000:0.0:1721880536.569298:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880506 00000100:00100000:2.0:1721880536.569299:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f419c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3689:1805522011900032:0@lo:400:kworker.0 00000100:00080000:0.0:1721880536.569300:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880506 00000100:00100000:1.0:1721880536.569302:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880536.569307:0:15432:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3090 00000100:00100000:2.0:1721880536.569307:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f41bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3689:1805522011900544:0@lo:400:kworker.0 00000100:00100000:0.0:1721880536.569310:0:15432:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800878dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011900416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880536.569316:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f419500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011899904:0@lo:400:kworker.0 00000100:00100000:3.0:1721880536.569317:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011901056 00000100:00100000:3.0:1721880536.569319:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011901056 00000100:00100000:0.0:1721880536.569322:0:15432:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800878dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011900416:12345-0@lo:400:kworker.0 Request processed in 12us (41us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880536.569324:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f41aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011900416:0@lo:400:kworker.0 00000100:00100000:0.0:1721880536.569326:0:15432:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3090 00000100:00080000:0.0:1721880536.569334:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880506 00000100:00100000:2.0:1721880536.569339:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f418700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3686:1805522011900160:0@lo:400:kworker.0 00000100:00100000:3.0:1721880536.569340:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011900928 00000100:00100000:3.0:1721880536.569341:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011900928 00000100:00100000:0.0:1721880536.569343:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 439 00000100:00100000:0.0:1721880536.569345:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011901056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880536.569347:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3686:1805522011900672:0@lo:400:kworker.0 00000100:00100000:3.0:1721880536.569355:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440 00000100:00100000:3.0:1721880536.569359:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800878daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011900928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880536.569362:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011901056:12345-0@lo:400:kworker.0 Request processed in 16us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880536.569365:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 439 00000100:00100000:2.0:1721880536.569368:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011901056:0@lo:400:kworker.0 00000100:00080000:0.0:1721880536.569373:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880506 00000100:00100000:3.0:1721880536.569396:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800878daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011900928:12345-0@lo:400:kworker.0 Request processed in 36us (92us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880536.569404:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440 00000100:00100000:1.0:1721880536.569417:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011900928:0@lo:400:kworker.0 00000100:00100000:1.0:1721880536.616906:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009e86fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011901312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1721880536.616916:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011901184:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1721880536.616970:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880536.617001:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880536.617031:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011901312 00000100:00100000:0.0:1721880536.617038:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011901312 00000100:00100000:3.0:1721880536.617041:0:10429:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011901184 00000100:00100000:3.0:1721880536.617047:0:10429:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011901184 00000100:00100000:0.0:1721880536.617069:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 658 00000100:00100000:0.0:1721880536.617074:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800878d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011901312:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1721880536.617076:0:10429:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 659 00000100:00100000:3.0:1721880536.617081:0:10429:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011901184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1721880536.617112:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00002000:00000024:3.0:1721880536.617112:0:10429:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:0.0:1721880536.617169:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800878d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011901312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880536.617170:0:10429:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011901184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880536.617173:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 658 00000100:00100000:3.0:1721880536.617176:0:10429:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 659 00000100:00100000:1.0:1721880536.617193:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009e86fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011901312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1721880536.617196:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011901184:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1721880536.672879:0:8270:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880537.674852:0:7120:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880538.002211:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880538.002256:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880538.002282:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257813632 00000100:00100000:0.0:1721880538.002290:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880538.002291:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257813632 00000100:00100000:0.0:1721880538.002315:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880538.002325:0:15432:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257813760 00000100:00100000:0.0:1721880538.002330:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880538.002330:0:15432:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257813760 00000100:00100000:2.0:1721880538.002340:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257814016 00000100:00100000:3.0:1721880538.002340:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 621 00000100:00100000:0.0:1721880538.002346:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880538.002346:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257814016 00000100:00100000:3.0:1721880538.002346:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c051050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4976b229-99ef-4953-87e9-78e1b901883f+12:2005:x1805522257813632:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880538.002358:0:15432:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257813888 00000100:00100000:1.0:1721880538.002360:0:15432:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257813888 00000100:00100000:0.0:1721880538.002363:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880538.002371:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257814144 00000100:00100000:2.0:1721880538.002373:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257814144 00000100:00100000:1.0:1721880538.002377:0:15432:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257814272 00000100:00100000:1.0:1721880538.002378:0:15432:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257814272 00000100:00100000:0.0:1721880538.002380:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880538.002385:0:15432:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257814400 00000100:00100000:1.0:1721880538.002387:0:15432:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257814400 00000100:00100000:2.0:1721880538.002389:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257814528 00000100:00100000:2.0:1721880538.002391:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257814528 00000100:00100000:1.0:1721880538.002397:0:15432:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3091 00000100:00100000:1.0:1721880538.002401:0:15432:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087bbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2004:x1805522257813760:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880538.002401:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c051050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4976b229-99ef-4953-87e9-78e1b901883f+12:2005:x1805522257813632:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 54us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880538.002402:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 441 00000100:00100000:2.0:1721880538.002406:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2004:x1805522257814016:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880538.002407:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 621 00000100:00100000:0.0:1721880538.002413:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880538.002428:0:15432:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087bbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2004:x1805522257813760:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 26us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880538.002432:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2004:x1805522257814016:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 26us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880538.002434:0:15432:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3091 00000100:00100000:2.0:1721880538.002436:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 441 00000100:00100000:3.0:1721880538.002447:0:15477:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3092 00000100:00100000:2.0:1721880538.002448:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257814656 00000100:00100000:2.0:1721880538.002450:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257814656 00000100:00100000:3.0:1721880538.002452:0:15477:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087bbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2005:x1805522257813888:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880538.002454:0:15432:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3093 00000100:00100000:1.0:1721880538.002459:0:15432:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:30425778-2709-4512-9d75-01ec53c4cfad+4135:2004:x1805522257814272:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880538.002459:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 442 00000100:00100000:2.0:1721880538.002462:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087bbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2005:x1805522257814144:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880538.002473:0:15477:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087bbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2005:x1805522257813888:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 21us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880538.002479:0:15477:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3092 00000100:00100000:2.0:1721880538.002481:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087bbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2005:x1805522257814144:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 18us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880538.002482:0:15432:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:30425778-2709-4512-9d75-01ec53c4cfad+4135:2004:x1805522257814272:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 23us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880538.002485:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 442 00000100:00100000:1.0:1721880538.002488:0:15432:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3093 00000100:00100000:2.0:1721880538.002490:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 443 00000100:00100000:2.0:1721880538.002492:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880125984a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:30425778-2709-4512-9d75-01ec53c4cfad+280:2004:x1805522257814528:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880538.002495:0:15477:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3094 00000100:00100000:3.0:1721880538.002499:0:15477:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:30425778-2709-4512-9d75-01ec53c4cfad+3694:2005:x1805522257814400:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880538.002503:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880125984a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:30425778-2709-4512-9d75-01ec53c4cfad+280:2004:x1805522257814528:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 10us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880538.002507:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 443 00000100:00100000:1.0:1721880538.002513:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 444 00000100:00100000:3.0:1721880538.002517:0:15477:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:30425778-2709-4512-9d75-01ec53c4cfad+3694:2005:x1805522257814400:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 17us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880538.002518:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880125987100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:30425778-2709-4512-9d75-01ec53c4cfad+665:2005:x1805522257814656:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880538.002523:0:15477:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3094 00000100:00100000:1.0:1721880538.002539:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880125987100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:30425778-2709-4512-9d75-01ec53c4cfad+665:2005:x1805522257814656:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 21us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880538.002543:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 444 00000100:00080000:0.0:1721880538.002583:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880508 00000100:00080000:0.0:1721880538.002587:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880508 00000100:00080000:0.0:1721880538.002589:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880508 00000100:00080000:0.0:1721880538.002591:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880508 00000100:00080000:0.0:1721880538.002592:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880508 00000100:00100000:1.0:1721880538.088938:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880125986680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011901440:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1721880538.089001:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880538.089048:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011901440 00000100:00100000:0.0:1721880538.089055:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011901440 00000100:00100000:0.0:1721880538.089112:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101154 00000100:00100000:0.0:1721880538.089117:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800878da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011901440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1721880538.089144:0:15587:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1435709440 avail 1306247168 00000100:00100000:0.0:1721880538.089188:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800878da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011901440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880538.089194:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101154 00000100:00100000:1.0:1721880538.089218:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880125986680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011901440:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1721880538.676927:0:15560:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721880539.678898:0:11721:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880540.680881:0:7119:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1721880540.984941:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1721880540.984961:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011901568:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1721880540.985010:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880540.985066:0:10429:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011901568 00000100:00100000:3.0:1721880540.985073:0:10429:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011901568 00000100:00080000:0.0:1721880540.985125:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880510 00000100:00100000:3.0:1721880540.985127:0:10429:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 660 00000100:00100000:3.0:1721880540.985134:0:10429:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800878d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011901568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1721880540.985163:0:10429:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:3.0:1721880540.985210:0:10429:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800878d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011901568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880540.985215:0:10429:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 660 00000100:00100000:1.0:1721880540.985231:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011901568:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1721880541.384962:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011901696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1721880541.385037:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880541.385105:0:10429:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011901696 00000100:00100000:3.0:1721880541.385113:0:10429:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011901696 00000100:00080000:0.0:1721880541.385147:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880511 00000100:00100000:3.0:1721880541.385159:0:10429:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 661 00000100:00100000:3.0:1721880541.385165:0:10429:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011901696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1721880541.385185:0:10429:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:3.0:1721880541.385227:0:10429:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011901696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880541.385233:0:10429:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 661 00000100:00100000:2.0:1721880541.385253:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011901696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1721880541.480931:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011901824:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1721880541.480985:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880541.481040:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011901824 00000100:00100000:2.0:1721880541.481047:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011901824 00000100:00100000:2.0:1721880541.481082:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101155 00000100:00100000:2.0:1721880541.481087:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880125984700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+19:3687:x1805522011901824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1721880541.481114:0:15587:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1437519872 avail 1308057600 00000100:00100000:2.0:1721880541.481161:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880125984700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+19:3687:x1805522011901824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880541.481166:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101155 00000100:00100000:0.0:1721880541.481180:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011901824:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1721880541.576978:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011901952:0@lo:400:kworker.0 00000100:00100000:3.0:1721880541.576978:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3686:1805522011902208:0@lo:400:kworker.0 00000100:00100000:0.0:1721880541.576982:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3689:1805522011902080:0@lo:400:kworker.0 00000100:00100000:0.0:1721880541.577054:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880541.577056:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880541.577076:0:7124:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011901952 00000100:00100000:3.0:1721880541.577081:0:7124:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011901952 00000100:00100000:2.0:1721880541.577085:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011902464:0@lo:400:kworker.0 00000100:00100000:0.0:1721880541.577088:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3689:1805522011902592:0@lo:400:kworker.0 00000100:00100000:2.0:1721880541.577098:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880541.577099:0:15434:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011902080 00000100:00080000:0.0:1721880541.577103:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880511 00000100:00100000:1.0:1721880541.577104:0:15434:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011902080 00000100:00100000:2.0:1721880541.577108:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011902976:0@lo:400:kworker.0 00000100:00100000:0.0:1721880541.577109:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880541.577114:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 622 00000100:00100000:0.0:1721880541.577117:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011903104:0@lo:400:kworker.0 00000100:00100000:3.0:1721880541.577119:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c050c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011901952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880541.577121:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880541.577129:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880541.577134:0:15434:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011902464 00000100:00100000:1.0:1721880541.577137:0:15434:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011902464 00000100:00100000:2.0:1721880541.577146:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011902592 00000100:00100000:2.0:1721880541.577149:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011902592 00000100:00100000:3.0:1721880541.577152:0:7124:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c050c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011901952:12345-0@lo:400:kworker.0 Request processed in 33us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880541.577157:0:15434:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3095 00000100:00100000:3.0:1721880541.577159:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 622 00000100:00100000:0.0:1721880541.577162:0:15415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3096 00000100:00100000:1.0:1721880541.577163:0:15434:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880125987b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1805522011902080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880541.577167:0:15415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011902464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880541.577176:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3097 00000100:00100000:2.0:1721880541.577179:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880125985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1805522011902592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880541.577187:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011902336:0@lo:400:kworker.0 00000100:00100000:0.0:1721880541.577206:0:15415:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011902464:12345-0@lo:400:kworker.0 Request processed in 38us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880541.577209:0:15434:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880125987b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1805522011902080:12345-0@lo:400:kworker.0 Request processed in 45us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880541.577210:0:7129:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880125985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1805522011902592:12345-0@lo:400:kworker.0 Request processed in 30us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880541.577212:0:15415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3096 00000100:00100000:3.0:1721880541.577212:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880541.577214:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3097 00000100:00100000:1.0:1721880541.577218:0:15434:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3095 00000100:00100000:3.0:1721880541.577221:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011902848:0@lo:400:kworker.0 00000100:00100000:3.0:1721880541.577231:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880541.577235:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011902976 00000100:00080000:0.0:1721880541.577236:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880511 00000100:00100000:2.0:1721880541.577236:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011902976 00000100:00080000:0.0:1721880541.577238:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880511 00000100:00080000:0.0:1721880541.577240:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880511 00000100:00100000:1.0:1721880541.577243:0:15420:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011902848 00000100:00100000:1.0:1721880541.577246:0:15420:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011902848 00000100:00100000:2.0:1721880541.577250:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011903104 00000100:00100000:3.0:1721880541.577251:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011902336 00000100:00100000:2.0:1721880541.577252:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011903104 00000100:00100000:3.0:1721880541.577254:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011902336 00000100:00100000:0.0:1721880541.577261:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3689:1805522011902080:0@lo:400:kworker.0 00000100:00100000:2.0:1721880541.577264:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445 00000100:00100000:2.0:1721880541.577266:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011902976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880541.577267:0:15420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3098 00000100:00100000:0.0:1721880541.577269:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3689:1805522011902592:0@lo:400:kworker.0 00000100:00100000:3.0:1721880541.577269:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101156 00000100:00100000:1.0:1721880541.577271:0:15420:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011902848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880541.577272:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011902336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880541.577281:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011902976:12345-0@lo:400:kworker.0 Request processed in 14us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880541.577284:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445 00000100:00100000:2.0:1721880541.577289:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:2.0:1721880541.577291:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880125986680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011903104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880541.577291:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011902336:12345-0@lo:400:kworker.0 Request processed in 19us (80us total) trans 0 rc 0/0 00000100:00080000:0.0:1721880541.577292:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880511 00000100:00080000:0.0:1721880541.577294:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880511 00000100:00100000:3.0:1721880541.577295:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101156 00000100:00100000:1.0:1721880541.577298:0:15420:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011902848:12345-0@lo:400:kworker.0 Request processed in 26us (65us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880541.577301:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880541.577303:0:15420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3098 00000100:00100000:2.0:1721880541.577304:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880125986680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011903104:12345-0@lo:400:kworker.0 Request processed in 12us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880541.577307:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00000100:00100000:3.0:1721880541.577308:0:15415:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011902208 00000100:00100000:3.0:1721880541.577309:0:15415:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011902208 00000100:00100000:0.0:1721880541.577315:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3686:1805522011902720:0@lo:400:kworker.0 00000100:00100000:1.0:1721880541.577320:0:15434:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3099 00000100:00100000:1.0:1721880541.577323:0:15434:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097138000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0000-lwp-MDT0001_UUID+5:3686:x1805522011902208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880541.577327:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011901952:0@lo:400:kworker.0 00000100:00100000:2.0:1721880541.577334:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011902464:0@lo:400:kworker.0 00000100:00100000:3.0:1721880541.577334:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011902336:0@lo:400:kworker.0 00000100:00100000:0.0:1721880541.577335:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880541.577339:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011902976:0@lo:400:kworker.0 00000100:00100000:1.0:1721880541.577341:0:15434:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880097138000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0000-lwp-MDT0001_UUID+5:3686:x1805522011902208:12345-0@lo:400:kworker.0 Request processed in 17us (40us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880541.577341:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011902848:0@lo:400:kworker.0 00000100:00100000:1.0:1721880541.577346:0:15434:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3099 00000100:00100000:0.0:1721880541.577353:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3686:1805522011902208:0@lo:400:kworker.0 00000100:00100000:1.0:1721880541.577354:0:15434:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011902720 00000100:00100000:1.0:1721880541.577356:0:15434:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011902720 00000100:00100000:0.0:1721880541.577369:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011903104:0@lo:400:kworker.0 00000100:00100000:1.0:1721880541.577370:0:15434:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3100 00000100:00100000:1.0:1721880541.577373:0:15434:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009713a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0000-lwp-OST0001_UUID+5:3686:x1805522011902720:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1721880541.577385:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880511 00000100:00100000:1.0:1721880541.577395:0:15434:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009713a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0000-lwp-OST0001_UUID+5:3686:x1805522011902720:12345-0@lo:400:kworker.0 Request processed in 20us (58us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880541.577399:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3686:1805522011902720:0@lo:400:kworker.0 00000100:00100000:1.0:1721880541.577400:0:15434:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3100 00000100:00100000:3.0:1721880541.624921:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011903232:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1721880541.624939:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011903360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1721880541.624981:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880541.625004:0:10429:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011903360 00000100:00100000:3.0:1721880541.625028:0:10429:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011903360 00000100:00100000:2.0:1721880541.625052:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880541.625073:0:10429:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011903232 00000100:00100000:3.0:1721880541.625076:0:10429:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011903232 00000100:00100000:0.0:1721880541.625083:0:9461:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 662 00000100:00100000:0.0:1721880541.625088:0:9461:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011903360:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1721880541.625093:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 663 00000100:00100000:1.0:1721880541.625098:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3687:x1805522011903232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1721880541.625111:0:9461:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00002000:00000024:1.0:1721880541.625111:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:0.0:1721880541.625146:0:9461:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011903360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880541.625146:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3687:x1805522011903232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880541.625150:0:9461:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 662 00000100:00100000:1.0:1721880541.625157:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 663 00000100:00100000:2.0:1721880541.625160:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011903232:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1721880541.625185:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011903360:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1721880541.682945:0:8270:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880542.684960:0:7120:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880543.010180:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880543.010213:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880543.010233:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880543.010244:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257814784 00000100:00100000:0.0:1721880543.010247:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880543.010252:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257814784 00000100:00100000:0.0:1721880543.010258:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880543.010268:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880543.010274:0:15434:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257814912 00000100:00100000:2.0:1721880543.010274:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257815168 00000100:00100000:0.0:1721880543.010278:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880543.010279:0:15434:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257814912 00000100:00100000:2.0:1721880543.010279:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257815168 00000100:00100000:0.0:1721880543.010289:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880543.010290:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 623 00000100:00100000:3.0:1721880543.010294:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c050850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4976b229-99ef-4953-87e9-78e1b901883f+12:2004:x1805522257814784:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880543.010302:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257815680 00000100:00100000:2.0:1721880543.010303:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257815680 00000100:00100000:1.0:1721880543.010305:0:15434:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257815040 00000100:00100000:1.0:1721880543.010307:0:15434:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257815040 00000100:00100000:2.0:1721880543.010311:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257815296 00000100:00100000:2.0:1721880543.010312:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257815296 00000100:00100000:0.0:1721880543.010313:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880543.010318:0:15434:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3101 00000100:00100000:2.0:1721880543.010320:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257815808 00000100:00100000:1.0:1721880543.010322:0:15434:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091badc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2005:x1805522257814912:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880543.010322:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257815808 00000100:00100000:0.0:1721880543.010327:0:15415:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257815424 00000100:00100000:0.0:1721880543.010330:0:15415:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257815424 00000100:00100000:2.0:1721880543.010332:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 447 00000100:00100000:2.0:1721880543.010335:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2005:x1805522257815168:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880543.010341:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c050850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4976b229-99ef-4953-87e9-78e1b901883f+12:2004:x1805522257814784:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 46us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880543.010347:0:15415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3102 00000100:00100000:3.0:1721880543.010347:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 623 00000100:00100000:1.0:1721880543.010348:0:15434:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880091badc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2005:x1805522257814912:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 26us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880543.010351:0:15415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2004:x1805522257815040:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880543.010352:0:15434:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3101 00000100:00100000:2.0:1721880543.010359:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2005:x1805522257815168:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 23us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880543.010362:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 447 00000100:00100000:1.0:1721880543.010366:0:15434:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257815552 00000100:00100000:1.0:1721880543.010368:0:15434:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257815552 00000100:00100000:0.0:1721880543.010374:0:15415:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2004:x1805522257815040:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 23us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880543.010384:0:15415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3102 00000100:00100000:2.0:1721880543.010385:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 448 00000100:00100000:1.0:1721880543.010387:0:15434:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3103 00000100:00100000:2.0:1721880543.010388:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:30425778-2709-4512-9d75-01ec53c4cfad+280:2005:x1805522257815680:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880543.010390:0:15434:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:30425778-2709-4512-9d75-01ec53c4cfad+4135:2005:x1805522257815424:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880543.010395:0:15477:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3104 00000100:00100000:2.0:1721880543.010399:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:30425778-2709-4512-9d75-01ec53c4cfad+280:2005:x1805522257815680:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 10us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880543.010399:0:15477:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:30425778-2709-4512-9d75-01ec53c4cfad+3694:2004:x1805522257815552:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880543.010402:0:15434:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:30425778-2709-4512-9d75-01ec53c4cfad+4135:2005:x1805522257815424:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 11us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880543.010402:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 448 00000100:00100000:1.0:1721880543.010406:0:15434:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3103 00000100:00100000:2.0:1721880543.010407:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 449 00000100:00100000:2.0:1721880543.010409:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091badf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2004:x1805522257815296:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880543.010412:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 450 00000100:00100000:0.0:1721880543.010415:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:30425778-2709-4512-9d75-01ec53c4cfad+665:2004:x1805522257815808:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880543.010415:0:15477:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:30425778-2709-4512-9d75-01ec53c4cfad+3694:2004:x1805522257815552:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 16us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880543.010419:0:15477:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3104 00000100:00100000:2.0:1721880543.010420:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880091badf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2004:x1805522257815296:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 10us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880543.010423:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 449 00000100:00100000:0.0:1721880543.010427:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:30425778-2709-4512-9d75-01ec53c4cfad+665:2004:x1805522257815808:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 12us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880543.010431:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 450 00000100:00080000:3.0:1721880543.010431:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880513 00000100:00080000:3.0:1721880543.010433:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880513 00000100:00080000:3.0:1721880543.010435:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880513 00000100:00080000:3.0:1721880543.010436:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880513 00000100:00080000:3.0:1721880543.010437:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880513 00000100:00100000:0.0:1721880543.096970:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1721880543.097137:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011903488:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1721880543.097191:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880543.097254:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011903488 00000100:00100000:3.0:1721880543.097261:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011903488 00000100:00100000:3.0:1721880543.097311:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101157 00000100:00100000:3.0:1721880543.097315:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f12f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3689:x1805522011903488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1721880543.097340:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1435709440 avail 1306247168 00000100:00100000:3.0:1721880543.097373:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f12f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3689:x1805522011903488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880543.097377:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101157 00000100:00100000:0.0:1721880543.097389:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011903488:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1721880543.687011:0:15560:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721880544.688949:0:11721:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880545.690923:0:7119:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880545.993137:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011903616:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1721880545.993224:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880545.993318:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011903616 00000100:00100000:1.0:1721880545.993331:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011903616 00000100:00100000:1.0:1721880545.993423:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 664 00000100:00100000:1.0:1721880545.993435:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f12d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011903616:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1721880545.993437:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880515 00002000:00000024:1.0:1721880545.993476:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:1.0:1721880545.993546:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f12d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011903616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880545.993557:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 664 00000100:00100000:0.0:1721880545.993573:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011903616:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1721880546.392962:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1721880546.392981:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8801355e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011903744:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1721880546.393034:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880546.393106:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011903744 00000100:00100000:1.0:1721880546.393115:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011903744 00000100:00080000:3.0:1721880546.393151:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880516 00000100:00100000:1.0:1721880546.393168:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 665 00000100:00100000:1.0:1721880546.393174:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011903744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1721880546.393196:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:1.0:1721880546.393244:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011903744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880546.393250:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 665 00000100:00100000:3.0:1721880546.393264:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8801355e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011903744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1721880546.488965:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1721880546.488988:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009f12dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011903872:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1721880546.489049:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880546.489085:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011903872 00000100:00100000:3.0:1721880546.489094:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011903872 00000100:00100000:3.0:1721880546.489134:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101158 00000100:00100000:3.0:1721880546.489139:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800878d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3686:x1805522011903872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1721880546.489166:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1437519872 avail 1308057600 00000100:00100000:3.0:1721880546.489207:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800878d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3686:x1805522011903872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880546.489212:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101158 00000100:00100000:1.0:1721880546.489247:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009f12dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011903872:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1721880546.584943:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011904000:0@lo:400:kworker.0 00000100:00100000:0.0:1721880546.584963:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3689:1805522011904128:0@lo:400:kworker.0 00000100:00100000:3.0:1721880546.584989:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011904384:0@lo:400:kworker.0 00000100:00100000:1.0:1721880546.584996:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3686:1805522011904256:0@lo:400:kworker.0 00000100:00100000:0.0:1721880546.585004:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880546.585013:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880546.585042:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3689:1805522011904640:0@lo:400:kworker.0 00000100:00100000:1.0:1721880546.585050:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880546.585050:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880546.585058:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011904512:0@lo:400:kworker.0 00000100:00100000:0.0:1721880546.585069:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011904128 00000100:00100000:0.0:1721880546.585074:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011904128 00000100:00100000:1.0:1721880546.585074:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3686:1805522011904768:0@lo:400:kworker.0 00000100:00100000:3.0:1721880546.585081:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011904896:0@lo:400:kworker.0 00000100:00100000:2.0:1721880546.585089:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880546.585101:0:7124:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011904000 00000100:00100000:0.0:1721880546.585102:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011904256 00000100:00100000:0.0:1721880546.585103:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011904256 00000100:00100000:1.0:1721880546.585104:0:7124:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011904000 00000100:00100000:3.0:1721880546.585104:0:15477:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011904512 00000100:00100000:3.0:1721880546.585107:0:15477:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011904512 00000100:00100000:2.0:1721880546.585113:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011905024:0@lo:400:kworker.0 00000100:00100000:0.0:1721880546.585114:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3105 00000100:00100000:0.0:1721880546.585117:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f12c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1805522011904128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880546.585126:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 624 00000100:00100000:3.0:1721880546.585126:0:15477:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3106 00000100:00100000:3.0:1721880546.585129:0:15477:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135302680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-lwp-MDT0001_UUID+5:3686:x1805522011904256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880546.585130:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c050450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011904000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880546.585134:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880546.585152:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f12c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1805522011904128:12345-0@lo:400:kworker.0 Request processed in 35us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880546.585152:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1721880546.585157:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3105 00000100:00100000:2.0:1721880546.585157:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135301880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011905152:0@lo:400:kworker.0 00000100:00100000:1.0:1721880546.585160:0:7124:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c050450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011904000:12345-0@lo:400:kworker.0 Request processed in 30us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880546.585161:0:15477:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135302680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-lwp-MDT0001_UUID+5:3686:x1805522011904256:12345-0@lo:400:kworker.0 Request processed in 32us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880546.585164:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 624 00000100:00100000:3.0:1721880546.585165:0:15477:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3106 00000100:00100000:2.0:1721880546.585172:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880546.585173:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3107 00000100:00100000:0.0:1721880546.585175:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011904512:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1721880546.585185:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880516 00000100:00080000:3.0:1721880546.585187:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880516 00000100:00100000:0.0:1721880546.585191:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011904512:12345-0@lo:400:kworker.0 Request processed in 15us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880546.585192:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011904000:0@lo:400:kworker.0 00000100:00100000:0.0:1721880546.585195:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3107 00000100:00100000:3.0:1721880546.585198:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011905024 00000100:00100000:1.0:1721880546.585200:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011904384 00000100:00100000:3.0:1721880546.585200:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011905024 00000100:00100000:1.0:1721880546.585202:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011904384 00000100:00100000:0.0:1721880546.585211:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880546.585211:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011904512:0@lo:400:kworker.0 00000100:00100000:3.0:1721880546.585215:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011905152 00000100:00100000:3.0:1721880546.585216:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011905152 00000100:00100000:1.0:1721880546.585217:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101159 00000100:00100000:1.0:1721880546.585220:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011904384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880546.585225:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 451 00000100:00100000:0.0:1721880546.585226:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3689:1805522011904128:0@lo:400:kworker.0 00000100:00100000:3.0:1721880546.585228:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011905024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880546.585233:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00000100:00100000:1.0:1721880546.585236:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011904384:12345-0@lo:400:kworker.0 Request processed in 16us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880546.585236:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3688:x1805522011905152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880546.585239:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101159 00000100:00100000:0.0:1721880546.585246:0:7130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011904640 00000100:00100000:3.0:1721880546.585246:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011905024:12345-0@lo:400:kworker.0 Request processed in 17us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880546.585248:0:7130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011904640 00000100:00100000:3.0:1721880546.585249:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 451 00000100:00100000:2.0:1721880546.585258:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3688:x1805522011905152:12345-0@lo:400:kworker.0 Request processed in 22us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880546.585259:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3108 00000100:00080000:3.0:1721880546.585259:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880516 00000100:00100000:0.0:1721880546.585261:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f12f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1805522011904640:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1721880546.585261:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880516 00000100:00100000:2.0:1721880546.585262:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00100000:2.0:1721880546.585280:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135301880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011905152:0@lo:400:kworker.0 00000100:00100000:2.0:1721880546.585285:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011905024:0@lo:400:kworker.0 00000100:00100000:0.0:1721880546.585288:0:7130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f12f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1805522011904640:12345-0@lo:400:kworker.0 Request processed in 24us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880546.585294:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3108 00000100:00100000:1.0:1721880546.585294:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3689:1805522011904640:0@lo:400:kworker.0 00000100:00100000:2.0:1721880546.585297:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880546.585305:0:7130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011904768 00000100:00100000:0.0:1721880546.585308:0:7130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011904768 00000100:00100000:2.0:1721880546.585311:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3686:1805522011904256:0@lo:400:kworker.0 00000100:00100000:2.0:1721880546.585322:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880546.585337:0:7130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011904896 00000100:00100000:0.0:1721880546.585340:0:7130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011904896 00000100:00100000:2.0:1721880546.585342:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011904384:0@lo:400:kworker.0 00000100:00080000:3.0:1721880546.585342:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880516 00000100:00080000:3.0:1721880546.585344:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880516 00000100:00100000:0.0:1721880546.585350:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3109 00000100:00100000:0.0:1721880546.585353:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800878db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3686:x1805522011904768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880546.585356:0:15420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3110 00000100:00100000:1.0:1721880546.585361:0:15420:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800878d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011904896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880546.585399:0:7130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800878db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3686:x1805522011904768:12345-0@lo:400:kworker.0 Request processed in 44us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880546.585400:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011904896:0@lo:400:kworker.0 00000100:00100000:1.0:1721880546.585401:0:15420:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800878d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011904896:12345-0@lo:400:kworker.0 Request processed in 39us (77us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880546.585402:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3109 00000100:00100000:2.0:1721880546.585405:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3686:1805522011904768:0@lo:400:kworker.0 00000100:00100000:1.0:1721880546.585407:0:15420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3110 00000100:00100000:0.0:1721880546.632879:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011905408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1721880546.632917:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011905280:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1721880546.632943:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880546.632960:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880546.632990:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011905408 00000100:00100000:0.0:1721880546.632995:0:9461:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011905280 00000100:00100000:1.0:1721880546.632996:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011905408 00000100:00100000:0.0:1721880546.632998:0:9461:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011905280 00000100:00100000:1.0:1721880546.633024:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 666 00000100:00100000:0.0:1721880546.633029:0:9461:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 667 00000100:00100000:1.0:1721880546.633029:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f12f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011905408:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1721880546.633032:0:9461:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e86fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3687:x1805522011905280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1721880546.633051:0:9461:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00002000:00000024:1.0:1721880546.633051:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:1.0:1721880546.633087:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f12f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011905408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880546.633090:0:9461:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e86fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3687:x1805522011905280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880546.633091:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 666 00000100:00100000:0.0:1721880546.633094:0:9461:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 667 00000100:00100000:0.0:1721880546.633124:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011905408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1721880546.633126:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011905280:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1721880546.692954:0:8270:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880547.694994:0:7120:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880548.018168:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880548.018238:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880548.018279:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880548.018285:0:7124:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257815936 00000100:00100000:1.0:1721880548.018297:0:7124:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257815936 00000100:00100000:0.0:1721880548.018312:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880548.018331:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880548.018349:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257816064 00000100:00100000:0.0:1721880548.018350:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880548.018351:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 625 00000100:00100000:2.0:1721880548.018356:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257816064 00000100:00100000:1.0:1721880548.018360:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c050050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2005:x1805522257815936:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880548.018369:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880548.018386:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880548.018388:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257816320 00000100:00100000:3.0:1721880548.018395:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257816320 00000100:00100000:2.0:1721880548.018399:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257816192 00000100:00100000:2.0:1721880548.018401:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257816192 00000100:00100000:2.0:1721880548.018429:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257816576 00000100:00100000:2.0:1721880548.018431:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257816576 00000100:00100000:1.0:1721880548.018439:0:7124:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c050050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2005:x1805522257815936:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 80us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880548.018439:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257816704 00000100:00100000:3.0:1721880548.018439:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257816832 00000100:00100000:2.0:1721880548.018441:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257816704 00000100:00100000:3.0:1721880548.018441:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257816832 00000100:00100000:1.0:1721880548.018446:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 625 00000100:00100000:0.0:1721880548.018450:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880548.018450:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257816448 00000100:00100000:2.0:1721880548.018452:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3111 00000100:00100000:3.0:1721880548.018452:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257816448 00000100:00100000:2.0:1721880548.018457:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f12dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2004:x1805522257816064:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880548.018462:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257816960 00000100:00100000:3.0:1721880548.018463:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257816960 00000100:00100000:3.0:1721880548.018476:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 453 00000100:00100000:3.0:1721880548.018480:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2004:x1805522257816320:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880548.018487:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f12dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2004:x1805522257816064:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 29us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880548.018488:0:15420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3112 00000100:00100000:2.0:1721880548.018492:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3111 00000100:00100000:1.0:1721880548.018493:0:15420:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2005:x1805522257816192:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880548.018507:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3113 00000100:00100000:3.0:1721880548.018507:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2004:x1805522257816320:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 26us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880548.018509:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:30425778-2709-4512-9d75-01ec53c4cfad+4135:2004:x1805522257816576:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880548.018511:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 453 00000100:00100000:1.0:1721880548.018520:0:15420:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2005:x1805522257816192:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 26us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880548.018522:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:30425778-2709-4512-9d75-01ec53c4cfad+4135:2004:x1805522257816576:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 12us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880548.018525:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 454 00000100:00100000:1.0:1721880548.018526:0:15420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3112 00000100:00100000:3.0:1721880548.018528:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:30425778-2709-4512-9d75-01ec53c4cfad+280:2004:x1805522257816832:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880548.018529:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3113 00000100:00100000:2.0:1721880548.018535:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3114 00000100:00100000:2.0:1721880548.018538:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:30425778-2709-4512-9d75-01ec53c4cfad+3694:2005:x1805522257816704:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880548.018541:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:30425778-2709-4512-9d75-01ec53c4cfad+280:2004:x1805522257816832:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 12us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880548.018545:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 454 00000100:00100000:2.0:1721880548.018549:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:30425778-2709-4512-9d75-01ec53c4cfad+3694:2005:x1805522257816704:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 10us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880548.018550:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 455 00000100:00100000:2.0:1721880548.018553:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3114 00000100:00100000:3.0:1721880548.018553:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2005:x1805522257816448:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880548.018562:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 456 00000100:00100000:0.0:1721880548.018568:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:30425778-2709-4512-9d75-01ec53c4cfad+665:2005:x1805522257816960:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880548.018569:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2005:x1805522257816448:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 15us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880548.018572:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 455 00000100:00080000:3.0:1721880548.018581:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880518 00000100:00080000:3.0:1721880548.018584:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880518 00000100:00080000:3.0:1721880548.018585:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880518 00000100:00080000:3.0:1721880548.018587:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880518 00000100:00080000:3.0:1721880548.018588:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880518 00000100:00100000:0.0:1721880548.018592:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:30425778-2709-4512-9d75-01ec53c4cfad+665:2005:x1805522257816960:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 24us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880548.018598:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 456 00000100:00100000:2.0:1721880548.104953:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011905536:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1721880548.105005:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880548.105043:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011905536 00000100:00100000:1.0:1721880548.105050:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011905536 00000100:00100000:1.0:1721880548.105090:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101160 00000100:00100000:1.0:1721880548.105095:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800878d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011905536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1721880548.105120:0:15587:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1435709440 avail 1306247168 00000100:00100000:1.0:1721880548.105157:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800878d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011905536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880548.105162:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101160 00000100:00100000:2.0:1721880548.105172:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011905536:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1721880548.697044:0:15560:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721880549.698982:0:11721:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880550.701023:0:7119:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1721880551.001079:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1721880551.001109:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011905664:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1721880551.001200:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880551.001272:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011905664 00000100:00100000:1.0:1721880551.001285:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011905664 00000100:00100000:1.0:1721880551.001361:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 668 00000100:00100000:1.0:1721880551.001369:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800878d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011905664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1721880551.001405:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00080000:3.0:1721880551.001427:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880521 00000100:00100000:1.0:1721880551.001473:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800878d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011905664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880551.001482:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 668 00000100:00100000:2.0:1721880551.001540:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c3bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011905664:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1721880551.401245:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012f418700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011905792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1721880551.401325:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880551.401442:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011905792 00000100:00100000:1.0:1721880551.401452:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011905792 00000100:00100000:1.0:1721880551.401523:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 669 00000100:00100000:1.0:1721880551.401531:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011905792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1721880551.401561:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00080000:3.0:1721880551.401583:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880521 00000100:00100000:1.0:1721880551.401619:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011905792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880551.401627:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 669 00000100:00100000:0.0:1721880551.401648:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012f418700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011905792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1721880551.497087:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135301500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011905920:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1721880551.497170:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880551.497235:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011905920 00000100:00100000:1.0:1721880551.497245:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011905920 00000100:00100000:1.0:1721880551.497290:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101161 00000100:00100000:1.0:1721880551.497298:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800878d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+19:3687:x1805522011905920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1721880551.497336:0:15587:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1437519872 avail 1308057600 00000100:00100000:1.0:1721880551.497401:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800878d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+19:3687:x1805522011905920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880551.497408:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101161 00000100:00100000:2.0:1721880551.497464:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135301500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011905920:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1721880551.593124:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135300a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3686:1805522011906304:0@lo:400:kworker.0 00000100:00100000:2.0:1721880551.593124:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135300700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011906048:0@lo:400:kworker.0 00000100:00100000:0.0:1721880551.593153:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135300380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3689:1805522011906176:0@lo:400:kworker.0 00000100:00100000:3.0:1721880551.593172:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011906432:0@lo:400:kworker.0 00000100:00100000:1.0:1721880551.593222:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880551.593228:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880551.593234:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880551.593249:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011906304 00000100:00100000:0.0:1721880551.593257:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011906304 00000100:00100000:1.0:1721880551.593265:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135303800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3686:1805522011906816:0@lo:400:kworker.0 00000100:00100000:2.0:1721880551.593276:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135301c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011906560:0@lo:400:kworker.0 00000100:00100000:3.0:1721880551.593278:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011906944:0@lo:400:kworker.0 00000100:00100000:1.0:1721880551.593283:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880551.593302:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880551.593320:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011906816 00000100:00100000:0.0:1721880551.593323:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011906816 00000100:00100000:2.0:1721880551.593325:0:15415:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011906944 00000100:00100000:1.0:1721880551.593329:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011906432 00000100:00100000:2.0:1721880551.593331:0:15415:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011906944 00000100:00100000:1.0:1721880551.593334:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011906432 00000100:00100000:0.0:1721880551.593349:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3115 00000100:00100000:3.0:1721880551.593352:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011906048 00000100:00100000:0.0:1721880551.593357:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135302300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3686:x1805522011906304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880551.593358:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011906048 00000100:00100000:1.0:1721880551.593364:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101162 00000100:00100000:1.0:1721880551.593370:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f41aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011906432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880551.593376:0:15415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3116 00000100:00100000:2.0:1721880551.593384:0:15415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135303100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3686:x1805522011906816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880551.593391:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 626 00000100:00100000:3.0:1721880551.593397:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b19d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011906048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880551.593422:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f41aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011906432:12345-0@lo:400:kworker.0 Request processed in 50us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880551.593429:0:7129:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135302300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3686:x1805522011906304:12345-0@lo:400:kworker.0 Request processed in 72us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880551.593429:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101162 00000100:00100000:0.0:1721880551.593436:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3115 00000100:00100000:3.0:1721880551.593447:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b19d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011906048:12345-0@lo:400:kworker.0 Request processed in 48us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880551.593453:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 626 00000100:00100000:2.0:1721880551.593460:0:15415:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135303100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3686:x1805522011906816:12345-0@lo:400:kworker.0 Request processed in 74us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880551.593462:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3117 00000100:00100000:0.0:1721880551.593466:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f419500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011906944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880551.593472:0:15415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3116 00000100:00100000:1.0:1721880551.593491:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135300a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3686:1805522011906304:0@lo:400:kworker.0 00000100:00100000:0.0:1721880551.593492:0:7129:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f419500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011906944:12345-0@lo:400:kworker.0 Request processed in 25us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880551.593499:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3117 00000100:00100000:1.0:1721880551.593505:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135303800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3686:1805522011906816:0@lo:400:kworker.0 00000100:00100000:3.0:1721880551.593509:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011906432:0@lo:400:kworker.0 00000100:00100000:3.0:1721880551.593521:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011906944:0@lo:400:kworker.0 00000100:00080000:0.0:1721880551.593522:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880521 00000100:00100000:2.0:1721880551.593525:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1721880551.593526:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880521 00000100:00080000:0.0:1721880551.593528:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880521 00000100:00100000:1.0:1721880551.593548:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011906560 00000100:00100000:1.0:1721880551.593552:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011906560 00000100:00080000:0.0:1721880551.593568:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880521 00000100:00100000:2.0:1721880551.593575:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135301f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011907072:0@lo:400:kworker.0 00000100:00100000:0.0:1721880551.593579:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880551.593607:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011906176 00000100:00100000:1.0:1721880551.593611:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011906176 00000100:00100000:2.0:1721880551.593613:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880551.593623:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135303480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3689:1805522011906688:0@lo:400:kworker.0 00000100:00100000:3.0:1721880551.593633:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3118 00000100:00100000:3.0:1721880551.593640:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800878d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011906560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880551.593642:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3119 00000100:00100000:0.0:1721880551.593649:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880551.593650:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1805522011906176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880551.593654:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135300700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011906048:0@lo:400:kworker.0 00000100:00100000:0.0:1721880551.593661:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011907200:0@lo:400:kworker.0 00000100:00100000:2.0:1721880551.593685:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135301c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011906560:0@lo:400:kworker.0 00000100:00100000:3.0:1721880551.593686:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800878d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011906560:12345-0@lo:400:kworker.0 Request processed in 46us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880551.593688:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880551.593693:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3118 00000100:00100000:1.0:1721880551.593706:0:7129:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1805522011906176:12345-0@lo:400:kworker.0 Request processed in 54us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880551.593710:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011906688 00000100:00100000:3.0:1721880551.593713:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011906688 00000100:00100000:1.0:1721880551.593716:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3119 00000100:00100000:0.0:1721880551.593722:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135300380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3689:1805522011906176:0@lo:400:kworker.0 00000100:00100000:1.0:1721880551.593771:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3120 00000100:00100000:1.0:1721880551.593777:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085a4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1805522011906688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880551.593792:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011907072 00000100:00100000:0.0:1721880551.593793:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011907200 00000100:00100000:0.0:1721880551.593796:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011907200 00000100:00100000:2.0:1721880551.593798:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011907072 00000100:00100000:1.0:1721880551.593816:0:7129:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880085a4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1805522011906688:12345-0@lo:400:kworker.0 Request processed in 39us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880551.593822:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3120 00000100:00100000:0.0:1721880551.593827:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 457 00000100:00100000:0.0:1721880551.593832:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085a4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011907200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880551.593838:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 458 00000100:00100000:2.0:1721880551.593877:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800878db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011907072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880551.593901:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880085a4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011907200:12345-0@lo:400:kworker.0 Request processed in 66us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880551.593907:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 457 00000100:00080000:0.0:1721880551.593926:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880521 00000100:00080000:0.0:1721880551.593929:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880521 00000100:00100000:2.0:1721880551.593940:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800878db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011907072:12345-0@lo:400:kworker.0 Request processed in 64us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880551.593948:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 458 00000100:00100000:0.0:1721880551.593951:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135303480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3689:1805522011906688:0@lo:400:kworker.0 00000100:00100000:3.0:1721880551.593951:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135301f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011907072:0@lo:400:kworker.0 00000100:00100000:0.0:1721880551.593960:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011907200:0@lo:400:kworker.0 00000100:00100000:0.0:1721880551.641167:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011907328:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1721880551.641167:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135303800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011907456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1721880551.641246:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880551.641296:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880551.641314:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011907328 00000100:00100000:1.0:1721880551.641325:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011907328 00000100:00100000:0.0:1721880551.641334:0:9461:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011907456 00000100:00100000:0.0:1721880551.641340:0:9461:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011907456 00000100:00100000:1.0:1721880551.641379:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 670 00000100:00100000:0.0:1721880551.641387:0:9461:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 671 00000100:00100000:1.0:1721880551.641388:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880085a4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011907328:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1721880551.641393:0:9461:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f41bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011907456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1721880551.641423:0:9461:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00002000:00000024:1.0:1721880551.641423:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:1.0:1721880551.641481:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880085a4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011907328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880551.641484:0:9461:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f41bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011907456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880551.641490:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 670 00000100:00100000:0.0:1721880551.641494:0:9461:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 671 00000100:00100000:3.0:1721880551.641513:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135303800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011907456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1721880551.641545:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011907328:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1721880551.703056:0:8270:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880552.705048:0:7120:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880553.026684:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880553.026768:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880553.026791:0:15415:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257817216 00000100:00100000:0.0:1721880553.026797:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880553.026806:0:15415:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257817216 00000100:00100000:0.0:1721880553.026813:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880553.026862:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880553.026875:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880553.026889:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880553.026894:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257817088 00000100:00100000:0.0:1721880553.026902:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880553.026902:0:15415:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257817344 00000100:00100000:3.0:1721880553.026902:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257817088 00000100:00100000:2.0:1721880553.026906:0:15415:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257817344 00000100:00100000:1.0:1721880553.026922:0:15477:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257817728 00000100:00100000:2.0:1721880553.026926:0:15415:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257817856 00000100:00100000:2.0:1721880553.026929:0:15415:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257817856 00000100:00100000:1.0:1721880553.026930:0:15477:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257817728 00000100:00100000:0.0:1721880553.026936:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880553.026943:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 627 00000100:00100000:3.0:1721880553.026951:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b19d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4976b229-99ef-4953-87e9-78e1b901883f+12:2004:x1805522257817088:12345-192.168.201.24@tcp:400:kworker.0 00000100:00080000:0.0:1721880553.026953:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880523 00000100:00100000:2.0:1721880553.026953:0:15415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3121 00000100:00080000:0.0:1721880553.026957:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880523 00000100:00080000:0.0:1721880553.026959:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880523 00000100:00100000:2.0:1721880553.026962:0:15415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2005:x1805522257817216:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880553.026973:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257817472 00000100:00100000:0.0:1721880553.026977:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257817472 00000100:00100000:1.0:1721880553.026983:0:15477:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3122 00000100:00100000:1.0:1721880553.026992:0:15477:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2004:x1805522257817344:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880553.027006:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257817600 00000100:00100000:0.0:1721880553.027008:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257817600 00000100:00100000:3.0:1721880553.027014:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b19d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4976b229-99ef-4953-87e9-78e1b901883f+12:2004:x1805522257817088:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 64us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880553.027019:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257817984 00000100:00100000:3.0:1721880553.027020:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 627 00000100:00100000:0.0:1721880553.027021:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257817984 00000100:00100000:2.0:1721880553.027027:0:15415:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2005:x1805522257817216:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 64us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880553.027030:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257818112 00000100:00100000:0.0:1721880553.027032:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257818112 00000100:00100000:2.0:1721880553.027036:0:15415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3121 00000100:00100000:1.0:1721880553.027038:0:15477:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2004:x1805522257817344:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 47us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880553.027046:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 459 00000100:00100000:1.0:1721880553.027047:0:15477:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3122 00000100:00100000:0.0:1721880553.027052:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2005:x1805522257817472:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880553.027061:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3123 00000100:00100000:3.0:1721880553.027066:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:30425778-2709-4512-9d75-01ec53c4cfad+3694:2004:x1805522257817856:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880553.027067:0:15415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3124 00000100:00100000:2.0:1721880553.027073:0:15415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:30425778-2709-4512-9d75-01ec53c4cfad+4135:2005:x1805522257817728:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880553.027086:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2005:x1805522257817472:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 33us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880553.027087:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:30425778-2709-4512-9d75-01ec53c4cfad+3694:2004:x1805522257817856:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 21us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880553.027092:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 459 00000100:00100000:3.0:1721880553.027092:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3123 00000100:00100000:1.0:1721880553.027099:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 460 00000100:00100000:1.0:1721880553.027106:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2004:x1805522257817600:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880553.027106:0:15415:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:30425778-2709-4512-9d75-01ec53c4cfad+4135:2005:x1805522257817728:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 32us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880553.027112:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 461 00000100:00100000:2.0:1721880553.027114:0:15415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3124 00000100:00100000:0.0:1721880553.027116:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:30425778-2709-4512-9d75-01ec53c4cfad+280:2005:x1805522257817984:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880553.027120:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 462 00000100:00100000:3.0:1721880553.027124:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:30425778-2709-4512-9d75-01ec53c4cfad+665:2004:x1805522257818112:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880553.027133:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:30425778-2709-4512-9d75-01ec53c4cfad+280:2005:x1805522257817984:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 17us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880553.027139:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 461 00000100:00100000:3.0:1721880553.027139:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:30425778-2709-4512-9d75-01ec53c4cfad+665:2004:x1805522257818112:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 14us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880553.027144:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2004:x1805522257817600:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 37us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880553.027145:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 462 00000100:00100000:1.0:1721880553.027153:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 460 00000100:00080000:0.0:1721880553.027370:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880523 00000100:00080000:0.0:1721880553.027375:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880523 00000100:00100000:3.0:1721880553.113109:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011907584:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1721880553.113182:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880553.113289:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011907584 00000100:00100000:1.0:1721880553.113303:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011907584 00000100:00100000:1.0:1721880553.113375:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101163 00000100:00100000:1.0:1721880553.113386:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f419c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011907584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1721880553.113427:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1435709440 avail 1306247168 00000100:00100000:1.0:1721880553.113500:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f419c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011907584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880553.113508:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101163 00000100:00100000:3.0:1721880553.113561:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011907584:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1721880553.706992:0:15560:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721880554.709019:0:11721:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880555.710976:0:7119:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880556.009196:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011907712:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1721880556.009275:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880556.009347:0:9461:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011907712 00000100:00100000:2.0:1721880556.009358:0:9461:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011907712 00000100:00080000:0.0:1721880556.009392:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880526 00000100:00100000:2.0:1721880556.009427:0:9461:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 672 00000100:00100000:2.0:1721880556.009435:0:9461:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094661180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011907712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1721880556.009470:0:9461:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:2.0:1721880556.009548:0:9461:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880094661180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011907712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880556.009556:0:9461:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 672 00000100:00100000:0.0:1721880556.009585:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011907712:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1721880556.409087:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1721880556.409116:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008779b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011907840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1721880556.409188:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880556.409249:0:9461:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011907840 00000100:00100000:2.0:1721880556.409260:0:9461:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011907840 00000100:00080000:0.0:1721880556.409322:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880526 00000100:00100000:2.0:1721880556.409332:0:9461:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 673 00000100:00100000:2.0:1721880556.409358:0:9461:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f41a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011907840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1721880556.409387:0:9461:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:2.0:1721880556.409470:0:9461:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f41a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011907840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880556.409478:0:9461:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 673 00000100:00100000:3.0:1721880556.409572:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008779b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011907840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1721880556.505153:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800878dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011907968:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1721880556.505254:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880556.505352:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011907968 00000100:00100000:1.0:1721880556.505366:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011907968 00000100:00100000:1.0:1721880556.505442:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101164 00000100:00100000:1.0:1721880556.505454:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f418700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3687:x1805522011907968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1721880556.505499:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1437519872 avail 1308057600 00000100:00100000:1.0:1721880556.505577:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f418700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3687:x1805522011907968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 123us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880556.505585:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101164 00000100:00100000:3.0:1721880556.505616:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800878dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011907968:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1721880556.601082:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135300a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011908096:0@lo:400:kworker.0 00000100:00100000:0.0:1721880556.601084:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135300000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3689:1805522011908224:0@lo:400:kworker.0 00000100:00100000:1.0:1721880556.601127:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135303800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3686:1805522011908352:0@lo:400:kworker.0 00000100:00100000:2.0:1721880556.601128:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011908480:0@lo:400:kworker.0 00000100:00100000:3.0:1721880556.601159:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880556.601162:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880556.601176:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880556.601191:0:7124:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011908096 00000100:00100000:1.0:1721880556.601199:0:7124:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011908096 00000100:00100000:3.0:1721880556.601210:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135303480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011908608:0@lo:400:kworker.0 00000100:00100000:0.0:1721880556.601214:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135301f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3689:1805522011908736:0@lo:400:kworker.0 00000100:00100000:2.0:1721880556.601219:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135301c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011908992:0@lo:400:kworker.0 00000100:00080000:0.0:1721880556.601244:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880526 00000100:00100000:3.0:1721880556.601244:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880556.601246:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 628 00000100:00100000:2.0:1721880556.601248:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011908480 00000100:00100000:2.0:1721880556.601252:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011908480 00000100:00100000:1.0:1721880556.601254:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b19d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011908096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880556.601263:0:15432:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011908224 00000100:00100000:0.0:1721880556.601266:0:15432:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011908224 00000100:00100000:3.0:1721880556.601274:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135300700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011909120:0@lo:400:kworker.0 00000100:00100000:2.0:1721880556.601280:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101165 00000100:00100000:2.0:1721880556.601284:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800878dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011908480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880556.601298:0:15432:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011908608 00000100:00100000:0.0:1721880556.601301:0:15432:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011908608 00000100:00100000:3.0:1721880556.601311:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880556.601313:0:7124:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b19d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011908096:12345-0@lo:400:kworker.0 Request processed in 58us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880556.601322:0:15432:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3125 00000100:00100000:1.0:1721880556.601322:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 628 00000100:00100000:2.0:1721880556.601326:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800878dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011908480:12345-0@lo:400:kworker.0 Request processed in 41us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880556.601327:0:15432:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008779b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1805522011908224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880556.601331:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101165 00000100:00100000:3.0:1721880556.601346:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135300a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011908096:0@lo:400:kworker.0 00000100:00100000:2.0:1721880556.601359:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3126 00000100:00100000:2.0:1721880556.601363:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011908608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880556.601364:0:15432:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008779b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1805522011908224:12345-0@lo:400:kworker.0 Request processed in 35us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880556.601370:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1721880556.601371:0:15432:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3125 00000100:00100000:3.0:1721880556.601377:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011909248:0@lo:400:kworker.0 00000100:00100000:2.0:1721880556.601382:0:7130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011908608:12345-0@lo:400:kworker.0 Request processed in 18us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880556.601386:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3126 00000100:00080000:0.0:1721880556.601393:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880526 00000100:00100000:1.0:1721880556.601401:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011909120 00000100:00100000:3.0:1721880556.601403:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880556.601404:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880556.601404:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011909120 00000100:00100000:2.0:1721880556.601422:0:7130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011908736 00000100:00100000:2.0:1721880556.601426:0:7130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011908736 00000100:00100000:1.0:1721880556.601432:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011909248 00000100:00100000:1.0:1721880556.601434:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011909248 00000100:00100000:3.0:1721880556.601438:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135303480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011908608:0@lo:400:kworker.0 00000100:00100000:0.0:1721880556.601442:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135300000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3689:1805522011908224:0@lo:400:kworker.0 00000100:00100000:2.0:1721880556.601449:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3127 00000100:00100000:1.0:1721880556.601451:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463 00000100:00100000:2.0:1721880556.601453:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1805522011908736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880556.601457:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011909120:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1721880556.601464:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880526 00000100:00080000:0.0:1721880556.601468:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880526 00000100:00100000:3.0:1721880556.601486:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:0.0:1721880556.601487:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880556.601493:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3688:x1805522011909248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880556.601508:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135300380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3686:1805522011908864:0@lo:400:kworker.0 00000100:00100000:1.0:1721880556.601518:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011909120:12345-0@lo:400:kworker.0 Request processed in 60us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880556.601544:0:7130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1805522011908736:12345-0@lo:400:kworker.0 Request processed in 71us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880556.601553:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463 00000100:00100000:2.0:1721880556.601558:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3127 00000100:00100000:3.0:1721880556.601559:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3688:x1805522011909248:12345-0@lo:400:kworker.0 Request processed in 66us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880556.601560:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880556.601566:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00000100:00100000:2.0:1721880556.601573:0:7130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011908352 00000100:00100000:2.0:1721880556.601576:0:7130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011908352 00000100:00100000:1.0:1721880556.601579:0:15420:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011908864 00000100:00100000:1.0:1721880556.601582:0:15420:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011908864 00000100:00100000:2.0:1721880556.601592:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3128 00000100:00100000:2.0:1721880556.601595:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3686:x1805522011908352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880556.601597:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135301f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3689:1805522011908736:0@lo:400:kworker.0 00000100:00100000:1.0:1721880556.601604:0:15420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3129 00000100:00100000:3.0:1721880556.601605:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011909248:0@lo:400:kworker.0 00000100:00100000:1.0:1721880556.601609:0:15420:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008779aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-OST0001_UUID+5:3686:x1805522011908864:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1721880556.601614:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880526 00000100:00100000:3.0:1721880556.601616:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135300700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011909120:0@lo:400:kworker.0 00000100:00100000:2.0:1721880556.601623:0:7130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3686:x1805522011908352:12345-0@lo:400:kworker.0 Request processed in 27us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880556.601627:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3128 00000100:00100000:0.0:1721880556.601631:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135303800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3686:1805522011908352:0@lo:400:kworker.0 00000100:00100000:0.0:1721880556.601643:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135300380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3686:1805522011908864:0@lo:400:kworker.0 00000100:00100000:2.0:1721880556.601643:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880556.601644:0:15420:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008779aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-OST0001_UUID+5:3686:x1805522011908864:12345-0@lo:400:kworker.0 Request processed in 35us (84us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880556.601652:0:15420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3129 00000100:00100000:1.0:1721880556.601665:0:15420:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011908992 00000100:00100000:2.0:1721880556.601665:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011908480:0@lo:400:kworker.0 00000100:00100000:1.0:1721880556.601668:0:15420:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011908992 00000100:00080000:0.0:1721880556.601687:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880526 00000100:00100000:1.0:1721880556.601704:0:15420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3130 00000100:00100000:1.0:1721880556.601709:0:15420:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800878da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011908992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880556.601780:0:15420:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800878da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011908992:12345-0@lo:400:kworker.0 Request processed in 70us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880556.601784:0:15420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3130 00000100:00100000:2.0:1721880556.601796:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135301c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011908992:0@lo:400:kworker.0 00000100:00100000:3.0:1721880556.648970:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011909504:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1721880556.648971:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011909376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1721880556.649024:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880556.649049:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880556.649066:0:9461:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011909376 00000100:00100000:2.0:1721880556.649074:0:9461:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011909376 00000100:00100000:1.0:1721880556.649100:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011909504 00000100:00100000:1.0:1721880556.649105:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011909504 00000100:00100000:2.0:1721880556.649106:0:9461:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 674 00000100:00100000:2.0:1721880556.649111:0:9461:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008779b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011909376:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1721880556.649126:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 675 00002000:00000024:2.0:1721880556.649135:0:9461:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:1.0:1721880556.649136:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cc72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3687:x1805522011909504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1721880556.649148:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:2.0:1721880556.649185:0:9461:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008779b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011909376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880556.649190:0:9461:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 674 00000100:00100000:1.0:1721880556.649194:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cc72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3687:x1805522011909504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880556.649201:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 675 00000100:00100000:3.0:1721880556.649203:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009fff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011909504:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1721880556.649211:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011909376:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1721880556.713077:0:8270:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880557.715046:0:7120:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880558.034624:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880558.034684:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880558.034711:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880558.034820:0:15420:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257818368 00000100:00100000:1.0:1721880558.034834:0:15420:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257818368 00000100:00100000:2.0:1721880558.034840:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257818240 00000100:00100000:2.0:1721880558.034850:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257818240 00000100:00100000:0.0:1721880558.034855:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880558.034855:0:15432:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257818496 00000100:00100000:3.0:1721880558.034865:0:15432:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257818496 00000100:00100000:0.0:1721880558.034888:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880558.034907:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 629 00000100:00100000:0.0:1721880558.034915:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880558.034915:0:15420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3131 00000100:00100000:2.0:1721880558.034916:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b19d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4976b229-99ef-4953-87e9-78e1b901883f+12:2005:x1805522257818240:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880558.034927:0:15420:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008779b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2004:x1805522257818368:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880558.034927:0:15432:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3132 00000100:00100000:3.0:1721880558.034935:0:15432:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fe6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2005:x1805522257818496:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880558.034943:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880558.034989:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b19d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4976b229-99ef-4953-87e9-78e1b901883f+12:2005:x1805522257818240:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 74us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880558.034994:0:15420:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008779b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2004:x1805522257818368:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 68us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880558.034999:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 629 00000100:00100000:0.0:1721880558.035001:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880558.035001:0:15432:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fe6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2005:x1805522257818496:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 65us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880558.035002:0:15420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3131 00000100:00100000:3.0:1721880558.035009:0:15432:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3132 00000100:00100000:1.0:1721880558.035029:0:15420:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257818880 00000100:00100000:3.0:1721880558.035029:0:15432:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257819008 00000100:00100000:3.0:1721880558.035032:0:15432:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257819008 00000100:00100000:1.0:1721880558.035033:0:15420:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257818880 00000100:00100000:3.0:1721880558.035052:0:15432:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3133 00000100:00100000:3.0:1721880558.035057:0:15432:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:30425778-2709-4512-9d75-01ec53c4cfad+3694:2005:x1805522257819008:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880558.035058:0:15420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3134 00000100:00100000:1.0:1721880558.035063:0:15420:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:30425778-2709-4512-9d75-01ec53c4cfad+4135:2004:x1805522257818880:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880558.035083:0:15432:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:30425778-2709-4512-9d75-01ec53c4cfad+3694:2005:x1805522257819008:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 24us (142us total) trans 0 rc 0/0 00000100:00080000:0.0:1721880558.035086:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880528 00000100:00100000:1.0:1721880558.035088:0:15420:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:30425778-2709-4512-9d75-01ec53c4cfad+4135:2004:x1805522257818880:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 23us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880558.035089:0:15432:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3133 00000100:00080000:0.0:1721880558.035093:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880528 00000100:00100000:1.0:1721880558.035094:0:15420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3134 00000100:00080000:0.0:1721880558.035096:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880528 00000100:00100000:2.0:1721880558.035100:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880558.035116:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257818624 00000100:00100000:3.0:1721880558.035118:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257818624 00000100:00100000:1.0:1721880558.035123:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257818752 00000100:00100000:1.0:1721880558.035126:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257818752 00000100:00080000:0.0:1721880558.035141:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880528 00000100:00080000:0.0:1721880558.035145:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880528 00000100:00100000:3.0:1721880558.035148:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257819136 00000100:00100000:3.0:1721880558.035150:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257819136 00000100:00100000:1.0:1721880558.035158:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257819264 00000100:00100000:1.0:1721880558.035162:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257819264 00000100:00100000:2.0:1721880558.035165:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 465 00000100:00100000:3.0:1721880558.035172:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 466 00000100:00100000:2.0:1721880558.035173:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fe4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2004:x1805522257818624:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880558.035178:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fe4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2005:x1805522257818752:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880558.035190:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 467 00000100:00100000:1.0:1721880558.035198:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fe4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:30425778-2709-4512-9d75-01ec53c4cfad+280:2004:x1805522257819136:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880558.035204:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fe4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2005:x1805522257818752:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 26us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880558.035210:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fe4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2004:x1805522257818624:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 38us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880558.035211:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 466 00000100:00100000:2.0:1721880558.035217:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 465 00000100:00100000:3.0:1721880558.035226:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 468 00000100:00100000:3.0:1721880558.035231:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:30425778-2709-4512-9d75-01ec53c4cfad+665:2005:x1805522257819264:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880558.035243:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fe4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:30425778-2709-4512-9d75-01ec53c4cfad+280:2004:x1805522257819136:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 43us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880558.035251:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:30425778-2709-4512-9d75-01ec53c4cfad+665:2005:x1805522257819264:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 19us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880558.035255:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 467 00000100:00100000:3.0:1721880558.035260:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 468 00000100:00080000:0.0:1721880558.035335:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880528 00000100:00080000:0.0:1721880558.035341:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880528 00000100:00100000:0.0:1721880558.120993:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008cc70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011909632:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1721880558.121059:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880558.121117:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011909632 00000100:00100000:1.0:1721880558.121127:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011909632 00000100:00100000:1.0:1721880558.121199:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101166 00000100:00100000:1.0:1721880558.121208:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011909632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1721880558.121248:0:15587:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1435709440 avail 1306247168 00000100:00100000:1.0:1721880558.121322:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011909632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880558.121340:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101166 00000100:00100000:0.0:1721880558.121363:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008cc70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011909632:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1721880558.716922:0:15560:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721880559.718930:0:11721:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880560.721022:0:7119:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1721880561.016997:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088fe4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011909760:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1721880561.017062:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880561.017116:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011909760 00000100:00100000:2.0:1721880561.017124:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011909760 00000100:00080000:0.0:1721880561.017175:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880531 00000100:00100000:2.0:1721880561.017186:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 676 00000100:00100000:2.0:1721880561.017192:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135301500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011909760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1721880561.017222:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:2.0:1721880561.017280:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135301500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011909760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880561.017287:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 676 00000100:00100000:1.0:1721880561.017315:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088fe4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011909760:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1721880561.417001:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1721880561.417024:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088fe5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011909888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1721880561.417080:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880561.417118:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011909888 00000100:00100000:2.0:1721880561.417126:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011909888 00000100:00100000:2.0:1721880561.417164:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 677 00000100:00100000:2.0:1721880561.417169:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cc73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011909888:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1721880561.417171:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880531 00002000:00000024:2.0:1721880561.417189:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:2.0:1721880561.417233:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cc73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011909888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880561.417237:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 677 00000100:00100000:3.0:1721880561.417250:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088fe5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011909888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1721880561.513064:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008cc70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011910016:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1721880561.513148:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880561.513262:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011910016 00000100:00100000:1.0:1721880561.513270:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011910016 00000100:00100000:1.0:1721880561.513319:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101167 00000100:00100000:1.0:1721880561.513325:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+19:3687:x1805522011910016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1721880561.513356:0:15587:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1437519872 avail 1308057600 00000100:00100000:1.0:1721880561.513408:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+19:3687:x1805522011910016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880561.513413:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101167 00000100:00100000:0.0:1721880561.513440:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008cc70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011910016:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1721880561.609079:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135301c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011910528:0@lo:400:kworker.0 00000100:00100000:2.0:1721880561.609079:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011910144:0@lo:400:kworker.0 00000100:00100000:0.0:1721880561.609095:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135301880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3689:1805522011910272:0@lo:400:kworker.0 00000100:00100000:3.0:1721880561.609105:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3686:1805522011910400:0@lo:400:kworker.0 00000100:00100000:1.0:1721880561.609161:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880561.609161:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880561.609162:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880561.609200:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135300700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011911040:0@lo:400:kworker.0 00000100:00100000:0.0:1721880561.609203:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880561.609205:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011910656:0@lo:400:kworker.0 00000100:00100000:3.0:1721880561.609205:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135303800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3686:1805522011910912:0@lo:400:kworker.0 00000100:00100000:1.0:1721880561.609230:0:7124:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011910144 00000100:00100000:1.0:1721880561.609237:0:7124:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011910144 00000100:00100000:3.0:1721880561.609249:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880561.609252:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135300380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3689:1805522011910784:0@lo:400:kworker.0 00000100:00100000:2.0:1721880561.609268:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011910400 00000100:00100000:2.0:1721880561.609274:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011910400 00000100:00100000:1.0:1721880561.609279:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 630 00000100:00100000:0.0:1721880561.609292:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880561.609297:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b19d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011910144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880561.609303:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011910272 00000100:00100000:3.0:1721880561.609307:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011910272 00000100:00100000:0.0:1721880561.609315:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135301f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011911296:0@lo:400:kworker.0 00000100:00100000:2.0:1721880561.609327:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011910912 00000100:00100000:2.0:1721880561.609331:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011910912 00000100:00100000:3.0:1721880561.609332:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011910784 00000100:00100000:3.0:1721880561.609335:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011910784 00000100:00100000:1.0:1721880561.609340:0:7124:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b19d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011910144:12345-0@lo:400:kworker.0 Request processed in 43us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880561.609346:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 630 00000100:00100000:0.0:1721880561.609347:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880561.609372:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3135 00000100:00100000:3.0:1721880561.609380:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3136 00000100:00100000:2.0:1721880561.609381:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cc73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-MDT0001_UUID+5:3686:x1805522011910400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880561.609389:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1805522011910272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880561.609411:0:15434:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3137 00000100:00100000:1.0:1721880561.609416:0:15434:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cc72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0000-lwp-OST0001_UUID+5:3686:x1805522011910912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880561.609419:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3138 00000100:00100000:0.0:1721880561.609428:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1805522011910784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880561.609450:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cc73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-MDT0001_UUID+5:3686:x1805522011910400:12345-0@lo:400:kworker.0 Request processed in 68us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880561.609455:0:15434:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cc72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0000-lwp-OST0001_UUID+5:3686:x1805522011910912:12345-0@lo:400:kworker.0 Request processed in 39us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880561.609456:0:7129:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1805522011910272:12345-0@lo:400:kworker.0 Request processed in 66us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880561.609461:0:15434:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3137 00000100:00100000:3.0:1721880561.609467:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3136 00000100:00100000:2.0:1721880561.609474:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3135 00000100:00100000:0.0:1721880561.609481:0:7130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1805522011910784:12345-0@lo:400:kworker.0 Request processed in 52us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880561.609486:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011910528 00000100:00100000:1.0:1721880561.609490:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011910528 00000100:00100000:0.0:1721880561.609491:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3138 00000100:00100000:1.0:1721880561.609513:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101168 00000100:00100000:2.0:1721880561.609513:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880561.609517:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011910528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880561.609523:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011911296 00000100:00100000:0.0:1721880561.609525:0:7130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011910656 00000100:00100000:3.0:1721880561.609528:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011911296 00000100:00100000:0.0:1721880561.609530:0:7130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011910656 00000100:00100000:2.0:1721880561.609534:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011911168:0@lo:400:kworker.0 00000100:00100000:1.0:1721880561.609542:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011910528:12345-0@lo:400:kworker.0 Request processed in 24us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880561.609548:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101168 00000100:00100000:3.0:1721880561.609555:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 469 00000100:00100000:0.0:1721880561.609559:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3139 00000100:00100000:2.0:1721880561.609560:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880561.609561:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fe7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011911296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880561.609565:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011910656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880561.609566:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880561.609590:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011910144:0@lo:400:kworker.0 00000100:00100000:1.0:1721880561.609594:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135301c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011910528:0@lo:400:kworker.0 00000100:00100000:3.0:1721880561.609599:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fe7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011911296:12345-0@lo:400:kworker.0 Request processed in 38us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880561.609605:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 469 00000100:00100000:0.0:1721880561.609615:0:7130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011910656:12345-0@lo:400:kworker.0 Request processed in 48us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880561.609615:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011910656:0@lo:400:kworker.0 00000100:00100000:3.0:1721880561.609615:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011911168 00000100:00100000:3.0:1721880561.609617:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011911168 00000100:00100000:0.0:1721880561.609625:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3139 00000100:00100000:1.0:1721880561.609625:0:15420:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011911040 00000100:00100000:1.0:1721880561.609628:0:15420:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011911040 00000100:00100000:3.0:1721880561.609633:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00000100:00100000:3.0:1721880561.609638:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011911168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880561.609648:0:15420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3140 00000100:00100000:2.0:1721880561.609651:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3686:1805522011910400:0@lo:400:kworker.0 00000100:00100000:1.0:1721880561.609653:0:15420:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135303480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011911040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880561.609661:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135303800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3686:1805522011910912:0@lo:400:kworker.0 00000100:00080000:0.0:1721880561.609706:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880531 00000100:00080000:0.0:1721880561.609711:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880531 00000100:00080000:0.0:1721880561.609713:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880531 00000100:00080000:0.0:1721880561.609715:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880531 00000100:00100000:3.0:1721880561.609721:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011911168:12345-0@lo:400:kworker.0 Request processed in 25us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880561.609753:0:15420:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135303480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011911040:12345-0@lo:400:kworker.0 Request processed in 74us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880561.609755:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00000100:00100000:1.0:1721880561.609760:0:15420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3140 00000100:00100000:2.0:1721880561.609764:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011911168:0@lo:400:kworker.0 00000100:00100000:1.0:1721880561.609791:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135300700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011911040:0@lo:400:kworker.0 00000100:00100000:0.0:1721880561.609796:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135301880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3689:1805522011910272:0@lo:400:kworker.0 00000100:00100000:0.0:1721880561.609813:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135300380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3689:1805522011910784:0@lo:400:kworker.0 00000100:00100000:0.0:1721880561.609826:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135301f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011911296:0@lo:400:kworker.0 00000100:00100000:0.0:1721880561.656930:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1721880561.656954:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008cc70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011911424:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1721880561.656993:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1721880561.657012:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135300700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011911552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1721880561.657028:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880561.657094:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011911424 00000100:00100000:2.0:1721880561.657095:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880561.657104:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011911424 00000100:00100000:0.0:1721880561.657134:0:9461:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011911552 00000100:00100000:0.0:1721880561.657142:0:9461:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011911552 00000100:00100000:3.0:1721880561.657145:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 678 00000100:00100000:3.0:1721880561.657153:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fe7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3687:x1805522011911424:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1721880561.657176:0:9461:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 679 00002000:00000024:3.0:1721880561.657183:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:0.0:1721880561.657185:0:9461:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011911552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1721880561.657206:0:9461:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:3.0:1721880561.657266:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fe7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3687:x1805522011911424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880561.657294:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 678 00000100:00100000:0.0:1721880561.657308:0:9461:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011911552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880561.657319:0:9461:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 679 00000100:00100000:1.0:1721880561.657320:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008cc70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011911424:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1721880561.657357:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135300700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011911552:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1721880561.722930:0:8270:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880562.724975:0:7120:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1721880563.043032:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880563.043092:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880563.043101:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257819392 00000100:00100000:0.0:1721880563.043115:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257819392 00000100:00100000:2.0:1721880563.043125:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880563.043151:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880563.043169:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880563.043188:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880563.043192:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 631 00000100:00100000:2.0:1721880563.043204:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880563.043205:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b19d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4976b229-99ef-4953-87e9-78e1b901883f+12:2004:x1805522257819392:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880563.043221:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880563.043222:0:15477:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257819520 00000100:00100000:1.0:1721880563.043230:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257819776 00000100:00100000:3.0:1721880563.043231:0:15477:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257819520 00000100:00100000:1.0:1721880563.043240:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257819776 00000100:00100000:2.0:1721880563.043272:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880563.043276:0:15477:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257819648 00000100:00100000:3.0:1721880563.043279:0:15477:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257819648 00000100:00100000:1.0:1721880563.043291:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257819904 00000100:00100000:3.0:1721880563.043294:0:15477:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257820032 00000100:00100000:0.0:1721880563.043295:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b19d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4976b229-99ef-4953-87e9-78e1b901883f+12:2004:x1805522257819392:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 90us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880563.043296:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257819904 00000100:00100000:3.0:1721880563.043297:0:15477:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257820032 00000100:00100000:0.0:1721880563.043307:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 631 00000100:00100000:3.0:1721880563.043307:0:15477:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257820160 00000100:00100000:3.0:1721880563.043310:0:15477:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257820160 00000100:00100000:1.0:1721880563.043318:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257820288 00000100:00100000:1.0:1721880563.043322:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257820288 00000100:00100000:3.0:1721880563.043329:0:15477:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3141 00000100:00100000:3.0:1721880563.043337:0:15477:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2005:x1805522257819520:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880563.043342:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257820416 00000100:00100000:1.0:1721880563.043346:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257820416 00000100:00100000:1.0:1721880563.043369:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 471 00000100:00100000:0.0:1721880563.043374:0:15415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3142 00000100:00100000:1.0:1721880563.043379:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2005:x1805522257819776:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880563.043383:0:15415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2004:x1805522257819648:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880563.043384:0:15477:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2005:x1805522257819520:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 47us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880563.043392:0:15477:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3141 00000100:00100000:3.0:1721880563.043424:0:15477:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3143 00000100:00100000:3.0:1721880563.043429:0:15477:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:30425778-2709-4512-9d75-01ec53c4cfad+4135:2005:x1805522257820032:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880563.043439:0:15415:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2004:x1805522257819648:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 56us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880563.043449:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2005:x1805522257819776:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 70us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880563.043451:0:15415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3142 00000100:00100000:1.0:1721880563.043461:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 471 00000100:00100000:3.0:1721880563.043466:0:15477:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:30425778-2709-4512-9d75-01ec53c4cfad+4135:2005:x1805522257820032:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 36us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880563.043473:0:15477:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3143 00000100:00100000:0.0:1721880563.043479:0:15415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3144 00000100:00100000:0.0:1721880563.043487:0:15415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:30425778-2709-4512-9d75-01ec53c4cfad+3694:2004:x1805522257820160:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880563.043494:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 472 00000100:00100000:1.0:1721880563.043502:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2004:x1805522257819904:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880563.043508:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 473 00000100:00100000:3.0:1721880563.043513:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:30425778-2709-4512-9d75-01ec53c4cfad+280:2005:x1805522257820288:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880563.043533:0:15415:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:30425778-2709-4512-9d75-01ec53c4cfad+3694:2004:x1805522257820160:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 44us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880563.043545:0:15415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3144 00000100:00100000:1.0:1721880563.043546:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2004:x1805522257819904:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 43us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880563.043547:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:30425778-2709-4512-9d75-01ec53c4cfad+280:2005:x1805522257820288:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 33us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880563.043553:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 473 00000100:00100000:1.0:1721880563.043559:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 472 00000100:00100000:3.0:1721880563.043570:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 474 00000100:00100000:3.0:1721880563.043574:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:30425778-2709-4512-9d75-01ec53c4cfad+665:2004:x1805522257820416:12345-192.168.201.24@tcp:400:kworker.0 00000100:00080000:1.0:1721880563.043589:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880533 00000100:00100000:3.0:1721880563.043592:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:30425778-2709-4512-9d75-01ec53c4cfad+665:2004:x1805522257820416:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 18us (320us total) trans 0 rc 0/0 00000100:00080000:1.0:1721880563.043595:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880533 00000100:00080000:1.0:1721880563.043598:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880533 00000100:00100000:3.0:1721880563.043599:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 474 00000100:00080000:1.0:1721880563.043602:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880533 00000100:00080000:1.0:1721880563.043605:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880533 00000100:00100000:2.0:1721880563.129089:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088fe6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011911680:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1721880563.129169:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880563.129233:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011911680 00000100:00100000:1.0:1721880563.129244:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011911680 00000100:00100000:1.0:1721880563.129309:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101169 00000100:00100000:1.0:1721880563.129317:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011911680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1721880563.129360:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1435709440 avail 1306247168 00000100:00100000:1.0:1721880563.129435:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011911680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880563.129443:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101169 00000100:00100000:2.0:1721880563.129467:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088fe6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011911680:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1721880563.726951:0:15560:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721880564.728946:0:11721:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880565.730998:0:7119:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1721880566.025035:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135301c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011911808:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1721880566.025125:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880566.025297:0:9461:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011911808 00000100:00100000:0.0:1721880566.025309:0:9461:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011911808 00000100:00100000:0.0:1721880566.025404:0:9461:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 680 00000100:00100000:0.0:1721880566.025417:0:9461:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011911808:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1721880566.025451:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880536 00002000:00000024:0.0:1721880566.025461:0:9461:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:0.0:1721880566.025551:0:9461:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011911808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 134us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880566.025562:0:9461:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 680 00000100:00100000:2.0:1721880566.025683:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135301c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011911808:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1721880566.425080:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008cc72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011911936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1721880566.425172:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880566.425268:0:9461:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011911936 00000100:00100000:0.0:1721880566.425280:0:9461:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011911936 00000100:00080000:1.0:1721880566.425339:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880536 00000100:00100000:0.0:1721880566.425347:0:9461:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 681 00000100:00100000:0.0:1721880566.425355:0:9461:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011911936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1721880566.425385:0:9461:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:0.0:1721880566.425457:0:9461:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011911936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880566.425465:0:9461:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 681 00000100:00100000:2.0:1721880566.425528:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008cc72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011911936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1721880566.521009:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088fe5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011912064:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1721880566.521069:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880566.521122:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011912064 00000100:00100000:2.0:1721880566.521132:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011912064 00000100:00100000:2.0:1721880566.521193:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101170 00000100:00100000:2.0:1721880566.521201:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135300a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3687:x1805522011912064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1721880566.521238:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1437519872 avail 1308057600 00000100:00100000:2.0:1721880566.521351:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135300a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3687:x1805522011912064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 148us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880566.521363:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101170 00000100:00100000:1.0:1721880566.521413:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088fe5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011912064:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1721880566.616915:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135301c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011912192:0@lo:400:kworker.0 00000100:00100000:2.0:1721880566.616931:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135300700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3689:1805522011912320:0@lo:400:kworker.0 00000100:00100000:0.0:1721880566.616962:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135300380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011912576:0@lo:400:kworker.0 00000100:00100000:2.0:1721880566.616983:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880566.616983:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880566.617013:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880566.617014:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3689:1805522011912832:0@lo:400:kworker.0 00000100:00100000:1.0:1721880566.617023:0:15420:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011912320 00000100:00100000:3.0:1721880566.617027:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135301880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011912704:0@lo:400:kworker.0 00000100:00100000:1.0:1721880566.617029:0:15420:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011912320 00000100:00100000:0.0:1721880566.617033:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011913088:0@lo:400:kworker.0 00000100:00100000:2.0:1721880566.617033:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880566.617043:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011913344:0@lo:400:kworker.0 00000100:00100000:0.0:1721880566.617048:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880566.617060:0:15420:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011912832 00000100:00100000:1.0:1721880566.617072:0:15420:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011912832 00000100:00100000:2.0:1721880566.617074:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880566.617077:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1721880566.617079:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011913088 00000100:00100000:0.0:1721880566.617081:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135301f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3687:1805522011912448:0@lo:400:kworker.0 00000100:00100000:3.0:1721880566.617083:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011913088 00000100:00100000:1.0:1721880566.617087:0:15420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3145 00000100:00100000:0.0:1721880566.617091:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880566.617092:0:15420:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1805522011912320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880566.617098:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135303800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3687:1805522011912960:0@lo:400:kworker.0 00000100:00100000:2.0:1721880566.617100:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011913344 00000100:00100000:2.0:1721880566.617103:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011913344 00000100:00100000:3.0:1721880566.617103:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011912448 00000100:00100000:0.0:1721880566.617105:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880566.617105:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011912448 00000100:00100000:3.0:1721880566.617118:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011912960 00000100:00100000:3.0:1721880566.617121:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011912960 00000100:00100000:2.0:1721880566.617123:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 475 00000100:00100000:0.0:1721880566.617126:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3146 00000100:00100000:2.0:1721880566.617127:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011913344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880566.617130:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1805522011912832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880566.617132:0:15420:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1805522011912320:12345-0@lo:400:kworker.0 Request processed in 41us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880566.617135:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3147 00000100:00100000:1.0:1721880566.617138:0:15420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3145 00000100:00100000:3.0:1721880566.617139:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fe5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011913088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880566.617148:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011913344:12345-0@lo:400:kworker.0 Request processed in 21us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880566.617151:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1805522011912832:12345-0@lo:400:kworker.0 Request processed in 20us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880566.617152:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 475 00000100:00100000:1.0:1721880566.617156:0:15420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3148 00000100:00100000:0.0:1721880566.617166:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3146 00000100:00100000:1.0:1721880566.617166:0:15420:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-MDT0001_UUID+5:3687:x1805522011912448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880566.617175:0:7129:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fe5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011913088:12345-0@lo:400:kworker.0 Request processed in 37us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880566.617179:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3147 00000100:00100000:1.0:1721880566.617180:0:15420:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-MDT0001_UUID+5:3687:x1805522011912448:12345-0@lo:400:kworker.0 Request processed in 13us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880566.617182:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3149 00000100:00100000:0.0:1721880566.617184:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-OST0001_UUID+5:3687:x1805522011912960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880566.617185:0:15420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3148 00000100:00100000:0.0:1721880566.617198:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-OST0001_UUID+5:3687:x1805522011912960:12345-0@lo:400:kworker.0 Request processed in 13us (92us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880566.617200:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880566.617201:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135300700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3689:1805522011912320:0@lo:400:kworker.0 00000100:00100000:0.0:1721880566.617202:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3149 00000100:00100000:1.0:1721880566.617202:0:7124:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011912192 00000100:00100000:1.0:1721880566.617203:0:7124:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011912192 00000100:00100000:2.0:1721880566.617207:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3689:1805522011912832:0@lo:400:kworker.0 00000100:00100000:3.0:1721880566.617208:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011913216:0@lo:400:kworker.0 00000100:00100000:0.0:1721880566.617211:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011912704 00000100:00100000:2.0:1721880566.617212:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011913344:0@lo:400:kworker.0 00000100:00100000:0.0:1721880566.617214:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011912704 00000100:00100000:1.0:1721880566.617217:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 632 00000100:00100000:1.0:1721880566.617220:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b19d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011912192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880566.617220:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880566.617226:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3150 00000100:00100000:0.0:1721880566.617228:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cc71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011912704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880566.617234:0:7124:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b19d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011912192:12345-0@lo:400:kworker.0 Request processed in 13us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880566.617236:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011913216 00000100:00100000:1.0:1721880566.617237:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 632 00000100:00100000:2.0:1721880566.617237:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011913216 00000100:00100000:0.0:1721880566.617244:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cc71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011912704:12345-0@lo:400:kworker.0 Request processed in 15us (43us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880566.617245:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135301c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011912192:0@lo:400:kworker.0 00000100:00100000:0.0:1721880566.617247:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3150 00000100:00100000:2.0:1721880566.617248:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00000100:00100000:2.0:1721880566.617250:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cc72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011913216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880566.617256:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135301880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011912704:0@lo:400:kworker.0 00000100:00080000:1.0:1721880566.617258:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880536 00000100:00080000:1.0:1721880566.617260:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880536 00000100:00080000:1.0:1721880566.617261:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880536 00000100:00080000:1.0:1721880566.617264:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880536 00000100:00100000:2.0:1721880566.617269:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cc72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011913216:12345-0@lo:400:kworker.0 Request processed in 18us (47us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880566.617270:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011913216:0@lo:400:kworker.0 00000100:00100000:2.0:1721880566.617272:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00000100:00100000:0.0:1721880566.617274:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011912576 00000100:00100000:0.0:1721880566.617276:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011912576 00000100:00100000:0.0:1721880566.617292:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101171 00000100:00100000:0.0:1721880566.617294:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011912576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880566.617311:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011912576:12345-0@lo:400:kworker.0 Request processed in 16us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880566.617317:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101171 00000100:00100000:0.0:1721880566.617339:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135301f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3687:1805522011912448:0@lo:400:kworker.0 00000100:00100000:0.0:1721880566.617347:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135303800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3687:1805522011912960:0@lo:400:kworker.0 00000100:00100000:0.0:1721880566.617354:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135300380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011912576:0@lo:400:kworker.0 00000100:00100000:0.0:1721880566.617361:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011913088:0@lo:400:kworker.0 00000100:00100000:3.0:1721880566.664909:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011913472:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1721880566.664918:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012edb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011913600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1721880566.664987:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880566.665013:0:9461:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011913472 00000100:00100000:0.0:1721880566.665020:0:9461:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011913472 00000100:00100000:1.0:1721880566.665029:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880566.665058:0:9461:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011913600 00000100:00100000:0.0:1721880566.665061:0:9461:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011913600 00000100:00100000:3.0:1721880566.665067:0:10429:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 682 00000100:00100000:3.0:1721880566.665073:0:10429:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cc71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011913472:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1721880566.665081:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 683 00000100:00100000:2.0:1721880566.665089:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135300380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011913600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1721880566.665100:0:10429:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00002000:00000024:2.0:1721880566.665103:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:2.0:1721880566.665161:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135300380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011913600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880566.665162:0:10429:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cc71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011913472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880566.665167:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 683 00000100:00100000:3.0:1721880566.665170:0:10429:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 682 00000100:00100000:1.0:1721880566.665177:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012edb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011913600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1721880566.665197:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011913472:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1721880566.733013:0:8270:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880567.735039:0:7120:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880568.050349:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880568.050391:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880568.050403:0:15415:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257820672 00000100:00100000:2.0:1721880568.050411:0:15415:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257820672 00000100:00100000:0.0:1721880568.050413:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880568.050427:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880568.050443:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880568.050452:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880568.050456:0:15415:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257820800 00000100:00100000:2.0:1721880568.050459:0:15415:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257820800 00000100:00100000:0.0:1721880568.050461:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880568.050470:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880568.050474:0:15415:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257821184 00000100:00100000:2.0:1721880568.050477:0:15415:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257821184 00000100:00100000:3.0:1721880568.050477:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257820928 00000100:00100000:1.0:1721880568.050499:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257820544 00000100:00100000:3.0:1721880568.050502:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257820928 00000100:00100000:1.0:1721880568.050508:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257820544 00000100:00100000:2.0:1721880568.050512:0:15415:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257821312 00000100:00100000:2.0:1721880568.050516:0:15415:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257821312 00000100:00100000:0.0:1721880568.050519:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880568.050541:0:15415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3151 00000100:00100000:3.0:1721880568.050553:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257821056 00000100:00100000:1.0:1721880568.050554:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 633 00000100:00100000:2.0:1721880568.050554:0:15415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2004:x1805522257820672:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880568.050556:0:15434:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3152 00000100:00100000:3.0:1721880568.050556:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257821056 00000100:00100000:1.0:1721880568.050561:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b19d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4976b229-99ef-4953-87e9-78e1b901883f+12:2005:x1805522257820544:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880568.050611:0:15434:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2005:x1805522257820800:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880568.050620:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257821440 00000100:00100000:3.0:1721880568.050621:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257821440 00000100:00100000:3.0:1721880568.050628:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257821568 00000100:00100000:3.0:1721880568.050630:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257821568 00000100:00100000:3.0:1721880568.050640:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 477 00000100:00100000:3.0:1721880568.050644:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098222a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2004:x1805522257820928:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880568.050651:0:15434:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2005:x1805522257820800:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 88us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880568.050653:0:15415:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2004:x1805522257820672:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 104us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880568.050655:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b19d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4976b229-99ef-4953-87e9-78e1b901883f+12:2005:x1805522257820544:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 96us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880568.050656:0:15434:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3152 00000100:00100000:1.0:1721880568.050660:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 633 00000100:00100000:2.0:1721880568.050660:0:15415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3151 00000100:00100000:3.0:1721880568.050669:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098222a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2004:x1805522257820928:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 25us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880568.050674:0:15434:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3153 00000100:00100000:3.0:1721880568.050674:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 477 00000100:00100000:0.0:1721880568.050677:0:15434:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:30425778-2709-4512-9d75-01ec53c4cfad+4135:2004:x1805522257821184:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880568.050678:0:15415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3154 00000100:00100000:2.0:1721880568.050683:0:15415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:30425778-2709-4512-9d75-01ec53c4cfad+3694:2005:x1805522257821312:12345-192.168.201.24@tcp:400:kworker.0 00000100:00080000:1.0:1721880568.050685:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880538 00000100:00100000:3.0:1721880568.050685:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 478 00000100:00080000:1.0:1721880568.050688:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880538 00000100:00100000:3.0:1721880568.050688:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2005:x1805522257821056:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880568.050689:0:15434:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:30425778-2709-4512-9d75-01ec53c4cfad+4135:2004:x1805522257821184:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 11us (236us total) trans 0 rc 0/0 00000100:00080000:1.0:1721880568.050689:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880538 00000100:00080000:1.0:1721880568.050691:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880538 00000100:00080000:1.0:1721880568.050692:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880538 00000100:00100000:0.0:1721880568.050693:0:15434:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3153 00000100:00100000:3.0:1721880568.050703:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2005:x1805522257821056:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 14us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880568.050706:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 478 00000100:00100000:0.0:1721880568.050709:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 479 00000100:00100000:2.0:1721880568.050709:0:15415:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:30425778-2709-4512-9d75-01ec53c4cfad+3694:2005:x1805522257821312:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 20us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880568.050712:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098220380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:30425778-2709-4512-9d75-01ec53c4cfad+280:2004:x1805522257821440:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880568.050712:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 480 00000100:00100000:1.0:1721880568.050715:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098222300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:30425778-2709-4512-9d75-01ec53c4cfad+665:2005:x1805522257821568:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880568.050715:0:15415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3154 00000100:00100000:0.0:1721880568.050724:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098220380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:30425778-2709-4512-9d75-01ec53c4cfad+280:2004:x1805522257821440:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 12us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880568.050728:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 479 00000100:00100000:1.0:1721880568.050759:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098222300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:30425778-2709-4512-9d75-01ec53c4cfad+665:2005:x1805522257821568:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 43us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880568.050763:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 480 00000100:00100000:3.0:1721880568.137062:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012edb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011913728:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1721880568.137138:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880568.137206:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011913728 00000100:00100000:0.0:1721880568.137219:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011913728 00000100:00100000:0.0:1721880568.137288:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101172 00000100:00100000:0.0:1721880568.137297:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cc70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011913728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1721880568.137338:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1435709440 avail 1306247168 00000100:00100000:0.0:1721880568.137414:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cc70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011913728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880568.137423:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101172 00000100:00100000:3.0:1721880568.137464:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012edb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011913728:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1721880568.736945:0:15560:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721880569.739102:0:11721:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880570.741009:0:7119:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1721880571.032981:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1721880571.033004:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012edb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011913856:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1721880571.033066:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880571.033131:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011913856 00000100:00100000:2.0:1721880571.033140:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011913856 00000100:00100000:2.0:1721880571.033211:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 684 00000100:00100000:2.0:1721880571.033230:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cc73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011913856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1721880571.033265:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00080000:1.0:1721880571.033293:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880541 00000100:00100000:2.0:1721880571.033346:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cc73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011913856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 116us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880571.033359:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 684 00000100:00100000:3.0:1721880571.033374:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012edb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011913856:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1721880571.433064:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1721880571.433096:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88012edb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011913984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1721880571.433185:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880571.433259:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011913984 00000100:00100000:2.0:1721880571.433270:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011913984 00000100:00080000:1.0:1721880571.433305:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880541 00000100:00100000:2.0:1721880571.433330:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 685 00000100:00100000:2.0:1721880571.433339:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135303800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011913984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1721880571.433367:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:2.0:1721880571.433446:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135303800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011913984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880571.433453:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 685 00000100:00100000:1.0:1721880571.433480:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88012edb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011913984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1721880571.528993:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1721880571.529017:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135301f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011914112:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1721880571.529085:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880571.529139:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011914112 00000100:00100000:2.0:1721880571.529149:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011914112 00000100:00100000:2.0:1721880571.529207:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101173 00000100:00100000:2.0:1721880571.529214:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098221180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3686:x1805522011914112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1721880571.529249:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1437519872 avail 1308057600 00000100:00100000:2.0:1721880571.529358:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098221180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3686:x1805522011914112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 143us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880571.529367:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101173 00000100:00100000:0.0:1721880571.529385:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135301f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011914112:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1721880571.624925:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011914240:0@lo:400:kworker.0 00000100:00100000:1.0:1721880571.624936:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135301c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3686:1805522011914496:0@lo:400:kworker.0 00000100:00100000:2.0:1721880571.624942:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011914624:0@lo:400:kworker.0 00000100:00100000:0.0:1721880571.624957:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135301880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3689:1805522011914368:0@lo:400:kworker.0 00000100:00100000:3.0:1721880571.625003:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880571.625004:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880571.625005:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880571.625022:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880571.625033:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011914752:0@lo:400:kworker.0 00000100:00100000:1.0:1721880571.625035:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135301f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3686:1805522011915008:0@lo:400:kworker.0 00000100:00100000:2.0:1721880571.625046:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011915136:0@lo:400:kworker.0 00000100:00100000:0.0:1721880571.625047:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135300700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3689:1805522011914880:0@lo:400:kworker.0 00000100:00100000:3.0:1721880571.625052:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880571.625064:0:7124:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011914240 00000100:00100000:1.0:1721880571.625069:0:7124:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011914240 00000100:00100000:0.0:1721880571.625071:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011914496 00000100:00100000:0.0:1721880571.625074:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011914496 00000100:00100000:2.0:1721880571.625074:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880571.625078:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009993a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011915264:0@lo:400:kworker.0 00000100:00100000:3.0:1721880571.625092:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880571.625099:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011914368 00000100:00100000:1.0:1721880571.625099:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 634 00000100:00100000:0.0:1721880571.625100:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011914368 00000100:00100000:2.0:1721880571.625102:0:15477:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011914752 00000100:00100000:1.0:1721880571.625103:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b19d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011914240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880571.625106:0:15477:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011914752 00000100:00100000:0.0:1721880571.625109:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011915136 00000100:00100000:0.0:1721880571.625110:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011915136 00000100:00100000:3.0:1721880571.625117:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3155 00000100:00100000:3.0:1721880571.625120:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099939500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3686:x1805522011914496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880571.625125:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3156 00000100:00100000:0.0:1721880571.625128:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1805522011914368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880571.625132:0:15477:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3157 00000100:00100000:2.0:1721880571.625136:0:15477:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095aebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011915136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880571.625137:0:7124:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b19d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011914240:12345-0@lo:400:kworker.0 Request processed in 34us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880571.625141:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 634 00000100:00100000:3.0:1721880571.625144:0:7130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099939500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3686:x1805522011914496:12345-0@lo:400:kworker.0 Request processed in 23us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880571.625148:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3155 00000100:00100000:0.0:1721880571.625152:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1805522011914368:12345-0@lo:400:kworker.0 Request processed in 24us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880571.625156:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3156 00000100:00100000:3.0:1721880571.625165:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3158 00000100:00100000:2.0:1721880571.625167:0:15477:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880095aebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011915136:12345-0@lo:400:kworker.0 Request processed in 30us (92us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880571.625168:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cc71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011914752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880571.625173:0:15477:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3157 00000100:00100000:1.0:1721880571.625175:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011915264 00000100:00100000:1.0:1721880571.625176:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011915264 00000100:00100000:0.0:1721880571.625178:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880571.625181:0:7130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cc71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011914752:12345-0@lo:400:kworker.0 Request processed in 12us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880571.625184:0:15477:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011914880 00000100:00100000:3.0:1721880571.625184:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3158 00000100:00100000:0.0:1721880571.625186:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011915392:0@lo:400:kworker.0 00000100:00100000:2.0:1721880571.625186:0:15477:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011914880 00000100:00100000:1.0:1721880571.625191:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 481 00000100:00100000:1.0:1721880571.625194:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cc73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011915264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880571.625195:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3159 00000100:00100000:0.0:1721880571.625198:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880571.625198:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098220e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1805522011914880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880571.625211:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cc73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011915264:12345-0@lo:400:kworker.0 Request processed in 17us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880571.625211:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011915392 00000100:00100000:2.0:1721880571.625212:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011915392 00000100:00100000:1.0:1721880571.625214:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 481 00000100:00100000:3.0:1721880571.625214:0:7130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098220e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1805522011914880:12345-0@lo:400:kworker.0 Request processed in 16us (36us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880571.625218:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3159 00000100:00100000:1.0:1721880571.625221:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 482 00000100:00100000:0.0:1721880571.625222:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135301880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3689:1805522011914368:0@lo:400:kworker.0 00000100:00100000:1.0:1721880571.625224:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011915392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880571.625228:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135300700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3689:1805522011914880:0@lo:400:kworker.0 00000100:00100000:3.0:1721880571.625240:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009993a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011915264:0@lo:400:kworker.0 00000100:00100000:1.0:1721880571.625243:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011915392:12345-0@lo:400:kworker.0 Request processed in 19us (45us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880571.625244:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011915392:0@lo:400:kworker.0 00000100:00100000:2.0:1721880571.625245:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011915136:0@lo:400:kworker.0 00000100:00100000:3.0:1721880571.625246:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011914240:0@lo:400:kworker.0 00000100:00100000:1.0:1721880571.625247:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 482 00000100:00100000:3.0:1721880571.625250:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011914752:0@lo:400:kworker.0 00000100:00080000:1.0:1721880571.625255:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880541 00000100:00080000:1.0:1721880571.625257:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880541 00000100:00080000:1.0:1721880571.625260:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880541 00000100:00100000:0.0:1721880571.625262:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011914624 00000100:00080000:1.0:1721880571.625262:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880541 00000100:00100000:0.0:1721880571.625264:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011914624 00000100:00100000:1.0:1721880571.625267:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880571.625281:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101174 00000100:00100000:0.0:1721880571.625283:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011914624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880571.625285:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135301c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3686:1805522011914496:0@lo:400:kworker.0 00000100:00100000:0.0:1721880571.625302:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011914624:12345-0@lo:400:kworker.0 Request processed in 18us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880571.625306:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101174 00000100:00100000:2.0:1721880571.625311:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011914624:0@lo:400:kworker.0 00000100:00100000:0.0:1721880571.625317:0:15420:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011915008 00000100:00100000:0.0:1721880571.625318:0:15420:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011915008 00000100:00100000:0.0:1721880571.625330:0:15420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3160 00000100:00080000:1.0:1721880571.625331:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880541 00000100:00100000:0.0:1721880571.625332:0:15420:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009993b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-OST0001_UUID+5:3686:x1805522011915008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880571.625346:0:15420:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009993b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-OST0001_UUID+5:3686:x1805522011915008:12345-0@lo:400:kworker.0 Request processed in 13us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880571.625349:0:15420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3160 00000100:00100000:1.0:1721880571.625360:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135301f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3686:1805522011915008:0@lo:400:kworker.0 00000100:00100000:0.0:1721880571.672897:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009993aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011915520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1721880571.672921:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880095ae9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011915648:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1721880571.672947:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880571.672974:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880571.673009:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011915520 00000100:00100000:0.0:1721880571.673017:0:10429:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011915648 00000100:00100000:2.0:1721880571.673017:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011915520 00000100:00100000:0.0:1721880571.673020:0:10429:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011915648 00000100:00100000:0.0:1721880571.673051:0:10429:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 686 00000100:00100000:0.0:1721880571.673055:0:10429:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cc70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3687:x1805522011915648:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1721880571.673060:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 687 00000100:00100000:2.0:1721880571.673066:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098221c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011915520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1721880571.673076:0:10429:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00002000:00000024:2.0:1721880571.673078:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:0.0:1721880571.673115:0:10429:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cc70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3687:x1805522011915648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880571.673119:0:10429:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 686 00000100:00100000:1.0:1721880571.673132:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009993aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011915520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1721880571.673134:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098221c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011915520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880571.673139:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880095ae9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011915648:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1721880571.673140:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 687 00010000:00010000:2.0:1721880571.743009:0:8270:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880572.745062:0:7120:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880573.058856:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880573.058907:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880573.058934:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880573.058955:0:15420:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257821824 00000100:00100000:0.0:1721880573.058966:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880573.058969:0:15420:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257821824 00000100:00100000:0.0:1721880573.058995:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880573.059008:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257822080 00000100:00100000:0.0:1721880573.059014:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880573.059018:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257822080 00000100:00100000:0.0:1721880573.059033:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880573.059033:0:15420:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257822336 00000100:00100000:2.0:1721880573.059036:0:15420:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257822336 00000100:00100000:2.0:1721880573.059050:0:15420:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257821952 00000100:00100000:0.0:1721880573.059051:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880573.059053:0:15420:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257821952 00000100:00100000:1.0:1721880573.059066:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257822592 00000100:00100000:2.0:1721880573.059067:0:15420:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257822464 00000100:00100000:2.0:1721880573.059069:0:15420:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257822464 00000100:00100000:1.0:1721880573.059070:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257822592 00000100:00100000:1.0:1721880573.059090:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257822208 00000100:00100000:2.0:1721880573.059090:0:15420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3161 00000100:00100000:1.0:1721880573.059094:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257822208 00000100:00100000:2.0:1721880573.059098:0:15420:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2005:x1805522257821824:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880573.059108:0:15434:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3162 00000100:00100000:3.0:1721880573.059119:0:15434:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:30425778-2709-4512-9d75-01ec53c4cfad+4135:2005:x1805522257822336:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880573.059122:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 483 00000100:00100000:1.0:1721880573.059132:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2005:x1805522257822080:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880573.059147:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880573.059176:0:15420:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2005:x1805522257821824:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 78us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880573.059184:0:15434:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:30425778-2709-4512-9d75-01ec53c4cfad+4135:2005:x1805522257822336:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 67us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880573.059185:0:15420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3161 00000100:00100000:1.0:1721880573.059187:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2005:x1805522257822080:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 54us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880573.059193:0:15434:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3162 00000100:00100000:1.0:1721880573.059199:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 483 00000100:00100000:2.0:1721880573.059211:0:15420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3163 00000100:00100000:2.0:1721880573.059216:0:15420:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098222d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2004:x1805522257821952:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880573.059220:0:15434:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3164 00000100:00100000:1.0:1721880573.059225:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257822720 00000100:00100000:3.0:1721880573.059225:0:15434:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135303b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:30425778-2709-4512-9d75-01ec53c4cfad+3694:2004:x1805522257822464:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880573.059229:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257822720 00000100:00100000:2.0:1721880573.059243:0:15420:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098222d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2004:x1805522257821952:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 26us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880573.059249:0:15434:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135303b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:30425778-2709-4512-9d75-01ec53c4cfad+3694:2004:x1805522257822464:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 23us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880573.059250:0:15420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3163 00000100:00100000:3.0:1721880573.059256:0:15434:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3164 00000100:00100000:1.0:1721880573.059259:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 484 00000100:00100000:1.0:1721880573.059267:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880098220700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:30425778-2709-4512-9d75-01ec53c4cfad+280:2005:x1805522257822592:12345-192.168.201.24@tcp:400:kworker.0 00000100:00080000:2.0:1721880573.059267:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880543 00000100:00080000:2.0:1721880573.059271:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880543 00000100:00080000:2.0:1721880573.059273:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880543 00000100:00080000:2.0:1721880573.059275:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880543 00000100:00100000:2.0:1721880573.059293:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 485 00000100:00100000:0.0:1721880573.059297:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257821696 00000100:00100000:2.0:1721880573.059298:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135301f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2004:x1805522257822208:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880573.059299:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 486 00000100:00100000:0.0:1721880573.059304:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257821696 00000100:00100000:3.0:1721880573.059304:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135301c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:30425778-2709-4512-9d75-01ec53c4cfad+665:2004:x1805522257822720:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880573.059315:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880098220700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:30425778-2709-4512-9d75-01ec53c4cfad+280:2005:x1805522257822592:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 46us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880573.059321:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135301f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2004:x1805522257822208:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 23us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880573.059326:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 484 00000100:00100000:3.0:1721880573.059327:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135301c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:30425778-2709-4512-9d75-01ec53c4cfad+665:2004:x1805522257822720:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 22us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880573.059331:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 485 00000100:00100000:3.0:1721880573.059335:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 486 00000100:00100000:0.0:1721880573.059345:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 635 00000100:00100000:0.0:1721880573.059352:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b19d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4976b229-99ef-4953-87e9-78e1b901883f+12:2004:x1805522257821696:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880573.059389:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b19d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4976b229-99ef-4953-87e9-78e1b901883f+12:2004:x1805522257821696:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 37us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880573.059402:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 635 00000100:00080000:2.0:1721880573.059468:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880543 00000100:00100000:3.0:1721880573.145079:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880095ae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011915776:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1721880573.145145:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880573.145192:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011915776 00000100:00100000:0.0:1721880573.145200:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011915776 00000100:00100000:0.0:1721880573.145253:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101175 00000100:00100000:0.0:1721880573.145260:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cc72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011915776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1721880573.145294:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1435709440 avail 1306247168 00000100:00100000:0.0:1721880573.145365:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cc72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011915776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880573.145375:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101175 00000100:00100000:3.0:1721880573.145391:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880095ae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011915776:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1721880573.747001:0:15560:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721880574.748952:0:11721:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880575.750957:0:7119:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1721880576.040939:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1721880576.040957:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880095aeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011915904:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1721880576.041006:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880576.041041:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011915904 00000100:00100000:2.0:1721880576.041048:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011915904 00000100:00080000:0.0:1721880576.041078:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880546 00000100:00100000:2.0:1721880576.041096:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 688 00000100:00100000:2.0:1721880576.041102:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cc70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011915904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1721880576.041128:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:2.0:1721880576.041182:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cc70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011915904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880576.041189:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 688 00000100:00100000:3.0:1721880576.041201:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880095aeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011915904:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1721880576.440920:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009993aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011916032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1721880576.440979:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880576.441061:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011916032 00000100:00100000:0.0:1721880576.441070:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011916032 00000100:00080000:2.0:1721880576.441124:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880546 00000100:00100000:0.0:1721880576.441130:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 689 00000100:00100000:0.0:1721880576.441136:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800830a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011916032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1721880576.441158:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:0.0:1721880576.441216:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800830a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011916032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880576.441224:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 689 00000100:00100000:2.0:1721880576.441234:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009993aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011916032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1721880576.537000:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880135301500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011916160:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1721880576.537075:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880576.537141:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011916160 00000100:00100000:0.0:1721880576.537150:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011916160 00000100:00100000:0.0:1721880576.537207:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101176 00000100:00100000:0.0:1721880576.537215:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cc70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3687:x1805522011916160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1721880576.537254:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1437519872 avail 1308057600 00000100:00100000:0.0:1721880576.537321:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cc70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3687:x1805522011916160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880576.537330:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101176 00000100:00100000:3.0:1721880576.537373:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880135301500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011916160:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1721880576.633038:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009993b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3689:1805522011916416:0@lo:400:kworker.0 00000100:00100000:1.0:1721880576.633038:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099939c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011916672:0@lo:400:kworker.0 00000100:00100000:3.0:1721880576.633044:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099938700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011916288:0@lo:400:kworker.0 00000100:00100000:2.0:1721880576.633055:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009993b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3686:1805522011916544:0@lo:400:kworker.0 00000100:00100000:1.0:1721880576.633138:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880576.633138:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880576.633139:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880576.633168:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011916672 00000100:00100000:1.0:1721880576.633171:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099938380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011917184:0@lo:400:kworker.0 00000100:00100000:0.0:1721880576.633178:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011916672 00000100:00100000:3.0:1721880576.633187:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009993a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011916800:0@lo:400:kworker.0 00000100:00100000:2.0:1721880576.633189:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3686:1805522011917056:0@lo:400:kworker.0 00000100:00100000:1.0:1721880576.633195:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880576.633214:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880576.633252:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101177 00000100:00100000:3.0:1721880576.633255:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011916544 00000100:00100000:1.0:1721880576.633260:0:11334:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011917184 00000100:00100000:0.0:1721880576.633261:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009993bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011916672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880576.633261:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011916544 00000100:00100000:1.0:1721880576.633265:0:11334:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011917184 00000100:00100000:2.0:1721880576.633272:0:15477:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011917056 00000100:00100000:2.0:1721880576.633277:0:15477:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011917056 00000100:00100000:1.0:1721880576.633299:0:11334:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3165 00000100:00100000:1.0:1721880576.633305:0:11334:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009993aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011917184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880576.633308:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3166 00000100:00100000:2.0:1721880576.633314:0:15477:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3167 00000100:00100000:3.0:1721880576.633315:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095aeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-MDT0001_UUID+5:3686:x1805522011916544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880576.633319:0:15477:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095aea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-lwp-OST0001_UUID+5:3686:x1805522011917056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880576.633335:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009993bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011916672:12345-0@lo:400:kworker.0 Request processed in 73us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880576.633345:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101177 00000100:00100000:1.0:1721880576.633347:0:11334:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009993aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011917184:12345-0@lo:400:kworker.0 Request processed in 42us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880576.633353:0:11334:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3165 00000100:00100000:2.0:1721880576.633365:0:15477:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880095aea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-lwp-OST0001_UUID+5:3686:x1805522011917056:12345-0@lo:400:kworker.0 Request processed in 45us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880576.633369:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880095aeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-MDT0001_UUID+5:3686:x1805522011916544:12345-0@lo:400:kworker.0 Request processed in 53us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880576.633375:0:15477:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3167 00000100:00080000:1.0:1721880576.633381:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880546 00000100:00100000:3.0:1721880576.633381:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3166 00000100:00080000:1.0:1721880576.633384:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880546 00000100:00100000:0.0:1721880576.633388:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011916288 00000100:00100000:0.0:1721880576.633393:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011916288 00000100:00100000:1.0:1721880576.633407:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099939c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011916672:0@lo:400:kworker.0 00000100:00100000:1.0:1721880576.633416:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099938380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011917184:0@lo:400:kworker.0 00000100:00100000:2.0:1721880576.633417:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880576.633459:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 636 00000100:00100000:3.0:1721880576.633461:0:15415:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011916416 00000100:00100000:0.0:1721880576.633466:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b19d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011916288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880576.633467:0:15415:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011916416 00000100:00100000:2.0:1721880576.633479:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009993ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3689:1805522011916928:0@lo:400:kworker.0 00000100:00080000:1.0:1721880576.633484:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880546 00000100:00100000:3.0:1721880576.633494:0:15415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3168 00000100:00100000:3.0:1721880576.633498:0:15415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1805522011916416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880576.633515:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b19d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011916288:12345-0@lo:400:kworker.0 Request processed in 47us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880576.633518:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880576.633525:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 636 00000100:00100000:3.0:1721880576.633534:0:15415:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1805522011916416:12345-0@lo:400:kworker.0 Request processed in 35us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880576.633540:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011917440:0@lo:400:kworker.0 00000100:00100000:3.0:1721880576.633540:0:15415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3168 00000100:00100000:3.0:1721880576.633550:0:15415:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011916928 00000100:00100000:3.0:1721880576.633552:0:15415:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011916928 00000100:00100000:2.0:1721880576.633567:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880576.633585:0:15415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3169 00000100:00100000:3.0:1721880576.633589:0:15415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095aeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1805522011916928:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1721880576.633597:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880546 00000100:00100000:2.0:1721880576.633599:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009993b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3689:1805522011916416:0@lo:400:kworker.0 00000100:00100000:3.0:1721880576.633613:0:15415:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880095aeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1805522011916928:12345-0@lo:400:kworker.0 Request processed in 22us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880576.633618:0:15415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3169 00000100:00100000:2.0:1721880576.633621:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009993ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3689:1805522011916928:0@lo:400:kworker.0 00000100:00100000:3.0:1721880576.633634:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011917440 00000100:00100000:3.0:1721880576.633637:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011917440 00000100:00080000:1.0:1721880576.633652:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880546 00000100:00100000:2.0:1721880576.633655:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009993b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3686:1805522011916544:0@lo:400:kworker.0 00000100:00100000:2.0:1721880576.633663:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3686:1805522011917056:0@lo:400:kworker.0 00000100:00100000:3.0:1721880576.633671:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 487 00000100:00100000:3.0:1721880576.633675:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011917440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880576.633700:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011917440:12345-0@lo:400:kworker.0 Request processed in 24us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880576.633705:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 487 00000100:00100000:2.0:1721880576.633711:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011917440:0@lo:400:kworker.0 00000100:00100000:3.0:1721880576.633722:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880576.633760:0:7130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011916800 00000100:00100000:0.0:1721880576.633766:0:7130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011916800 00000100:00100000:3.0:1721880576.633767:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099938a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011917312:0@lo:400:kworker.0 00000100:00100000:3.0:1721880576.633787:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880576.633812:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011917312 00000100:00100000:2.0:1721880576.633816:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011917312 00000100:00100000:0.0:1721880576.633817:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3170 00000100:00100000:3.0:1721880576.633819:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099938700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011916288:0@lo:400:kworker.0 00000100:00100000:0.0:1721880576.633826:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cc70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011916800:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1721880576.633828:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880546 00000100:00080000:1.0:1721880576.633834:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880546 00000100:00100000:2.0:1721880576.633838:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 00000100:00100000:2.0:1721880576.633842:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cc72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011917312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880576.633878:0:7130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cc70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011916800:12345-0@lo:400:kworker.0 Request processed in 52us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880576.633882:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cc72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011917312:12345-0@lo:400:kworker.0 Request processed in 39us (93us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880576.633883:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009993a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011916800:0@lo:400:kworker.0 00000100:00100000:0.0:1721880576.633888:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3170 00000100:00100000:2.0:1721880576.633888:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00000100:00100000:3.0:1721880576.633892:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099938a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011917312:0@lo:400:kworker.0 00000100:00100000:2.0:1721880576.680988:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008cc73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011917568:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1721880576.681014:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099938380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011917696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1721880576.681083:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880576.681117:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011917568 00000100:00100000:0.0:1721880576.681125:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011917568 00000100:00100000:1.0:1721880576.681140:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880576.681163:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011917696 00000100:00100000:0.0:1721880576.681166:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011917696 00000100:00100000:2.0:1721880576.681174:0:10429:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 690 00000100:00100000:2.0:1721880576.681182:0:10429:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011917568:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1721880576.681194:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 691 00000100:00100000:0.0:1721880576.681201:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099939c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011917696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1721880576.681214:0:10429:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00002000:00000024:0.0:1721880576.681216:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:0.0:1721880576.681261:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099939c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011917696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880576.681269:0:10429:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011917568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880576.681270:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 691 00000100:00100000:2.0:1721880576.681275:0:10429:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 690 00000100:00100000:1.0:1721880576.681279:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099938380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011917696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1721880576.681311:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008cc73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011917568:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1721880576.752976:0:8270:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880577.755080:0:7120:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880578.066616:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880578.066666:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880578.066698:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880578.066699:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257822848 00000100:00100000:2.0:1721880578.066713:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257822848 00000100:00100000:0.0:1721880578.066718:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880578.066770:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880578.066788:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880578.066803:0:7130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257822976 00000100:00100000:0.0:1721880578.066805:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880578.066808:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 637 00000100:00100000:1.0:1721880578.066815:0:7130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257822976 00000100:00100000:2.0:1721880578.066818:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b19d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4976b229-99ef-4953-87e9-78e1b901883f+12:2005:x1805522257822848:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880578.066822:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880578.066859:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257823104 00000100:00100000:0.0:1721880578.066864:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880578.066868:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257823104 00000100:00100000:1.0:1721880578.066873:0:7130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257823488 00000100:00100000:1.0:1721880578.066879:0:7130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257823488 00000100:00100000:2.0:1721880578.066898:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b19d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4976b229-99ef-4953-87e9-78e1b901883f+12:2005:x1805522257822848:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 80us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880578.066905:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 637 00000100:00100000:3.0:1721880578.066905:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257823616 00000100:00100000:3.0:1721880578.066908:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257823616 00000100:00100000:1.0:1721880578.066926:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3171 00000100:00100000:1.0:1721880578.066937:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135300380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2004:x1805522257822976:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880578.066941:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3172 00000100:00100000:3.0:1721880578.066949:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135302d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2005:x1805522257823104:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880578.066952:0:15432:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3173 00000100:00100000:2.0:1721880578.066957:0:15432:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135300e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:30425778-2709-4512-9d75-01ec53c4cfad+4135:2004:x1805522257823488:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880578.067000:0:7130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135300380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2004:x1805522257822976:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 61us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880578.067007:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135302d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2005:x1805522257823104:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 58us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880578.067013:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3171 00000100:00100000:3.0:1721880578.067018:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3172 00000100:00100000:2.0:1721880578.067019:0:15432:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135300e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:30425778-2709-4512-9d75-01ec53c4cfad+4135:2004:x1805522257823488:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 60us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880578.067026:0:15432:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3173 00000100:00100000:3.0:1721880578.067043:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3174 00000100:00100000:3.0:1721880578.067048:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135301880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:30425778-2709-4512-9d75-01ec53c4cfad+3694:2005:x1805522257823616:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880578.067058:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257823232 00000100:00080000:1.0:1721880578.067061:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880548 00000100:00100000:2.0:1721880578.067062:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257823232 00000100:00100000:0.0:1721880578.067065:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257823360 00000100:00080000:1.0:1721880578.067066:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880548 00000100:00080000:1.0:1721880578.067070:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880548 00000100:00100000:0.0:1721880578.067071:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257823360 00000100:00080000:1.0:1721880578.067074:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880548 00000100:00100000:3.0:1721880578.067078:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135301880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:30425778-2709-4512-9d75-01ec53c4cfad+3694:2005:x1805522257823616:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 29us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880578.067085:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3174 00000100:00100000:2.0:1721880578.067091:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257823744 00000100:00100000:2.0:1721880578.067093:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257823744 00000100:00100000:1.0:1721880578.067101:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257823872 00000100:00100000:1.0:1721880578.067106:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257823872 00000100:00100000:2.0:1721880578.067113:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 489 00000100:00100000:2.0:1721880578.067118:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135303800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2004:x1805522257823232:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880578.067119:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 490 00000100:00100000:0.0:1721880578.067126:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135302a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2005:x1805522257823360:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880578.067140:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 491 00000100:00100000:2.0:1721880578.067144:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135303800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2004:x1805522257823232:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 26us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880578.067149:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135300700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:30425778-2709-4512-9d75-01ec53c4cfad+280:2004:x1805522257823744:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880578.067151:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 489 00000100:00100000:2.0:1721880578.067163:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 492 00000100:00100000:0.0:1721880578.067165:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135302a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2005:x1805522257823360:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 39us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880578.067168:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135301500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:30425778-2709-4512-9d75-01ec53c4cfad+665:2005:x1805522257823872:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880578.067173:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 490 00000100:00100000:1.0:1721880578.067193:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135300700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:30425778-2709-4512-9d75-01ec53c4cfad+280:2004:x1805522257823744:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 42us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880578.067197:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880135301500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:30425778-2709-4512-9d75-01ec53c4cfad+665:2005:x1805522257823872:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 28us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880578.067204:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 491 00000100:00100000:2.0:1721880578.067209:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 492 00000100:00080000:1.0:1721880578.067231:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880548 00000100:00080000:1.0:1721880578.067236:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880548 00000100:00100000:2.0:1721880578.153005:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1721880578.153032:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008cc73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011917824:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1721880578.153114:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880578.153191:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011917824 00000100:00100000:0.0:1721880578.153206:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011917824 00000100:00100000:0.0:1721880578.153289:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101178 00000100:00100000:0.0:1721880578.153302:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3689:x1805522011917824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1721880578.153351:0:15587:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1435709440 avail 1306247168 00000100:00100000:0.0:1721880578.153449:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3689:x1805522011917824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 148us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880578.153458:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101178 00000100:00100000:2.0:1721880578.153520:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008cc73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011917824:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1721880578.756982:0:15560:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721880579.759142:0:11721:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880580.761059:0:7119:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1721880581.048872:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008cc71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011917952:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1721880581.048929:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880581.048969:0:10429:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011917952 00000100:00100000:0.0:1721880581.048978:0:10429:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011917952 00000100:00100000:0.0:1721880581.049030:0:10429:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 692 00000100:00100000:0.0:1721880581.049036:0:10429:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011917952:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1721880581.049040:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880551 00002000:00000024:0.0:1721880581.049061:0:10429:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:0.0:1721880581.049103:0:10429:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011917952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880581.049110:0:10429:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 692 00000100:00100000:2.0:1721880581.049121:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008cc71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011917952:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1721880581.448953:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011918080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1721880581.449008:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880581.449073:0:10429:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011918080 00000100:00100000:0.0:1721880581.449079:0:10429:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011918080 00000100:00080000:1.0:1721880581.449109:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880551 00000100:00100000:0.0:1721880581.449119:0:10429:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 693 00000100:00100000:0.0:1721880581.449123:0:10429:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cc73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011918080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1721880581.449142:0:10429:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:0.0:1721880581.449184:0:10429:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cc73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011918080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880581.449188:0:10429:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 693 00000100:00100000:3.0:1721880581.449233:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011918080:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1721880581.544924:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008cc70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011918208:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1721880581.544976:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880581.545035:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011918208 00000100:00100000:0.0:1721880581.545043:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011918208 00000100:00100000:0.0:1721880581.545109:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101179 00000100:00100000:0.0:1721880581.545118:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+19:3687:x1805522011918208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1721880581.545147:0:15587:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1437519872 avail 1308057600 00000100:00100000:0.0:1721880581.545200:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+19:3687:x1805522011918208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880581.545207:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101179 00000100:00100000:1.0:1721880581.545225:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008cc70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011918208:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1721880581.640928:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3689:1805522011918464:0@lo:400:kworker.0 00000100:00100000:1.0:1721880581.640935:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009993a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011918720:0@lo:400:kworker.0 00000100:00100000:3.0:1721880581.640939:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099938a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3686:1805522011918592:0@lo:400:kworker.0 00000100:00100000:0.0:1721880581.640941:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009993a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011918336:0@lo:400:kworker.0 00000100:00100000:1.0:1721880581.640996:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880581.640996:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880581.640997:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880581.641014:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880581.641018:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009993b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011919232:0@lo:400:kworker.0 00000100:00100000:0.0:1721880581.641020:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099938700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011918848:0@lo:400:kworker.0 00000100:00100000:3.0:1721880581.641022:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3686:1805522011919104:0@lo:400:kworker.0 00000100:00100000:1.0:1721880581.641037:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880581.641037:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880099938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3689:1805522011918976:0@lo:400:kworker.0 00000100:00100000:0.0:1721880581.641049:0:15434:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011918592 00000100:00100000:3.0:1721880581.641052:0:15420:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011918464 00000100:00100000:0.0:1721880581.641054:0:15434:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011918592 00000100:00100000:2.0:1721880581.641054:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880581.641055:0:15420:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011918464 00000100:00100000:2.0:1721880581.641065:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009993b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011919488:0@lo:400:kworker.0 00000100:00100000:1.0:1721880581.641073:0:7124:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011918336 00000100:00100000:1.0:1721880581.641076:0:7124:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011918336 00000100:00100000:2.0:1721880581.641076:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880581.641081:0:15434:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011919232 00000100:00100000:0.0:1721880581.641082:0:15434:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011919232 00000100:00100000:3.0:1721880581.641083:0:15420:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011918976 00000100:00100000:3.0:1721880581.641085:0:15420:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011918976 00000100:00100000:0.0:1721880581.641094:0:15434:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3175 00000100:00100000:3.0:1721880581.641098:0:15420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3176 00000100:00100000:0.0:1721880581.641099:0:15434:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cc70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0000-lwp-MDT0001_UUID+5:3686:x1805522011918592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880581.641099:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 638 00000100:00100000:2.0:1721880581.641102:0:11334:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3177 00000100:00100000:3.0:1721880581.641102:0:15420:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1805522011918464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880581.641103:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b19d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011918336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880581.641106:0:11334:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011919232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880581.641133:0:7124:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b19d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011918336:12345-0@lo:400:kworker.0 Request processed in 30us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880581.641135:0:15434:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cc70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0000-lwp-MDT0001_UUID+5:3686:x1805522011918592:12345-0@lo:400:kworker.0 Request processed in 37us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880581.641137:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 638 00000100:00100000:3.0:1721880581.641137:0:15420:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1805522011918464:12345-0@lo:400:kworker.0 Request processed in 35us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880581.641138:0:11334:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011919232:12345-0@lo:400:kworker.0 Request processed in 31us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880581.641139:0:15434:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3175 00000100:00100000:3.0:1721880581.641141:0:15420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3176 00000100:00100000:2.0:1721880581.641143:0:11334:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3177 00000100:00100000:0.0:1721880581.641154:0:15434:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3178 00000100:00100000:0.0:1721880581.641156:0:15434:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1805522011918976:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1721880581.641164:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880551 00000100:00080000:1.0:1721880581.641166:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880551 00000100:00100000:2.0:1721880581.641169:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011919488 00000100:00100000:0.0:1721880581.641171:0:15434:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1805522011918976:12345-0@lo:400:kworker.0 Request processed in 15us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880581.641171:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011919488 00000100:00100000:0.0:1721880581.641174:0:15434:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3178 00000100:00100000:3.0:1721880581.641178:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3689:1805522011918464:0@lo:400:kworker.0 00000100:00100000:3.0:1721880581.641184:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3689:1805522011918976:0@lo:400:kworker.0 00000100:00100000:0.0:1721880581.641187:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880581.641187:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009993b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011919232:0@lo:400:kworker.0 00000100:00100000:2.0:1721880581.641190:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:2.0:1721880581.641193:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011919488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880581.641194:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009993ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011919360:0@lo:400:kworker.0 00000100:00080000:1.0:1721880581.641206:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880551 00000100:00100000:0.0:1721880581.641207:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880581.641208:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880581.641210:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011919488:12345-0@lo:400:kworker.0 Request processed in 17us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880581.641214:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00100000:1.0:1721880581.641217:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011919360 00000100:00100000:1.0:1721880581.641219:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011919360 00000100:00100000:3.0:1721880581.641223:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099938a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3686:1805522011918592:0@lo:400:kworker.0 00000100:00100000:0.0:1721880581.641227:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009993a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011918336:0@lo:400:kworker.0 00000100:00100000:2.0:1721880581.641229:0:15432:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011918848 00000100:00100000:2.0:1721880581.641230:0:15432:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011918848 00000100:00100000:1.0:1721880581.641234:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:1.0:1721880581.641238:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800959a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011919360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880581.641238:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011919104 00000100:00100000:3.0:1721880581.641241:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011919104 00000100:00100000:2.0:1721880581.641242:0:15432:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3179 00000100:00100000:2.0:1721880581.641244:0:15432:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880125986a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011918848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880581.641259:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011918720 00000100:00100000:0.0:1721880581.641261:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011918720 00000100:00100000:3.0:1721880581.641261:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3180 00000100:00100000:2.0:1721880581.641263:0:15432:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880125986a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011918848:12345-0@lo:400:kworker.0 Request processed in 18us (76us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880581.641265:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cc70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-OST0001_UUID+5:3686:x1805522011919104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880581.641266:0:15432:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3179 00000100:00100000:1.0:1721880581.641267:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800959a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011919360:12345-0@lo:400:kworker.0 Request processed in 27us (57us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880581.641272:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00000100:00100000:0.0:1721880581.641284:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101180 00000100:00080000:1.0:1721880581.641287:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880551 00000100:00100000:0.0:1721880581.641289:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011918720:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1721880581.641289:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880551 00000100:00100000:3.0:1721880581.641293:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cc70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-OST0001_UUID+5:3686:x1805522011919104:12345-0@lo:400:kworker.0 Request processed in 26us (83us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880581.641298:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3180 00000100:00100000:3.0:1721880581.641317:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3686:1805522011919104:0@lo:400:kworker.0 00000100:00100000:0.0:1721880581.641319:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011918720:12345-0@lo:400:kworker.0 Request processed in 29us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880581.641325:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101180 00000100:00100000:1.0:1721880581.641330:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009993a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011918720:0@lo:400:kworker.0 00000100:00100000:3.0:1721880581.641330:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009993b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011919488:0@lo:400:kworker.0 00000100:00100000:0.0:1721880581.641373:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880099938700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011918848:0@lo:400:kworker.0 00000100:00100000:0.0:1721880581.641381:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009993ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011919360:0@lo:400:kworker.0 00000100:00100000:0.0:1721880581.688929:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011919744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1721880581.688929:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008cc71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011919616:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1721880581.688992:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880581.689023:0:10429:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011919744 00000100:00100000:2.0:1721880581.689029:0:10429:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011919744 00000100:00100000:3.0:1721880581.689042:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880581.689070:0:10429:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011919616 00000100:00100000:2.0:1721880581.689072:0:10429:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011919616 00000100:00100000:2.0:1721880581.689091:0:10429:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 694 00000100:00100000:2.0:1721880581.689097:0:10429:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009713a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011919744:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1721880581.689102:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 695 00000100:00100000:3.0:1721880581.689108:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cc73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011919616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1721880581.689124:0:10429:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00002000:00000024:3.0:1721880581.689125:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:2.0:1721880581.689182:0:10429:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009713a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011919744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880581.689186:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cc73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011919616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880581.689187:0:10429:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 694 00000100:00100000:3.0:1721880581.689190:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 695 00000100:00100000:0.0:1721880581.689196:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011919744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1721880581.689222:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008cc71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011919616:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1721880581.762889:0:8270:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880582.764986:0:7120:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880583.074138:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880583.074184:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880583.074204:0:15434:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257824128 00000100:00100000:0.0:1721880583.074206:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880583.074214:0:15434:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257824128 00000100:00100000:0.0:1721880583.074227:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880583.074237:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880583.074246:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257824000 00000100:00100000:0.0:1721880583.074247:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880583.074249:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257824000 00000100:00100000:0.0:1721880583.074257:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880583.074259:0:15434:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257824256 00000100:00100000:1.0:1721880583.074262:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257824384 00000100:00100000:2.0:1721880583.074262:0:15434:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257824256 00000100:00100000:1.0:1721880583.074266:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257824384 00000100:00100000:0.0:1721880583.074267:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880583.074275:0:15434:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257824640 00000100:00100000:2.0:1721880583.074278:0:15434:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257824640 00000100:00100000:3.0:1721880583.074279:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 639 00000100:00100000:3.0:1721880583.074285:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b19d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4976b229-99ef-4953-87e9-78e1b901883f+12:2004:x1805522257824000:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880583.074287:0:15434:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257824768 00000100:00100000:1.0:1721880583.074289:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257824512 00000100:00100000:2.0:1721880583.074289:0:15434:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257824768 00000100:00100000:1.0:1721880583.074290:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257824512 00000100:00100000:0.0:1721880583.074294:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880583.074301:0:15434:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3181 00000100:00100000:1.0:1721880583.074302:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257824896 00000100:00100000:1.0:1721880583.074303:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257824896 00000100:00100000:2.0:1721880583.074306:0:15434:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009713aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2005:x1805522257824128:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880583.074335:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3182 00000100:00100000:1.0:1721880583.074336:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257825024 00000100:00100000:1.0:1721880583.074337:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257825024 00000100:00100000:0.0:1721880583.074342:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2004:x1805522257824256:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880583.074348:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 495 00000100:00100000:1.0:1721880583.074352:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2005:x1805522257824384:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880583.074355:0:15434:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009713aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2005:x1805522257824128:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 48us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880583.074356:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b19d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4976b229-99ef-4953-87e9-78e1b901883f+12:2004:x1805522257824000:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 72us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880583.074361:0:15434:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3181 00000100:00100000:3.0:1721880583.074362:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 639 00000100:00100000:0.0:1721880583.074369:0:7130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2004:x1805522257824256:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 28us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880583.074375:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3182 00000100:00100000:1.0:1721880583.074376:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2005:x1805522257824384:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 24us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880583.074379:0:15434:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3183 00000100:00100000:1.0:1721880583.074381:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 495 00000100:00100000:2.0:1721880583.074383:0:15434:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:30425778-2709-4512-9d75-01ec53c4cfad+4135:2005:x1805522257824640:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880583.074393:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3184 00000100:00100000:1.0:1721880583.074396:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 496 00000100:00100000:0.0:1721880583.074397:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30425778-2709-4512-9d75-01ec53c4cfad+3694:2004:x1805522257824768:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880583.074398:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2004:x1805522257824512:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880583.074402:0:15434:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:30425778-2709-4512-9d75-01ec53c4cfad+4135:2005:x1805522257824640:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 18us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880583.074406:0:15434:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3183 00000100:00100000:1.0:1721880583.074411:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2004:x1805522257824512:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 12us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880583.074414:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 496 00000100:00100000:0.0:1721880583.074418:0:7130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30425778-2709-4512-9d75-01ec53c4cfad+3694:2004:x1805522257824768:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 20us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880583.074419:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 497 00000100:00100000:1.0:1721880583.074422:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:30425778-2709-4512-9d75-01ec53c4cfad+280:2005:x1805522257824896:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880583.074423:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3184 00000100:00100000:2.0:1721880583.074425:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 498 00000100:00100000:2.0:1721880583.074428:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880095a12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:30425778-2709-4512-9d75-01ec53c4cfad+665:2004:x1805522257825024:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880583.074432:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:30425778-2709-4512-9d75-01ec53c4cfad+280:2005:x1805522257824896:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 9us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880583.074435:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 497 00000100:00100000:2.0:1721880583.074444:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880095a12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:30425778-2709-4512-9d75-01ec53c4cfad+665:2004:x1805522257825024:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 14us (149us total) trans 0 rc 0/0 00000100:00080000:1.0:1721880583.074447:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880553 00000100:00100000:2.0:1721880583.074448:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 498 00000100:00080000:1.0:1721880583.074450:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880553 00000100:00080000:1.0:1721880583.074452:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880553 00000100:00080000:1.0:1721880583.074454:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880553 00000100:00080000:1.0:1721880583.074456:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880553 00000100:00100000:0.0:1721880583.160855:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011919872:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1721880583.160904:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880583.160944:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011919872 00000100:00100000:2.0:1721880583.160953:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011919872 00000100:00100000:2.0:1721880583.161000:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101181 00000100:00100000:2.0:1721880583.161007:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011919872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1721880583.161037:0:15587:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1435709440 avail 1306247168 00000100:00100000:2.0:1721880583.161099:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011919872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880583.161105:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011919872:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1721880583.161106:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101181 00010000:00010000:1.0:1721880583.766947:0:15560:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721880584.769054:0:11721:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880585.771050:0:7119:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1721880586.057047:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011920000:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1721880586.057130:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880586.057193:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011920000 00000100:00100000:0.0:1721880586.057205:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011920000 00000100:00100000:0.0:1721880586.057311:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 696 00000100:00100000:0.0:1721880586.057319:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cc72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011920000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1721880586.057356:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00080000:1.0:1721880586.057368:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880556 00000100:00100000:0.0:1721880586.057425:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cc72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011920000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880586.057433:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 696 00000100:00100000:3.0:1721880586.057477:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011920000:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1721880586.456987:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008cc73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011920128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1721880586.457042:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880586.457106:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011920128 00000100:00100000:2.0:1721880586.457114:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011920128 00000100:00080000:1.0:1721880586.457146:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880556 00000100:00100000:2.0:1721880586.457157:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 697 00000100:00100000:2.0:1721880586.457162:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011920128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1721880586.457180:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:2.0:1721880586.457234:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011920128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880586.457239:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 697 00000100:00100000:0.0:1721880586.457319:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008cc73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011920128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1721880586.552953:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011920256:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1721880586.553004:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880586.553042:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011920256 00000100:00100000:0.0:1721880586.553048:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011920256 00000100:00100000:0.0:1721880586.553087:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101182 00000100:00100000:0.0:1721880586.553093:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+19:3687:x1805522011920256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1721880586.553120:0:15587:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1437519872 avail 1308057600 00000100:00100000:0.0:1721880586.553159:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+19:3687:x1805522011920256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880586.553163:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101182 00000100:00100000:2.0:1721880586.553174:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011920256:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1721880586.648941:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3689:1805522011920512:0@lo:400:kworker.0 00000100:00100000:1.0:1721880586.648953:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3686:1805522011920640:0@lo:400:kworker.0 00000100:00100000:0.0:1721880586.648961:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011920384:0@lo:400:kworker.0 00000100:00100000:2.0:1721880586.648965:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011920768:0@lo:400:kworker.0 00000100:00100000:3.0:1721880586.649000:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880586.649003:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880586.649009:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880586.649022:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011920896:0@lo:400:kworker.0 00000100:00100000:1.0:1721880586.649025:0:7124:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011920384 00000100:00100000:1.0:1721880586.649030:0:7124:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011920384 00000100:00100000:3.0:1721880586.649033:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3689:1805522011921024:0@lo:400:kworker.0 00000100:00100000:2.0:1721880586.649041:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011921280:0@lo:400:kworker.0 00000100:00100000:0.0:1721880586.649045:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1721880586.649054:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880556 00000100:00100000:0.0:1721880586.649057:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011921408:0@lo:400:kworker.0 00000100:00100000:2.0:1721880586.649062:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880586.649064:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 640 00000100:00100000:1.0:1721880586.649068:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011920384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880586.649070:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880586.649077:0:11334:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011920512 00000100:00100000:3.0:1721880586.649079:0:11334:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011920512 00000100:00100000:0.0:1721880586.649080:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1721880586.649083:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011921536:0@lo:400:kworker.0 00000100:00100000:2.0:1721880586.649093:0:15432:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011920896 00000100:00100000:0.0:1721880586.649094:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880586.649097:0:15432:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011920896 00000100:00100000:3.0:1721880586.649099:0:11334:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011921280 00000100:00100000:3.0:1721880586.649101:0:11334:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011921280 00000100:00100000:1.0:1721880586.649104:0:7124:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011920384:12345-0@lo:400:kworker.0 Request processed in 35us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880586.649108:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 640 00000100:00100000:3.0:1721880586.649112:0:11334:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3185 00000100:00100000:0.0:1721880586.649114:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011920384:0@lo:400:kworker.0 00000100:00100000:3.0:1721880586.649115:0:11334:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cc72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1805522011920512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880586.649124:0:15432:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3186 00000100:00100000:2.0:1721880586.649129:0:15432:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011921280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880586.649136:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880586.649138:0:11334:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cc72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1805522011920512:12345-0@lo:400:kworker.0 Request processed in 22us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880586.649140:0:7130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011920640 00000100:00100000:3.0:1721880586.649141:0:11334:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3185 00000100:00100000:0.0:1721880586.649143:0:7130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011920640 00000100:00100000:1.0:1721880586.649149:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3686:1805522011921152:0@lo:400:kworker.0 00000100:00100000:3.0:1721880586.649154:0:11334:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3187 00000100:00100000:3.0:1721880586.649156:0:11334:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011920896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880586.649160:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3188 00000100:00100000:2.0:1721880586.649161:0:15432:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011921280:12345-0@lo:400:kworker.0 Request processed in 31us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880586.649162:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880586.649163:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3686:x1805522011920640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880586.649167:0:15432:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3186 00000100:00100000:3.0:1721880586.649174:0:11334:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011920896:12345-0@lo:400:kworker.0 Request processed in 17us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880586.649178:0:15432:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011921152 00000100:00100000:3.0:1721880586.649178:0:11334:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3187 00000100:00100000:2.0:1721880586.649180:0:15432:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011921152 00000100:00100000:0.0:1721880586.649186:0:7130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3686:x1805522011920640:12345-0@lo:400:kworker.0 Request processed in 22us (49us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880586.649189:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3188 00000100:00100000:3.0:1721880586.649191:0:11334:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3189 00000100:00100000:3.0:1721880586.649194:0:11334:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3686:x1805522011921152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880586.649195:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3686:1805522011920640:0@lo:400:kworker.0 00000100:00100000:2.0:1721880586.649204:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011921408 00000100:00100000:2.0:1721880586.649206:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011921408 00000100:00100000:0.0:1721880586.649208:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011921536 00000100:00100000:3.0:1721880586.649208:0:11334:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3686:x1805522011921152:12345-0@lo:400:kworker.0 Request processed in 14us (46us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880586.649209:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011921536 00000100:00100000:3.0:1721880586.649211:0:11334:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3189 00000100:00100000:1.0:1721880586.649216:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011920768 00000100:00100000:1.0:1721880586.649218:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011920768 00000100:00100000:0.0:1721880586.649223:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 499 00000100:00100000:0.0:1721880586.649226:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+5:3688:x1805522011921536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880586.649227:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880586.649228:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 500 00000100:00100000:2.0:1721880586.649233:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011921408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880586.649234:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101183 00000100:00100000:1.0:1721880586.649237:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011920768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880586.649243:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+5:3688:x1805522011921536:12345-0@lo:400:kworker.0 Request processed in 16us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880586.649243:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3689:1805522011920512:0@lo:400:kworker.0 00000100:00100000:0.0:1721880586.649247:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 499 00000100:00100000:1.0:1721880586.649277:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011920768:12345-0@lo:400:kworker.0 Request processed in 38us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880586.649280:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101183 00000100:00100000:2.0:1721880586.649281:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011921408:12345-0@lo:400:kworker.0 Request processed in 46us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880586.649284:0:15420:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011921024 00000100:00100000:3.0:1721880586.649286:0:15420:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011921024 00000100:00100000:2.0:1721880586.649287:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 500 00000100:00100000:1.0:1721880586.649298:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3686:1805522011921152:0@lo:400:kworker.0 00000100:00100000:3.0:1721880586.649298:0:15420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3190 00000100:00100000:3.0:1721880586.649300:0:15420:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cc71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1805522011921024:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1721880586.649305:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880556 00000100:00100000:0.0:1721880586.649306:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011921536:0@lo:400:kworker.0 00000100:00080000:2.0:1721880586.649307:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880556 00000100:00080000:2.0:1721880586.649309:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880556 00000100:00100000:0.0:1721880586.649311:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011920896:0@lo:400:kworker.0 00000100:00100000:0.0:1721880586.649316:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011921408:0@lo:400:kworker.0 00000100:00100000:3.0:1721880586.649322:0:15420:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cc71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1805522011921024:12345-0@lo:400:kworker.0 Request processed in 21us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880586.649325:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011920768:0@lo:400:kworker.0 00000100:00100000:3.0:1721880586.649325:0:15420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3190 00000100:00100000:2.0:1721880586.649334:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011921280:0@lo:400:kworker.0 00000100:00100000:3.0:1721880586.649339:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3689:1805522011921024:0@lo:400:kworker.0 00000100:00100000:0.0:1721880586.696931:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011921664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1721880586.696961:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008cc73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011921792:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1721880586.696965:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880586.696990:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880586.696998:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011921664 00000100:00100000:3.0:1721880586.697003:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011921664 00000100:00100000:0.0:1721880586.697010:0:10429:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011921792 00000100:00100000:0.0:1721880586.697013:0:10429:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011921792 00000100:00100000:3.0:1721880586.697029:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 698 00000100:00100000:0.0:1721880586.697034:0:10429:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 699 00000100:00100000:3.0:1721880586.697034:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011921664:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1721880586.697039:0:10429:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3687:x1805522011921792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1721880586.697054:0:10429:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00002000:00000024:3.0:1721880586.697054:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:3.0:1721880586.697085:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011921664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880586.697089:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 698 00000100:00100000:0.0:1721880586.697102:0:10429:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3687:x1805522011921792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880586.697106:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011921664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1721880586.697109:0:10429:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 699 00000100:00100000:2.0:1721880586.697116:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008cc73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011921792:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1721880586.772934:0:8270:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880587.775192:0:7120:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880588.082876:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880588.082958:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880588.083011:0:7124:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257825152 00000100:00100000:0.0:1721880588.083012:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880588.083028:0:7124:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257825152 00000100:00100000:0.0:1721880588.083062:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880588.083097:0:15477:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257825280 00000100:00100000:0.0:1721880588.083102:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880588.083102:0:15420:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257825408 00000100:00100000:1.0:1721880588.083106:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 641 00000100:00100000:2.0:1721880588.083109:0:15420:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257825408 00000100:00100000:3.0:1721880588.083109:0:15477:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257825280 00000100:00100000:1.0:1721880588.083120:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2005:x1805522257825152:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880588.083133:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880588.083160:0:15420:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257825920 00000100:00100000:2.0:1721880588.083163:0:15420:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257825920 00000100:00100000:2.0:1721880588.083186:0:15420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3191 00000100:00100000:2.0:1721880588.083193:0:15420:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2005:x1805522257825408:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880588.083198:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880588.083204:0:15477:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3192 00000100:00100000:1.0:1721880588.083214:0:7124:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2005:x1805522257825152:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 94us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880588.083215:0:15477:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2004:x1805522257825280:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880588.083256:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 641 00000100:00100000:2.0:1721880588.083288:0:15420:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2005:x1805522257825408:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 93us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880588.083297:0:15420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3191 00000100:00100000:3.0:1721880588.083311:0:15477:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2004:x1805522257825280:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 94us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880588.083318:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257825792 00000100:00100000:2.0:1721880588.083322:0:15420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3193 00000100:00100000:1.0:1721880588.083323:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257825792 00000100:00100000:2.0:1721880588.083327:0:15420:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:30425778-2709-4512-9d75-01ec53c4cfad+3694:2005:x1805522257825920:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880588.083329:0:15477:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3192 00000100:00100000:1.0:1721880588.083352:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3194 00000100:00100000:1.0:1721880588.083358:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:30425778-2709-4512-9d75-01ec53c4cfad+4135:2004:x1805522257825792:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880588.083358:0:15420:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:30425778-2709-4512-9d75-01ec53c4cfad+3694:2005:x1805522257825920:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 30us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880588.083365:0:15420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3193 00000100:00080000:2.0:1721880588.083385:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880558 00000100:00080000:2.0:1721880588.083389:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880558 00000100:00080000:2.0:1721880588.083391:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880558 00000100:00100000:0.0:1721880588.083401:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880588.083402:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:30425778-2709-4512-9d75-01ec53c4cfad+4135:2004:x1805522257825792:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 40us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880588.083413:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3194 00000100:00100000:2.0:1721880588.083422:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257825536 00000100:00100000:2.0:1721880588.083426:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257825536 00000100:00100000:2.0:1721880588.083454:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257825664 00000100:00100000:2.0:1721880588.083457:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257825664 00000100:00100000:1.0:1721880588.083459:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257826176 00000100:00100000:1.0:1721880588.083464:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257826176 00000100:00100000:2.0:1721880588.083474:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 501 00000100:00100000:2.0:1721880588.083479:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2004:x1805522257825536:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880588.083493:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 502 00000100:00100000:3.0:1721880588.083503:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880588.083504:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f823800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2005:x1805522257825664:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880588.083504:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2004:x1805522257825536:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 23us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880588.083505:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 503 00000100:00100000:2.0:1721880588.083512:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 501 00000100:00100000:0.0:1721880588.083516:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:30425778-2709-4512-9d75-01ec53c4cfad+665:2005:x1805522257826176:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880588.083522:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257826048 00000100:00100000:2.0:1721880588.083525:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257826048 00000100:00100000:2.0:1721880588.083540:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 504 00000100:00100000:1.0:1721880588.083544:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f823800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2005:x1805522257825664:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 43us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880588.083545:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cc73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:30425778-2709-4512-9d75-01ec53c4cfad+280:2004:x1805522257826048:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880588.083552:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 502 00000100:00100000:2.0:1721880588.083569:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cc73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:30425778-2709-4512-9d75-01ec53c4cfad+280:2004:x1805522257826048:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 23us (70us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880588.083575:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:30425778-2709-4512-9d75-01ec53c4cfad+665:2005:x1805522257826176:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 58us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880588.083576:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 504 00000100:00100000:0.0:1721880588.083587:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 503 00000100:00080000:2.0:1721880588.083589:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880558 00000100:00080000:2.0:1721880588.083592:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880558 00000100:00100000:2.0:1721880588.168941:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800858b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011921920:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1721880588.169026:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880588.169182:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011921920 00000100:00100000:1.0:1721880588.169194:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011921920 00000100:00100000:1.0:1721880588.169287:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101184 00000100:00100000:1.0:1721880588.169296:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011921920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1721880588.169337:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1435709440 avail 1306247168 00000100:00100000:1.0:1721880588.169400:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011921920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880588.169409:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101184 00000100:00100000:2.0:1721880588.169443:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800858b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011921920:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1721880588.777025:0:15560:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721880589.778963:0:11721:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880590.780946:0:7119:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880591.064927:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009993ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011922048:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1721880591.064988:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880591.065028:0:10429:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011922048 00000100:00100000:2.0:1721880591.065036:0:10429:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011922048 00000100:00080000:0.0:1721880591.065056:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880561 00000100:00100000:2.0:1721880591.065078:0:10429:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 700 00000100:00100000:2.0:1721880591.065083:0:10429:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011922048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1721880591.065106:0:10429:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:2.0:1721880591.065152:0:10429:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011922048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880591.065157:0:10429:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 700 00000100:00100000:0.0:1721880591.065202:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009993ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011922048:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1721880591.464959:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800858b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011922176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1721880591.465021:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880591.465064:0:10429:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011922176 00000100:00100000:2.0:1721880591.465072:0:10429:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011922176 00000100:00080000:0.0:1721880591.465113:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880561 00000100:00100000:2.0:1721880591.465123:0:10429:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 701 00000100:00100000:2.0:1721880591.465129:0:10429:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011922176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1721880591.465150:0:10429:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:2.0:1721880591.465219:0:10429:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011922176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880591.465225:0:10429:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 701 00000100:00100000:1.0:1721880591.465274:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800858b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011922176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1721880591.561020:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1721880591.561045:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880087bbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011922304:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1721880591.561113:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880591.561196:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011922304 00000100:00100000:2.0:1721880591.561207:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011922304 00000100:00100000:2.0:1721880591.561290:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101185 00000100:00100000:2.0:1721880591.561300:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3686:x1805522011922304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1721880591.561343:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1437519872 avail 1308057600 00000100:00100000:2.0:1721880591.561413:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3686:x1805522011922304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880591.561423:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101185 00000100:00100000:1.0:1721880591.561446:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880087bbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011922304:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1721880591.657092:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011922432:0@lo:400:kworker.0 00000100:00100000:0.0:1721880591.657107:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3689:1805522011922560:0@lo:400:kworker.0 00000100:00100000:1.0:1721880591.657145:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3686:1805522011922688:0@lo:400:kworker.0 00000100:00100000:0.0:1721880591.657239:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880591.657241:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880591.657293:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3689:1805522011923072:0@lo:400:kworker.0 00000100:00100000:1.0:1721880591.657303:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880591.657321:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011922944:0@lo:400:kworker.0 00000100:00100000:0.0:1721880591.657322:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011922816:0@lo:400:kworker.0 00000100:00100000:1.0:1721880591.657348:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3686:1805522011923200:0@lo:400:kworker.0 00000100:00100000:3.0:1721880591.657352:0:7130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011922560 00000100:00100000:0.0:1721880591.657355:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880591.657366:0:7130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011922560 00000100:00100000:2.0:1721880591.657368:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880591.657378:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076e5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011923328:0@lo:400:kworker.0 00000100:00100000:1.0:1721880591.657388:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880591.657398:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076e5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011923456:0@lo:400:kworker.0 00000100:00100000:0.0:1721880591.657427:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011922688 00000100:00100000:3.0:1721880591.657429:0:7130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011922944 00000100:00100000:0.0:1721880591.657433:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011922688 00000100:00100000:3.0:1721880591.657434:0:7130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011922944 00000100:00100000:2.0:1721880591.657459:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880591.657462:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011923200 00000100:00100000:0.0:1721880591.657464:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011923200 00000100:00100000:3.0:1721880591.657478:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3195 00000100:00100000:2.0:1721880591.657489:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1721880591.657489:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1805522011922560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880591.657490:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3196 00000100:00100000:0.0:1721880591.657496:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3197 00000100:00100000:1.0:1721880591.657498:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076e5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-MDT0001_UUID+5:3686:x1805522011922688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880591.657500:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076e5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011923584:0@lo:400:kworker.0 00000100:00100000:0.0:1721880591.657503:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011922944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880591.657546:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880591.657584:0:7129:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011922944:12345-0@lo:400:kworker.0 Request processed in 80us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880591.657590:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880076e5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-MDT0001_UUID+5:3686:x1805522011922688:12345-0@lo:400:kworker.0 Request processed in 92us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880591.657592:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3197 00000100:00100000:1.0:1721880591.657598:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3196 00000100:00100000:3.0:1721880591.657606:0:7130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1805522011922560:12345-0@lo:400:kworker.0 Request processed in 116us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880591.657610:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011922944:0@lo:400:kworker.0 00000100:00100000:0.0:1721880591.657615:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3198 00000100:00100000:0.0:1721880591.657621:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076e5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3686:x1805522011923200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880591.657622:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3195 00000100:00100000:1.0:1721880591.657645:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3686:1805522011922688:0@lo:400:kworker.0 00000100:00100000:0.0:1721880591.657649:0:7129:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880076e5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3686:x1805522011923200:12345-0@lo:400:kworker.0 Request processed in 27us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880591.657656:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3198 00000100:00100000:1.0:1721880591.657657:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3686:1805522011923200:0@lo:400:kworker.0 00000100:00100000:3.0:1721880591.657663:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011922432 00000100:00100000:3.0:1721880591.657668:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011922432 00000100:00100000:2.0:1721880591.657669:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011923456 00000100:00100000:2.0:1721880591.657676:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011923456 00000100:00080000:0.0:1721880591.657678:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880561 00000100:00080000:0.0:1721880591.657682:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880561 00000100:00100000:0.0:1721880591.657691:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880591.657708:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 642 00000100:00100000:1.0:1721880591.657709:0:11334:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011923328 00000100:00100000:1.0:1721880591.657715:0:11334:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011923328 00000100:00100000:3.0:1721880591.657716:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011922432:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1721880591.657720:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880561 00000100:00100000:2.0:1721880591.657720:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011923584 00000100:00100000:2.0:1721880591.657724:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011923584 00000100:00080000:0.0:1721880591.657725:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880561 00000100:00080000:0.0:1721880591.657789:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880561 00000100:00100000:2.0:1721880591.657790:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 505 00000100:00100000:1.0:1721880591.657791:0:11334:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3199 00000100:00100000:2.0:1721880591.657797:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087bbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011923456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880591.657801:0:11334:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011923328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880591.657842:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00000100:00100000:3.0:1721880591.657843:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011922432:12345-0@lo:400:kworker.0 Request processed in 124us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880591.657847:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087bbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011923456:12345-0@lo:400:kworker.0 Request processed in 50us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880591.657851:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087bbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+5:3688:x1805522011923584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880591.657855:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 505 00000100:00100000:3.0:1721880591.657855:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 642 00000100:00100000:1.0:1721880591.657871:0:11334:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011923328:12345-0@lo:400:kworker.0 Request processed in 68us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880591.657883:0:11334:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3199 00000100:00100000:2.0:1721880591.657886:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011922816 00000100:00100000:2.0:1721880591.657890:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011922816 00000100:00100000:0.0:1721880591.657903:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087bbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+5:3688:x1805522011923584:12345-0@lo:400:kworker.0 Request processed in 52us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880591.657910:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00000100:00100000:2.0:1721880591.657915:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101186 00000100:00100000:2.0:1721880591.657920:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011922816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880591.657954:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011922816:12345-0@lo:400:kworker.0 Request processed in 34us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880591.657956:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076e5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011923328:0@lo:400:kworker.0 00000100:00100000:2.0:1721880591.657962:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101186 00000100:00100000:0.0:1721880591.657977:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011922816:0@lo:400:kworker.0 00000100:00100000:2.0:1721880591.657990:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076e5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011923584:0@lo:400:kworker.0 00000100:00100000:0.0:1721880591.657994:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880591.657999:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076e5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011923456:0@lo:400:kworker.0 00000100:00100000:2.0:1721880591.658007:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011922432:0@lo:400:kworker.0 00000100:00100000:0.0:1721880591.658032:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3689:1805522011922560:0@lo:400:kworker.0 00000100:00100000:1.0:1721880591.658060:0:15477:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011923072 00000100:00100000:1.0:1721880591.658067:0:15477:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011923072 00000100:00100000:1.0:1721880591.658125:0:15477:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3200 00000100:00080000:0.0:1721880591.658126:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880561 00000100:00100000:1.0:1721880591.658130:0:15477:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1805522011923072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880591.658196:0:15477:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1805522011923072:12345-0@lo:400:kworker.0 Request processed in 65us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880591.658203:0:15477:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3200 00000100:00100000:0.0:1721880591.658219:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3689:1805522011923072:0@lo:400:kworker.0 00000100:00100000:2.0:1721880591.704947:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076e5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011923840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1721880591.704984:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011923712:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1721880591.705020:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880591.705071:0:10429:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011923840 00000100:00100000:0.0:1721880591.705079:0:10429:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011923840 00000100:00100000:1.0:1721880591.705085:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880591.705123:0:10429:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011923712 00000100:00100000:0.0:1721880591.705127:0:10429:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011923712 00000100:00100000:0.0:1721880591.705149:0:10429:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 702 00000100:00100000:0.0:1721880591.705157:0:10429:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088683480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011923840:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1721880591.705162:0:9462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 703 00000100:00100000:1.0:1721880591.705186:0:9462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076e5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011923712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1721880591.705210:0:10429:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00002000:00000024:1.0:1721880591.705210:0:9462:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:1.0:1721880591.705274:0:9462:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880076e5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011923712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880591.705283:0:9462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 703 00000100:00100000:0.0:1721880591.705286:0:10429:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088683480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011923840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880591.705295:0:10429:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 702 00000100:00100000:3.0:1721880591.705310:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076e5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011923840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1721880591.705316:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011923712:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1721880591.782975:0:8270:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880592.784935:0:7120:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880593.090344:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880593.090387:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880593.090405:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880593.090415:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880593.090416:0:15477:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257826432 00000100:00100000:1.0:1721880593.090425:0:15477:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257826432 00000100:00100000:0.0:1721880593.090427:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880593.090442:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880593.090450:0:7124:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257826304 00000100:00100000:0.0:1721880593.090452:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880593.090455:0:7124:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257826304 00000100:00100000:0.0:1721880593.090462:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880593.090465:0:15477:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257826560 00000100:00100000:1.0:1721880593.090467:0:15477:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257826560 00000100:00100000:1.0:1721880593.090476:0:15477:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257826944 00000100:00100000:1.0:1721880593.090477:0:15477:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257826944 00000100:00100000:1.0:1721880593.090485:0:15477:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257827072 00000100:00100000:2.0:1721880593.090485:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 643 00000100:00100000:1.0:1721880593.090486:0:15477:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257827072 00000100:00100000:0.0:1721880593.090489:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880593.090491:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2004:x1805522257826304:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880593.090496:0:15477:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3201 00000100:00100000:1.0:1721880593.090500:0:15477:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2005:x1805522257826432:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880593.090505:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257826688 00000100:00100000:0.0:1721880593.090508:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257826688 00000100:00100000:3.0:1721880593.090514:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257826816 00000100:00100000:3.0:1721880593.090519:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257826816 00000100:00100000:0.0:1721880593.090527:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257827200 00000100:00100000:0.0:1721880593.090529:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257827200 00000100:00100000:0.0:1721880593.090538:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257827328 00000100:00100000:0.0:1721880593.090539:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257827328 00000100:00100000:1.0:1721880593.090541:0:15477:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2005:x1805522257826432:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 40us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880593.090542:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 507 00000100:00100000:1.0:1721880593.090545:0:15477:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3201 00000100:00100000:2.0:1721880593.090546:0:7124:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2004:x1805522257826304:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 55us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880593.090546:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2005:x1805522257826688:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880593.090549:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 508 00000100:00100000:0.0:1721880593.090553:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2004:x1805522257826816:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880593.090553:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 643 00000100:00100000:1.0:1721880593.090563:0:15477:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3202 00000100:00100000:1.0:1721880593.090566:0:15477:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2004:x1805522257826560:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880593.090570:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2005:x1805522257826688:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 24us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880593.090574:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2004:x1805522257826816:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 21us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880593.090574:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 507 00000100:00100000:1.0:1721880593.090577:0:15477:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2004:x1805522257826560:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 11us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880593.090578:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 508 00000100:00100000:1.0:1721880593.090581:0:15477:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3202 00000100:00100000:2.0:1721880593.090586:0:15434:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3203 00000100:00100000:3.0:1721880593.090589:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 509 00000100:00100000:2.0:1721880593.090591:0:15434:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:30425778-2709-4512-9d75-01ec53c4cfad+4135:2005:x1805522257826944:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880593.090593:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 510 00000100:00100000:3.0:1721880593.090593:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:30425778-2709-4512-9d75-01ec53c4cfad+280:2005:x1805522257827200:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880593.090594:0:15477:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3204 00000100:00100000:1.0:1721880593.090597:0:15477:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:30425778-2709-4512-9d75-01ec53c4cfad+3694:2004:x1805522257827072:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880593.090598:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:30425778-2709-4512-9d75-01ec53c4cfad+665:2004:x1805522257827328:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880593.090604:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:30425778-2709-4512-9d75-01ec53c4cfad+280:2005:x1805522257827200:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 11us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880593.090607:0:15477:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:30425778-2709-4512-9d75-01ec53c4cfad+3694:2004:x1805522257827072:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 10us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880593.090608:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 509 00000100:00100000:1.0:1721880593.090611:0:15477:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3204 00000100:00100000:0.0:1721880593.090615:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:30425778-2709-4512-9d75-01ec53c4cfad+665:2004:x1805522257827328:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 16us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880593.090615:0:15434:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:30425778-2709-4512-9d75-01ec53c4cfad+4135:2005:x1805522257826944:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 23us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880593.090620:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 510 00000100:00100000:2.0:1721880593.090621:0:15434:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3203 00000100:00080000:1.0:1721880593.090622:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880563 00000100:00080000:1.0:1721880593.090624:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880563 00000100:00080000:1.0:1721880593.090626:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880563 00000100:00080000:1.0:1721880593.090627:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880563 00000100:00080000:1.0:1721880593.090628:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880563 00000100:00100000:0.0:1721880593.176963:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011923968:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1721880593.177015:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880593.177060:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011923968 00000100:00100000:2.0:1721880593.177068:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011923968 00000100:00100000:2.0:1721880593.177114:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101187 00000100:00100000:2.0:1721880593.177120:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011923968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1721880593.177163:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1435709440 avail 1306247168 00000100:00100000:2.0:1721880593.177219:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011923968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880593.177225:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101187 00000100:00100000:0.0:1721880593.177237:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011923968:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1721880593.786930:0:15560:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721880594.788992:0:11721:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880595.790976:0:7119:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1721880596.072914:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c0d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011924096:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1721880596.072967:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880596.073021:0:10429:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011924096 00000100:00100000:0.0:1721880596.073028:0:10429:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011924096 00000100:00080000:1.0:1721880596.073047:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880566 00000100:00100000:0.0:1721880596.073060:0:10429:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 704 00000100:00100000:0.0:1721880596.073066:0:10429:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076e5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011924096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1721880596.073089:0:10429:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:0.0:1721880596.073165:0:10429:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880076e5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011924096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880596.073170:0:10429:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 704 00000100:00100000:1.0:1721880596.073189:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c0d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011924096:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1721880596.472930:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1721880596.472948:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076e5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011924224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1721880596.472997:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880596.473046:0:10429:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011924224 00000100:00100000:0.0:1721880596.473052:0:10429:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011924224 00000100:00100000:0.0:1721880596.473111:0:10429:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 705 00000100:00100000:0.0:1721880596.473119:0:10429:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011924224:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1721880596.473124:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880566 00002000:00000024:0.0:1721880596.473137:0:10429:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:0.0:1721880596.473180:0:10429:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011924224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880596.473184:0:10429:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 705 00000100:00100000:3.0:1721880596.473205:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076e5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011924224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1721880596.568943:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076e5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011924352:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1721880596.569001:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880596.569057:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011924352 00000100:00100000:2.0:1721880596.569065:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011924352 00000100:00100000:2.0:1721880596.569125:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101188 00000100:00100000:2.0:1721880596.569130:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009993a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3687:x1805522011924352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1721880596.569157:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1437519872 avail 1308057600 00000100:00100000:2.0:1721880596.569211:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009993a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3687:x1805522011924352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880596.569215:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101188 00000100:00100000:0.0:1721880596.569254:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076e5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011924352:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1721880596.664943:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076e5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3686:1805522011924736:0@lo:400:kworker.0 00000100:00100000:1.0:1721880596.664949:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076e5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011924864:0@lo:400:kworker.0 00000100:00100000:2.0:1721880596.664950:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076e5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011924480:0@lo:400:kworker.0 00000100:00100000:0.0:1721880596.664965:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076e5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3689:1805522011924608:0@lo:400:kworker.0 00000100:00100000:3.0:1721880596.665005:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880596.665010:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880596.665013:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880596.665029:0:7130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011924736 00000100:00100000:0.0:1721880596.665035:0:7130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011924736 00000100:00100000:1.0:1721880596.665035:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076e5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011925376:0@lo:400:kworker.0 00000100:00100000:2.0:1721880596.665040:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076e5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011924992:0@lo:400:kworker.0 00000100:00100000:3.0:1721880596.665044:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076e5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3686:1805522011925248:0@lo:400:kworker.0 00000100:00100000:1.0:1721880596.665046:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880596.665059:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011924480 00000100:00100000:2.0:1721880596.665062:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011924480 00000100:00100000:0.0:1721880596.665064:0:7130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011925376 00000100:00100000:3.0:1721880596.665068:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880596.665070:0:7130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011925376 00000100:00100000:1.0:1721880596.665076:0:15420:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011925248 00000100:00100000:1.0:1721880596.665078:0:15420:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011925248 00000100:00100000:0.0:1721880596.665099:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3205 00000100:00100000:0.0:1721880596.665104:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009993b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3686:x1805522011924736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880596.665106:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 644 00000100:00100000:2.0:1721880596.665111:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011924480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880596.665112:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011924864 00000100:00100000:3.0:1721880596.665116:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011924864 00000100:00100000:1.0:1721880596.665127:0:15420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3206 00000100:00100000:1.0:1721880596.665131:0:15420:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076e5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011925376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880596.665138:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011924480:12345-0@lo:400:kworker.0 Request processed in 26us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880596.665141:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101189 00000100:00100000:2.0:1721880596.665142:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 644 00000100:00100000:0.0:1721880596.665146:0:7130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009993b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3686:x1805522011924736:12345-0@lo:400:kworker.0 Request processed in 42us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880596.665147:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800731e7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011924864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880596.665150:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3205 00000100:00100000:1.0:1721880596.665155:0:15420:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880076e5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011925376:12345-0@lo:400:kworker.0 Request processed in 24us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880596.665159:0:15420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3206 00000100:00100000:0.0:1721880596.665166:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3207 00000100:00100000:0.0:1721880596.665168:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3686:x1805522011925248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880596.665172:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800731e7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011924864:12345-0@lo:400:kworker.0 Request processed in 26us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880596.665175:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1721880596.665176:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880566 00000100:00100000:3.0:1721880596.665176:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101189 00000100:00080000:1.0:1721880596.665178:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880566 00000100:00080000:1.0:1721880596.665179:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880566 00000100:00100000:0.0:1721880596.665181:0:7130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3686:x1805522011925248:12345-0@lo:400:kworker.0 Request processed in 12us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880596.665184:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3207 00000100:00100000:2.0:1721880596.665185:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076e5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011925504:0@lo:400:kworker.0 00000100:00100000:1.0:1721880596.665196:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076e5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011924864:0@lo:400:kworker.0 00000100:00100000:0.0:1721880596.665197:0:7130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011924992 00000100:00100000:0.0:1721880596.665198:0:7130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011924992 00000100:00100000:2.0:1721880596.665198:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880596.665201:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076e5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011925376:0@lo:400:kworker.0 00000100:00100000:0.0:1721880596.665209:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3208 00000100:00100000:0.0:1721880596.665211:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011924992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880596.665214:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076e5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011924480:0@lo:400:kworker.0 00000100:00080000:1.0:1721880596.665217:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880566 00000100:00100000:0.0:1721880596.665223:0:7130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011924992:12345-0@lo:400:kworker.0 Request processed in 11us (47us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880596.665226:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3208 00000100:00100000:2.0:1721880596.665227:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076e5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011924992:0@lo:400:kworker.0 00000100:00100000:1.0:1721880596.665235:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011925504 00000100:00100000:0.0:1721880596.665236:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880596.665237:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011925504 00000100:00100000:2.0:1721880596.665250:0:11334:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011924608 00000100:00100000:2.0:1721880596.665252:0:11334:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011924608 00000100:00100000:1.0:1721880596.665253:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 511 00000100:00100000:0.0:1721880596.665254:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076e5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3689:1805522011925120:0@lo:400:kworker.0 00000100:00100000:1.0:1721880596.665256:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011925504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880596.665264:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880596.665264:0:11334:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3209 00000100:00100000:2.0:1721880596.665267:0:11334:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1805522011924608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880596.665271:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076e5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011925632:0@lo:400:kworker.0 00000100:00100000:1.0:1721880596.665275:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011925504:12345-0@lo:400:kworker.0 Request processed in 19us (76us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880596.665279:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 511 00000100:00100000:0.0:1721880596.665282:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880596.665285:0:11334:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1805522011924608:12345-0@lo:400:kworker.0 Request processed in 18us (48us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880596.665286:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011925632 00000100:00100000:1.0:1721880596.665288:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011925632 00000100:00100000:2.0:1721880596.665289:0:11334:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3209 00000100:00100000:2.0:1721880596.665294:0:11334:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011925120 00000100:00100000:2.0:1721880596.665296:0:11334:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011925120 00000100:00100000:0.0:1721880596.665297:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076e5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3689:1805522011924608:0@lo:400:kworker.0 00000100:00100000:1.0:1721880596.665298:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:1.0:1721880596.665300:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011925632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880596.665304:0:11334:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3210 00000100:00100000:2.0:1721880596.665306:0:11334:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1805522011925120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880596.665317:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011925632:12345-0@lo:400:kworker.0 Request processed in 16us (34us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880596.665321:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076e5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3689:1805522011925120:0@lo:400:kworker.0 00000100:00100000:1.0:1721880596.665321:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00000100:00100000:2.0:1721880596.665322:0:11334:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1805522011925120:12345-0@lo:400:kworker.0 Request processed in 13us (56us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880596.665325:0:11334:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3210 00000100:00100000:0.0:1721880596.665326:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076e5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011925632:0@lo:400:kworker.0 00000100:00080000:1.0:1721880596.665329:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880566 00000100:00080000:1.0:1721880596.665330:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880566 00000100:00100000:2.0:1721880596.665343:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076e5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011925504:0@lo:400:kworker.0 00000100:00100000:3.0:1721880596.665561:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076e5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3686:1805522011924736:0@lo:400:kworker.0 00000100:00100000:3.0:1721880596.665567:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076e5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3686:1805522011925248:0@lo:400:kworker.0 00000100:00100000:3.0:1721880596.712897:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011925760:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1721880596.712947:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076e5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011925888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1721880596.712951:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880596.713009:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880596.713023:0:10429:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011925760 00000100:00100000:1.0:1721880596.713031:0:10429:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011925760 00000100:00100000:2.0:1721880596.713046:0:9462:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011925888 00000100:00100000:2.0:1721880596.713052:0:9462:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011925888 00000100:00100000:1.0:1721880596.713072:0:10429:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 706 00000100:00100000:1.0:1721880596.713079:0:10429:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009993bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011925760:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1721880596.713079:0:9462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 707 00000100:00100000:2.0:1721880596.713097:0:9462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011925888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1721880596.713119:0:10429:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00002000:00000024:2.0:1721880596.713119:0:9462:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:2.0:1721880596.713185:0:9462:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011925888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880596.713188:0:10429:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009993bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011925760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880596.713202:0:9462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 707 00000100:00100000:1.0:1721880596.713206:0:10429:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 706 00000100:00100000:3.0:1721880596.713209:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011925760:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1721880596.713219:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076e5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011925888:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1721880596.792984:0:8270:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880597.794932:0:7120:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880598.098327:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880598.098362:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880598.098380:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880598.098397:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880598.098406:0:7124:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257827456 00000100:00100000:0.0:1721880598.098408:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880598.098416:0:7124:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257827456 00000100:00100000:0.0:1721880598.098417:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880598.098417:0:7130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257827584 00000100:00100000:3.0:1721880598.098421:0:7130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257827584 00000100:00100000:0.0:1721880598.098427:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880598.098436:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880598.098458:0:7130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257827712 00000100:00100000:3.0:1721880598.098459:0:7130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257827712 00000100:00100000:1.0:1721880598.098461:0:15420:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257828096 00000100:00100000:2.0:1721880598.098462:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 645 00000100:00100000:0.0:1721880598.098463:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880598.098466:0:15420:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257828096 00000100:00100000:3.0:1721880598.098468:0:7130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257828224 00000100:00100000:2.0:1721880598.098469:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2005:x1805522257827456:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880598.098470:0:7130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257828224 00000100:00100000:0.0:1721880598.098480:0:11334:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3211 00000100:00100000:0.0:1721880598.098484:0:11334:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2004:x1805522257827584:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880598.098488:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3212 00000100:00100000:3.0:1721880598.098492:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2005:x1805522257827712:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880598.098497:0:15420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3213 00000100:00100000:1.0:1721880598.098501:0:15420:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:30425778-2709-4512-9d75-01ec53c4cfad+3694:2005:x1805522257828224:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880598.098526:0:11334:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2004:x1805522257827584:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 41us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880598.098526:0:7124:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2005:x1805522257827456:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 56us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880598.098526:0:7130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2005:x1805522257827712:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 33us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880598.098527:0:15420:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:30425778-2709-4512-9d75-01ec53c4cfad+3694:2005:x1805522257828224:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 26us (99us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880598.098530:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3212 00000100:00100000:0.0:1721880598.098533:0:11334:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3211 00000100:00100000:2.0:1721880598.098533:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 645 00000100:00100000:1.0:1721880598.098535:0:15420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3213 00000100:00100000:3.0:1721880598.098545:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3214 00000100:00100000:3.0:1721880598.098548:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30425778-2709-4512-9d75-01ec53c4cfad+4135:2004:x1805522257828096:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880598.098556:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257827840 00000100:00100000:1.0:1721880598.098557:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257827840 00000100:00100000:0.0:1721880598.098559:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257827968 00000100:00100000:3.0:1721880598.098560:0:7130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30425778-2709-4512-9d75-01ec53c4cfad+4135:2004:x1805522257828096:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 11us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880598.098562:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257827968 00000100:00100000:3.0:1721880598.098563:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3214 00000100:00100000:2.0:1721880598.098566:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257828352 00000100:00100000:2.0:1721880598.098569:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257828352 00000100:00100000:1.0:1721880598.098572:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257828480 00000100:00100000:1.0:1721880598.098574:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257828480 00000100:00100000:0.0:1721880598.098578:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 513 00000100:00100000:0.0:1721880598.098581:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2004:x1805522257827840:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880598.098591:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 514 00000100:00100000:2.0:1721880598.098596:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2005:x1805522257827968:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880598.098597:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2004:x1805522257827840:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 16us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880598.098599:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 515 00000100:00100000:1.0:1721880598.098603:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:30425778-2709-4512-9d75-01ec53c4cfad+280:2004:x1805522257828352:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880598.098604:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 516 00000100:00100000:0.0:1721880598.098606:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 513 00000100:00100000:3.0:1721880598.098606:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:30425778-2709-4512-9d75-01ec53c4cfad+665:2005:x1805522257828480:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880598.098621:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:30425778-2709-4512-9d75-01ec53c4cfad+280:2004:x1805522257828352:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 17us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880598.098622:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:30425778-2709-4512-9d75-01ec53c4cfad+665:2005:x1805522257828480:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 13us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880598.098623:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2005:x1805522257827968:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 25us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880598.098625:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 515 00000100:00100000:3.0:1721880598.098627:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 516 00000100:00100000:2.0:1721880598.098630:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 514 00000100:00080000:0.0:1721880598.098634:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880568 00000100:00080000:0.0:1721880598.098636:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880568 00000100:00080000:0.0:1721880598.098637:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880568 00000100:00080000:0.0:1721880598.098639:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880568 00000100:00080000:0.0:1721880598.098640:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880568 00000100:00100000:2.0:1721880598.184923:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c0d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011926016:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1721880598.184982:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880598.185044:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011926016 00000100:00100000:3.0:1721880598.185051:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011926016 00000100:00100000:3.0:1721880598.185109:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101190 00000100:00100000:3.0:1721880598.185114:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011926016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1721880598.185142:0:15587:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1435709440 avail 1306247168 00000100:00100000:3.0:1721880598.185176:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011926016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880598.185180:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101190 00000100:00100000:2.0:1721880598.185198:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c0d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011926016:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1721880598.796935:0:15560:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721880599.798965:0:11721:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880600.800929:0:7119:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1721880601.080964:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076e5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011926144:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1721880601.081049:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880601.081088:0:10429:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011926144 00000100:00100000:1.0:1721880601.081095:0:10429:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011926144 00000100:00100000:1.0:1721880601.081138:0:10429:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 708 00000100:00100000:1.0:1721880601.081143:0:10429:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088683b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011926144:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1721880601.081155:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880571 00002000:00000024:1.0:1721880601.081166:0:10429:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:1.0:1721880601.081199:0:10429:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088683b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011926144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880601.081204:0:10429:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 708 00000100:00100000:2.0:1721880601.081216:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076e5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011926144:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1721880601.480945:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076e5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011926272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1721880601.481032:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880601.481076:0:10429:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011926272 00000100:00100000:1.0:1721880601.481084:0:10429:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011926272 00000100:00080000:0.0:1721880601.481132:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880571 00000100:00100000:1.0:1721880601.481135:0:10429:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 709 00000100:00100000:1.0:1721880601.481141:0:10429:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011926272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1721880601.481162:0:10429:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:1.0:1721880601.481212:0:10429:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011926272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880601.481219:0:10429:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 709 00000100:00100000:3.0:1721880601.481233:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076e5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011926272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1721880601.576979:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009c0d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011926400:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1721880601.577051:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880601.577092:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011926400 00000100:00100000:3.0:1721880601.577101:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011926400 00000100:00100000:3.0:1721880601.577151:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101191 00000100:00100000:3.0:1721880601.577158:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+19:3687:x1805522011926400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1721880601.577190:0:15587:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1437519872 avail 1308057600 00000100:00100000:3.0:1721880601.577238:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+19:3687:x1805522011926400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880601.577243:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101191 00000100:00100000:2.0:1721880601.577260:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009c0d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011926400:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1721880601.672901:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076e5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011926528:0@lo:400:kworker.0 00000100:00100000:1.0:1721880601.672904:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076e5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011926912:0@lo:400:kworker.0 00000100:00100000:2.0:1721880601.672914:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076e5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3689:1805522011926656:0@lo:400:kworker.0 00000100:00100000:1.0:1721880601.672962:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880601.672966:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880601.672966:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880601.672996:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076e5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011927424:0@lo:400:kworker.0 00000100:00100000:2.0:1721880601.673016:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076e5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3689:1805522011927168:0@lo:400:kworker.0 00000100:00100000:3.0:1721880601.673020:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076e5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011927040:0@lo:400:kworker.0 00000100:00100000:2.0:1721880601.673030:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880601.673042:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076e5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011927680:0@lo:400:kworker.0 00000100:00100000:3.0:1721880601.673042:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880601.673043:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011926528 00000100:00100000:1.0:1721880601.673049:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011926528 00000100:00100000:0.0:1721880601.673051:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011926656 00000100:00100000:3.0:1721880601.673055:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076e5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011927552:0@lo:400:kworker.0 00000100:00100000:2.0:1721880601.673056:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880601.673057:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011926656 00000100:00100000:3.0:1721880601.673081:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880601.673093:0:15432:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011927168 00000100:00100000:0.0:1721880601.673094:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011927040 00000100:00100000:1.0:1721880601.673095:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 646 00000100:00100000:2.0:1721880601.673095:0:15432:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011927168 00000100:00100000:0.0:1721880601.673096:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011927040 00000100:00100000:1.0:1721880601.673100:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011926528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880601.673109:0:15477:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3215 00000100:00100000:3.0:1721880601.673114:0:15477:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1805522011926656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880601.673116:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3216 00000100:00100000:2.0:1721880601.673120:0:15432:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3217 00000100:00100000:0.0:1721880601.673121:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009993a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011927040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880601.673123:0:15432:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1805522011927168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880601.673138:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011926528:12345-0@lo:400:kworker.0 Request processed in 38us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880601.673141:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 646 00000100:00100000:3.0:1721880601.673162:0:15477:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1805522011926656:12345-0@lo:400:kworker.0 Request processed in 47us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880601.673163:0:15432:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1805522011927168:12345-0@lo:400:kworker.0 Request processed in 39us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880601.673167:0:15432:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3217 00000100:00100000:3.0:1721880601.673169:0:15477:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3215 00000100:00100000:1.0:1721880601.673178:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076e5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011926528:0@lo:400:kworker.0 00000100:00100000:0.0:1721880601.673180:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009993a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011927040:12345-0@lo:400:kworker.0 Request processed in 58us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880601.673186:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3216 00000100:00100000:1.0:1721880601.673186:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076e5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011927040:0@lo:400:kworker.0 00000100:00100000:2.0:1721880601.673186:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011927680 00000100:00100000:2.0:1721880601.673188:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011927680 00000100:00100000:3.0:1721880601.673197:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011927552 00000100:00100000:3.0:1721880601.673199:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011927552 00000100:00100000:2.0:1721880601.673203:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 517 00000100:00080000:0.0:1721880601.673205:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880571 00000100:00100000:2.0:1721880601.673206:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011927680:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1721880601.673208:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880571 00000100:00080000:0.0:1721880601.673210:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880571 00000100:00100000:1.0:1721880601.673210:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 518 00000100:00080000:0.0:1721880601.673211:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880571 00000100:00100000:1.0:1721880601.673213:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009993a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011927552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880601.673222:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011927680:12345-0@lo:400:kworker.0 Request processed in 15us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880601.673222:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076e5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3686:1805522011926784:0@lo:400:kworker.0 00000100:00100000:0.0:1721880601.673224:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011926912 00000100:00100000:2.0:1721880601.673226:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 517 00000100:00100000:0.0:1721880601.673227:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011926912 00000100:00100000:1.0:1721880601.673230:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009993a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011927552:12345-0@lo:400:kworker.0 Request processed in 16us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880601.673233:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 518 00000100:00100000:3.0:1721880601.673237:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880601.673244:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076e5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3686:1805522011927296:0@lo:400:kworker.0 00000100:00100000:2.0:1721880601.673245:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076e5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3689:1805522011926656:0@lo:400:kworker.0 00000100:00100000:1.0:1721880601.673249:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076e5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011927552:0@lo:400:kworker.0 00000100:00100000:0.0:1721880601.673250:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101192 00000100:00100000:2.0:1721880601.673252:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076e5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3689:1805522011927168:0@lo:400:kworker.0 00000100:00100000:3.0:1721880601.673253:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880601.673254:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076e5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011926912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880601.673257:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076e5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011927680:0@lo:400:kworker.0 00000100:00100000:1.0:1721880601.673266:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880601.673274:0:7130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011927296 00000100:00100000:3.0:1721880601.673274:0:15434:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011926784 00000100:00100000:3.0:1721880601.673275:0:15434:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011926784 00000100:00100000:2.0:1721880601.673276:0:7130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011927296 00000100:00100000:3.0:1721880601.673285:0:15434:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011927424 00000100:00100000:3.0:1721880601.673286:0:15434:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011927424 00000100:00100000:2.0:1721880601.673289:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3218 00000100:00100000:0.0:1721880601.673290:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880076e5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011926912:12345-0@lo:400:kworker.0 Request processed in 34us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880601.673291:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3686:x1805522011926784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880601.673295:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101192 00000100:00100000:3.0:1721880601.673296:0:15434:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3219 00000100:00100000:3.0:1721880601.673298:0:15434:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0000-lwp-OST0001_UUID+5:3686:x1805522011927296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880601.673299:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076e5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011926912:0@lo:400:kworker.0 00000100:00100000:2.0:1721880601.673311:0:7130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3686:x1805522011926784:12345-0@lo:400:kworker.0 Request processed in 19us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880601.673314:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3220 00000100:00100000:3.0:1721880601.673315:0:15434:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0000-lwp-OST0001_UUID+5:3686:x1805522011927296:12345-0@lo:400:kworker.0 Request processed in 16us (62us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880601.673317:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3218 00000100:00100000:0.0:1721880601.673319:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076e5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011927424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880601.673320:0:15434:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3219 00000100:00080000:1.0:1721880601.673326:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880571 00000100:00080000:1.0:1721880601.673328:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880571 00000100:00100000:3.0:1721880601.673337:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076e5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3686:1805522011926784:0@lo:400:kworker.0 00000100:00100000:3.0:1721880601.673342:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076e5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3686:1805522011927296:0@lo:400:kworker.0 00000100:00100000:0.0:1721880601.673349:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880076e5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011927424:12345-0@lo:400:kworker.0 Request processed in 29us (81us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880601.673352:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076e5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011927424:0@lo:400:kworker.0 00000100:00100000:0.0:1721880601.673354:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3220 00000100:00100000:3.0:1721880601.720843:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1721880601.720858:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076e5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011927936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1721880601.720904:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880601.720925:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009993b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011927808:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1721880601.720934:0:10429:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011927936 00000100:00100000:3.0:1721880601.720935:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880601.720941:0:10429:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011927936 00000100:00100000:1.0:1721880601.720966:0:10429:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011927808 00000100:00100000:1.0:1721880601.720967:0:10429:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011927808 00000100:00100000:2.0:1721880601.720977:0:9462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 710 00000100:00100000:3.0:1721880601.720983:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 711 00000100:00100000:2.0:1721880601.720985:0:9462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099939880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011927936:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1721880601.720987:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009993ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3687:x1805522011927808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1721880601.721021:0:9462:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00002000:00000024:3.0:1721880601.721021:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:3.0:1721880601.721059:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009993ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3687:x1805522011927808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880601.721063:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 711 00000100:00100000:2.0:1721880601.721067:0:9462:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880099939880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011927936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880601.721072:0:9462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 710 00000100:00100000:0.0:1721880601.721136:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076e5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011927936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1721880601.721150:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009993b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011927808:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1721880601.802953:0:8270:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880602.804967:0:7120:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880603.106445:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880603.106491:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880603.106515:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880603.106536:0:7124:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257828608 00000100:00100000:0.0:1721880603.106537:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880603.106547:0:7124:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257828608 00000100:00100000:0.0:1721880603.106551:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880603.106587:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880603.106599:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880603.106612:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257828736 00000100:00100000:0.0:1721880603.106614:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880603.106621:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257828736 00000100:00100000:2.0:1721880603.106624:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 647 00000100:00100000:2.0:1721880603.106631:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2004:x1805522257828608:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880603.106654:0:15477:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257828864 00000100:00100000:3.0:1721880603.106661:0:15477:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257828864 00000100:00100000:0.0:1721880603.106666:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880603.106684:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257829376 00000100:00100000:1.0:1721880603.106687:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257829376 00000100:00100000:3.0:1721880603.106690:0:15477:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257829248 00000100:00100000:3.0:1721880603.106692:0:15477:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257829248 00000100:00100000:0.0:1721880603.106697:0:15432:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3221 00000100:00100000:0.0:1721880603.106704:0:15432:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2005:x1805522257828736:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880603.106709:0:7124:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2004:x1805522257828608:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 79us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880603.106715:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3222 00000100:00100000:2.0:1721880603.106716:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 647 00000100:00100000:3.0:1721880603.106722:0:15477:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3223 00000100:00100000:1.0:1721880603.106723:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2004:x1805522257828864:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880603.106765:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257828992 00000100:00100000:2.0:1721880603.106767:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257828992 00000100:00100000:3.0:1721880603.106773:0:15477:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:30425778-2709-4512-9d75-01ec53c4cfad+3694:2004:x1805522257829376:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880603.106775:0:15432:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2005:x1805522257828736:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 72us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880603.106779:0:15432:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3221 00000100:00100000:0.0:1721880603.106801:0:15432:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3224 00000100:00100000:1.0:1721880603.106801:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2004:x1805522257828864:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 78us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880603.106802:0:15477:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:30425778-2709-4512-9d75-01ec53c4cfad+3694:2004:x1805522257829376:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 73us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880603.106804:0:15432:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f70a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:30425778-2709-4512-9d75-01ec53c4cfad+4135:2005:x1805522257829248:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880603.106804:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257829120 00000100:00100000:2.0:1721880603.106806:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257829120 00000100:00100000:3.0:1721880603.106806:0:15477:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3223 00000100:00100000:1.0:1721880603.106810:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3222 00000100:00100000:0.0:1721880603.106817:0:15432:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f70a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:30425778-2709-4512-9d75-01ec53c4cfad+4135:2005:x1805522257829248:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 12us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880603.106817:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257829632 00000100:00100000:2.0:1721880603.106818:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257829632 00000100:00100000:0.0:1721880603.106820:0:15432:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3224 00000100:00100000:3.0:1721880603.106824:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257829504 00000100:00100000:3.0:1721880603.106826:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257829504 00000100:00100000:2.0:1721880603.106833:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 519 00000100:00100000:0.0:1721880603.106838:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 520 00000100:00100000:2.0:1721880603.106838:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2005:x1805522257828992:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880603.106840:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2004:x1805522257829120:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880603.106842:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 521 00000100:00100000:3.0:1721880603.106846:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 522 00000100:00100000:1.0:1721880603.106847:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f70aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:30425778-2709-4512-9d75-01ec53c4cfad+665:2004:x1805522257829632:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880603.106849:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f70bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:30425778-2709-4512-9d75-01ec53c4cfad+280:2005:x1805522257829504:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880603.106851:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2004:x1805522257829120:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 10us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880603.106854:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 520 00000100:00100000:3.0:1721880603.106863:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f70bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:30425778-2709-4512-9d75-01ec53c4cfad+280:2005:x1805522257829504:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 13us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880603.106865:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c0d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2005:x1805522257828992:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 26us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880603.106867:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 522 00000100:00100000:1.0:1721880603.106869:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f70aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:30425778-2709-4512-9d75-01ec53c4cfad+665:2004:x1805522257829632:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 21us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880603.106871:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 519 00000100:00100000:1.0:1721880603.106875:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 521 00000100:00080000:1.0:1721880603.106891:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880573 00000100:00080000:1.0:1721880603.106894:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880573 00000100:00080000:1.0:1721880603.106896:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880573 00000100:00080000:1.0:1721880603.106898:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880573 00000100:00080000:1.0:1721880603.106900:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880573 00000100:00100000:1.0:1721880603.193018:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880125984e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011928064:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1721880603.193108:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880603.193225:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011928064 00000100:00100000:0.0:1721880603.193236:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011928064 00000100:00100000:0.0:1721880603.193296:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101193 00000100:00100000:0.0:1721880603.193304:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011928064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1721880603.193343:0:15587:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1435709440 avail 1306247168 00000100:00100000:0.0:1721880603.193404:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880076e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011928064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880603.193412:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101193 00000100:00100000:1.0:1721880603.193436:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880125984e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011928064:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1721880603.806927:0:15560:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721880604.809013:0:11721:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880605.811041:0:7119:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1721880606.088982:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1721880606.089005:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880125984380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011928192:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1721880606.089070:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880606.089134:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011928192 00000100:00100000:3.0:1721880606.089144:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011928192 00000100:00080000:1.0:1721880606.089189:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880576 00000100:00100000:3.0:1721880606.089201:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 712 00000100:00100000:3.0:1721880606.089207:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076e5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011928192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1721880606.089236:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:3.0:1721880606.089288:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880076e5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011928192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880606.089294:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 712 00000100:00100000:1.0:1721880606.089318:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880125984380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011928192:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1721880606.489013:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88009993b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011928320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1721880606.489071:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880606.489117:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011928320 00000100:00100000:3.0:1721880606.489124:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011928320 00000100:00100000:3.0:1721880606.489170:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 713 00000100:00100000:3.0:1721880606.489176:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880125984700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011928320:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1721880606.489190:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880576 00002000:00000024:3.0:1721880606.489197:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:3.0:1721880606.489232:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880125984700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011928320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880606.489237:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 713 00000100:00100000:2.0:1721880606.489251:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88009993b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011928320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1721880606.585132:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880125984a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011928448:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1721880606.585207:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880606.585358:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011928448 00000100:00100000:2.0:1721880606.585369:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011928448 00000100:00100000:2.0:1721880606.585435:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101194 00000100:00100000:2.0:1721880606.585445:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+19:3687:x1805522011928448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1721880606.585486:0:15587:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1437519872 avail 1308057600 00000100:00100000:2.0:1721880606.585561:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+19:3687:x1805522011928448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 116us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880606.585569:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101194 00000100:00100000:0.0:1721880606.585637:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880125984a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011928448:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1721880606.680980:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076e5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011928576:0@lo:400:kworker.0 00000100:00100000:2.0:1721880606.681073:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880606.681084:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076e5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3689:1805522011928704:0@lo:400:kworker.0 00000100:00100000:1.0:1721880606.681103:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011928576 00000100:00100000:0.0:1721880606.681104:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076e5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011928960:0@lo:400:kworker.0 00000100:00100000:1.0:1721880606.681112:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011928576 00000100:00100000:2.0:1721880606.681119:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076e5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011929088:0@lo:400:kworker.0 00000100:00100000:3.0:1721880606.681126:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880606.681153:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880606.681154:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076e5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3689:1805522011929216:0@lo:400:kworker.0 00000100:00100000:0.0:1721880606.681156:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880606.681158:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 648 00000100:00100000:1.0:1721880606.681164:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011928576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880606.681170:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120346680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011929600:0@lo:400:kworker.0 00000100:00100000:3.0:1721880606.681171:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880606.681192:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076e5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011929472:0@lo:400:kworker.0 00000100:00100000:3.0:1721880606.681193:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011929728:0@lo:400:kworker.0 00000100:00100000:2.0:1721880606.681213:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880606.681226:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011928576:12345-0@lo:400:kworker.0 Request processed in 62us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880606.681232:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 648 00000100:00100000:3.0:1721880606.681233:0:7130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011928704 00000100:00100000:0.0:1721880606.681236:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880606.681237:0:7130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011928704 00000100:00100000:2.0:1721880606.681252:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076e5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011928576:0@lo:400:kworker.0 00000100:00100000:0.0:1721880606.681255:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1721880606.681261:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076e5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3687:1805522011928832:0@lo:400:kworker.0 00000100:00100000:3.0:1721880606.681267:0:7130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011929088 00000100:00100000:3.0:1721880606.681269:0:7130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011929088 00000100:00100000:1.0:1721880606.681274:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011929216 00000100:00100000:0.0:1721880606.681276:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880606.681277:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011929216 00000100:00100000:3.0:1721880606.681286:0:7130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011929472 00000100:00100000:3.0:1721880606.681287:0:7130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011929472 00000100:00100000:0.0:1721880606.681290:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076e5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3687:1805522011929344:0@lo:400:kworker.0 00000100:00100000:1.0:1721880606.681295:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011928832 00000100:00100000:1.0:1721880606.681296:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011928832 00000100:00100000:0.0:1721880606.681302:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880606.681303:0:11334:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3225 00000100:00100000:2.0:1721880606.681309:0:11334:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009993b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1805522011928704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880606.681309:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3226 00000100:00100000:3.0:1721880606.681314:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880125987100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011929088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880606.681320:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011929344 00000100:00100000:1.0:1721880606.681322:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011929344 00000100:00100000:0.0:1721880606.681329:0:15434:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3227 00000100:00100000:0.0:1721880606.681335:0:15434:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097139c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1805522011929216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880606.681344:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3228 00000100:00100000:2.0:1721880606.681347:0:11334:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009993b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1805522011928704:12345-0@lo:400:kworker.0 Request processed in 38us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880606.681348:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f70b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011929472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880606.681351:0:7130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880125987100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011929088:12345-0@lo:400:kworker.0 Request processed in 36us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880606.681353:0:11334:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3225 00000100:00100000:3.0:1721880606.681357:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3226 00000100:00100000:0.0:1721880606.681366:0:15434:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880097139c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1805522011929216:12345-0@lo:400:kworker.0 Request processed in 31us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880606.681372:0:15434:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3227 00000100:00100000:3.0:1721880606.681376:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3229 00000100:00100000:1.0:1721880606.681378:0:7129:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f70b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011929472:12345-0@lo:400:kworker.0 Request processed in 29us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880606.681381:0:11334:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3230 00000100:00100000:3.0:1721880606.681381:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f708a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3687:x1805522011928832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880606.681385:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3228 00000100:00100000:2.0:1721880606.681386:0:11334:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3687:x1805522011929344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880606.681399:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011928960 00000100:00100000:3.0:1721880606.681401:0:7130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f708a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3687:x1805522011928832:12345-0@lo:400:kworker.0 Request processed in 21us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880606.681402:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011928960 00000100:00100000:3.0:1721880606.681406:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3229 00000100:00100000:2.0:1721880606.681408:0:11334:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3687:x1805522011929344:12345-0@lo:400:kworker.0 Request processed in 22us (105us total) trans 0 rc 0/0 00000100:00080000:1.0:1721880606.681412:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880576 00000100:00100000:2.0:1721880606.681412:0:11334:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3230 00000100:00080000:1.0:1721880606.681415:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880576 00000100:00080000:1.0:1721880606.681417:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880576 00000100:00100000:0.0:1721880606.681426:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101195 00000100:00100000:3.0:1721880606.681427:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880606.681430:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f709500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011928960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880606.681433:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011929600 00000100:00100000:2.0:1721880606.681437:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011929600 00000100:00080000:1.0:1721880606.681450:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880576 00000100:00100000:3.0:1721880606.681455:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076e5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3689:1805522011928704:0@lo:400:kworker.0 00000100:00100000:2.0:1721880606.681463:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011929728 00000100:00100000:3.0:1721880606.681464:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076e5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3689:1805522011929216:0@lo:400:kworker.0 00000100:00100000:2.0:1721880606.681465:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011929728 00000100:00100000:0.0:1721880606.681468:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f709500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011928960:12345-0@lo:400:kworker.0 Request processed in 37us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880606.681472:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 523 00000100:00100000:0.0:1721880606.681474:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101195 00000100:00100000:1.0:1721880606.681476:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880125986680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011929600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880606.681482:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 524 00000100:00100000:2.0:1721880606.681486:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009713b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011929728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880606.681504:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880125986680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011929600:12345-0@lo:400:kworker.0 Request processed in 28us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880606.681508:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076e5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3687:1805522011928832:0@lo:400:kworker.0 00000100:00100000:1.0:1721880606.681513:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 523 00000100:00100000:2.0:1721880606.681513:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009713b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011929728:12345-0@lo:400:kworker.0 Request processed in 26us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880606.681517:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076e5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3687:1805522011929344:0@lo:400:kworker.0 00000100:00100000:2.0:1721880606.681518:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 524 00000100:00100000:0.0:1721880606.681524:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076e5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011928960:0@lo:400:kworker.0 00000100:00100000:3.0:1721880606.681528:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011929728:0@lo:400:kworker.0 00000100:00100000:0.0:1721880606.681532:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076e5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011929472:0@lo:400:kworker.0 00000100:00080000:1.0:1721880606.681533:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880576 00000100:00100000:2.0:1721880606.681541:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076e5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011929088:0@lo:400:kworker.0 00000100:00100000:2.0:1721880606.681550:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120346680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011929600:0@lo:400:kworker.0 00000100:00100000:0.0:1721880606.729107:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120345f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011929856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1721880606.729108:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880097139500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011929984:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1721880606.729193:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880606.729247:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880606.729275:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011929856 00000100:00100000:3.0:1721880606.729285:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011929856 00000100:00100000:3.0:1721880606.729327:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011929984 00000100:00100000:3.0:1721880606.729330:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011929984 00000100:00100000:3.0:1721880606.729360:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 714 00000100:00100000:3.0:1721880606.729369:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f70b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011929856:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1721880606.729374:0:9461:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 715 00000100:00100000:1.0:1721880606.729385:0:9461:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120344000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3687:x1805522011929984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1721880606.729405:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00002000:00000024:1.0:1721880606.729411:0:9461:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:3.0:1721880606.729464:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f70b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011929856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880606.729472:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 714 00000100:00100000:1.0:1721880606.729473:0:9461:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880120344000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3687:x1805522011929984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880606.729485:0:9461:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 715 00000100:00100000:0.0:1721880606.729501:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120345f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011929856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1721880606.729559:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880097139500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011929984:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1721880606.813002:0:8270:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880607.815150:0:7120:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880608.114281:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880608.114336:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880608.114356:0:15423:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257829888 00000100:00100000:1.0:1721880608.114380:0:15423:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257829888 00000100:00100000:0.0:1721880608.114384:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880608.114407:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880608.114421:0:7124:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257829760 00000100:00100000:0.0:1721880608.114424:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880608.114427:0:7124:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257829760 00000100:00100000:0.0:1721880608.114441:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880608.114451:0:15423:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257830016 00000100:00100000:1.0:1721880608.114454:0:15423:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257830016 00000100:00100000:0.0:1721880608.114457:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880608.114461:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 649 00000100:00100000:2.0:1721880608.114468:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2005:x1805522257829760:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880608.114474:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880608.114481:0:15423:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257830400 00000100:00100000:3.0:1721880608.114484:0:11334:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257830528 00000100:00100000:1.0:1721880608.114489:0:15423:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257830400 00000100:00100000:3.0:1721880608.114491:0:11334:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257830528 00000100:00100000:1.0:1721880608.114508:0:15423:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3231 00000100:00100000:1.0:1721880608.114514:0:15423:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2004:x1805522257829888:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880608.114522:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880608.114525:0:7124:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2005:x1805522257829760:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 57us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880608.114530:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 649 00000100:00100000:3.0:1721880608.114534:0:11334:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3232 00000100:00100000:3.0:1721880608.114541:0:11334:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f709180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2005:x1805522257830016:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880608.114552:0:15423:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2004:x1805522257829888:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 36us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880608.114560:0:15423:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3231 00000100:00100000:2.0:1721880608.114562:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257830144 00000100:00100000:2.0:1721880608.114564:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257830144 00000100:00100000:2.0:1721880608.114581:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257830272 00000100:00100000:2.0:1721880608.114582:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257830272 00000100:00100000:1.0:1721880608.114583:0:15423:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3233 00000100:00100000:1.0:1721880608.114587:0:15423:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f70a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:30425778-2709-4512-9d75-01ec53c4cfad+4135:2004:x1805522257830400:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880608.114592:0:11334:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f709180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2005:x1805522257830016:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 50us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880608.114593:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257830656 00000100:00100000:2.0:1721880608.114594:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257830656 00000100:00100000:3.0:1721880608.114600:0:11334:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3232 00000100:00100000:2.0:1721880608.114601:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257830784 00000100:00100000:2.0:1721880608.114603:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257830784 00000100:00100000:1.0:1721880608.114610:0:15423:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f70a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:30425778-2709-4512-9d75-01ec53c4cfad+4135:2004:x1805522257830400:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 21us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880608.114613:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 525 00000100:00100000:1.0:1721880608.114617:0:15423:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3233 00000100:00100000:2.0:1721880608.114617:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f708000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2004:x1805522257830144:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880608.114622:0:11334:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3234 00000100:00100000:3.0:1721880608.114627:0:11334:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f70ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30425778-2709-4512-9d75-01ec53c4cfad+3694:2005:x1805522257830528:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880608.114635:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f708000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2004:x1805522257830144:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 18us (229us total) trans 0 rc 0/0 00000100:00080000:1.0:1721880608.114639:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880578 00000100:00100000:2.0:1721880608.114639:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 525 00000100:00080000:1.0:1721880608.114643:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880578 00000100:00080000:1.0:1721880608.114645:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880578 00000100:00100000:2.0:1721880608.114646:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 526 00000100:00080000:1.0:1721880608.114647:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880578 00000100:00100000:2.0:1721880608.114649:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f709c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2005:x1805522257830272:12345-192.168.201.24@tcp:400:kworker.0 00000100:00080000:1.0:1721880608.114650:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880578 00000100:00100000:3.0:1721880608.114655:0:11334:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f70ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30425778-2709-4512-9d75-01ec53c4cfad+3694:2005:x1805522257830528:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 26us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880608.114661:0:11334:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3234 00000100:00100000:2.0:1721880608.114662:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f709c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2005:x1805522257830272:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 12us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880608.114666:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 526 00000100:00100000:2.0:1721880608.114688:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 527 00000100:00100000:2.0:1721880608.114692:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f709880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:30425778-2709-4512-9d75-01ec53c4cfad+280:2004:x1805522257830656:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880608.114699:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 528 00000100:00100000:1.0:1721880608.114705:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:30425778-2709-4512-9d75-01ec53c4cfad+665:2005:x1805522257830784:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880608.114705:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f709880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:30425778-2709-4512-9d75-01ec53c4cfad+280:2004:x1805522257830656:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 13us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880608.114709:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 527 00000100:00100000:1.0:1721880608.114728:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:30425778-2709-4512-9d75-01ec53c4cfad+665:2005:x1805522257830784:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 22us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880608.114735:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 528 00000100:00100000:3.0:1721880608.201013:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1721880608.201039:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120347800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011930112:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1721880608.201104:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880608.201180:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011930112 00000100:00100000:0.0:1721880608.201190:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011930112 00000100:00100000:0.0:1721880608.201255:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101196 00000100:00100000:0.0:1721880608.201263:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097139f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3689:x1805522011930112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1721880608.201302:0:15587:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1435709440 avail 1306247168 00000100:00100000:0.0:1721880608.201375:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880097139f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3689:x1805522011930112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880608.201384:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101196 00000100:00100000:3.0:1721880608.201421:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120347800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011930112:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1721880608.816923:0:15560:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721880609.819110:0:11721:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880610.821001:0:7119:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1721880611.097079:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011930240:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1721880611.097165:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880611.097281:0:9461:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011930240 00000100:00100000:1.0:1721880611.097292:0:9461:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011930240 00000100:00100000:1.0:1721880611.097387:0:9461:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 716 00000100:00100000:1.0:1721880611.097396:0:9461:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880097139500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011930240:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1721880611.097410:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880581 00002000:00000024:1.0:1721880611.097432:0:9461:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:1.0:1721880611.097511:0:9461:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880097139500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011930240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880611.097522:0:9461:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 716 00000100:00100000:3.0:1721880611.097540:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011930240:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1721880611.497033:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1721880611.497055:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880125984a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011930368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1721880611.497116:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880611.497170:0:9461:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011930368 00000100:00100000:2.0:1721880611.497180:0:9461:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011930368 00000100:00100000:2.0:1721880611.497232:0:9461:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 717 00000100:00080000:0.0:1721880611.497234:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880581 00000100:00100000:2.0:1721880611.497239:0:9461:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120344700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011930368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1721880611.497262:0:9461:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:2.0:1721880611.497324:0:9461:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880120344700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011930368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880611.497330:0:9461:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 717 00000100:00100000:1.0:1721880611.497352:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880125984a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011930368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1721880611.593128:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800913b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011930496:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1721880611.593196:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880611.593264:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011930496 00000100:00100000:0.0:1721880611.593274:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011930496 00000100:00100000:0.0:1721880611.593334:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101197 00000100:00100000:0.0:1721880611.593341:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120346300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+19:3687:x1805522011930496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1721880611.593376:0:15587:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1437519872 avail 1308057600 00000100:00100000:0.0:1721880611.593439:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880120346300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+19:3687:x1805522011930496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880611.593447:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101197 00000100:00100000:1.0:1721880611.593465:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800913b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011930496:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1721880611.688923:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120347100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3689:1805522011930752:0@lo:400:kworker.0 00000100:00100000:2.0:1721880611.688929:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120346a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011930624:0@lo:400:kworker.0 00000100:00100000:0.0:1721880611.688959:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120344e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011931008:0@lo:400:kworker.0 00000100:00100000:3.0:1721880611.688980:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880611.688983:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880611.689002:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120345180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3689:1805522011931264:0@lo:400:kworker.0 00000100:00100000:0.0:1721880611.689007:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880611.689012:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120345c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011931136:0@lo:400:kworker.0 00000100:00100000:3.0:1721880611.689012:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880611.689025:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011931776:0@lo:400:kworker.0 00000100:00100000:0.0:1721880611.689042:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120347b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011931520:0@lo:400:kworker.0 00000100:00100000:2.0:1721880611.689042:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880611.689044:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011931008 00000100:00100000:3.0:1721880611.689044:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880611.689051:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011931008 00000100:00100000:3.0:1721880611.689054:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1721880611.689057:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011931648:0@lo:400:kworker.0 00000100:00100000:0.0:1721880611.689063:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880611.689067:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880611.689079:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011930624 00000100:00100000:0.0:1721880611.689080:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1721880611.689082:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101198 00000100:00100000:2.0:1721880611.689083:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011930624 00000100:00100000:0.0:1721880611.689086:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120345500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3687:1805522011930880:0@lo:400:kworker.0 00000100:00100000:1.0:1721880611.689086:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011931008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880611.689088:0:15415:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011930752 00000100:00100000:3.0:1721880611.689090:0:15415:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011930752 00000100:00100000:0.0:1721880611.689102:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880611.689114:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 650 00000100:00100000:3.0:1721880611.689115:0:15415:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011931264 00000100:00100000:0.0:1721880611.689116:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120346d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3687:1805522011931392:0@lo:400:kworker.0 00000100:00100000:3.0:1721880611.689116:0:15415:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011931264 00000100:00100000:2.0:1721880611.689119:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011930624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880611.689124:0:15415:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011931136 00000100:00100000:3.0:1721880611.689126:0:15415:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011931136 00000100:00100000:1.0:1721880611.689129:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011931008:12345-0@lo:400:kworker.0 Request processed in 42us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880611.689131:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880611.689133:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101198 00000100:00100000:3.0:1721880611.689135:0:15415:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011931520 00000100:00100000:3.0:1721880611.689136:0:15415:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011931520 00000100:00100000:3.0:1721880611.689144:0:15415:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011930880 00000100:00100000:3.0:1721880611.689145:0:15415:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011930880 00000100:00100000:0.0:1721880611.689151:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120344e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011931008:0@lo:400:kworker.0 00000100:00100000:3.0:1721880611.689152:0:15415:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011931392 00000100:00100000:3.0:1721880611.689153:0:15415:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011931392 00000100:00100000:2.0:1721880611.689154:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011930624:12345-0@lo:400:kworker.0 Request processed in 34us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880611.689159:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011931776 00000100:00100000:1.0:1721880611.689161:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011931776 00000100:00100000:2.0:1721880611.689161:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 650 00000100:00100000:3.0:1721880611.689161:0:15415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3235 00000100:00100000:3.0:1721880611.689164:0:15415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1805522011930752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880611.689175:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011931648 00000100:00100000:1.0:1721880611.689176:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011931648 00000100:00100000:0.0:1721880611.689179:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 529 00000100:00100000:0.0:1721880611.689183:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076fe5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011931776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880611.689185:0:15415:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1805522011930752:12345-0@lo:400:kworker.0 Request processed in 20us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880611.689186:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 530 00000100:00100000:1.0:1721880611.689189:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087bbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011931648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880611.689189:0:15415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3235 00000100:00080000:2.0:1721880611.689198:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880581 00000100:00100000:3.0:1721880611.689199:0:15415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3236 00000100:00100000:3.0:1721880611.689201:0:15415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1805522011931264:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1721880611.689202:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880581 00000100:00100000:0.0:1721880611.689204:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880076fe5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011931776:12345-0@lo:400:kworker.0 Request processed in 21us (159us total) trans 0 rc 0/0 00000100:00080000:2.0:1721880611.689204:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880581 00000100:00080000:2.0:1721880611.689206:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880581 00000100:00100000:0.0:1721880611.689207:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 529 00000100:00100000:1.0:1721880611.689209:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087bbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011931648:12345-0@lo:400:kworker.0 Request processed in 18us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880611.689213:0:15415:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1805522011931264:12345-0@lo:400:kworker.0 Request processed in 11us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880611.689214:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 530 00000100:00100000:3.0:1721880611.689216:0:15415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3236 00000100:00100000:2.0:1721880611.689223:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120346a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011930624:0@lo:400:kworker.0 00000100:00100000:0.0:1721880611.689225:0:11334:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3237 00000100:00100000:3.0:1721880611.689227:0:15415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3238 00000100:00100000:0.0:1721880611.689228:0:11334:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880125984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011931136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880611.689229:0:15415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011931520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880611.689233:0:15416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3239 00000100:00100000:1.0:1721880611.689237:0:15416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3687:x1805522011930880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880611.689244:0:15415:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011931520:12345-0@lo:400:kworker.0 Request processed in 14us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880611.689247:0:15415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3238 00000100:00100000:3.0:1721880611.689253:0:15415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3240 00000100:00100000:3.0:1721880611.689255:0:15415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3687:x1805522011931392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880611.689257:0:11334:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880125984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011931136:12345-0@lo:400:kworker.0 Request processed in 29us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880611.689260:0:11334:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3237 00000100:00100000:1.0:1721880611.689262:0:15416:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3687:x1805522011930880:12345-0@lo:400:kworker.0 Request processed in 25us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880611.689266:0:15415:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3687:x1805522011931392:12345-0@lo:400:kworker.0 Request processed in 10us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880611.689268:0:15416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3239 00000100:00100000:3.0:1721880611.689271:0:15415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3240 00000100:00100000:2.0:1721880611.689277:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120345c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011931136:0@lo:400:kworker.0 00000100:00100000:0.0:1721880611.689283:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120345500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3687:1805522011930880:0@lo:400:kworker.0 00000100:00100000:0.0:1721880611.689291:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120346d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3687:1805522011931392:0@lo:400:kworker.0 00000100:00100000:0.0:1721880611.689299:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120347b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011931520:0@lo:400:kworker.0 00000100:00100000:3.0:1721880611.689310:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011931648:0@lo:400:kworker.0 00000100:00100000:3.0:1721880611.689318:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011931776:0@lo:400:kworker.0 00000100:00100000:3.0:1721880611.689325:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120347100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3689:1805522011930752:0@lo:400:kworker.0 00000100:00100000:3.0:1721880611.689332:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120345180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3689:1805522011931264:0@lo:400:kworker.0 00000100:00100000:0.0:1721880611.736916:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880125984e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011932032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1721880611.736950:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120347800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011931904:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1721880611.736980:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880611.737011:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880611.737028:0:9461:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011932032 00000100:00100000:2.0:1721880611.737036:0:9461:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011932032 00000100:00100000:0.0:1721880611.737048:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011931904 00000100:00100000:0.0:1721880611.737053:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011931904 00000100:00100000:2.0:1721880611.737082:0:9461:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 718 00000100:00100000:2.0:1721880611.737089:0:9461:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011932032:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1721880611.737093:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 719 00000100:00100000:0.0:1721880611.737098:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087bbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011931904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1721880611.737115:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00002000:00000024:2.0:1721880611.737115:0:9461:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:0.0:1721880611.737151:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087bbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011931904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880611.737157:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 719 00000100:00100000:1.0:1721880611.737172:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880125984e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011932032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1721880611.737176:0:9461:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011932032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880611.737182:0:9461:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 718 00000100:00100000:3.0:1721880611.737183:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120347800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011931904:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1721880611.822898:0:8270:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880612.825020:0:7120:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880613.122465:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880613.122520:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880613.122541:0:7124:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257830912 00000100:00100000:2.0:1721880613.122550:0:7124:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257830912 00000100:00100000:0.0:1721880613.122556:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880613.122588:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880613.122607:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880613.122607:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 651 00000100:00100000:2.0:1721880613.122613:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2007:x1805522257830912:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880613.122619:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257831168 00000100:00100000:0.0:1721880613.122620:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880613.122630:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257831168 00000100:00100000:0.0:1721880613.122634:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880613.122647:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257831424 00000100:00100000:0.0:1721880613.122651:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880613.122652:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257831424 00000100:00100000:1.0:1721880613.122677:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257831680 00000100:00100000:2.0:1721880613.122677:0:7124:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2007:x1805522257830912:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 64us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880613.122679:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257831680 00000100:00100000:3.0:1721880613.122679:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257831936 00000100:00100000:3.0:1721880613.122681:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257831936 00000100:00100000:2.0:1721880613.122682:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 651 00000100:00100000:1.0:1721880613.122690:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257831040 00000100:00100000:3.0:1721880613.122690:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257831296 00000100:00100000:1.0:1721880613.122692:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257831040 00000100:00100000:3.0:1721880613.122692:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257831296 00000100:00100000:1.0:1721880613.122702:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257831552 00000100:00100000:1.0:1721880613.122703:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257831552 00000100:00100000:3.0:1721880613.122705:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 531 00000100:00100000:3.0:1721880613.122709:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2007:x1805522257831424:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880613.122719:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3241 00000100:00100000:1.0:1721880613.122724:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2007:x1805522257831168:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880613.122762:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3242 00000100:00100000:0.0:1721880613.122764:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880613.122766:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30425778-2709-4512-9d75-01ec53c4cfad+3694:2007:x1805522257831680:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880613.122771:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2007:x1805522257831424:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 61us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880613.122775:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 531 00000100:00100000:2.0:1721880613.122785:0:7130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30425778-2709-4512-9d75-01ec53c4cfad+3694:2007:x1805522257831680:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 20us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880613.122790:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3242 00000100:00100000:3.0:1721880613.122805:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257831808 00000100:00100000:2.0:1721880613.122824:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3243 00000100:00100000:2.0:1721880613.122827:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2006:x1805522257831040:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880613.122828:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257831808 00000100:00100000:1.0:1721880613.122833:0:7129:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2007:x1805522257831168:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 107us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880613.122853:0:7130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2006:x1805522257831040:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 25us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880613.122853:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 532 00000100:00100000:1.0:1721880613.122855:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3241 00000100:00100000:3.0:1721880613.122857:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:30425778-2709-4512-9d75-01ec53c4cfad+665:2007:x1805522257831936:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880613.122858:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3243 00000100:00100000:2.0:1721880613.122867:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3244 00000100:00100000:2.0:1721880613.122870:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30425778-2709-4512-9d75-01ec53c4cfad+4135:2006:x1805522257831552:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880613.122874:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:30425778-2709-4512-9d75-01ec53c4cfad+665:2007:x1805522257831936:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 17us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880613.122878:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 532 00000100:00100000:3.0:1721880613.122886:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 533 00000100:00100000:2.0:1721880613.122887:0:7130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30425778-2709-4512-9d75-01ec53c4cfad+4135:2006:x1805522257831552:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 17us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880613.122888:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2006:x1805522257831296:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880613.122891:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3244 00000100:00100000:3.0:1721880613.122900:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2006:x1805522257831296:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 11us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880613.122903:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 533 00000100:00100000:2.0:1721880613.122907:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 534 00000100:00100000:2.0:1721880613.122911:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:30425778-2709-4512-9d75-01ec53c4cfad+280:2006:x1805522257831808:12345-192.168.201.24@tcp:400:kworker.0 00000100:00080000:3.0:1721880613.122916:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880583 00000100:00080000:3.0:1721880613.122918:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880583 00000100:00080000:3.0:1721880613.122920:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880583 00000100:00080000:3.0:1721880613.122921:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880583 00000100:00080000:3.0:1721880613.122923:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880583 00000100:00100000:2.0:1721880613.122931:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:30425778-2709-4512-9d75-01ec53c4cfad+280:2006:x1805522257831808:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 20us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880613.122935:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 534 00000100:00100000:2.0:1721880613.209024:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880087bbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011932160:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1721880613.209105:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880613.209151:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011932160 00000100:00100000:0.0:1721880613.209161:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011932160 00000100:00100000:0.0:1721880613.209213:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101199 00000100:00100000:0.0:1721880613.209219:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880125984e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011932160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1721880613.209254:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1435709440 avail 1306247168 00000100:00100000:0.0:1721880613.209306:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880125984e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011932160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880613.209312:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101199 00000100:00100000:2.0:1721880613.209349:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880087bbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011932160:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1721880613.826995:0:15560:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721880614.829059:0:11721:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880615.830978:0:7119:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880616.104960:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880087bbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011932288:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1721880616.105031:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880616.105068:0:9461:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011932288 00000100:00100000:2.0:1721880616.105077:0:9461:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011932288 00000100:00100000:2.0:1721880616.105126:0:9461:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 720 00000100:00080000:3.0:1721880616.105127:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880586 00000100:00100000:2.0:1721880616.105132:0:9461:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011932288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1721880616.105161:0:9461:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:2.0:1721880616.105220:0:9461:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011932288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880616.105223:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880087bbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011932288:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1721880616.105227:0:9461:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 720 00000100:00100000:3.0:1721880616.504986:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120345f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011932416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1721880616.505059:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880616.505120:0:9461:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011932416 00000100:00100000:2.0:1721880616.505128:0:9461:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011932416 00000100:00080000:3.0:1721880616.505148:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880586 00000100:00100000:2.0:1721880616.505173:0:9461:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 721 00000100:00100000:2.0:1721880616.505179:0:9461:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087bbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011932416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1721880616.505204:0:9461:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:2.0:1721880616.505260:0:9461:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087bbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011932416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880616.505267:0:9461:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 721 00000100:00100000:3.0:1721880616.505278:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120345f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011932416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1721880616.600974:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120346680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011932544:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1721880616.601040:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880616.601122:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011932544 00000100:00100000:2.0:1721880616.601132:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011932544 00000100:00100000:2.0:1721880616.601185:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101200 00000100:00100000:2.0:1721880616.601193:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3687:x1805522011932544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1721880616.601230:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1437519872 avail 1308057600 00000100:00100000:2.0:1721880616.601297:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3687:x1805522011932544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880616.601305:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101200 00000100:00100000:0.0:1721880616.601337:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120346680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011932544:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1721880616.696976:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120346680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3689:1805522011932800:0@lo:400:kworker.0 00000100:00100000:2.0:1721880616.696976:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011932672:0@lo:400:kworker.0 00000100:00100000:3.0:1721880616.697005:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120345f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3686:1805522011932928:0@lo:400:kworker.0 00000100:00100000:0.0:1721880616.697043:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880616.697049:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880616.697068:0:15415:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011932800 00000100:00100000:3.0:1721880616.697076:0:15415:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011932800 00000100:00100000:2.0:1721880616.697092:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120345180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011933184:0@lo:400:kworker.0 00000100:00100000:0.0:1721880616.697095:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120347100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3689:1805522011933312:0@lo:400:kworker.0 00000100:00100000:2.0:1721880616.697115:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880616.697121:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120347800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011933056:0@lo:400:kworker.0 00000100:00100000:3.0:1721880616.697123:0:15415:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011933184 00000100:00100000:3.0:1721880616.697126:0:15415:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011933184 00000100:00100000:2.0:1721880616.697136:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120347b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011933696:0@lo:400:kworker.0 00000100:00100000:1.0:1721880616.697141:0:15432:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3245 00000100:00100000:0.0:1721880616.697142:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880616.697148:0:15432:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800913b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1805522011932800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880616.697155:0:15415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3246 00000100:00100000:0.0:1721880616.697157:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011933568:0@lo:400:kworker.0 00000100:00100000:3.0:1721880616.697161:0:15415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880125984a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011933184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880616.697163:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880616.697170:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880616.697193:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880616.697195:0:15432:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800913b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1805522011932800:12345-0@lo:400:kworker.0 Request processed in 48us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880616.697199:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011932672 00000100:00100000:1.0:1721880616.697200:0:15432:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3245 00000100:00100000:2.0:1721880616.697203:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011932672 00000100:00100000:0.0:1721880616.697205:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120346d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011933824:0@lo:400:kworker.0 00000100:00100000:3.0:1721880616.697205:0:15415:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880125984a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011933184:12345-0@lo:400:kworker.0 Request processed in 44us (89us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880616.697211:0:15415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3246 00000100:00100000:0.0:1721880616.697219:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880616.697230:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 652 00000100:00100000:1.0:1721880616.697233:0:15432:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011933568 00000100:00100000:1.0:1721880616.697235:0:15432:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011933568 00000100:00100000:2.0:1721880616.697235:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011932672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880616.697235:0:15415:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011933312 00000100:00100000:3.0:1721880616.697238:0:15415:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011933312 00000100:00100000:0.0:1721880616.697245:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120346680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3689:1805522011932800:0@lo:400:kworker.0 00000100:00100000:1.0:1721880616.697250:0:15432:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3247 00000100:00100000:1.0:1721880616.697253:0:15432:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011933568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880616.697256:0:15415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3248 00000100:00100000:3.0:1721880616.697261:0:15415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1805522011933312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880616.697267:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011932672:12345-0@lo:400:kworker.0 Request processed in 31us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880616.697273:0:15432:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011933568:12345-0@lo:400:kworker.0 Request processed in 19us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880616.697273:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 652 00000100:00100000:1.0:1721880616.697276:0:15432:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3247 00000100:00100000:0.0:1721880616.697279:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011933696 00000100:00100000:0.0:1721880616.697282:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011933696 00000100:00100000:3.0:1721880616.697298:0:15415:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1805522011933312:12345-0@lo:400:kworker.0 Request processed in 36us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880616.697302:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011933824 00000100:00100000:0.0:1721880616.697303:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011933824 00000100:00100000:3.0:1721880616.697304:0:15415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3248 00000100:00100000:1.0:1721880616.697310:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 535 00000100:00100000:1.0:1721880616.697313:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076e5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011933696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880616.697315:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 536 00000100:00100000:2.0:1721880616.697320:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011933824:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1721880616.697322:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880586 00000100:00080000:3.0:1721880616.697325:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880586 00000100:00080000:3.0:1721880616.697327:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880586 00000100:00100000:0.0:1721880616.697328:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011933568:0@lo:400:kworker.0 00000100:00100000:1.0:1721880616.697329:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880076e5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011933696:12345-0@lo:400:kworker.0 Request processed in 15us (166us total) trans 0 rc 0/0 00000100:00080000:3.0:1721880616.697329:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880586 00000100:00100000:1.0:1721880616.697333:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 535 00000100:00100000:0.0:1721880616.697344:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120347100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3689:1805522011933312:0@lo:400:kworker.0 00000100:00100000:3.0:1721880616.697348:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120347b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011933696:0@lo:400:kworker.0 00000100:00100000:0.0:1721880616.697350:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120346d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011933824:0@lo:400:kworker.0 00000100:00100000:2.0:1721880616.697351:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011933824:12345-0@lo:400:kworker.0 Request processed in 31us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880616.697356:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011932672:0@lo:400:kworker.0 00000100:00100000:2.0:1721880616.697357:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 536 00000100:00100000:1.0:1721880616.697364:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011933056 00000100:00100000:3.0:1721880616.697364:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120345180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011933184:0@lo:400:kworker.0 00000100:00100000:1.0:1721880616.697367:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011933056 00000100:00100000:1.0:1721880616.697384:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101201 00000100:00100000:3.0:1721880616.697387:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880616.697388:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011933056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880616.697402:0:15415:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011932928 00000100:00100000:3.0:1721880616.697402:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3686:1805522011933440:0@lo:400:kworker.0 00000100:00100000:1.0:1721880616.697406:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011933056:12345-0@lo:400:kworker.0 Request processed in 18us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880616.697406:0:15415:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011932928 00000100:00100000:1.0:1721880616.697409:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101201 00000100:00100000:0.0:1721880616.697412:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120347800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011933056:0@lo:400:kworker.0 00000100:00100000:3.0:1721880616.697422:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880616.697424:0:15415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3249 00000100:00100000:2.0:1721880616.697428:0:15415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f820a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3686:x1805522011932928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880616.697432:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011933440 00000100:00100000:1.0:1721880616.697434:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011933440 00000100:00080000:3.0:1721880616.697442:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880586 00000100:00100000:1.0:1721880616.697447:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3250 00000100:00100000:1.0:1721880616.697450:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f821c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3686:x1805522011933440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880616.697461:0:15415:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f820a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3686:x1805522011932928:12345-0@lo:400:kworker.0 Request processed in 31us (72us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880616.697466:0:7129:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f821c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3686:x1805522011933440:12345-0@lo:400:kworker.0 Request processed in 15us (44us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880616.697467:0:15415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3249 00000100:00100000:1.0:1721880616.697470:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3250 00000100:00100000:3.0:1721880616.697481:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120345f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3686:1805522011932928:0@lo:400:kworker.0 00000100:00100000:3.0:1721880616.697490:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3686:1805522011933440:0@lo:400:kworker.0 00000100:00100000:1.0:1721880616.744936:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880087745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011934080:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1721880616.744936:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120345500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011933952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1721880616.745003:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880616.745029:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880616.745089:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011933952 00000100:00100000:2.0:1721880616.745096:0:9461:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011934080 00000100:00100000:0.0:1721880616.745099:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011933952 00000100:00100000:2.0:1721880616.745101:0:9461:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011934080 00000100:00100000:2.0:1721880616.745152:0:9461:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 722 00000100:00100000:2.0:1721880616.745160:0:9461:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120345c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3687:x1805522011934080:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1721880616.745161:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 723 00000100:00100000:0.0:1721880616.745167:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f820000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011933952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1721880616.745192:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00002000:00000024:2.0:1721880616.745192:0:9461:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:2.0:1721880616.745253:0:9461:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880120345c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3687:x1805522011934080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880616.745258:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f820000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011933952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880616.745259:0:9461:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 722 00000100:00100000:0.0:1721880616.745265:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 723 00000100:00100000:1.0:1721880616.745269:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880087745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011934080:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1721880616.745269:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120345500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011933952:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1721880616.833049:0:8270:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880617.834987:0:7120:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880618.130100:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880618.130140:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880618.130174:0:7124:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257832064 00000100:00100000:0.0:1721880618.130177:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880618.130183:0:7124:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257832064 00000100:00100000:0.0:1721880618.130209:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880618.130226:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880618.130226:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 653 00000100:00100000:1.0:1721880618.130231:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2006:x1805522257832064:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880618.130237:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257832448 00000100:00100000:3.0:1721880618.130242:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257832448 00000100:00100000:0.0:1721880618.130244:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880618.130244:0:7130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257832192 00000100:00100000:2.0:1721880618.130249:0:7130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257832192 00000100:00100000:0.0:1721880618.130262:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880618.130270:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 537 00000100:00100000:3.0:1721880618.130274:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2007:x1805522257832448:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880618.130275:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880618.130279:0:7124:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2006:x1805522257832064:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 48us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880618.130279:0:7130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257832320 00000100:00100000:2.0:1721880618.130297:0:7130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257832320 00000100:00100000:1.0:1721880618.130300:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 653 00000100:00100000:2.0:1721880618.130309:0:7130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257832704 00000100:00100000:2.0:1721880618.130311:0:7130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257832704 00000100:00100000:2.0:1721880618.130318:0:7130:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257832832 00000100:00100000:2.0:1721880618.130319:0:7130:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257832832 00000100:00100000:3.0:1721880618.130321:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2007:x1805522257832448:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 46us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880618.130326:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 537 00000100:00100000:2.0:1721880618.130332:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3251 00000100:00100000:2.0:1721880618.130337:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2007:x1805522257832192:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880618.130339:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257832576 00000100:00100000:1.0:1721880618.130341:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257832576 00000100:00100000:1.0:1721880618.130371:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257832960 00000100:00100000:1.0:1721880618.130372:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257832960 00000100:00100000:3.0:1721880618.130376:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 538 00000100:00100000:3.0:1721880618.130380:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087745f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2006:x1805522257832576:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880618.130381:0:7130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2007:x1805522257832192:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 44us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880618.130383:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 539 00000100:00100000:1.0:1721880618.130386:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087745880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:30425778-2709-4512-9d75-01ec53c4cfad+280:2007:x1805522257832960:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880618.130386:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3251 00000100:00100000:2.0:1721880618.130399:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3252 00000100:00100000:1.0:1721880618.130402:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087745880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:30425778-2709-4512-9d75-01ec53c4cfad+280:2007:x1805522257832960:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 16us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880618.130402:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2006:x1805522257832320:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880618.130405:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880618.130406:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 539 00000100:00100000:3.0:1721880618.130408:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087745f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2006:x1805522257832576:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 26us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880618.130412:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257833088 00000100:00100000:1.0:1721880618.130413:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257833088 00000100:00100000:2.0:1721880618.130413:0:7130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2006:x1805522257832320:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 11us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880618.130414:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 538 00000100:00100000:2.0:1721880618.130417:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3252 00000100:00100000:1.0:1721880618.130423:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 540 00000100:00100000:2.0:1721880618.130424:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3253 00000100:00100000:1.0:1721880618.130425:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087745500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:30425778-2709-4512-9d75-01ec53c4cfad+665:2007:x1805522257833088:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880618.130426:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30425778-2709-4512-9d75-01ec53c4cfad+4135:2007:x1805522257832704:12345-192.168.201.24@tcp:400:kworker.0 00000100:00080000:3.0:1721880618.130433:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880588 00000100:00080000:3.0:1721880618.130436:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880588 00000100:00080000:3.0:1721880618.130438:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880588 00000100:00100000:1.0:1721880618.130439:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087745500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:30425778-2709-4512-9d75-01ec53c4cfad+665:2007:x1805522257833088:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 14us (34us total) trans 0 rc 0/0 00000100:00080000:3.0:1721880618.130440:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880588 00000100:00100000:2.0:1721880618.130441:0:7130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30425778-2709-4512-9d75-01ec53c4cfad+4135:2007:x1805522257832704:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 14us (215us total) trans 0 rc 0/0 00000100:00080000:3.0:1721880618.130442:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880588 00000100:00100000:1.0:1721880618.130443:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 540 00000100:00100000:2.0:1721880618.130444:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3253 00000100:00100000:2.0:1721880618.130450:0:7130:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3254 00000100:00100000:2.0:1721880618.130452:0:7130:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30425778-2709-4512-9d75-01ec53c4cfad+3694:2006:x1805522257832832:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880618.130461:0:7130:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30425778-2709-4512-9d75-01ec53c4cfad+3694:2006:x1805522257832832:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 9us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880618.130465:0:7130:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3254 00000100:00100000:0.0:1721880618.217003:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1721880618.217046:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880076e5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011934208:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1721880618.217108:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880618.217238:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011934208 00000100:00100000:1.0:1721880618.217247:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011934208 00000100:00100000:1.0:1721880618.217298:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101202 00000100:00100000:1.0:1721880618.217303:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3689:x1805522011934208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1721880618.217334:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1435709440 avail 1306247168 00000100:00100000:1.0:1721880618.217381:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3689:x1805522011934208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880618.217387:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101202 00000100:00100000:0.0:1721880618.217404:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880076e5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011934208:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1721880618.836997:0:15560:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721880619.839025:0:11721:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880620.841058:0:7119:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880621.112973:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88011f820e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011934336:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1721880621.113037:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880621.113107:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011934336 00000100:00100000:2.0:1721880621.113118:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011934336 00000100:00080000:3.0:1721880621.113164:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880591 00000100:00100000:2.0:1721880621.113187:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 724 00000100:00100000:2.0:1721880621.113195:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087746d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011934336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1721880621.113228:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:2.0:1721880621.113291:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087746d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011934336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880621.113300:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 724 00000100:00100000:0.0:1721880621.113311:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88011f820e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011934336:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1721880621.512943:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88011f822300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011934464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1721880621.512997:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880621.513097:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011934464 00000100:00100000:2.0:1721880621.513105:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011934464 00000100:00080000:3.0:1721880621.513142:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880591 00000100:00100000:2.0:1721880621.513151:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 725 00000100:00100000:2.0:1721880621.513156:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011934464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1721880621.513176:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:2.0:1721880621.513214:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011934464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880621.513218:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 725 00000100:00100000:0.0:1721880621.513231:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88011f822300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011934464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1721880621.608948:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880087745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011934592:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1721880621.609014:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880621.609064:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011934592 00000100:00100000:2.0:1721880621.609073:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011934592 00000100:00100000:2.0:1721880621.609128:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101203 00000100:00100000:2.0:1721880621.609136:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120346a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3687:x1805522011934592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1721880621.609172:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1437519872 avail 1308057600 00000100:00100000:2.0:1721880621.609258:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880120346a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3687:x1805522011934592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880621.609268:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101203 00000100:00100000:1.0:1721880621.609281:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880087745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011934592:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1721880621.704967:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120345500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3689:1805522011934848:0@lo:400:kworker.0 00000100:00100000:2.0:1721880621.704985:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120344e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011934720:0@lo:400:kworker.0 00000100:00100000:3.0:1721880621.704998:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3686:1805522011934976:0@lo:400:kworker.0 00000100:00100000:1.0:1721880621.705004:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120345f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011935104:0@lo:400:kworker.0 00000100:00100000:0.0:1721880621.705026:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880621.705031:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880621.705055:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880621.705056:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120347800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011935232:0@lo:400:kworker.0 00000100:00100000:1.0:1721880621.705060:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880621.705062:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120345180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3689:1805522011935360:0@lo:400:kworker.0 00000100:00100000:3.0:1721880621.705073:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3686:1805522011935488:0@lo:400:kworker.0 00000100:00100000:2.0:1721880621.705079:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880621.705090:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120347b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011935616:0@lo:400:kworker.0 00000100:00100000:3.0:1721880621.705091:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880621.705093:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120346d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011935744:0@lo:400:kworker.0 00000100:00100000:0.0:1721880621.705097:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011934848 00000100:00100000:0.0:1721880621.705104:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011934848 00000100:00100000:1.0:1721880621.705109:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880621.705110:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880621.705122:0:15423:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011934976 00000100:00100000:3.0:1721880621.705125:0:15423:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011934976 00000100:00100000:2.0:1721880621.705130:0:15415:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011935232 00000100:00100000:2.0:1721880621.705133:0:15415:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011935232 00000100:00100000:1.0:1721880621.705141:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011934720 00000100:00100000:1.0:1721880621.705145:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011934720 00000100:00100000:0.0:1721880621.705148:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011935488 00000100:00100000:3.0:1721880621.705150:0:15423:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011935616 00000100:00100000:0.0:1721880621.705151:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011935488 00000100:00100000:3.0:1721880621.705152:0:15423:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011935616 00000100:00100000:2.0:1721880621.705155:0:15415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3255 00000100:00100000:2.0:1721880621.705160:0:15415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087745180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1805522011934848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880621.705164:0:15423:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3256 00000100:00100000:3.0:1721880621.705169:0:15423:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f822300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:lustre-MDT0000-lwp-MDT0001_UUID+5:3686:x1805522011934976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880621.705170:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3257 00000100:00100000:1.0:1721880621.705171:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 654 00000100:00100000:1.0:1721880621.705174:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011934720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880621.705175:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076e5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011935232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880621.705193:0:15415:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087745180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1805522011934848:12345-0@lo:400:kworker.0 Request processed in 33us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880621.705197:0:15415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3255 00000100:00100000:1.0:1721880621.705203:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011934720:12345-0@lo:400:kworker.0 Request processed in 28us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880621.705204:0:15423:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f822300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:lustre-MDT0000-lwp-MDT0001_UUID+5:3686:x1805522011934976:12345-0@lo:400:kworker.0 Request processed in 34us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880621.705207:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 654 00000100:00100000:0.0:1721880621.705208:0:7129:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880076e5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011935232:12345-0@lo:400:kworker.0 Request processed in 33us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880621.705208:0:15423:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3256 00000100:00100000:0.0:1721880621.705212:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3257 00000100:00100000:2.0:1721880621.705214:0:15415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3258 00000100:00100000:2.0:1721880621.705216:0:15415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120346680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011935616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880621.705227:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3259 00000100:00100000:0.0:1721880621.705229:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f820e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3686:x1805522011935488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880621.705233:0:15415:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880120346680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011935616:12345-0@lo:400:kworker.0 Request processed in 15us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880621.705236:0:15415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3258 00000100:00100000:1.0:1721880621.705238:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011935744 00000100:00100000:1.0:1721880621.705240:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011935744 00000100:00080000:3.0:1721880621.705241:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880591 00000100:00100000:0.0:1721880621.705242:0:7129:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f820e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3686:x1805522011935488:12345-0@lo:400:kworker.0 Request processed in 12us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880621.705245:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3259 00000100:00080000:3.0:1721880621.705245:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880591 00000100:00080000:3.0:1721880621.705247:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880591 00000100:00080000:3.0:1721880621.705249:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880591 00000100:00100000:2.0:1721880621.705255:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011935104 00000100:00100000:1.0:1721880621.705256:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 541 00000100:00100000:2.0:1721880621.705257:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011935104 00000100:00100000:1.0:1721880621.705258:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011935744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880621.705263:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880621.705272:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120347100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011935872:0@lo:400:kworker.0 00000100:00100000:3.0:1721880621.705272:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3686:1805522011934976:0@lo:400:kworker.0 00000100:00100000:2.0:1721880621.705273:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101204 00000100:00100000:1.0:1721880621.705275:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880076e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011935744:12345-0@lo:400:kworker.0 Request processed in 16us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880621.705276:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011935104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880621.705279:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 541 00000100:00100000:3.0:1721880621.705282:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3686:1805522011935488:0@lo:400:kworker.0 00000100:00100000:0.0:1721880621.705286:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880621.705290:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011935360 00000100:00100000:1.0:1721880621.705292:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011935360 00000100:00100000:2.0:1721880621.705292:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880120344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011935104:12345-0@lo:400:kworker.0 Request processed in 16us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880621.705296:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101204 00000100:00100000:0.0:1721880621.705300:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120345500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3689:1805522011934848:0@lo:400:kworker.0 00000100:00080000:3.0:1721880621.705303:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880591 00000100:00100000:1.0:1721880621.705304:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3260 00000100:00100000:1.0:1721880621.705307:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1805522011935360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880621.705313:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120346d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011935744:0@lo:400:kworker.0 00000100:00100000:2.0:1721880621.705318:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120344e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011934720:0@lo:400:kworker.0 00000100:00100000:0.0:1721880621.705320:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011935872 00000100:00100000:0.0:1721880621.705321:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011935872 00000100:00100000:1.0:1721880621.705323:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1805522011935360:12345-0@lo:400:kworker.0 Request processed in 15us (59us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880621.705323:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120347800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011935232:0@lo:400:kworker.0 00000100:00100000:1.0:1721880621.705327:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3260 00000100:00080000:3.0:1721880621.705334:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880591 00000100:00100000:0.0:1721880621.705340:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 542 00000100:00100000:1.0:1721880621.705342:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120345f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011935104:0@lo:400:kworker.0 00000100:00100000:0.0:1721880621.705344:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087a1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011935872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880621.705348:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120347b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011935616:0@lo:400:kworker.0 00000100:00100000:0.0:1721880621.705370:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087a1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011935872:12345-0@lo:400:kworker.0 Request processed in 25us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880621.705375:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 542 00000100:00100000:0.0:1721880621.705401:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120345180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3689:1805522011935360:0@lo:400:kworker.0 00000100:00100000:0.0:1721880621.705409:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120347100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011935872:0@lo:400:kworker.0 00000100:00100000:1.0:1721880621.752885:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880087a1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011936128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1721880621.752885:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120347b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011936000:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1721880621.752939:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880621.752964:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880621.753014:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011936000 00000100:00100000:0.0:1721880621.753016:0:9461:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011936128 00000100:00100000:0.0:1721880621.753022:0:9461:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011936128 00000100:00100000:2.0:1721880621.753022:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011936000 00000100:00100000:0.0:1721880621.753059:0:9461:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 726 00000100:00100000:0.0:1721880621.753065:0:9461:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120345f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011936128:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1721880621.753070:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 727 00000100:00100000:2.0:1721880621.753076:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cc70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011936000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1721880621.753094:0:9461:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00002000:00000024:2.0:1721880621.753094:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:2.0:1721880621.753143:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cc70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011936000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880621.753150:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 727 00000100:00100000:3.0:1721880621.753155:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120347b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011936000:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1721880621.753156:0:9461:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880120345f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011936128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880621.753156:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880087a1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011936128:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1721880621.753162:0:9461:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 726 00010000:00010000:2.0:1721880621.842941:0:8270:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880622.845016:0:7120:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880623.138556:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880623.138611:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880623.138676:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880623.138693:0:7124:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257833216 00000100:00100000:0.0:1721880623.138700:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880623.138706:0:7124:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257833216 00000100:00100000:0.0:1721880623.138719:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880623.138801:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257833344 00000100:00100000:1.0:1721880623.138811:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257833344 00000100:00100000:3.0:1721880623.138830:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 655 00000100:00100000:0.0:1721880623.138837:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880623.138840:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2007:x1805522257833216:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880623.138867:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257833472 00000100:00100000:1.0:1721880623.138870:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257833472 00000100:00100000:2.0:1721880623.138878:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257833600 00000100:00100000:1.0:1721880623.138889:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257833984 00000100:00100000:2.0:1721880623.138889:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257833600 00000100:00100000:1.0:1721880623.138892:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257833984 00000100:00100000:0.0:1721880623.138894:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880623.138910:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257833856 00000100:00100000:1.0:1721880623.138912:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257833856 00000100:00100000:0.0:1721880623.138924:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880623.138930:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3261 00000100:00100000:3.0:1721880623.138932:0:7124:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2007:x1805522257833216:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 90us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880623.138938:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087a1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2006:x1805522257833344:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880623.138940:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257833728 00000100:00100000:2.0:1721880623.138944:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257833728 00000100:00100000:3.0:1721880623.138945:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 655 00000100:00100000:2.0:1721880623.138969:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257834240 00000100:00100000:2.0:1721880623.138972:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257834240 00000100:00100000:1.0:1721880623.138986:0:7129:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087a1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2006:x1805522257833344:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 48us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880623.138993:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3261 00000100:00100000:2.0:1721880623.139000:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 543 00000100:00100000:2.0:1721880623.139011:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087a1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2006:x1805522257833600:12345-192.168.201.24@tcp:400:kworker.0 00000100:00080000:3.0:1721880623.139014:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880593 00000100:00100000:1.0:1721880623.139019:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3262 00000100:00080000:3.0:1721880623.139020:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880593 00000100:00100000:1.0:1721880623.139024:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087a1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2007:x1805522257833472:12345-192.168.201.24@tcp:400:kworker.0 00000100:00080000:3.0:1721880623.139024:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880593 00000100:00080000:3.0:1721880623.139028:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880593 00000100:00080000:3.0:1721880623.139031:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880593 00000100:00100000:1.0:1721880623.139045:0:7129:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087a1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2007:x1805522257833472:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 20us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880623.139053:0:15434:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3263 00000100:00100000:3.0:1721880623.139062:0:15434:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087a1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:30425778-2709-4512-9d75-01ec53c4cfad+3694:2007:x1805522257833984:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880623.139063:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3262 00000100:00100000:2.0:1721880623.139071:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087a1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2006:x1805522257833600:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 60us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880623.139078:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3264 00000100:00100000:1.0:1721880623.139082:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30425778-2709-4512-9d75-01ec53c4cfad+4135:2006:x1805522257833856:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880623.139083:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 543 00000100:00100000:0.0:1721880623.139096:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880623.139106:0:7129:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30425778-2709-4512-9d75-01ec53c4cfad+4135:2006:x1805522257833856:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 23us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880623.139111:0:15434:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087a1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:30425778-2709-4512-9d75-01ec53c4cfad+3694:2007:x1805522257833984:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 48us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880623.139113:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3264 00000100:00100000:2.0:1721880623.139122:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257834112 00000100:00100000:3.0:1721880623.139123:0:15434:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3263 00000100:00100000:2.0:1721880623.139127:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257834112 00000100:00100000:1.0:1721880623.139146:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 544 00000100:00100000:1.0:1721880623.139151:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087a1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2007:x1805522257833728:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880623.139167:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 545 00000100:00100000:1.0:1721880623.139172:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087a1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2007:x1805522257833728:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 21us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880623.139176:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087a1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:30425778-2709-4512-9d75-01ec53c4cfad+665:2007:x1805522257834240:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880623.139179:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 544 00000100:00100000:3.0:1721880623.139187:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 546 00000100:00100000:3.0:1721880623.139196:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087a1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:30425778-2709-4512-9d75-01ec53c4cfad+280:2006:x1805522257834112:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880623.139224:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087a1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:30425778-2709-4512-9d75-01ec53c4cfad+665:2007:x1805522257834240:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 47us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880623.139234:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 545 00000100:00100000:3.0:1721880623.139240:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087a1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:30425778-2709-4512-9d75-01ec53c4cfad+280:2006:x1805522257834112:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 44us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880623.139251:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 546 00000100:00080000:3.0:1721880623.139278:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880593 00000100:00100000:1.0:1721880623.225006:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1721880623.225032:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880087a1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011936256:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1721880623.225104:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880623.225192:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011936256 00000100:00100000:3.0:1721880623.225204:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011936256 00000100:00100000:3.0:1721880623.225272:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101205 00000100:00100000:3.0:1721880623.225283:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120347b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3689:x1805522011936256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1721880623.225329:0:15587:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1435709440 avail 1306247168 00000100:00100000:3.0:1721880623.225412:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880120347b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3689:x1805522011936256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 129us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880623.225421:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101205 00000100:00100000:1.0:1721880623.225452:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880087a1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011936256:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1721880623.846928:0:15560:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721880624.849048:0:11721:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880625.850917:0:7119:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1721880626.120924:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880087a1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011936384:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1721880626.120984:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880626.121024:0:9461:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011936384 00000100:00100000:0.0:1721880626.121031:0:9461:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011936384 00000100:00100000:0.0:1721880626.121073:0:9461:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 728 00000100:00100000:0.0:1721880626.121079:0:9461:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120347100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011936384:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1721880626.121085:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880596 00002000:00000024:0.0:1721880626.121107:0:9461:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:0.0:1721880626.121153:0:9461:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880120347100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011936384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880626.121160:0:9461:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 728 00000100:00100000:1.0:1721880626.121188:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880087a1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011936384:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1721880626.520911:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880087a1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011936512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1721880626.520968:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880626.521013:0:9461:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011936512 00000100:00100000:0.0:1721880626.521020:0:9461:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011936512 00000100:00080000:3.0:1721880626.521052:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880596 00000100:00100000:0.0:1721880626.521073:0:9461:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 729 00000100:00100000:0.0:1721880626.521079:0:9461:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cc72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011936512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1721880626.521100:0:9461:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:0.0:1721880626.521151:0:9461:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cc72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011936512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880626.521158:0:9461:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 729 00000100:00100000:3.0:1721880626.521169:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880087a1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011936512:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1721880626.616927:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120345180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011936640:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1721880626.616985:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880626.617026:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011936640 00000100:00100000:3.0:1721880626.617033:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011936640 00000100:00100000:3.0:1721880626.617074:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101206 00000100:00100000:3.0:1721880626.617079:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076e5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+19:3687:x1805522011936640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1721880626.617109:0:15587:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1437519872 avail 1308057600 00000100:00100000:3.0:1721880626.617145:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880076e5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+19:3687:x1805522011936640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880626.617150:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101206 00000100:00100000:2.0:1721880626.617162:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120345180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011936640:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1721880626.712892:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120347800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011936768:0@lo:400:kworker.0 00000100:00100000:3.0:1721880626.712909:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120346d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3686:1805522011937024:0@lo:400:kworker.0 00000100:00100000:0.0:1721880626.712912:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120344e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3689:1805522011936896:0@lo:400:kworker.0 00000100:00100000:1.0:1721880626.712935:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120345500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011937152:0@lo:400:kworker.0 00000100:00100000:2.0:1721880626.712946:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880626.712951:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880626.712966:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011936768 00000100:00100000:0.0:1721880626.712972:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011936768 00000100:00100000:3.0:1721880626.712977:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120345180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3686:1805522011937536:0@lo:400:kworker.0 00000100:00100000:1.0:1721880626.712980:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880626.712985:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011937280:0@lo:400:kworker.0 00000100:00100000:3.0:1721880626.712989:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880626.713005:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013076ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011937664:0@lo:400:kworker.0 00000100:00100000:0.0:1721880626.713008:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 656 00000100:00100000:2.0:1721880626.713008:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1721880626.713012:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880596 00000100:00100000:0.0:1721880626.713013:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011936768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880626.713020:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880626.713022:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880130769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011937792:0@lo:400:kworker.0 00000100:00100000:3.0:1721880626.713023:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011937152 00000100:00100000:3.0:1721880626.713026:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011937152 00000100:00100000:2.0:1721880626.713046:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880626.713052:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101207 00000100:00100000:1.0:1721880626.713053:0:15415:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011937024 00000100:00100000:3.0:1721880626.713055:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011937152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880626.713057:0:15415:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011937024 00000100:00100000:0.0:1721880626.713060:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011936768:12345-0@lo:400:kworker.0 Request processed in 46us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880626.713069:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120347800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011936768:0@lo:400:kworker.0 00000100:00100000:0.0:1721880626.713070:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 656 00000100:00100000:1.0:1721880626.713082:0:15415:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011937536 00000100:00100000:3.0:1721880626.713082:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880130768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011937152:12345-0@lo:400:kworker.0 Request processed in 26us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880626.713084:0:15415:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011937536 00000100:00100000:3.0:1721880626.713085:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101207 00000100:00100000:2.0:1721880626.713086:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1721880626.713089:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880130769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011937920:0@lo:400:kworker.0 00000100:00100000:1.0:1721880626.713098:0:15415:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011937280 00000100:00100000:1.0:1721880626.713100:0:15415:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011937280 00000100:00100000:2.0:1721880626.713100:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880626.713106:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880626.713113:0:15415:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011937664 00000100:00100000:1.0:1721880626.713114:0:15415:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011937664 00000100:00100000:3.0:1721880626.713114:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011937792 00000100:00100000:3.0:1721880626.713115:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011937792 00000100:00100000:2.0:1721880626.713120:0:15420:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011936896 00000100:00100000:0.0:1721880626.713122:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3689:1805522011937408:0@lo:400:kworker.0 00000100:00100000:2.0:1721880626.713123:0:15420:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011936896 00000100:00100000:1.0:1721880626.713127:0:15415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3265 00000100:00100000:3.0:1721880626.713129:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011937920 00000100:00100000:3.0:1721880626.713130:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011937920 00000100:00100000:1.0:1721880626.713131:0:15415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008cc70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3686:x1805522011937024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880626.713137:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880626.713139:0:15420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3266 00000100:00100000:3.0:1721880626.713139:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 547 00000100:00100000:3.0:1721880626.713141:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076e5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011937792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880626.713143:0:15420:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-OST0001_UUID+5:3686:x1805522011937536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880626.713161:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880076e5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011937792:12345-0@lo:400:kworker.0 Request processed in 20us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880626.713162:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011937408 00000100:00100000:1.0:1721880626.713163:0:15415:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008cc70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3686:x1805522011937024:12345-0@lo:400:kworker.0 Request processed in 31us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880626.713164:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 547 00000100:00100000:0.0:1721880626.713165:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011937408 00000100:00100000:2.0:1721880626.713165:0:15420:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-OST0001_UUID+5:3686:x1805522011937536:12345-0@lo:400:kworker.0 Request processed in 22us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880626.713169:0:15415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3265 00000100:00100000:3.0:1721880626.713171:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 548 00000100:00100000:2.0:1721880626.713172:0:15420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3266 00000100:00100000:3.0:1721880626.713173:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076e5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+5:3688:x1805522011937920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880626.713184:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3267 00000100:00100000:3.0:1721880626.713184:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880076e5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+5:3688:x1805522011937920:12345-0@lo:400:kworker.0 Request processed in 10us (84us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880626.713187:0:15415:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3268 00000100:00100000:0.0:1721880626.713188:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076e5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011937280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880626.713188:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 548 00000100:00100000:2.0:1721880626.713191:0:15420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3269 00000100:00100000:1.0:1721880626.713192:0:15415:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011937664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880626.713195:0:15420:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087a1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1805522011936896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880626.713199:0:15432:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3270 00000100:00100000:3.0:1721880626.713201:0:15432:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087a1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1805522011937408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880626.713216:0:7129:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880076e5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011937280:12345-0@lo:400:kworker.0 Request processed in 28us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880626.713217:0:15415:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011937664:12345-0@lo:400:kworker.0 Request processed in 25us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880626.713221:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3267 00000100:00100000:1.0:1721880626.713223:0:15415:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3268 00000100:00100000:3.0:1721880626.713228:0:15432:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087a1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1805522011937408:12345-0@lo:400:kworker.0 Request processed in 26us (91us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880626.713229:0:15420:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087a1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1805522011936896:12345-0@lo:400:kworker.0 Request processed in 33us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880626.713231:0:15432:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3270 00000100:00100000:2.0:1721880626.713235:0:15420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3269 00000100:00080000:3.0:1721880626.713247:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880596 00000100:00080000:3.0:1721880626.713249:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880596 00000100:00080000:3.0:1721880626.713250:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880596 00000100:00100000:1.0:1721880626.713259:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120345500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011937152:0@lo:400:kworker.0 00000100:00100000:3.0:1721880626.713263:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120346d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3686:1805522011937024:0@lo:400:kworker.0 00000100:00100000:0.0:1721880626.713268:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120344e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3689:1805522011936896:0@lo:400:kworker.0 00000100:00100000:1.0:1721880626.713269:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013076ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011937664:0@lo:400:kworker.0 00000100:00100000:3.0:1721880626.713269:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120345180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3686:1805522011937536:0@lo:400:kworker.0 00000100:00100000:2.0:1721880626.713272:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880130769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011937920:0@lo:400:kworker.0 00000100:00100000:0.0:1721880626.713276:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3689:1805522011937408:0@lo:400:kworker.0 00000100:00100000:2.0:1721880626.713280:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011937280:0@lo:400:kworker.0 00000100:00100000:2.0:1721880626.713285:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880130769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011937792:0@lo:400:kworker.0 00000100:00100000:0.0:1721880626.760915:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011938176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1721880626.760915:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011938048:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1721880626.760974:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880626.761002:0:9461:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011938048 00000100:00100000:0.0:1721880626.761009:0:9461:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011938048 00000100:00100000:1.0:1721880626.761032:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880626.761057:0:9461:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011938176 00000100:00100000:0.0:1721880626.761059:0:9461:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011938176 00000100:00100000:0.0:1721880626.761073:0:9461:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 730 00000100:00100000:0.0:1721880626.761079:0:9461:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880076e5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011938048:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1721880626.761079:0:9462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 731 00000100:00100000:2.0:1721880626.761085:0:9462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011938176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1721880626.761106:0:9461:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00002000:00000024:2.0:1721880626.761106:0:9462:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:0.0:1721880626.761144:0:9461:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880076e5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011938048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880626.761144:0:9462:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011938176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880626.761149:0:9461:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 730 00000100:00100000:2.0:1721880626.761152:0:9462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 731 00000100:00100000:3.0:1721880626.761161:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011938048:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1721880626.761162:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e3dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011938176:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1721880626.852902:0:8270:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880627.854899:0:7120:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880628.146069:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880628.146105:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880628.146122:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880628.146130:0:7124:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257834368 00000100:00100000:2.0:1721880628.146139:0:7124:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257834368 00000100:00100000:0.0:1721880628.146141:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880628.146153:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880628.146162:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880628.146162:0:15416:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257834496 00000100:00100000:3.0:1721880628.146168:0:15416:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257834496 00000100:00100000:0.0:1721880628.146173:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880628.146179:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 657 00000100:00100000:0.0:1721880628.146180:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880628.146181:0:15477:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257834624 00000100:00100000:2.0:1721880628.146184:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2004:x1805522257834368:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880628.146186:0:15477:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257834624 00000100:00100000:3.0:1721880628.146200:0:15416:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257835008 00000100:00100000:3.0:1721880628.146203:0:15416:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257835008 00000100:00100000:0.0:1721880628.146205:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880628.146206:0:15477:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257835136 00000100:00100000:1.0:1721880628.146208:0:15477:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257835136 00000100:00100000:2.0:1721880628.146229:0:7124:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2004:x1805522257834368:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 45us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880628.146231:0:15416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3271 00000100:00100000:2.0:1721880628.146233:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 657 00000100:00100000:1.0:1721880628.146237:0:15477:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3272 00000100:00100000:3.0:1721880628.146237:0:15416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087a1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2005:x1805522257834496:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880628.146241:0:15477:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087a1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2004:x1805522257834624:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880628.146242:0:15420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3273 00000100:00100000:0.0:1721880628.146246:0:15420:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087a1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:30425778-2709-4512-9d75-01ec53c4cfad+4135:2005:x1805522257835008:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880628.146262:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257834752 00000100:00100000:2.0:1721880628.146264:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257834752 00000100:00100000:3.0:1721880628.146270:0:15416:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087a1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2005:x1805522257834496:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 33us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880628.146271:0:15477:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087a1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2004:x1805522257834624:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 30us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880628.146273:0:15420:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087a1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:30425778-2709-4512-9d75-01ec53c4cfad+4135:2005:x1805522257835008:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 27us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880628.146275:0:15477:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3272 00000100:00100000:2.0:1721880628.146279:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257834880 00000100:00100000:3.0:1721880628.146279:0:15416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3271 00000100:00100000:2.0:1721880628.146280:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257834880 00000100:00100000:0.0:1721880628.146282:0:15420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3273 00000100:00100000:2.0:1721880628.146289:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257835264 00000100:00100000:2.0:1721880628.146290:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257835264 00000100:00100000:1.0:1721880628.146292:0:15477:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3274 00000100:00100000:1.0:1721880628.146294:0:15477:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ea6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:30425778-2709-4512-9d75-01ec53c4cfad+3694:2004:x1805522257835136:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880628.146297:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257835392 00000100:00100000:2.0:1721880628.146298:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257835392 00000100:00100000:1.0:1721880628.146305:0:15477:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ea6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:30425778-2709-4512-9d75-01ec53c4cfad+3694:2004:x1805522257835136:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 10us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880628.146308:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 549 00000100:00100000:1.0:1721880628.146309:0:15477:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3274 00000100:00100000:2.0:1721880628.146311:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087a1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2005:x1805522257834752:12345-192.168.201.24@tcp:400:kworker.0 00000100:00080000:3.0:1721880628.146313:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880598 00000100:00080000:3.0:1721880628.146317:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880598 00000100:00080000:3.0:1721880628.146319:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880598 00000100:00080000:3.0:1721880628.146321:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880598 00000100:00080000:3.0:1721880628.146323:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880598 00000100:00100000:1.0:1721880628.146324:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 550 00000100:00100000:2.0:1721880628.146325:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087a1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2005:x1805522257834752:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 13us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880628.146326:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087a1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2004:x1805522257834880:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880628.146328:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 549 00000100:00100000:3.0:1721880628.146336:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 551 00000100:00100000:1.0:1721880628.146338:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880087a1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2004:x1805522257834880:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 11us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880628.146341:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ea4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:30425778-2709-4512-9d75-01ec53c4cfad+280:2005:x1805522257835264:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880628.146342:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 552 00000100:00100000:1.0:1721880628.146345:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 550 00000100:00100000:2.0:1721880628.146345:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ea5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:30425778-2709-4512-9d75-01ec53c4cfad+665:2004:x1805522257835392:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880628.146355:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ea5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:30425778-2709-4512-9d75-01ec53c4cfad+665:2004:x1805522257835392:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 10us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880628.146358:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 552 00000100:00100000:3.0:1721880628.146361:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ea4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:30425778-2709-4512-9d75-01ec53c4cfad+280:2005:x1805522257835264:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 19us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880628.146366:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 551 00000100:00100000:0.0:1721880628.232960:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1721880628.232978:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011938304:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1721880628.233030:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880628.233088:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011938304 00000100:00100000:3.0:1721880628.233097:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011938304 00000100:00100000:3.0:1721880628.233146:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101208 00000100:00100000:3.0:1721880628.233152:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ea5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3689:x1805522011938304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1721880628.233184:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1435709440 avail 1306247168 00000100:00100000:3.0:1721880628.233237:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ea5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3689:x1805522011938304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880628.233243:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101208 00000100:00100000:0.0:1721880628.233276:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e3dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011938304:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1721880628.856943:0:15560:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721880629.858990:0:11721:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880630.860996:0:7119:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880631.128934:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011938432:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1721880631.129000:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880631.129048:0:9462:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011938432 00000100:00100000:2.0:1721880631.129065:0:9462:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011938432 00000100:00100000:2.0:1721880631.129185:0:9462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 732 00000100:00100000:2.0:1721880631.129202:0:9462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ea7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011938432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1721880631.129258:0:9462:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00080000:3.0:1721880631.129266:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880601 00000100:00100000:2.0:1721880631.129378:0:9462:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ea7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011938432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 181us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880631.129387:0:9462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 732 00000100:00100000:0.0:1721880631.129488:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e3dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011938432:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1721880631.528934:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1721880631.528957:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011938560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1721880631.529018:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880631.529159:0:9462:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011938560 00000100:00100000:2.0:1721880631.529174:0:9462:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011938560 00000100:00100000:2.0:1721880631.529254:0:9462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 733 00000100:00100000:2.0:1721880631.529262:0:9462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011938560:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1721880631.529267:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880601 00002000:00000024:2.0:1721880631.529295:0:9462:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:2.0:1721880631.529386:0:9462:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3687:x1805522011938560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880631.529393:0:9462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 733 00000100:00100000:1.0:1721880631.529421:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011938560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1721880631.625136:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880120345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011938688:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1721880631.625246:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880631.625323:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011938688 00000100:00100000:3.0:1721880631.625330:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011938688 00000100:00100000:3.0:1721880631.625369:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101209 00000100:00100000:3.0:1721880631.625373:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3687:x1805522011938688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1721880631.625404:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1437519872 avail 1308057600 00000100:00100000:3.0:1721880631.625445:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3687:x1805522011938688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880631.625450:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101209 00000100:00100000:1.0:1721880631.625476:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880120345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011938688:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1721880631.720969:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011939200:0@lo:400:kworker.0 00000100:00100000:2.0:1721880631.720981:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011938816:0@lo:400:kworker.0 00000100:00100000:0.0:1721880631.720987:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3686:1805522011939072:0@lo:400:kworker.0 00000100:00100000:1.0:1721880631.721033:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880631.721085:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011939712:0@lo:400:kworker.0 00000100:00100000:0.0:1721880631.721093:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880631.721093:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880631.721093:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011939200 00000100:00100000:3.0:1721880631.721100:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011939200 00000100:00100000:1.0:1721880631.721130:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011939072 00000100:00100000:1.0:1721880631.721133:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011939072 00000100:00100000:3.0:1721880631.721151:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101210 00000100:00100000:2.0:1721880631.721156:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011939328:0@lo:400:kworker.0 00000100:00100000:1.0:1721880631.721158:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3275 00000100:00100000:0.0:1721880631.721159:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3686:1805522011939584:0@lo:400:kworker.0 00000100:00100000:3.0:1721880631.721160:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011939200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880631.721162:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-MDT0001_UUID+5:3686:x1805522011939072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880631.721193:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880631.721213:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011939200:12345-0@lo:400:kworker.0 Request processed in 54us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880631.721219:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101210 00000100:00100000:1.0:1721880631.721223:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-MDT0001_UUID+5:3686:x1805522011939072:12345-0@lo:400:kworker.0 Request processed in 59us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880631.721225:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011939840:0@lo:400:kworker.0 00000100:00100000:0.0:1721880631.721228:0:15423:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011939328 00000100:00100000:1.0:1721880631.721231:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3275 00000100:00100000:0.0:1721880631.721237:0:15423:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011939328 00000100:00100000:2.0:1721880631.721262:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880631.721263:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1721880631.721272:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880601 00000100:00100000:3.0:1721880631.721287:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011939840 00000100:00100000:3.0:1721880631.721290:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011939840 00000100:00100000:0.0:1721880631.721295:0:15423:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011939584 00000100:00100000:2.0:1721880631.721297:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1721880631.721299:0:15423:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011939584 00000100:00100000:2.0:1721880631.721306:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3688:1805522011938944:0@lo:400:kworker.0 00000100:00100000:1.0:1721880631.721308:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e3df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3686:1805522011939072:0@lo:400:kworker.0 00000100:00100000:3.0:1721880631.721314:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 553 00000100:00100000:3.0:1721880631.721317:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120344e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011939840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880631.721324:0:15423:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3276 00000100:00100000:0.0:1721880631.721332:0:15423:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120344380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011939328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880631.721334:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880631.721339:0:15477:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3277 00000100:00100000:3.0:1721880631.721343:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880120344e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011939840:12345-0@lo:400:kworker.0 Request processed in 26us (83us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880631.721344:0:15477:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-lwp-OST0001_UUID+5:3686:x1805522011939584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880631.721347:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 553 00000100:00100000:2.0:1721880631.721356:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3688:1805522011939456:0@lo:400:kworker.0 00000100:00080000:3.0:1721880631.721361:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880601 00000100:00080000:3.0:1721880631.721363:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880601 00000100:00100000:1.0:1721880631.721373:0:15477:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-lwp-OST0001_UUID+5:3686:x1805522011939584:12345-0@lo:400:kworker.0 Request processed in 29us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880631.721376:0:15477:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3277 00000100:00100000:3.0:1721880631.721378:0:15420:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011938944 00000100:00100000:3.0:1721880631.721381:0:15420:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011938944 00000100:00100000:2.0:1721880631.721385:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880631.721397:0:15477:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011939456 00000100:00100000:1.0:1721880631.721399:0:15477:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011939456 00000100:00100000:0.0:1721880631.721404:0:15423:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880120344380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011939328:12345-0@lo:400:kworker.0 Request processed in 70us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880631.721406:0:15420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3278 00000100:00100000:2.0:1721880631.721408:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011939968:0@lo:400:kworker.0 00000100:00100000:3.0:1721880631.721410:0:15420:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120345180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-MDT0000_UUID+5:3688:x1805522011938944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880631.721414:0:15423:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3276 00000100:00100000:1.0:1721880631.721419:0:15477:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3279 00000100:00100000:1.0:1721880631.721422:0:15477:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120346d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:lustre-MDT0001-lwp-OST0000_UUID+5:3688:x1805522011939456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880631.721434:0:15420:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880120345180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-MDT0000_UUID+5:3688:x1805522011938944:12345-0@lo:400:kworker.0 Request processed in 24us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880631.721438:0:15420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3278 00000100:00100000:2.0:1721880631.721441:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880631.721442:0:15477:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880120346d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:lustre-MDT0001-lwp-OST0000_UUID+5:3688:x1805522011939456:12345-0@lo:400:kworker.0 Request processed in 19us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880631.721446:0:15477:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3279 00000100:00080000:3.0:1721880631.721457:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880601 00000100:00100000:1.0:1721880631.721468:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e3df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3686:1805522011939584:0@lo:400:kworker.0 00000100:00100000:3.0:1721880631.721472:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011938816 00000100:00100000:3.0:1721880631.721474:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011938816 00000100:00100000:2.0:1721880631.721477:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e3de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011939328:0@lo:400:kworker.0 00000100:00100000:1.0:1721880631.721482:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880631.721513:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 658 00000100:00100000:1.0:1721880631.721514:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e3de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011939200:0@lo:400:kworker.0 00000100:00100000:3.0:1721880631.721517:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133037c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011938816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880631.721520:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e3ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011939840:0@lo:400:kworker.0 00000100:00100000:3.0:1721880631.721536:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880133037c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011938816:12345-0@lo:400:kworker.0 Request processed in 19us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880631.721537:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011939712 00000100:00100000:3.0:1721880631.721540:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 658 00000100:00100000:0.0:1721880631.721543:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011939712 00000100:00080000:3.0:1721880631.721560:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880601 00000100:00080000:3.0:1721880631.721562:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880601 00000100:00100000:2.0:1721880631.721563:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e3ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3688:1805522011938944:0@lo:400:kworker.0 00000100:00100000:0.0:1721880631.721576:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3280 00000100:00100000:2.0:1721880631.721577:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e3dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3688:1805522011939456:0@lo:400:kworker.0 00000100:00100000:0.0:1721880631.721584:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011939712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880631.721591:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e3ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011938816:0@lo:400:kworker.0 00000100:00100000:2.0:1721880631.721634:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011939968 00000100:00100000:2.0:1721880631.721639:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011939968 00000100:00100000:0.0:1721880631.721653:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011939712:12345-0@lo:400:kworker.0 Request processed in 68us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880631.721663:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3280 00000100:00100000:1.0:1721880631.721669:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e3dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011939712:0@lo:400:kworker.0 00000100:00100000:2.0:1721880631.721691:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 554 00000100:00100000:2.0:1721880631.721699:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120345500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+5:3688:x1805522011939968:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1721880631.721701:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880601 00000100:00100000:2.0:1721880631.721811:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880120345500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+5:3688:x1805522011939968:12345-0@lo:400:kworker.0 Request processed in 94us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880631.721817:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 554 00000100:00100000:0.0:1721880631.721845:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e3dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011939968:0@lo:400:kworker.0 00000100:00100000:0.0:1721880631.769096:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011940224:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1721880631.769210:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880631.769300:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1721880631.769312:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011940096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1721880631.769341:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880631.769369:0:9462:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011940224 00000100:00100000:2.0:1721880631.769382:0:9462:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011940224 00000100:00100000:2.0:1721880631.769457:0:9462:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011940096 00000100:00100000:2.0:1721880631.769459:0:9462:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011940096 00000100:00100000:2.0:1721880631.769489:0:9462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 734 00000100:00100000:2.0:1721880631.769530:0:9462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ea5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011940224:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1721880631.769549:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 735 00000100:00100000:3.0:1721880631.769567:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ea6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011940096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1721880631.769574:0:9462:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00002000:00000024:3.0:1721880631.769604:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:2.0:1721880631.769640:0:9462:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ea5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011940224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 144us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880631.769648:0:9462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 734 00000100:00100000:0.0:1721880631.769698:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011940224:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1721880631.769707:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ea6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011940096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 144us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880631.769733:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 735 00000100:00100000:0.0:1721880631.769842:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e3dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011940096:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1721880631.863034:0:8270:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880632.865079:0:7120:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880633.154814:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880633.154879:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880633.154912:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880633.154954:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880633.154974:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880633.154977:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257835648 00000100:00100000:2.0:1721880633.154991:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257835648 00000100:00100000:0.0:1721880633.154995:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880633.154995:0:15434:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257836160 00000100:00100000:3.0:1721880633.155001:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257835904 00000100:00100000:1.0:1721880633.155009:0:15434:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257836160 00000100:00100000:3.0:1721880633.155011:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257835904 00000100:00100000:0.0:1721880633.155015:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880633.155045:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880633.155073:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257836416 00000100:00100000:2.0:1721880633.155077:0:15426:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257835776 00000100:00100000:3.0:1721880633.155077:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257836416 00000100:00100000:2.0:1721880633.155080:0:15426:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257835776 00000100:00100000:1.0:1721880633.155083:0:15434:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257836288 00000100:00100000:1.0:1721880633.155085:0:15434:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257836288 00000100:00100000:3.0:1721880633.155099:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257836032 00000100:00100000:3.0:1721880633.155103:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257836032 00000100:00100000:2.0:1721880633.155111:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3281 00000100:00100000:0.0:1721880633.155112:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880633.155121:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ea4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2004:x1805522257835648:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880633.155126:0:15434:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3282 00000100:00100000:1.0:1721880633.155133:0:15434:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:30425778-2709-4512-9d75-01ec53c4cfad+4135:2004:x1805522257836160:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880633.155135:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257836544 00000100:00100000:3.0:1721880633.155139:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257836544 00000100:00100000:0.0:1721880633.155171:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 555 00000100:00100000:3.0:1721880633.155184:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 556 00000100:00100000:0.0:1721880633.155185:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ea6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2004:x1805522257835904:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880633.155194:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ea7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:30425778-2709-4512-9d75-01ec53c4cfad+280:2004:x1805522257836416:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880633.155226:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ea4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2004:x1805522257835648:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 106us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880633.155231:0:15434:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:30425778-2709-4512-9d75-01ec53c4cfad+4135:2004:x1805522257836160:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 98us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880633.155235:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3281 00000100:00100000:0.0:1721880633.155236:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ea6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2004:x1805522257835904:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 54us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880633.155240:0:15434:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3282 00000100:00100000:0.0:1721880633.155245:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 555 00000100:00100000:3.0:1721880633.155246:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ea7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:30425778-2709-4512-9d75-01ec53c4cfad+280:2004:x1805522257836416:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 52us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880633.155257:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 556 00000100:00100000:2.0:1721880633.155266:0:15426:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3283 00000100:00100000:1.0:1721880633.155272:0:15434:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3284 00000100:00100000:2.0:1721880633.155273:0:15426:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2005:x1805522257835776:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880633.155277:0:15434:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ea5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:30425778-2709-4512-9d75-01ec53c4cfad+3694:2005:x1805522257836288:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880633.155295:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 557 00000100:00100000:2.0:1721880633.155301:0:15426:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2005:x1805522257835776:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 28us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880633.155302:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2005:x1805522257836032:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880633.155304:0:15434:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ea5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:30425778-2709-4512-9d75-01ec53c4cfad+3694:2005:x1805522257836288:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 26us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880633.155309:0:15426:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3283 00000100:00100000:3.0:1721880633.155311:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 558 00000100:00100000:1.0:1721880633.155313:0:15434:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3284 00000100:00100000:3.0:1721880633.155319:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ea4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:30425778-2709-4512-9d75-01ec53c4cfad+665:2005:x1805522257836544:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880633.155328:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2005:x1805522257836032:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 26us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880633.155335:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 557 00000100:00100000:3.0:1721880633.155354:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ea4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:30425778-2709-4512-9d75-01ec53c4cfad+665:2005:x1805522257836544:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 34us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880633.155363:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 558 00000100:00100000:0.0:1721880633.155399:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257835520 00000100:00100000:0.0:1721880633.155404:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257835520 00000100:00080000:3.0:1721880633.155407:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880603 00000100:00080000:3.0:1721880633.155413:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880603 00000100:00080000:3.0:1721880633.155418:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880603 00000100:00080000:3.0:1721880633.155421:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880603 00000100:00080000:3.0:1721880633.155424:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880603 00000100:00100000:0.0:1721880633.155455:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 659 00000100:00100000:0.0:1721880633.155460:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133037850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4976b229-99ef-4953-87e9-78e1b901883f+12:2005:x1805522257835520:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880633.155509:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880133037850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4976b229-99ef-4953-87e9-78e1b901883f+12:2005:x1805522257835520:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 47us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880633.155516:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 659 00000100:00100000:2.0:1721880633.241108:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880131ea6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011940352:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1721880633.241206:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880633.241280:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011940352 00000100:00100000:3.0:1721880633.241291:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011940352 00000100:00100000:3.0:1721880633.241346:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101211 00000100:00100000:3.0:1721880633.241351:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120347800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011940352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1721880633.241383:0:15587:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1435709440 avail 1306247168 00000100:00100000:3.0:1721880633.241462:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880120347800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3688:x1805522011940352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880633.241484:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101211 00000100:00100000:2.0:1721880633.241562:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880131ea6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011940352:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1721880633.867034:0:15560:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721880634.869092:0:11721:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880635.870946:0:7119:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1721880636.137007:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880131ea6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011940480:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1721880636.137070:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880636.137169:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011940480 00000100:00100000:3.0:1721880636.137180:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011940480 00000100:00080000:0.0:1721880636.137246:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880606 00000100:00100000:3.0:1721880636.137256:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 736 00000100:00100000:3.0:1721880636.137266:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011940480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1721880636.137298:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:3.0:1721880636.137362:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011940480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880636.137371:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 736 00000100:00100000:1.0:1721880636.137406:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880131ea6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011940480:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1721880636.536928:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011940608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1721880636.536991:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880636.537050:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011940608 00000100:00100000:3.0:1721880636.537057:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011940608 00000100:00080000:0.0:1721880636.537095:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880606 00000100:00100000:3.0:1721880636.537098:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 737 00000100:00100000:3.0:1721880636.537103:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011940608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1721880636.537123:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:3.0:1721880636.537156:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011940608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880636.537160:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 737 00000100:00100000:0.0:1721880636.537181:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e3df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011940608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1721880636.632918:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011940736:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1721880636.632970:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880636.633025:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011940736 00000100:00100000:3.0:1721880636.633032:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011940736 00000100:00100000:3.0:1721880636.633072:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101212 00000100:00100000:3.0:1721880636.633078:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880120345880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+19:3687:x1805522011940736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1721880636.633111:0:15587:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1437519872 avail 1308057600 00000100:00100000:3.0:1721880636.633159:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880120345880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+19:3687:x1805522011940736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880636.633164:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101212 00000100:00100000:2.0:1721880636.633183:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e3df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011940736:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1721880636.728985:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011940864:0@lo:400:kworker.0 00000100:00100000:0.0:1721880636.728991:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3686:1805522011941120:0@lo:400:kworker.0 00000100:00100000:3.0:1721880636.729003:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011941248:0@lo:400:kworker.0 00000100:00100000:2.0:1721880636.729059:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880636.729061:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880636.729062:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880636.729094:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011941376:0@lo:400:kworker.0 00000100:00100000:3.0:1721880636.729096:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011941760:0@lo:400:kworker.0 00000100:00100000:0.0:1721880636.729099:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3686:1805522011941632:0@lo:400:kworker.0 00000100:00100000:2.0:1721880636.729117:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880636.729119:0:15432:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011941120 00000100:00100000:0.0:1721880636.729120:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3689:1805522011940992:0@lo:400:kworker.0 00000100:00100000:3.0:1721880636.729125:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011941248 00000100:00100000:1.0:1721880636.729127:0:15432:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011941120 00000100:00100000:3.0:1721880636.729129:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011941248 00000100:00100000:0.0:1721880636.729147:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880636.729151:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880130769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011941888:0@lo:400:kworker.0 00000100:00100000:0.0:1721880636.729158:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3689:1805522011941504:0@lo:400:kworker.0 00000100:00100000:0.0:1721880636.729169:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880636.729173:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880636.729175:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880130769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011942016:0@lo:400:kworker.0 00000100:00100000:1.0:1721880636.729175:0:15432:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011941376 00000100:00100000:1.0:1721880636.729178:0:15432:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011941376 00000100:00100000:3.0:1721880636.729178:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101213 00000100:00100000:3.0:1721880636.729183:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011941248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880636.729187:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880636.729195:0:15432:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011940992 00000100:00100000:1.0:1721880636.729197:0:15432:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011940992 00000100:00100000:2.0:1721880636.729201:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011940864 00000100:00100000:2.0:1721880636.729204:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011940864 00000100:00100000:1.0:1721880636.729207:0:15432:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011941504 00000100:00100000:1.0:1721880636.729209:0:15432:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011941504 00000100:00100000:0.0:1721880636.729213:0:15431:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3285 00000100:00100000:0.0:1721880636.729219:0:15431:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800887a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-MDT0001_UUID+5:3686:x1805522011941120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880636.729223:0:15432:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3286 00000100:00100000:2.0:1721880636.729224:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 660 00000100:00100000:3.0:1721880636.729224:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011941248:12345-0@lo:400:kworker.0 Request processed in 40us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880636.729227:0:15432:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011941376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880636.729227:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133037450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011940864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880636.729230:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101213 00000100:00100000:0.0:1721880636.729252:0:15431:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800887a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-MDT0001_UUID+5:3686:x1805522011941120:12345-0@lo:400:kworker.0 Request processed in 33us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880636.729253:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880133037450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3688:x1805522011940864:12345-0@lo:400:kworker.0 Request processed in 25us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880636.729257:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 660 00000100:00100000:0.0:1721880636.729259:0:15431:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3285 00000100:00100000:3.0:1721880636.729266:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880636.729267:0:15432:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-OST0000_UUID+5:3688:x1805522011941376:12345-0@lo:400:kworker.0 Request processed in 39us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880636.729272:0:15432:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3286 00000100:00100000:2.0:1721880636.729280:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011941888 00000100:00100000:0.0:1721880636.729281:0:15431:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011941760 00000100:00100000:2.0:1721880636.729282:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011941888 00000100:00100000:1.0:1721880636.729283:0:15432:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3287 00000100:00100000:0.0:1721880636.729285:0:15431:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011941760 00000100:00100000:1.0:1721880636.729286:0:15432:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800887a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1805522011940992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880636.729289:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e3dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011941248:0@lo:400:kworker.0 00000100:00100000:2.0:1721880636.729296:0:16081:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011942016 00000100:00100000:2.0:1721880636.729297:0:16081:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011942016 00000100:00100000:0.0:1721880636.729305:0:15431:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3288 00000100:00100000:2.0:1721880636.729306:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 559 00000100:00100000:1.0:1721880636.729307:0:15432:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800887a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-MDT0000_UUID+5:3689:x1805522011940992:12345-0@lo:400:kworker.0 Request processed in 19us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880636.729308:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011941888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880636.729309:0:15431:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800887abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1805522011941504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880636.729311:0:15432:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3287 00000100:00100000:1.0:1721880636.729322:0:15432:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3289 00000100:00100000:1.0:1721880636.729325:0:15432:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011941760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880636.729326:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011941888:12345-0@lo:400:kworker.0 Request processed in 17us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880636.729329:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 559 00000100:00100000:0.0:1721880636.729331:0:15431:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800887abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001-lwp-OST0000_UUID+5:3689:x1805522011941504:12345-0@lo:400:kworker.0 Request processed in 23us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880636.729333:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 560 00000100:00100000:0.0:1721880636.729335:0:15431:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3288 00000100:00100000:3.0:1721880636.729336:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800887ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011942016:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1721880636.729349:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880606 00000100:00080000:0.0:1721880636.729351:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880606 00000100:00080000:0.0:1721880636.729352:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880606 00000100:00080000:0.0:1721880636.729354:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880606 00000100:00100000:1.0:1721880636.729355:0:15432:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0001-lwp-OST0001_UUID+5:3687:x1805522011941760:12345-0@lo:400:kworker.0 Request processed in 28us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880636.729357:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880130769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011941888:0@lo:400:kworker.0 00000100:00100000:3.0:1721880636.729357:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800887ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011942016:12345-0@lo:400:kworker.0 Request processed in 20us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880636.729360:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 560 00000100:00100000:1.0:1721880636.729361:0:15432:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3289 00000100:00100000:2.0:1721880636.729364:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e3dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0603f996-9d5e-4498-85ba-9976a06b304f:3688:1805522011940864:0@lo:400:kworker.0 00000100:00100000:0.0:1721880636.729366:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e3dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3689:1805522011940992:0@lo:400:kworker.0 00000100:00100000:0.0:1721880636.729371:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e3ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3689:1805522011941504:0@lo:400:kworker.0 00000100:00100000:2.0:1721880636.729372:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e3ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3688:1805522011941376:0@lo:400:kworker.0 00000100:00100000:0.0:1721880636.729376:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880130769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011942016:0@lo:400:kworker.0 00000100:00100000:3.0:1721880636.729377:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e3df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3687:1805522011941760:0@lo:400:kworker.0 00000100:00100000:0.0:1721880636.729392:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880636.729404:0:15434:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011941632 00000100:00100000:0.0:1721880636.729405:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e3ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3686:1805522011941120:0@lo:400:kworker.0 00000100:00100000:3.0:1721880636.729406:0:15434:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011941632 00000100:00080000:1.0:1721880636.729438:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880606 00000100:00100000:3.0:1721880636.729442:0:15434:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3290 00000100:00100000:3.0:1721880636.729444:0:15434:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800887aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0000-lwp-OST0001_UUID+5:3686:x1805522011941632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880636.729464:0:15434:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800887aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0000-lwp-OST0001_UUID+5:3686:x1805522011941632:12345-0@lo:400:kworker.0 Request processed in 19us (72us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880636.729467:0:15434:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3290 00000100:00100000:0.0:1721880636.729473:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e3de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3686:1805522011941632:0@lo:400:kworker.0 00000100:00100000:0.0:1721880636.776912:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013076ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011942272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1721880636.776974:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880636.777010:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011942144:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1721880636.777012:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011942272 00000100:00100000:3.0:1721880636.777019:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011942272 00000100:00100000:0.0:1721880636.777024:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880636.777060:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011942144 00000100:00100000:3.0:1721880636.777063:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011942144 00000100:00100000:3.0:1721880636.777088:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 738 00000100:00100000:3.0:1721880636.777094:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800887a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011942272:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1721880636.777097:0:9461:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 739 00000100:00100000:1.0:1721880636.777105:0:9461:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800887a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011942144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1721880636.777121:0:9461:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00002000:00000024:3.0:1721880636.777121:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:3.0:1721880636.777160:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800887a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011942272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880636.777165:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 738 00000100:00100000:1.0:1721880636.777166:0:9461:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800887a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011942144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880636.777172:0:9461:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 739 00000100:00100000:0.0:1721880636.777173:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013076ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011942272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1721880636.777181:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011942144:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1721880636.872909:0:8270:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880637.874934:0:7120:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880638.162160:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880638.162196:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880638.162212:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880638.162218:0:7124:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257836672 00000100:00100000:2.0:1721880638.162230:0:7124:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257836672 00000100:00100000:0.0:1721880638.162231:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880638.162237:0:15434:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257836800 00000100:00100000:3.0:1721880638.162241:0:15434:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257836800 00000100:00100000:0.0:1721880638.162242:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880638.162255:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880638.162264:0:15416:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257836928 00000100:00100000:1.0:1721880638.162269:0:15416:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257836928 00000100:00100000:0.0:1721880638.162272:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880638.162281:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 661 00000100:00100000:3.0:1721880638.162281:0:15434:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257837312 00000100:00100000:3.0:1721880638.162284:0:15434:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257837312 00000100:00100000:2.0:1721880638.162288:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133037050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2004:x1805522257836672:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880638.162289:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880638.162294:0:15416:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257837440 00000100:00100000:1.0:1721880638.162297:0:15416:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257837440 00000100:00100000:3.0:1721880638.162300:0:15434:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3291 00000100:00100000:3.0:1721880638.162305:0:15434:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800887a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2005:x1805522257836800:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880638.162311:0:15416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3292 00000100:00100000:1.0:1721880638.162317:0:15416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800887ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2004:x1805522257836928:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880638.162328:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880638.162352:0:15434:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800887a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2005:x1805522257836800:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 46us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880638.162353:0:7124:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880133037050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2004:x1805522257836672:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 65us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880638.162359:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 661 00000100:00100000:3.0:1721880638.162359:0:15434:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3291 00000100:00100000:1.0:1721880638.162362:0:15416:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800887ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2004:x1805522257836928:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 44us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880638.162370:0:15416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3292 00000100:00080000:2.0:1721880638.162404:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880608 00000100:00100000:3.0:1721880638.162405:0:15434:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3293 00000100:00080000:2.0:1721880638.162407:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880608 00000100:00100000:1.0:1721880638.162409:0:15416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3294 00000100:00080000:2.0:1721880638.162409:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880608 00000100:00100000:3.0:1721880638.162409:0:15434:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800887aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:30425778-2709-4512-9d75-01ec53c4cfad+4135:2005:x1805522257837312:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880638.162414:0:15416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800887a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:30425778-2709-4512-9d75-01ec53c4cfad+3694:2004:x1805522257837440:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880638.162424:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257837056 00000100:00100000:2.0:1721880638.162426:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257837056 00000100:00100000:3.0:1721880638.162437:0:15434:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800887aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:30425778-2709-4512-9d75-01ec53c4cfad+4135:2005:x1805522257837312:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 27us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880638.162441:0:15416:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800887a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:30425778-2709-4512-9d75-01ec53c4cfad+3694:2004:x1805522257837440:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 26us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880638.162443:0:15434:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3293 00000100:00100000:1.0:1721880638.162446:0:15416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3294 00000100:00100000:2.0:1721880638.162449:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257837184 00000100:00100000:2.0:1721880638.162451:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257837184 00000100:00100000:1.0:1721880638.162461:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257837568 00000100:00100000:1.0:1721880638.162463:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257837568 00000100:00100000:2.0:1721880638.162463:0:16101:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257837696 00000100:00100000:2.0:1721880638.162465:0:16101:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257837696 00000100:00100000:3.0:1721880638.162472:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 561 00000100:00100000:3.0:1721880638.162476:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800887aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2005:x1805522257837056:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880638.162481:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 562 00000100:00100000:1.0:1721880638.162484:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800887a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2004:x1805522257837184:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880638.162487:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 563 00000100:00100000:2.0:1721880638.162491:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800887ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:30425778-2709-4512-9d75-01ec53c4cfad+280:2005:x1805522257837568:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880638.162501:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800887a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2004:x1805522257837184:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 16us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880638.162501:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800887aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2005:x1805522257837056:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 25us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880638.162505:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 562 00000100:00100000:3.0:1721880638.162508:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 561 00000100:00100000:2.0:1721880638.162511:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800887ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:30425778-2709-4512-9d75-01ec53c4cfad+280:2005:x1805522257837568:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 19us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880638.162512:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 564 00000100:00100000:1.0:1721880638.162514:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800887a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:30425778-2709-4512-9d75-01ec53c4cfad+665:2004:x1805522257837696:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880638.162516:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 563 00000100:00100000:1.0:1721880638.162526:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800887a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:30425778-2709-4512-9d75-01ec53c4cfad+665:2004:x1805522257837696:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 11us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880638.162530:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 564 00000100:00080000:2.0:1721880638.162534:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880608 00000100:00080000:2.0:1721880638.162536:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880608 00000100:00100000:3.0:1721880638.248925:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011942400:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1721880638.248974:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880638.249028:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011942400 00000100:00100000:0.0:1721880638.249040:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011942400 00000100:00100000:0.0:1721880638.249107:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101214 00000100:00100000:0.0:1721880638.249115:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011942400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1721880638.249154:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1435709440 avail 1306247168 00000100:00100000:0.0:1721880638.249239:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011942400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 124us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880638.249246:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101214 00000100:00100000:3.0:1721880638.249257:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007ca5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011942400:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1721880638.876981:0:15560:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880639.878961:0:11721:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880640.880957:0:7119:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880641.144941:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1721880641.144960:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013076ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011942528:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1721880641.145035:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880641.145082:0:9461:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011942528 00000100:00100000:1.0:1721880641.145090:0:9461:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011942528 00000100:00080000:2.0:1721880641.145127:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880611 00000100:00100000:1.0:1721880641.145140:0:9461:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 740 00000100:00100000:1.0:1721880641.145146:0:9461:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800887a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011942528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1721880641.145174:0:9461:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:1.0:1721880641.145220:0:9461:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800887a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011942528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880641.145226:0:9461:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 740 00000100:00100000:0.0:1721880641.145253:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013076ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011942528:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1721880641.544921:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800887aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011942656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1721880641.544981:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880641.545081:0:9461:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011942656 00000100:00100000:1.0:1721880641.545089:0:9461:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011942656 00000100:00080000:2.0:1721880641.545125:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880611 00000100:00100000:1.0:1721880641.545131:0:9461:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 741 00000100:00100000:1.0:1721880641.545136:0:9461:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011942656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1721880641.545154:0:9461:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:1.0:1721880641.545188:0:9461:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011942656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880641.545192:0:9461:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 741 00000100:00100000:2.0:1721880641.545211:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800887aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011942656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1721880641.640951:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88007ca5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011942784:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1721880641.641009:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880641.641097:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011942784 00000100:00100000:2.0:1721880641.641104:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011942784 00000100:00100000:2.0:1721880641.641143:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101215 00000100:00100000:2.0:1721880641.641148:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800887aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3686:x1805522011942784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1721880641.641175:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1437519872 avail 1308057600 00000100:00100000:2.0:1721880641.641228:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800887aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3686:x1805522011942784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880641.641235:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101215 00000100:00100000:0.0:1721880641.641271:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88007ca5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011942784:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1721880641.736944:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880130769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0603f996-9d5e-4498-85ba-9976a06b304f:3687:1805522011942912:0@lo:400:kworker.0 00000100:00100000:0.0:1721880641.736947:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880131eeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011943296:0@lo:400:kworker.0 00000100:00100000:2.0:1721880641.736964:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880130769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3688:1805522011943040:0@lo:400:kworker.0 00000100:00100000:0.0:1721880641.737003:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880641.737004:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880641.737005:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880641.737030:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880131eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3687:1805522011943424:0@lo:400:kworker.0 00000100:00100000:2.0:1721880641.737035:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880131eed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3688:1805522011943552:0@lo:400:kworker.0 00000100:00100000:0.0:1721880641.737041:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880131eeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3686:1805522011943808:0@lo:400:kworker.0 00000100:00100000:3.0:1721880641.737044:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880641.737049:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88013076ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3689:1805522011943168:0@lo:400:kworker.0 00000100:00100000:1.0:1721880641.737051:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011943296 00000100:00100000:3.0:1721880641.737053:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880131eed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011943936:0@lo:400:kworker.0 00000100:00100000:0.0:1721880641.737054:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880641.737059:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011943296 00000100:00100000:2.0:1721880641.737065:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880641.737069:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880641.737076:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880131eec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011944064:0@lo:400:kworker.0 00000100:00100000:0.0:1721880641.737083:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011943040 00000100:00100000:0.0:1721880641.737086:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011943040 00000100:00100000:2.0:1721880641.737087:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880641.737090:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011942912 00000100:00100000:3.0:1721880641.737092:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011942912 00000100:00100000:1.0:1721880641.737095:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101216 00000100:00100000:1.0:1721880641.737101:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3686:x1805522011943296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880641.737105:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011943424 00000100:00100000:0.0:1721880641.737107:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011943424 00000100:00100000:2.0:1721880641.737108:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011943936 00000100:00100000:2.0:1721880641.737111:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011943936 00000100:00100000:3.0:1721880641.737115:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 662 00000100:00100000:0.0:1721880641.737116:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011943808 00000100:00100000:0.0:1721880641.737117:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011943808 00000100:00100000:3.0:1721880641.737118:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133036c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3687:x1805522011942912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880641.737125:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011943552 00000100:00100000:0.0:1721880641.737126:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011943552 00000100:00100000:2.0:1721880641.737128:0:16017:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011944064 00000100:00100000:2.0:1721880641.737130:0:16017:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011944064 00000100:00100000:0.0:1721880641.737135:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3295 00000100:00100000:0.0:1721880641.737138:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ca5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3688:x1805522011943040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880641.737140:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 565 00000100:00100000:3.0:1721880641.737140:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880133036c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3687:x1805522011942912:12345-0@lo:400:kworker.0 Request processed in 21us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880641.737143:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3687:x1805522011943936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880641.737144:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 662 00000100:00100000:1.0:1721880641.737148:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3686:x1805522011943296:12345-0@lo:400:kworker.0 Request processed in 47us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880641.737153:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101216 00000100:00100000:0.0:1721880641.737162:0:7129:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ca5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3688:x1805522011943040:12345-0@lo:400:kworker.0 Request processed in 23us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880641.737165:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0001-mdtlov_UUID+5:3687:x1805522011943936:12345-0@lo:400:kworker.0 Request processed in 21us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880641.737166:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3295 00000100:00100000:2.0:1721880641.737169:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 565 00000100:00100000:1.0:1721880641.737180:0:15432:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3296 00000100:00100000:0.0:1721880641.737183:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3297 00000100:00100000:2.0:1721880641.737183:0:16017:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 566 00000100:00100000:1.0:1721880641.737185:0:15432:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-OST0000_UUID+5:3687:x1805522011943424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880641.737186:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3686:x1805522011943808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880641.737186:0:15431:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3298 00000100:00100000:2.0:1721880641.737187:0:16017:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+5:3688:x1805522011944064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880641.737189:0:15431:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001-lwp-OST0000_UUID+5:3688:x1805522011943552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880641.737199:0:7129:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3686:x1805522011943808:12345-0@lo:400:kworker.0 Request processed in 13us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880641.737202:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3297 00000100:00100000:3.0:1721880641.737212:0:15431:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001-lwp-OST0000_UUID+5:3688:x1805522011943552:12345-0@lo:400:kworker.0 Request processed in 22us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880641.737218:0:16017:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_023:lustre-MDT0000-mdtlov_UUID+5:3688:x1805522011944064:12345-0@lo:400:kworker.0 Request processed in 30us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880641.737218:0:15431:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3298 00000100:00100000:1.0:1721880641.737219:0:15432:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-OST0000_UUID+5:3687:x1805522011943424:12345-0@lo:400:kworker.0 Request processed in 34us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880641.737224:0:16017:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 566 00000100:00100000:1.0:1721880641.737226:0:15432:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3296 00000100:00100000:0.0:1721880641.737229:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880131eeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3686:1805522011943808:0@lo:400:kworker.0 00000100:00100000:0.0:1721880641.737234:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880131eeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011943296:0@lo:400:kworker.0 00000100:00080000:2.0:1721880641.737243:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880611 00000100:00080000:2.0:1721880641.737246:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880611 00000100:00080000:2.0:1721880641.737248:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880611 00000100:00080000:2.0:1721880641.737250:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880611 00000100:00100000:3.0:1721880641.737254:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880131eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3687:1805522011943424:0@lo:400:kworker.0 00000100:00100000:3.0:1721880641.737265:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880131eed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011943936:0@lo:400:kworker.0 00000100:00100000:2.0:1721880641.737268:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880131eec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011944064:0@lo:400:kworker.0 00000100:00100000:3.0:1721880641.737272:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880130769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0603f996-9d5e-4498-85ba-9976a06b304f:3687:1805522011942912:0@lo:400:kworker.0 00000100:00100000:2.0:1721880641.737276:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880130769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3688:1805522011943040:0@lo:400:kworker.0 00000100:00100000:2.0:1721880641.737280:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880131eed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3688:1805522011943552:0@lo:400:kworker.0 00000100:00100000:2.0:1721880641.737302:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880641.737312:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880131eee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3689:1805522011943680:0@lo:400:kworker.0 00000100:00100000:1.0:1721880641.737317:0:15416:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011943168 00000100:00100000:1.0:1721880641.737321:0:15416:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011943168 00000100:00100000:2.0:1721880641.737324:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880641.737373:0:15432:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011943680 00000100:00100000:0.0:1721880641.737377:0:15432:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011943680 00000100:00080000:2.0:1721880641.737407:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880611 00000100:00100000:0.0:1721880641.737415:0:15432:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3299 00000100:00100000:0.0:1721880641.737420:0:15432:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-OST0001_UUID+5:3689:x1805522011943680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880641.737450:0:15432:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880130769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-OST0001_UUID+5:3689:x1805522011943680:12345-0@lo:400:kworker.0 Request processed in 29us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880641.737456:0:15432:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3299 00000100:00100000:2.0:1721880641.737463:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880131eee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3689:1805522011943680:0@lo:400:kworker.0 00000100:00100000:1.0:1721880641.737500:0:15416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3300 00000100:00100000:1.0:1721880641.737504:0:15416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3689:x1805522011943168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880641.737531:0:15416:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880130769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3689:x1805522011943168:12345-0@lo:400:kworker.0 Request processed in 27us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880641.737535:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88013076ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3689:1805522011943168:0@lo:400:kworker.0 00000100:00100000:1.0:1721880641.737536:0:15416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3300 00000100:00100000:1.0:1721880641.784933:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1721880641.784935:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880131eec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011944320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1721880641.784946:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880122c1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011944192:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1721880641.784990:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880641.785010:0:9461:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011944320 00000100:00100000:2.0:1721880641.785013:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880641.785015:0:9461:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011944320 00000100:00100000:1.0:1721880641.785040:0:9461:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011944192 00000100:00100000:1.0:1721880641.785041:0:9461:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011944192 00000100:00100000:1.0:1721880641.785052:0:9461:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 742 00000100:00100000:2.0:1721880641.785057:0:9462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 743 00000100:00100000:1.0:1721880641.785058:0:9461:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011944320:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1721880641.785062:0:9462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013076ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011944192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1721880641.785080:0:9461:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00002000:00000024:2.0:1721880641.785080:0:9462:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:2.0:1721880641.785116:0:9462:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88013076ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011944192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880641.785123:0:9462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 743 00000100:00100000:1.0:1721880641.785130:0:9461:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1805522011944320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880641.785134:0:9461:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 742 00000100:00100000:3.0:1721880641.785137:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880122c1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011944192:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1721880641.785143:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880131eec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011944320:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1721880641.882893:0:8270:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880642.884930:0:7120:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880643.170136:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880643.170175:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880643.170198:0:15416:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257837952 00000100:00100000:0.0:1721880643.170199:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880643.170207:0:15416:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257837952 00000100:00100000:0.0:1721880643.170217:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880643.170232:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880643.170249:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880643.170252:0:7124:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257837824 00000100:00100000:2.0:1721880643.170256:0:7124:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257837824 00000100:00100000:1.0:1721880643.170258:0:15416:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257838080 00000100:00100000:1.0:1721880643.170261:0:15416:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257838080 00000100:00100000:0.0:1721880643.170264:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880643.170274:0:15416:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257838464 00000100:00100000:1.0:1721880643.170276:0:15416:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257838464 00000100:00100000:0.0:1721880643.170278:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880643.170286:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 663 00000100:00100000:1.0:1721880643.170288:0:15416:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257838592 00000100:00100000:1.0:1721880643.170290:0:15416:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257838592 00000100:00100000:2.0:1721880643.170292:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133036850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2005:x1805522257837824:12345-192.168.201.24@tcp:400:kworker.0 00000100:00080000:3.0:1721880643.170296:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880613 00000100:00080000:3.0:1721880643.170300:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880613 00000100:00080000:3.0:1721880643.170310:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880613 00000100:00100000:0.0:1721880643.170320:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880643.170320:0:15416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3301 00000100:00100000:1.0:1721880643.170326:0:15416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2004:x1805522257837952:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880643.170326:0:11334:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3302 00000100:00100000:3.0:1721880643.170331:0:11334:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2005:x1805522257838080:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880643.170345:0:15432:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3303 00000100:00100000:0.0:1721880643.170351:0:15432:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:30425778-2709-4512-9d75-01ec53c4cfad+4135:2004:x1805522257838464:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880643.170351:0:7124:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880133036850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2005:x1805522257837824:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 59us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880643.170356:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 663 00000100:00100000:1.0:1721880643.170358:0:15416:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2004:x1805522257837952:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 32us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880643.170362:0:11334:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2005:x1805522257838080:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 32us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880643.170364:0:15416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3301 00000100:00100000:3.0:1721880643.170367:0:11334:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3302 00000100:00100000:0.0:1721880643.170377:0:15432:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:30425778-2709-4512-9d75-01ec53c4cfad+4135:2004:x1805522257838464:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 26us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880643.170382:0:15416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3304 00000100:00100000:2.0:1721880643.170384:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257838208 00000100:00100000:0.0:1721880643.170386:0:15432:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3303 00000100:00100000:1.0:1721880643.170386:0:15416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:30425778-2709-4512-9d75-01ec53c4cfad+3694:2005:x1805522257838592:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880643.170386:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257838208 00000100:00080000:3.0:1721880643.170396:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880613 00000100:00100000:2.0:1721880643.170402:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257838336 00000100:00100000:2.0:1721880643.170403:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257838336 00000100:00100000:1.0:1721880643.170404:0:15416:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:30425778-2709-4512-9d75-01ec53c4cfad+3694:2005:x1805522257838592:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 17us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880643.170406:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257838720 00000100:00100000:1.0:1721880643.170409:0:15416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3304 00000100:00100000:3.0:1721880643.170409:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257838720 00000100:00100000:0.0:1721880643.170411:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257838848 00000100:00100000:0.0:1721880643.170414:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257838848 00000100:00100000:2.0:1721880643.170415:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 567 00000100:00100000:2.0:1721880643.170418:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c849050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2004:x1805522257838208:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880643.170426:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 568 00000100:00100000:3.0:1721880643.170429:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2005:x1805522257838336:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880643.170430:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 569 00000100:00100000:2.0:1721880643.170433:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c849050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2004:x1805522257838208:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 14us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880643.170434:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:30425778-2709-4512-9d75-01ec53c4cfad+280:2004:x1805522257838720:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880643.170438:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 570 00000100:00100000:0.0:1721880643.170441:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:30425778-2709-4512-9d75-01ec53c4cfad+665:2005:x1805522257838848:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880643.170445:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 567 00000100:00100000:3.0:1721880643.170445:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2005:x1805522257838336:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 15us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880643.170451:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 568 00000100:00100000:1.0:1721880643.170453:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:30425778-2709-4512-9d75-01ec53c4cfad+280:2004:x1805522257838720:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 18us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880643.170456:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:30425778-2709-4512-9d75-01ec53c4cfad+665:2005:x1805522257838848:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 14us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880643.170459:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 569 00000100:00100000:0.0:1721880643.170461:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 570 00000100:00080000:3.0:1721880643.170469:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880613 00000100:00080000:3.0:1721880643.170470:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880613 00000100:00100000:3.0:1721880643.256997:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011944448:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1721880643.257049:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880643.257084:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011944448 00000100:00100000:0.0:1721880643.257091:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011944448 00000100:00100000:0.0:1721880643.257133:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101217 00000100:00100000:0.0:1721880643.257137:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011944448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1721880643.257164:0:15587:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1435709440 avail 1306247168 00000100:00100000:0.0:1721880643.257209:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011944448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880643.257214:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101217 00000100:00100000:3.0:1721880643.257231:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011944448:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1721880643.886964:0:15560:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880644.889009:0:11721:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880645.890953:0:7119:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1721880646.152949:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800942e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011944576:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1721880646.153018:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880646.153087:0:9461:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011944576 00000100:00100000:1.0:1721880646.153095:0:9461:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011944576 00000100:00080000:3.0:1721880646.153157:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880616 00000100:00100000:1.0:1721880646.153165:0:9461:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 744 00000100:00100000:1.0:1721880646.153174:0:9461:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880122c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011944576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1721880646.153210:0:9461:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:1.0:1721880646.153302:0:9461:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880122c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011944576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 128us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880646.153307:0:9461:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 744 00000100:00100000:3.0:1721880646.153335:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800942e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011944576:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1721880646.552958:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011944704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1721880646.553018:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880646.553074:0:9461:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011944704 00000100:00100000:1.0:1721880646.553081:0:9461:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011944704 00000100:00100000:1.0:1721880646.553129:0:9461:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 745 00000100:00080000:3.0:1721880646.553134:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880616 00000100:00100000:1.0:1721880646.553135:0:9461:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011944704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1721880646.553158:0:9461:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:1.0:1721880646.553202:0:9461:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011944704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880646.553207:0:9461:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 745 00000100:00100000:0.0:1721880646.553239:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011944704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1721880646.649132:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011944832:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1721880646.649193:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880646.649240:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011944832 00000100:00100000:2.0:1721880646.649266:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011944832 00000100:00100000:2.0:1721880646.649321:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101218 00000100:00100000:2.0:1721880646.649330:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+19:3686:x1805522011944832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1721880646.649369:0:15587:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1437519872 avail 1308057600 00000100:00100000:2.0:1721880646.649438:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+19:3686:x1805522011944832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880646.649444:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101218 00000100:00100000:0.0:1721880646.649459:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008fc51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011944832:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1721880646.745001:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880131eefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0603f996-9d5e-4498-85ba-9976a06b304f:3687:1805522011944960:0@lo:400:kworker.0 00000100:00100000:2.0:1721880646.745019:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880131eef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3688:1805522011945088:0@lo:400:kworker.0 00000100:00100000:1.0:1721880646.745028:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880131eef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011945344:0@lo:400:kworker.0 00000100:00100000:0.0:1721880646.745032:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880131eef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3689:1805522011945216:0@lo:400:kworker.0 00000100:00100000:3.0:1721880646.745072:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880646.745073:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880646.745073:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880646.745096:0:15477:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011945088 00000100:00100000:0.0:1721880646.745101:0:15477:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011945088 00000100:00100000:1.0:1721880646.745109:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880131eedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3686:1805522011945856:0@lo:400:kworker.0 00000100:00100000:3.0:1721880646.745109:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880131eece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3687:1805522011945472:0@lo:400:kworker.0 00000100:00100000:2.0:1721880646.745116:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880131eeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3688:1805522011945600:0@lo:400:kworker.0 00000100:00100000:1.0:1721880646.745134:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880646.745140:0:15477:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011945856 00000100:00100000:0.0:1721880646.745142:0:15477:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011945856 00000100:00100000:2.0:1721880646.745146:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011945344 00000100:00100000:3.0:1721880646.745147:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011944960 00000100:00100000:2.0:1721880646.745150:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011945344 00000100:00100000:3.0:1721880646.745151:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011944960 00000100:00100000:1.0:1721880646.745154:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1721880646.745158:0:15477:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3305 00000100:00100000:1.0:1721880646.745160:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880131eee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011945984:0@lo:400:kworker.0 00000100:00100000:0.0:1721880646.745162:0:15477:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-lwp-MDT0000_UUID+5:3688:x1805522011945088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880646.745179:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101219 00000100:00100000:1.0:1721880646.745181:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880646.745185:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131eee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3686:x1805522011945344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880646.745186:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 664 00000100:00100000:3.0:1721880646.745192:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133036450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3687:x1805522011944960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880646.745206:0:15477:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-lwp-MDT0000_UUID+5:3688:x1805522011945088:12345-0@lo:400:kworker.0 Request processed in 44us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880646.745211:0:15434:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3306 00000100:00100000:0.0:1721880646.745215:0:15477:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3305 00000100:00100000:1.0:1721880646.745216:0:15434:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131eed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0001-lwp-OST0001_UUID+5:3686:x1805522011945856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880646.745233:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880131eee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3686:x1805522011945344:12345-0@lo:400:kworker.0 Request processed in 48us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880646.745240:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101219 00000100:00100000:3.0:1721880646.745240:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880133036450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3687:x1805522011944960:12345-0@lo:400:kworker.0 Request processed in 47us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880646.745261:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880646.745266:0:15434:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880131eed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0001-lwp-OST0001_UUID+5:3686:x1805522011945856:12345-0@lo:400:kworker.0 Request processed in 49us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880646.745270:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 664 00000100:00100000:1.0:1721880646.745272:0:15434:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3306 00000100:00100000:0.0:1721880646.745275:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880131eedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3689:1805522011945728:0@lo:400:kworker.0 00000100:00100000:2.0:1721880646.745299:0:15466:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011945984 00000100:00100000:0.0:1721880646.745301:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880646.745301:0:15434:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011945216 00000100:00100000:2.0:1721880646.745302:0:15466:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011945984 00000100:00100000:1.0:1721880646.745303:0:15434:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011945216 00000100:00100000:1.0:1721880646.745319:0:15434:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011945728 00000100:00100000:1.0:1721880646.745321:0:15434:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011945728 00000100:00080000:3.0:1721880646.745322:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880616 00000100:00100000:2.0:1721880646.745324:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 571 00000100:00100000:0.0:1721880646.745326:0:15420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3307 00000100:00080000:3.0:1721880646.745326:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880616 00000100:00080000:3.0:1721880646.745327:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880616 00000100:00100000:0.0:1721880646.745329:0:15420:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-MDT0001_UUID+5:3689:x1805522011945216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880646.745329:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131eec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011945984:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1721880646.745329:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880616 00000100:00100000:1.0:1721880646.745337:0:15434:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3308 00000100:00100000:3.0:1721880646.745339:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880646.745341:0:15434:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0000-lwp-OST0001_UUID+5:3689:x1805522011945728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880646.745353:0:15420:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-MDT0001_UUID+5:3689:x1805522011945216:12345-0@lo:400:kworker.0 Request processed in 24us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880646.745361:0:15420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3307 00000100:00100000:2.0:1721880646.745366:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880131eec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011945984:12345-0@lo:400:kworker.0 Request processed in 36us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880646.745368:0:15434:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:lustre-MDT0000-lwp-OST0001_UUID+5:3689:x1805522011945728:12345-0@lo:400:kworker.0 Request processed in 28us (66us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880646.745372:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 571 00000100:00100000:3.0:1721880646.745372:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880131eefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0603f996-9d5e-4498-85ba-9976a06b304f:3687:1805522011944960:0@lo:400:kworker.0 00000100:00100000:1.0:1721880646.745375:0:15434:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3308 00000100:00100000:0.0:1721880646.745376:0:15420:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011945472 00000100:00100000:0.0:1721880646.745379:0:15420:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011945472 00000100:00100000:2.0:1721880646.745391:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880646.745393:0:15420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3309 00000100:00100000:0.0:1721880646.745395:0:15420:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-OST0000_UUID+5:3687:x1805522011945472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880646.745397:0:15416:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011945600 00000100:00100000:1.0:1721880646.745400:0:15416:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011945600 00000100:00080000:3.0:1721880646.745405:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880616 00000100:00100000:2.0:1721880646.745407:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880131eec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011946112:0@lo:400:kworker.0 00000100:00080000:3.0:1721880646.745408:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880616 00000100:00100000:0.0:1721880646.745412:0:15420:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-OST0000_UUID+5:3687:x1805522011945472:12345-0@lo:400:kworker.0 Request processed in 16us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880646.745416:0:15420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3309 00000100:00100000:1.0:1721880646.745419:0:15416:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3310 00000100:00100000:1.0:1721880646.745424:0:15416:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3688:x1805522011945600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880646.745428:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880646.745444:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880131eef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3689:1805522011945216:0@lo:400:kworker.0 00000100:00100000:3.0:1721880646.745444:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880131eece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3687:1805522011945472:0@lo:400:kworker.0 00000100:00100000:0.0:1721880646.745453:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880131eedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3689:1805522011945728:0@lo:400:kworker.0 00000100:00100000:1.0:1721880646.745453:0:15416:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3688:x1805522011945600:12345-0@lo:400:kworker.0 Request processed in 28us (61us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880646.745456:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880131eef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3688:1805522011945088:0@lo:400:kworker.0 00000100:00100000:1.0:1721880646.745459:0:15416:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3310 00000100:00100000:2.0:1721880646.745464:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880131eeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3688:1805522011945600:0@lo:400:kworker.0 00000100:00100000:1.0:1721880646.745485:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880131eee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011945984:0@lo:400:kworker.0 00000100:00100000:1.0:1721880646.745493:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880131eef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011945344:0@lo:400:kworker.0 00000100:00100000:2.0:1721880646.745493:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011946112 00000100:00100000:2.0:1721880646.745496:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011946112 00000100:00100000:1.0:1721880646.745501:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880131eedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3686:1805522011945856:0@lo:400:kworker.0 00000100:00080000:3.0:1721880646.745511:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880616 00000100:00100000:2.0:1721880646.745517:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 572 00000100:00100000:2.0:1721880646.745522:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3688:x1805522011946112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880646.745564:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3688:x1805522011946112:12345-0@lo:400:kworker.0 Request processed in 40us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880646.745569:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880131eec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011946112:0@lo:400:kworker.0 00000100:00100000:2.0:1721880646.745570:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 572 00000100:00100000:0.0:1721880646.792867:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1721880646.792884:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800942e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011946240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1721880646.792894:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88011f823800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011946368:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1721880646.792935:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880646.792954:0:9461:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011946240 00000100:00100000:1.0:1721880646.792960:0:9461:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011946240 00000100:00100000:2.0:1721880646.792978:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880646.792991:0:9461:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011946368 00000100:00100000:1.0:1721880646.792992:0:9461:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011946368 00000100:00100000:1.0:1721880646.793003:0:9461:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 746 00000100:00100000:1.0:1721880646.793007:0:9461:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3688:x1805522011946240:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1721880646.793013:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 747 00000100:00100000:3.0:1721880646.793019:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011946368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1721880646.793031:0:9461:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00002000:00000024:3.0:1721880646.793031:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:1.0:1721880646.793066:0:9461:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3688:x1805522011946240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880646.793066:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011946368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (91us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880646.793071:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 747 00000100:00100000:1.0:1721880646.793074:0:9461:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 746 00000100:00100000:0.0:1721880646.793081:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800942e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011946240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1721880646.793085:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88011f823800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011946368:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1721880646.892963:0:8270:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880647.894990:0:7120:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880648.178284:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880648.178315:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880648.178333:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880648.178352:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880648.178363:0:15431:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257839104 00000100:00100000:0.0:1721880648.178364:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880648.178369:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257838976 00000100:00100000:2.0:1721880648.178372:0:15431:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257839104 00000100:00100000:0.0:1721880648.178373:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880648.178374:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257838976 00000100:00100000:0.0:1721880648.178384:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880648.178385:0:15434:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257839232 00000100:00100000:1.0:1721880648.178390:0:15434:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257839232 00000100:00100000:0.0:1721880648.178393:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880648.178413:0:15431:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257839744 00000100:00100000:2.0:1721880648.178414:0:15431:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257839744 00000100:00100000:3.0:1721880648.178414:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 665 00000100:00100000:0.0:1721880648.178415:0:3679:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880648.178416:0:15434:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257839616 00000100:00100000:1.0:1721880648.178418:0:15434:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257839616 00000100:00100000:3.0:1721880648.178419:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133036050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4976b229-99ef-4953-87e9-78e1b901883f+12:2004:x1805522257838976:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880648.178428:0:15431:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3311 00000100:00100000:0.0:1721880648.178431:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257839360 00000100:00100000:1.0:1721880648.178433:0:15434:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3312 00000100:00100000:2.0:1721880648.178433:0:15431:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2005:x1805522257839104:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880648.178434:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257839360 00000100:00100000:1.0:1721880648.178437:0:15434:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800942e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2004:x1805522257839232:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880648.178452:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257839488 00000100:00100000:0.0:1721880648.178454:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257839488 00000100:00100000:0.0:1721880648.178462:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257840000 00000100:00100000:0.0:1721880648.178464:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257840000 00000100:00100000:1.0:1721880648.178466:0:15434:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2004:x1805522257839232:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 29us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880648.178466:0:15431:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800942e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2005:x1805522257839104:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 33us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880648.178466:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880133036050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4976b229-99ef-4953-87e9-78e1b901883f+12:2004:x1805522257838976:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 47us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880648.178470:0:15452:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257839872 00000100:00100000:0.0:1721880648.178471:0:15452:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257839872 00000100:00100000:2.0:1721880648.178471:0:15431:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3311 00000100:00100000:3.0:1721880648.178471:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 665 00000100:00100000:1.0:1721880648.178474:0:15434:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3312 00000100:00100000:0.0:1721880648.178481:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 573 00000100:00100000:0.0:1721880648.178484:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0bca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2005:x1805522257839360:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880648.178485:0:15431:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3313 00000100:00100000:2.0:1721880648.178488:0:15431:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0bc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:30425778-2709-4512-9d75-01ec53c4cfad+3694:2004:x1805522257839744:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880648.178490:0:15434:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3314 00000100:00100000:1.0:1721880648.178493:0:15434:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0bcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:30425778-2709-4512-9d75-01ec53c4cfad+4135:2005:x1805522257839616:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880648.178499:0:15431:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0bc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:30425778-2709-4512-9d75-01ec53c4cfad+3694:2004:x1805522257839744:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 11us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880648.178503:0:15431:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3313 00000100:00100000:0.0:1721880648.178505:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0bca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2005:x1805522257839360:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 20us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880648.178505:0:15434:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0bcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:30425778-2709-4512-9d75-01ec53c4cfad+4135:2005:x1805522257839616:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 11us (120us total) trans 0 rc 0/0 00000100:00080000:3.0:1721880648.178506:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880618 00000100:00080000:3.0:1721880648.178508:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880618 00000100:00100000:0.0:1721880648.178509:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 573 00000100:00100000:1.0:1721880648.178509:0:15434:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3314 00000100:00080000:3.0:1721880648.178509:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880618 00000100:00080000:3.0:1721880648.178510:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880618 00000100:00080000:3.0:1721880648.178512:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880618 00000100:00100000:2.0:1721880648.178519:0:15466:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 574 00000100:00100000:2.0:1721880648.178522:0:15466:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2004:x1805522257839488:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880648.178523:0:16081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 575 00000100:00100000:3.0:1721880648.178526:0:16081:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0bc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:30425778-2709-4512-9d75-01ec53c4cfad+665:2004:x1805522257840000:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880648.178530:0:15452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 576 00000100:00100000:0.0:1721880648.178534:0:15452:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0bca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:30425778-2709-4512-9d75-01ec53c4cfad+280:2005:x1805522257839872:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880648.178534:0:15466:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2004:x1805522257839488:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 10us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880648.178537:0:15466:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 574 00000100:00100000:3.0:1721880648.178539:0:16081:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0bc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_071:30425778-2709-4512-9d75-01ec53c4cfad+665:2004:x1805522257840000:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 12us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880648.178543:0:16081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 575 00000100:00100000:0.0:1721880648.178544:0:15452:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0bca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:30425778-2709-4512-9d75-01ec53c4cfad+280:2005:x1805522257839872:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 10us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880648.178547:0:15452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 576 00000100:00100000:0.0:1721880648.264937:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff88008e3ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011946496:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1721880648.264997:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880648.265034:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011946496 00000100:00100000:2.0:1721880648.265041:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011946496 00000100:00100000:2.0:1721880648.265080:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101220 00000100:00100000:2.0:1721880648.265085:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0bc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011946496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1721880648.265113:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1435709440 avail 1306247168 00000100:00100000:2.0:1721880648.265155:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0bc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011946496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880648.265159:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101220 00000100:00100000:0.0:1721880648.265170:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff88008e3ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011946496:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1721880648.896885:0:15560:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880649.898976:0:11721:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880650.901002:0:7119:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1721880651.160967:0:3689:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1721880651.160986:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0bc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011946624:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1721880651.161040:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880651.161078:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011946624 00000100:00100000:0.0:1721880651.161084:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011946624 00000100:00080000:3.0:1721880651.161100:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880621 00000100:00100000:0.0:1721880651.161123:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 748 00000100:00100000:0.0:1721880651.161127:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011946624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1721880651.161150:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:0.0:1721880651.161219:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3689:x1805522011946624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880651.161224:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 748 00000100:00100000:3.0:1721880651.161251:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a0bc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3689:1805522011946624:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1721880651.560953:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0bcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011946752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1721880651.561006:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880651.561059:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011946752 00000100:00100000:0.0:1721880651.561066:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011946752 00000100:00080000:3.0:1721880651.561086:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880621 00000100:00100000:0.0:1721880651.561113:0:11673:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 749 00000100:00100000:0.0:1721880651.561119:0:11673:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011946752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1721880651.561137:0:11673:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:0.0:1721880651.561221:0:11673:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011946752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880651.561228:0:11673:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 749 00000100:00100000:3.0:1721880651.561242:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a0bcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011946752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1721880651.656964:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011946880:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1721880651.657018:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880651.657053:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011946880 00000100:00100000:2.0:1721880651.657059:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011946880 00000100:00100000:2.0:1721880651.657092:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101221 00000100:00100000:2.0:1721880651.657097:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0bcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3686:x1805522011946880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1721880651.657124:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1437519872 avail 1308057600 00000100:00100000:2.0:1721880651.657196:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0bcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:3686:x1805522011946880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880651.657197:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011946880:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1721880651.657201:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101221 00000100:00100000:2.0:1721880651.752985:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880131eedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0603f996-9d5e-4498-85ba-9976a06b304f:3687:1805522011947008:0@lo:400:kworker.0 00000100:00100000:3.0:1721880651.752996:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880131eef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3688:1805522011947136:0@lo:400:kworker.0 00000100:00100000:0.0:1721880651.753020:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880131eed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011947392:0@lo:400:kworker.0 00000100:00100000:1.0:1721880651.753027:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880131eee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3689:1805522011947264:0@lo:400:kworker.0 00000100:00100000:3.0:1721880651.753054:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880651.753060:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880651.753076:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880651.753081:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880651.753081:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880131eeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3688:1805522011947648:0@lo:400:kworker.0 00000100:00100000:2.0:1721880651.753087:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880131eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3687:1805522011947520:0@lo:400:kworker.0 00000100:00100000:0.0:1721880651.753102:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880131eec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3686:1805522011947904:0@lo:400:kworker.0 00000100:00100000:1.0:1721880651.753104:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880131eeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3689:1805522011947776:0@lo:400:kworker.0 00000100:00100000:3.0:1721880651.753105:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880651.753117:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880651.753123:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011947136 00000100:00100000:2.0:1721880651.753129:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011947136 00000100:00100000:3.0:1721880651.753129:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880131eef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011948160:0@lo:400:kworker.0 00000100:00100000:0.0:1721880651.753134:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1721880651.753134:0:15420:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011947264 00000100:00100000:0.0:1721880651.753138:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880131eeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011948032:0@lo:400:kworker.0 00000100:00100000:1.0:1721880651.753138:0:15420:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011947264 00000100:00100000:3.0:1721880651.753148:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880651.753178:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011947392 00000100:00100000:0.0:1721880651.753181:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011947392 00000100:00100000:2.0:1721880651.753181:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011947648 00000100:00100000:2.0:1721880651.753183:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011947648 00000100:00100000:2.0:1721880651.753205:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011947904 00000100:00100000:0.0:1721880651.753206:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101222 00000100:00100000:2.0:1721880651.753207:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011947904 00000100:00100000:1.0:1721880651.753210:0:15420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3315 00000100:00100000:0.0:1721880651.753211:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0bc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3686:x1805522011947392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880651.753216:0:15477:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3316 00000100:00100000:1.0:1721880651.753217:0:15420:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-MDT0000_UUID+5:3688:x1805522011947136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880651.753221:0:15477:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131eedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-lwp-MDT0001_UUID+5:3689:x1805522011947264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880651.753224:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3317 00000100:00100000:2.0:1721880651.753228:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3688:x1805522011947648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880651.753255:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0bc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3686:x1805522011947392:12345-0@lo:400:kworker.0 Request processed in 45us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880651.753261:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101222 00000100:00100000:1.0:1721880651.753263:0:15420:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-MDT0000_UUID+5:3688:x1805522011947136:12345-0@lo:400:kworker.0 Request processed in 46us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880651.753263:0:15477:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880131eedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-lwp-MDT0001_UUID+5:3689:x1805522011947264:12345-0@lo:400:kworker.0 Request processed in 40us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880651.753270:0:15420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3315 00000100:00100000:2.0:1721880651.753272:0:7129:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3688:x1805522011947648:12345-0@lo:400:kworker.0 Request processed in 43us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880651.753273:0:15477:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3316 00000100:00100000:2.0:1721880651.753276:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3317 00000100:00100000:0.0:1721880651.753286:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880651.753287:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3318 00000100:00100000:2.0:1721880651.753290:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0bc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3686:x1805522011947904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880651.753303:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011948160 00000100:00100000:2.0:1721880651.753305:0:7129:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0bc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3686:x1805522011947904:12345-0@lo:400:kworker.0 Request processed in 15us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880651.753307:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880131eed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011947392:0@lo:400:kworker.0 00000100:00100000:3.0:1721880651.753307:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011948160 00000100:00100000:1.0:1721880651.753308:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880651.753309:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3318 00000100:00100000:0.0:1721880651.753314:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880131eec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3686:1805522011947904:0@lo:400:kworker.0 00000100:00100000:2.0:1721880651.753317:0:7129:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011947776 00000100:00100000:2.0:1721880651.753319:0:7129:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011947776 00000100:00100000:2.0:1721880651.753330:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3319 00000100:00100000:3.0:1721880651.753330:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011948032 00000100:00100000:1.0:1721880651.753332:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880131eee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3689:1805522011947264:0@lo:400:kworker.0 00000100:00100000:2.0:1721880651.753332:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3689:x1805522011947776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880651.753333:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011948032 00000100:00100000:0.0:1721880651.753344:0:16101:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 577 00000100:00100000:2.0:1721880651.753346:0:7129:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880131eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3689:x1805522011947776:12345-0@lo:400:kworker.0 Request processed in 14us (39us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880651.753348:0:16101:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+5:3688:x1805522011948160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880651.753349:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 578 00000100:00100000:2.0:1721880651.753350:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3319 00000100:00100000:1.0:1721880651.753352:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880131eeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3689:1805522011947776:0@lo:400:kworker.0 00000100:00100000:3.0:1721880651.753353:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0bc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011948032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880651.753363:0:7124:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011947008 00000100:00100000:2.0:1721880651.753365:0:7124:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011947008 00000100:00100000:0.0:1721880651.753367:0:16101:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_088:lustre-MDT0000-mdtlov_UUID+5:3688:x1805522011948160:12345-0@lo:400:kworker.0 Request processed in 19us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880651.753371:0:16101:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 577 00000100:00100000:2.0:1721880651.753382:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 666 00000100:00080000:1.0:1721880651.753384:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880621 00000100:00100000:2.0:1721880651.753385:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133035c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0603f996-9d5e-4498-85ba-9976a06b304f+23:3687:x1805522011947008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880651.753385:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0bc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011948032:12345-0@lo:400:kworker.0 Request processed in 31us (98us total) trans 0 rc 0/0 00000100:00080000:1.0:1721880651.753388:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880621 00000100:00080000:1.0:1721880651.753391:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880621 00000100:00100000:3.0:1721880651.753392:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 578 00000100:00080000:1.0:1721880651.753393:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880621 00000100:00100000:2.0:1721880651.753401:0:7124:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880133035c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0603f996-9d5e-4498-85ba-9976a06b304f+23:3687:x1805522011947008:12345-0@lo:400:kworker.0 Request processed in 16us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880651.753405:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880131eeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011948032:0@lo:400:kworker.0 00000100:00100000:2.0:1721880651.753406:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 666 00000100:00100000:3.0:1721880651.753426:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880131eef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011948160:0@lo:400:kworker.0 00000100:00100000:2.0:1721880651.753428:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880651.753436:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880131eef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3688:1805522011947136:0@lo:400:kworker.0 00000100:00100000:1.0:1721880651.753443:0:15431:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011947520 00000100:00100000:1.0:1721880651.753445:0:15431:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011947520 00000100:00100000:2.0:1721880651.753446:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880131eedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0603f996-9d5e-4498-85ba-9976a06b304f:3687:1805522011947008:0@lo:400:kworker.0 00000100:00100000:3.0:1721880651.753447:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880131eeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3688:1805522011947648:0@lo:400:kworker.0 00000100:00080000:0.0:1721880651.753460:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880621 00000100:00100000:1.0:1721880651.753469:0:15431:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3320 00000100:00100000:1.0:1721880651.753473:0:15431:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-OST0000_UUID+5:3687:x1805522011947520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880651.753512:0:15431:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-lwp-OST0000_UUID+5:3687:x1805522011947520:12345-0@lo:400:kworker.0 Request processed in 38us (83us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880651.753518:0:15431:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3320 00000100:00100000:2.0:1721880651.753532:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880131eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3687:1805522011947520:0@lo:400:kworker.0 00000100:00100000:2.0:1721880651.800909:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1721880651.800929:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011948288:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1721880651.800949:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0bcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011948416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1721880651.800983:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880651.801031:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011948288 00000100:00100000:1.0:1721880651.801032:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880651.801038:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011948288 00000100:00100000:0.0:1721880651.801067:0:11673:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011948416 00000100:00100000:0.0:1721880651.801068:0:11673:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011948416 00000100:00100000:1.0:1721880651.801080:0:9461:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 750 00000100:00100000:2.0:1721880651.801086:0:9462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 751 00000100:00100000:1.0:1721880651.801087:0:9461:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3687:x1805522011948288:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1721880651.801091:0:9462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131eeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011948416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1721880651.801116:0:9462:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00002000:00000024:1.0:1721880651.801117:0:9461:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:2.0:1721880651.801152:0:9462:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880131eeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011948416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880651.801174:0:9462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 751 00000100:00100000:1.0:1721880651.801184:0:9461:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3687:x1805522011948288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880651.801188:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800a0bcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011948416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1721880651.801191:0:9461:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 750 00000100:00100000:3.0:1721880651.801232:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011948288:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1721880651.902945:0:8270:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880652.904993:0:7120:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880653.186130:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880653.186208:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880653.186232:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880653.186249:0:15434:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257840256 00000100:00100000:0.0:1721880653.186253:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880653.186254:0:7124:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257840128 00000100:00100000:1.0:1721880653.186257:0:15434:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257840256 00000100:00100000:2.0:1721880653.186259:0:7124:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257840128 00000100:00100000:0.0:1721880653.186271:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880653.186278:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257840512 00000100:00100000:3.0:1721880653.186283:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257840512 00000100:00100000:0.0:1721880653.186284:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880653.186295:0:15434:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257840384 00000100:00100000:1.0:1721880653.186297:0:15434:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257840384 00000100:00100000:0.0:1721880653.186300:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880653.186303:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 667 00000100:00100000:1.0:1721880653.186306:0:15434:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257840768 00000100:00100000:1.0:1721880653.186308:0:15434:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257840768 00000100:00100000:3.0:1721880653.186308:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257840640 00000100:00100000:2.0:1721880653.186309:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133035850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2005:x1805522257840128:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880653.186310:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257840640 00000100:00100000:0.0:1721880653.186317:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880653.186318:0:15434:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3321 00000100:00100000:1.0:1721880653.186322:0:15434:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0bcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2004:x1805522257840256:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880653.186322:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257841024 00000100:00100000:3.0:1721880653.186324:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257841024 00000100:00100000:3.0:1721880653.186337:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 579 00000100:00100000:3.0:1721880653.186341:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0bcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2004:x1805522257840512:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880653.186346:0:3681:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880653.186364:0:15434:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0bcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2004:x1805522257840256:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 40us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880653.186364:0:7124:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880133035850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2005:x1805522257840128:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 54us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880653.186364:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0bcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2004:x1805522257840512:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 22us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880653.186368:0:15434:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3321 00000100:00100000:2.0:1721880653.186370:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 667 00000100:00100000:3.0:1721880653.186370:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 579 00000100:00100000:1.0:1721880653.186385:0:15434:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257840896 00000100:00100000:1.0:1721880653.186387:0:15434:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257840896 00000100:00100000:1.0:1721880653.186396:0:15434:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3322 00000100:00100000:3.0:1721880653.186396:0:16125:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257841152 00000100:00100000:1.0:1721880653.186398:0:15434:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0bcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2005:x1805522257840384:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880653.186398:0:16125:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257841152 00000100:00100000:2.0:1721880653.186407:0:7129:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3323 00000100:00100000:1.0:1721880653.186411:0:15434:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0bcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2005:x1805522257840384:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 12us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880653.186412:0:7129:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0bcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30425778-2709-4512-9d75-01ec53c4cfad+4135:2004:x1805522257840768:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880653.186413:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 580 00000100:00100000:1.0:1721880653.186415:0:15434:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3322 00000100:00100000:3.0:1721880653.186416:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0bc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2005:x1805522257840640:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880653.186420:0:15434:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3324 00000100:00100000:1.0:1721880653.186423:0:15434:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800994b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:30425778-2709-4512-9d75-01ec53c4cfad+3694:2005:x1805522257840896:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880653.186436:0:15434:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800994b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_022:30425778-2709-4512-9d75-01ec53c4cfad+3694:2005:x1805522257840896:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 12us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880653.186436:0:7129:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0bcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30425778-2709-4512-9d75-01ec53c4cfad+4135:2004:x1805522257840768:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 23us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880653.186436:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0bc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2005:x1805522257840640:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 18us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880653.186439:0:15434:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3324 00000100:00100000:3.0:1721880653.186441:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 580 00000100:00100000:2.0:1721880653.186442:0:7129:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3323 00000100:00100000:3.0:1721880653.186453:0:16125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 581 00000100:00100000:3.0:1721880653.186456:0:16125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800994b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:30425778-2709-4512-9d75-01ec53c4cfad+280:2004:x1805522257841024:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880653.186466:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 582 00000100:00100000:1.0:1721880653.186469:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800994b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:30425778-2709-4512-9d75-01ec53c4cfad+665:2005:x1805522257841152:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880653.186474:0:16125:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800994b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_109:30425778-2709-4512-9d75-01ec53c4cfad+280:2004:x1805522257841024:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 17us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880653.186479:0:16125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 581 00000100:00100000:1.0:1721880653.186481:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800994b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:30425778-2709-4512-9d75-01ec53c4cfad+665:2005:x1805522257841152:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 11us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880653.186484:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 582 00000100:00080000:3.0:1721880653.186500:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880623 00000100:00080000:3.0:1721880653.186503:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880623 00000100:00080000:3.0:1721880653.186505:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880623 00000100:00080000:3.0:1721880653.186506:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880623 00000100:00080000:3.0:1721880653.186508:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880623 00000100:00100000:3.0:1721880653.272921:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800994b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011948544:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1721880653.272980:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880653.273052:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011948544 00000100:00100000:0.0:1721880653.273061:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011948544 00000100:00100000:0.0:1721880653.273118:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101223 00000100:00100000:0.0:1721880653.273126:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011948544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1721880653.273175:0:15587:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1435709440 avail 1306247168 00000100:00100000:0.0:1721880653.273258:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3687:x1805522011948544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880653.273268:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101223 00000100:00100000:3.0:1721880653.273286:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800994b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3687:1805522011948544:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1721880653.907008:0:15560:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880654.908953:0:11721:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880655.910848:0:7119:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1721880656.168964:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800994b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011948672:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1721880656.169030:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880656.169063:0:9461:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011948672 00000100:00100000:1.0:1721880656.169070:0:9461:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011948672 00000100:00080000:3.0:1721880656.169112:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880626 00000100:00100000:1.0:1721880656.169125:0:9461:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 752 00000100:00100000:1.0:1721880656.169131:0:9461:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e3ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011948672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1721880656.169158:0:9461:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:1.0:1721880656.169206:0:9461:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e3ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3688:x1805522011948672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880656.169211:0:9461:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 752 00000100:00100000:3.0:1721880656.169227:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800994b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3688:1805522011948672:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1721880656.568940:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800858b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011948800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1721880656.568995:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880656.569035:0:9461:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011948800 00000100:00100000:2.0:1721880656.569042:0:9461:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011948800 00000100:00100000:2.0:1721880656.569114:0:9461:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 753 00000100:00100000:2.0:1721880656.569120:0:9461:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131eee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011948800:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1721880656.569126:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880626 00002000:00000024:2.0:1721880656.569141:0:9461:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 57344 granted 979967004 pending 0 free 3908886528 avail 3677364224 00000100:00100000:2.0:1721880656.569197:0:9461:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880131eee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3689:x1805522011948800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880656.569204:0:9461:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 753 00000100:00100000:1.0:1721880656.569226:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800858b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3689:1805522011948800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1721880656.664972:0:3687:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1721880656.664988:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880088dd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011948928:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1721880656.665038:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880656.665130:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011948928 00000100:00100000:0.0:1721880656.665137:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011948928 00000100:00100000:0.0:1721880656.665175:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101224 00000100:00100000:0.0:1721880656.665180:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+19:3687:x1805522011948928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1721880656.665205:0:15587:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1437519872 avail 1308057600 00000100:00100000:0.0:1721880656.665253:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0001-mdtlov_UUID+19:3687:x1805522011948928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880656.665258:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101224 00000100:00100000:3.0:1721880656.665294:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880088dd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011948928:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1721880656.760962:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880131eefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3688:1805522011949184:0@lo:400:kworker.0 00000100:00100000:0.0:1721880656.760963:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880131eeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011949440:0@lo:400:kworker.0 00000100:00100000:3.0:1721880656.760963:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880131eef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0603f996-9d5e-4498-85ba-9976a06b304f:3687:1805522011949056:0@lo:400:kworker.0 00000100:00100000:1.0:1721880656.760966:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880131eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3689:1805522011949312:0@lo:400:kworker.0 00000100:00100000:0.0:1721880656.761023:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880656.761023:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880656.761026:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721880656.761046:0:15477:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011949312 00000100:00100000:2.0:1721880656.761052:0:15477:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011949312 00000100:00100000:3.0:1721880656.761052:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880131eef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3687:1805522011949568:0@lo:400:kworker.0 00000100:00100000:1.0:1721880656.761053:0:3689:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880131eedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3689:1805522011949824:0@lo:400:kworker.0 00000100:00100000:0.0:1721880656.761056:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880131eeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3686:1805522011949952:0@lo:400:kworker.0 00000100:00100000:1.0:1721880656.761065:0:3689:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880656.761095:0:15587:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011949440 00000100:00100000:3.0:1721880656.761095:0:7126:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011949056 00000100:00100000:0.0:1721880656.761099:0:15587:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011949440 00000100:00100000:3.0:1721880656.761099:0:7126:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011949056 00000100:00100000:1.0:1721880656.761115:0:15420:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011949824 00000100:00100000:1.0:1721880656.761118:0:15420:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011949824 00000100:00100000:0.0:1721880656.761126:0:15587:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101225 00000100:00100000:2.0:1721880656.761126:0:15477:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3325 00000100:00100000:3.0:1721880656.761126:0:7126:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 668 00000100:00100000:3.0:1721880656.761131:0:7126:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133035450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3687:x1805522011949056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880656.761133:0:15587:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800994b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3686:x1805522011949440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880656.761133:0:15477:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801360cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-lwp-MDT0001_UUID+5:3689:x1805522011949312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880656.761137:0:15420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3326 00000100:00100000:1.0:1721880656.761140:0:15420:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801360cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-OST0001_UUID+5:3689:x1805522011949824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880656.761172:0:15587:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800994b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_006:lustre-MDT0000-mdtlov_UUID+63:3686:x1805522011949440:12345-0@lo:400:kworker.0 Request processed in 40us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880656.761177:0:15587:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101225 00000100:00100000:3.0:1721880656.761177:0:7126:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880133035450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0603f996-9d5e-4498-85ba-9976a06b304f+23:3687:x1805522011949056:12345-0@lo:400:kworker.0 Request processed in 46us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880656.761182:0:7126:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 668 00000100:00100000:1.0:1721880656.761190:0:15420:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801360cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-lwp-OST0001_UUID+5:3689:x1805522011949824:12345-0@lo:400:kworker.0 Request processed in 50us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880656.761191:0:15477:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801360cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_024:lustre-MDT0000-lwp-MDT0001_UUID+5:3689:x1805522011949312:12345-0@lo:400:kworker.0 Request processed in 58us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880656.761194:0:15420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3326 00000100:00100000:2.0:1721880656.761197:0:15477:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3325 00000100:00100000:0.0:1721880656.761204:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880656.761213:0:15420:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011949952 00000100:00100000:1.0:1721880656.761215:0:15420:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011949952 00000100:00080000:3.0:1721880656.761221:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880626 00000100:00080000:3.0:1721880656.761224:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880626 00000100:00080000:3.0:1721880656.761226:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880626 00000100:00100000:1.0:1721880656.761228:0:15420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3327 00000100:00100000:2.0:1721880656.761229:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880656.761230:0:15420:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800994b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-lwp-OST0001_UUID+5:3686:x1805522011949952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1721880656.761232:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880131eeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011949440:0@lo:400:kworker.0 00000100:00100000:3.0:1721880656.761245:0:11334:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011949184 00000100:00100000:3.0:1721880656.761247:0:11334:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011949184 00000100:00100000:2.0:1721880656.761256:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880131eef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3688:1805522011949696:0@lo:400:kworker.0 00000100:00100000:1.0:1721880656.761259:0:15420:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800994b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-lwp-OST0001_UUID+5:3686:x1805522011949952:12345-0@lo:400:kworker.0 Request processed in 28us (54us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880656.761264:0:11334:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3328 00000100:00100000:0.0:1721880656.761265:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880131eeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3686:1805522011949952:0@lo:400:kworker.0 00000100:00100000:1.0:1721880656.761267:0:15420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3327 00000100:00100000:3.0:1721880656.761268:0:11334:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3688:x1805522011949184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880656.761275:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880656.761282:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880131eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3689:1805522011949312:0@lo:400:kworker.0 00000100:00100000:1.0:1721880656.761288:0:3689:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880131eedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3689:1805522011949824:0@lo:400:kworker.0 00000100:00100000:2.0:1721880656.761295:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880131eed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011950208:0@lo:400:kworker.0 00000100:00100000:3.0:1721880656.761295:0:11334:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3688:x1805522011949184:12345-0@lo:400:kworker.0 Request processed in 26us (67us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880656.761300:0:11334:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3328 00000100:00100000:0.0:1721880656.761304:0:15432:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011949696 00000100:00100000:0.0:1721880656.761307:0:15432:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011949696 00000100:00100000:2.0:1721880656.761314:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880656.761318:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1721880656.761320:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880626 00000100:00100000:0.0:1721880656.761324:0:15432:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011949568 00000100:00100000:0.0:1721880656.761326:0:15432:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011949568 00000100:00100000:1.0:1721880656.761327:0:15420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3329 00000100:00100000:1.0:1721880656.761330:0:15420:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-lwp-OST0000_UUID+5:3688:x1805522011949696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1721880656.761331:0:3687:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff880131eec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011950080:0@lo:400:kworker.0 00000100:00100000:2.0:1721880656.761338:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880131eefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3688:1805522011949184:0@lo:400:kworker.0 00000100:00100000:0.0:1721880656.761341:0:15432:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3330 00000100:00100000:0.0:1721880656.761344:0:15432:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-OST0000_UUID+5:3687:x1805522011949568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880656.761348:0:15420:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001-lwp-OST0000_UUID+5:3688:x1805522011949696:12345-0@lo:400:kworker.0 Request processed in 18us (73us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880656.761349:0:3687:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721880656.761352:0:15420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3329 00000100:00100000:2.0:1721880656.761353:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880131eef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3688:1805522011949696:0@lo:400:kworker.0 00000100:00080000:1.0:1721880656.761364:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880626 00000100:00100000:3.0:1721880656.761369:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880131eef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0603f996-9d5e-4498-85ba-9976a06b304f:3687:1805522011949056:0@lo:400:kworker.0 00000100:00100000:0.0:1721880656.761370:0:15432:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_020:lustre-MDT0000-lwp-OST0000_UUID+5:3687:x1805522011949568:12345-0@lo:400:kworker.0 Request processed in 25us (51us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880656.761376:0:15432:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3330 00000100:00100000:3.0:1721880656.761377:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880131eef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3687:1805522011949568:0@lo:400:kworker.0 00000100:00100000:1.0:1721880656.761379:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011950208 00000100:00100000:1.0:1721880656.761381:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011950208 00000100:00100000:2.0:1721880656.761383:0:16088:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011950080 00000100:00100000:2.0:1721880656.761386:0:16088:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011950080 00000100:00100000:1.0:1721880656.761397:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 583 00000100:00100000:1.0:1721880656.761400:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+5:3688:x1805522011950208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1721880656.761406:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 584 00000100:00100000:2.0:1721880656.761410:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800858b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0001-mdtlov_UUID+5:3687:x1805522011950080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1721880656.761416:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:lustre-MDT0000-mdtlov_UUID+5:3688:x1805522011950208:12345-0@lo:400:kworker.0 Request processed in 15us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880656.761419:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 583 00000100:00080000:1.0:1721880656.761427:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880626 00000100:00100000:2.0:1721880656.761439:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800858b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:lustre-MDT0001-mdtlov_UUID+5:3687:x1805522011950080:12345-0@lo:400:kworker.0 Request processed in 29us (89us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880656.761445:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 584 00000100:00100000:3.0:1721880656.761447:0:3687:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880131eec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3687:1805522011950080:0@lo:400:kworker.0 00000100:00100000:2.0:1721880656.761480:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff880131eed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011950208:0@lo:400:kworker.0 00000100:00100000:0.0:1721880656.808853:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800858b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011950336:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1721880656.808871:0:3688:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1721880656.808887:0:3688:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800994b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011950464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1721880656.808904:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880656.808937:0:9461:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011950336 00000100:00100000:3.0:1721880656.808944:0:9461:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011950336 00000100:00100000:2.0:1721880656.808950:0:3688:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721880656.808985:0:9461:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011950464 00000100:00100000:3.0:1721880656.808988:0:9461:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011950464 00000100:00100000:0.0:1721880656.808994:0:9462:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 754 00000100:00100000:0.0:1721880656.809001:0:9462:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800994b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011950336:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1721880656.809007:0:9461:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 755 00000100:00100000:3.0:1721880656.809011:0:9461:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3688:x1805522011950464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1721880656.809027:0:9462:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00002000:00000024:3.0:1721880656.809027:0:9461:0:(ofd_obd.c:742:ofd_statfs()) blocks cached 0 granted 979938304 pending 0 free 3914027008 avail 3682504704 00000100:00100000:0.0:1721880656.809059:0:9462:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800994b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1805522011950336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880656.809063:0:9462:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 754 00000100:00100000:3.0:1721880656.809087:0:9461:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880088dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3688:x1805522011950464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880656.809092:0:9461:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 755 00000100:00100000:1.0:1721880656.809101:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800858b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3686:1805522011950336:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1721880656.809106:0:3688:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800994b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3688:1805522011950464:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1721880656.912839:0:8270:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721880657.914930:0:7120:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721880658.194213:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880658.194266:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880658.194280:0:11334:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257841408 00000100:00100000:3.0:1721880658.194289:0:11334:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257841408 00000100:00100000:0.0:1721880658.194295:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:0.0:1721880658.194312:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880658.194329:0:7124:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257841280 00000100:00100000:0.0:1721880658.194330:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880658.194334:0:7124:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257841280 00000100:00100000:0.0:1721880658.194347:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880658.194354:0:11334:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257841536 00000100:00080000:1.0:1721880658.194356:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd MGS older than 1721880628 00000100:00100000:3.0:1721880658.194356:0:11334:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257841536 00000100:00080000:1.0:1721880658.194361:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880628 00000100:00080000:1.0:1721880658.194363:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880628 00000100:00100000:0.0:1721880658.194364:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:2.0:1721880658.194365:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 669 00000100:00100000:2.0:1721880658.194371:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880133035050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2004:x1805522257841280:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880658.194374:0:11334:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257841920 00000100:00100000:0.0:1721880658.194376:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:3.0:1721880658.194376:0:11334:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257841920 00000100:00100000:1.0:1721880658.194380:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257841664 00000100:00100000:1.0:1721880658.194384:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257841664 00000100:00100000:3.0:1721880658.194387:0:11334:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257842048 00000100:00100000:3.0:1721880658.194389:0:11334:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257842048 00000100:00100000:3.0:1721880658.194399:0:11334:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3331 00000100:00100000:3.0:1721880658.194402:0:11334:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800994b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2005:x1805522257841408:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:0.0:1721880658.194409:0:3680:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.24@tcp (source: 12345-192.168.201.24@tcp) 00000100:00100000:1.0:1721880658.194413:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257841792 00000100:00100000:1.0:1721880658.194416:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257841792 00000100:00100000:2.0:1721880658.194417:0:7124:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff880133035050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4976b229-99ef-4953-87e9-78e1b901883f+12:2004:x1805522257841280:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 47us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880658.194422:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 669 00000100:00100000:1.0:1721880658.194429:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257842176 00000100:00100000:3.0:1721880658.194429:0:11334:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800994b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:262d1f41-ba81-41c5-b215-67c74ea63f50+2027:2005:x1805522257841408:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 26us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880658.194430:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257842176 00000100:00100000:3.0:1721880658.194434:0:11334:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3331 00000100:00100000:1.0:1721880658.194440:0:16111:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522257842304 00000100:00100000:1.0:1721880658.194441:0:16111:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522257842304 00000100:00100000:1.0:1721880658.194453:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 585 00000100:00100000:1.0:1721880658.194458:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800994b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2005:x1805522257841664:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880658.194458:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 586 00000100:00100000:3.0:1721880658.194459:0:11334:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3332 00000100:00100000:2.0:1721880658.194462:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800994b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2004:x1805522257841792:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880658.194462:0:11334:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800994b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2004:x1805522257841536:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880658.194474:0:11334:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800994b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:262d1f41-ba81-41c5-b215-67c74ea63f50+3396:2004:x1805522257841536:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 11us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880658.194477:0:11334:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3332 00000100:00100000:2.0:1721880658.194478:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800994b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:262d1f41-ba81-41c5-b215-67c74ea63f50+2223:2004:x1805522257841792:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 16us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880658.194482:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 586 00000100:00100000:3.0:1721880658.194483:0:11334:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3333 00000100:00100000:3.0:1721880658.194485:0:11334:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800994b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30425778-2709-4512-9d75-01ec53c4cfad+4135:2005:x1805522257841920:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880658.194488:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800994b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:262d1f41-ba81-41c5-b215-67c74ea63f50+1726:2005:x1805522257841664:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 30us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880658.194494:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 585 00000100:00100000:3.0:1721880658.194497:0:11334:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800994b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30425778-2709-4512-9d75-01ec53c4cfad+4135:2005:x1805522257841920:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 11us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880658.194499:0:16088:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 587 00000100:00100000:3.0:1721880658.194500:0:11334:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3333 00000100:00100000:2.0:1721880658.194501:0:16088:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800994b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:30425778-2709-4512-9d75-01ec53c4cfad+280:2005:x1805522257842176:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:3.0:1721880658.194506:0:11334:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 3334 00000100:00100000:1.0:1721880658.194507:0:16111:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.24@tcp, seq: 588 00000100:00100000:3.0:1721880658.194508:0:11334:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800994b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30425778-2709-4512-9d75-01ec53c4cfad+3694:2004:x1805522257842048:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:1.0:1721880658.194511:0:16111:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800994b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:30425778-2709-4512-9d75-01ec53c4cfad+665:2004:x1805522257842304:12345-192.168.201.24@tcp:400:kworker.0 00000100:00100000:2.0:1721880658.194512:0:16088:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800994b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_078:30425778-2709-4512-9d75-01ec53c4cfad+280:2005:x1805522257842176:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 10us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1721880658.194515:0:16088:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 587 00000100:00100000:3.0:1721880658.194519:0:11334:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800994b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30425778-2709-4512-9d75-01ec53c4cfad+3694:2004:x1805522257842048:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 10us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1721880658.194521:0:11334:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 3334 00000100:00100000:1.0:1721880658.194529:0:16111:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8800994b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_095:30425778-2709-4512-9d75-01ec53c4cfad+665:2004:x1805522257842304:12345-192.168.201.24@tcp:400:kworker.0 Request processed in 18us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1721880658.194534:0:16111:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.24@tcp, seq: 588 00000100:00080000:1.0:1721880658.194545:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1721880628 00000100:00080000:1.0:1721880658.194547:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1721880628 00000100:00080000:1.0:1721880658.194549:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1721880628 00000100:00080000:1.0:1721880658.194551:0:7127:0:(pinger.c:501:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1721880628 00000100:00100000:1.0:1721880658.280980:0:3686:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1721880658.281000:0:3686:0:(client.c:1796:ptlrpc_send_new_req()) Sending RPC req@ffff8800858b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011950592:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1721880658.281073:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721880658.281112:0:8276:0:(service.c:2094:ptlrpc_server_handle_req_in()) unwrap req x1805522011950592 00000100:00100000:0.0:1721880658.281119:0:8276:0:(service.c:2159:ptlrpc_server_handle_req_in()) got req x1805522011950592 00000100:00100000:0.0:1721880658.281163:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101226 00000100:00100000:0.0:1721880658.281167:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801360ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3686:x1805522011950592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1721880658.281195:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1435709440 avail 1306247168 00000100:00100000:0.0:1721880658.281241:0:8276:0:(service.c:2388:ptlrpc_server_handle_request()) Handled RPC req@ffff8801360ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+63:3686:x1805522011950592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1721880658.281245:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101226 00000100:00100000:1.0:1721880658.281269:0:3686:0:(client.c:2281:ptlrpc_check_set()) Completed RPC req@ffff8800858b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3686:1805522011950592:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1721880658.916952:0:15560:0:(ldlm_lockd.c:2892:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 65189 lines, 65189 kept, 0 dropped, 0 bad.